{"id":19517288,"url":"https://github.com/paraskevi-kivroglou/hackathon-llamaeval","last_synced_at":"2026-02-17T09:41:15.394Z","repository":{"id":262156008,"uuid":"883325193","full_name":"Paraskevi-KIvroglou/Hackathon-LlamaEval","owner":"Paraskevi-KIvroglou","description":"LlamaEval is a rapid prototype developed during a hackathon to provide a user-friendly dashboard for evaluating and comparing Llama models using the TogetherAI API.","archived":false,"fork":false,"pushed_at":"2024-11-10T23:02:52.000Z","size":69993,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-04T23:53:18.089Z","etag":null,"topics":["ai-benchmarks","evaluation-metrics","llama3","llms","llms-benchmarking","streamlit","togetherai"],"latest_commit_sha":null,"homepage":"https://llama-eval-container-app.niceglacier-ab6723e0.westeurope.azurecontainerapps.io","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Paraskevi-KIvroglou.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-11-04T19:09:43.000Z","updated_at":"2024-11-10T23:02:56.000Z","dependencies_parsed_at":"2025-04-15T21:42:01.273Z","dependency_job_id":null,"html_url":"https://github.com/Paraskevi-KIvroglou/Hackathon-LlamaEval","commit_stats":null,"previous_names":["paraskevi-kivroglou/hackathon-llamaeval"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Paraskevi-KIvroglou/Hackathon-LlamaEval","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Paraskevi-KIvroglou%2FHackathon-LlamaEval","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Paraskevi-KIvroglou%2FHackathon-LlamaEval/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Paraskevi-KIvroglou%2FHackathon-LlamaEval/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Paraskevi-KIvroglou%2FHackathon-LlamaEval/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Paraskevi-KIvroglou","download_url":"https://codeload.github.com/Paraskevi-KIvroglou/Hackathon-LlamaEval/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Paraskevi-KIvroglou%2FHackathon-LlamaEval/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278391189,"owners_count":25978944,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-04T02:00:05.491Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai-benchmarks","evaluation-metrics","llama3","llms","llms-benchmarking","streamlit","togetherai"],"created_at":"2024-11-11T00:01:27.217Z","updated_at":"2025-10-04T23:53:18.961Z","avatar_url":"https://github.com/Paraskevi-KIvroglou.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Llama Impact Hackathon\n\n## LlamaEval: Quick Evaluation Dashboard\nLlamaEval is a rapid prototype developed during a hackathon to provide a user-friendly dashboard for evaluating and comparing Llama models using the TogetherAI API.\n\nFeatures\n\n  Model Selection: Choose from various Llama models available through TogetherAI.\n  Benchmark Tasks: Evaluate models on predefined tasks such as question answering and text summarization. \n  Performance Metrics: View accuracy, BLEU scores, and other relevant metrics for each model.\n  User-Friendly Interface: Simple web interface for inputting prompts and viewing results.\n  Quick Comparison: Easily compare the performance of different Llama models side-by-side.\n\nNote\n\nFor the prototype, we kept the size of the benchmark small. In later, steps we plan to iterate on top of real-world datasets. \n\nInstallation\n\n  1.Clone the repository\n     \n  2.Install dependencies\n\n    bash\n    pip install -r requirements.txt\n  3. Set up your TogetherAI API key:\n    \n    bash\n    export TOGETHERAI_API_KEY=your_api_key_here\n\n  Usage\n  \n  Run the application:\n\n    bash\n    streamlit run app.py\n\nOpen your web browser and navigate to http://localhost:8501.\nSelect a Llama model, choose a benchmark task, and input your prompt.\nView the results and performance metrics on the dashboard.\n\nFuture Development\n\n  - Custom dataset uploads\n  \n  - Support for additional AI models\n  \n  - Advanced visualization of performance metrics\n  \n  - Integration with other AI model providers\n\nContributors\n  - [Paraskevi Kivroglou] [https://www.linkedin.com/in/paraskevi-kivroglou-925881292/] \n  - [Mayank Varshney]  [LinkedIn : https://www.linkedin.com/in/varsh-mayank/] \n  - [Amina Asif] [LinkedIn : https://www.linkedin.com/in/amina-work/] [GitHub:https://github.com/AminaAsif9]\n\nLicense\n\nThis project is licensed under the MIT License - see the LICENSE file for details.\n\n    \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparaskevi-kivroglou%2Fhackathon-llamaeval","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fparaskevi-kivroglou%2Fhackathon-llamaeval","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparaskevi-kivroglou%2Fhackathon-llamaeval/lists"}