{"id":14366144,"url":"https://github.com/arc53/llm-price-compass","last_synced_at":"2025-04-04T07:07:36.317Z","repository":{"id":252940176,"uuid":"841537832","full_name":"arc53/llm-price-compass","owner":"arc53","description":"This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table","archived":false,"fork":false,"pushed_at":"2024-12-16T05:37:52.000Z","size":421,"stargazers_count":220,"open_issues_count":1,"forks_count":7,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-28T06:08:20.492Z","etag":null,"topics":["benchmark","gpu","hacktoberfest","inference-comparison","llm","llm-comparison","llm-inference","llm-price"],"latest_commit_sha":null,"homepage":"https://compass.arc53.com","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arc53.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-12T15:50:55.000Z","updated_at":"2025-03-19T03:26:54.000Z","dependencies_parsed_at":"2024-08-20T15:57:31.102Z","dependency_job_id":"0bdf13e3-b3ec-4322-924d-a6630f58a70a","html_url":"https://github.com/arc53/llm-price-compass","commit_stats":null,"previous_names":["arc53/llm-price-compass"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arc53%2Fllm-price-compass","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arc53%2Fllm-price-compass/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arc53%2Fllm-price-compass/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arc53%2Fllm-price-compass/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arc53","download_url":"https://codeload.github.com/arc53/llm-price-compass/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247135144,"owners_count":20889421,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["benchmark","gpu","hacktoberfest","inference-comparison","llm","llm-comparison","llm-inference","llm-price"],"created_at":"2024-08-27T19:01:31.635Z","updated_at":"2025-04-04T07:07:36.299Z","avatar_url":"https://github.com/arc53.png","language":"TypeScript","funding_links":[],"categories":["TypeScript"],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003e\n  LLM price compass 🧭\n\u003c/h1\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003cstrong\u003eOpen-Source LLM inference cost comparison for compute nomads\u003c/strong\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \n  \u003ca href=\"https://github.com/arc53/llm-price-compass\"\u003e![link to main GitHub showing Stars number](https://img.shields.io/github/stars/arc53/llm-price-compass?style=social)\u003c/a\u003e\n  \u003ca href=\"https://github.com/arc53/llm-price-compass/blob/main/LICENSE\"\u003e![link to license file](https://img.shields.io/github/license/arc53/llm-price-compass)\u003c/a\u003e\n  \u003ca href=\"https://discord.gg/n5BX8dh8rU\"\u003e![link to discord](https://img.shields.io/discord/1070046503302877216)\u003c/a\u003e\n  \u003ca href=\"https://twitter.com/docsgptai\"\u003e![X (formerly Twitter) URL](https://img.shields.io/twitter/follow/docsgptai)\u003c/a\u003e\n\n \n\u003c/div\u003e\n\nThis project aims to collect benchmark data from different GPUs on various clouds/providers and compare it to fixed per token costs from other providers. By utilizing our platform, you can make informed decisions on cost-effective LLM options, affordable language models, and efficient LLM GPU selections.\n\nOur comprehensive **LLM Price Comparison** tool empowers users to evaluate multiple AI models and provides insights into AI model pricing guides. This project will help you choose the right GPU and cloud provider for the model of your choice—facilitating GPU inference and LLM GPU benchmarks.\n\n\u003cdiv align=\"center\"\u003e\n  \u003ca href=\"https://compass.arc53.com/\"\u003eDashboard \u003c/a\u003e\n\u003c/div\u003e\n\n## Contributing\n\nPlease refer to the [CONTRIBUTING.md](CONTRIBUTING.md) file for information about how to get involved. We welcome issues, questions, and pull requests. If you have insights on GPU comparisons, benchmarks, or AI model evaluations, please share them with our community.\n\n\n## Llama 3.1 instruct 8b comparison\n![CleanShot 2024-08-17 at 14 59 47@2x](https://github.com/user-attachments/assets/d22f92d5-8ddc-4a21-9b3b-c408c89b5579)\n\n## Llama 3.1 instruct 70b comparison\n![CleanShot 2024-08-17 at 15 00 08@2x](https://github.com/user-attachments/assets/9c587266-ebe2-4078-a6e3-2dff8cf9cf35)\n\n[Source Providers](https://github.com/arc53/llm-price-compass/blob/main/LLM-Provider-comparison.csv)\n[Source Self-hosted](https://github.com/arc53/llm-price-compass/blob/main/gpu-benchmarks.csv)\n\n## Code Of Conduct\n\nWe as members, contributors, and leaders, pledge to make participation in our community a harassment-free experience for everyone, regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, level of experience, education, socio-economic status, nationality, personal appearance, race, religion, or sexual identity and orientation. Please refer to the [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md) file for more information about contributing.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farc53%2Fllm-price-compass","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farc53%2Fllm-price-compass","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farc53%2Fllm-price-compass/lists"}