https://github.com/arc53/llm-price-compass

This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
https://github.com/arc53/llm-price-compass

benchmark gpu hacktoberfest inference-comparison llm llm-comparison llm-inference llm-price

Last synced: about 1 year ago
JSON representation

This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

• Host: GitHub
• URL: https://github.com/arc53/llm-price-compass
• Owner: arc53
• License: mit
• Created: 2024-08-12T15:50:55.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-12-16T05:37:52.000Z (over 1 year ago)
• Last Synced: 2025-03-28T06:08:20.492Z (about 1 year ago)
• Topics: benchmark, gpu, hacktoberfest, inference-comparison, llm, llm-comparison, llm-inference, llm-price
• Language: TypeScript
• Homepage: https://compass.arc53.com
• Size: 411 KB
• Stars: 220
• Watchers: 3
• Forks: 7
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

          


  LLM price compass 🧭





  Open-Source LLM inference cost comparison for compute nomads





  

  ![link to main GitHub showing Stars number](https://img.shields.io/github/stars/arc53/llm-price-compass?style=social)

  ![link to license file](https://img.shields.io/github/license/arc53/llm-price-compass)

  ![link to discord](https://img.shields.io/discord/1070046503302877216)

  ![X (formerly Twitter) URL](https://img.shields.io/twitter/follow/docsgptai)


 



This project aims to collect benchmark data from different GPUs on various clouds/providers and compare it to fixed per token costs from other providers. By utilizing our platform, you can make informed decisions on cost-effective LLM options, affordable language models, and efficient LLM GPU selections.

Our comprehensive **LLM Price Comparison** tool empowers users to evaluate multiple AI models and provides insights into AI model pricing guides. This project will help you choose the right GPU and cloud provider for the model of your choice—facilitating GPU inference and LLM GPU benchmarks.



  Dashboard 



## Contributing

Please refer to the [CONTRIBUTING.md](CONTRIBUTING.md) file for information about how to get involved. We welcome issues, questions, and pull requests. If you have insights on GPU comparisons, benchmarks, or AI model evaluations, please share them with our community.

## Llama 3.1 instruct 8b comparison

![CleanShot 2024-08-17 at 14 59 47@2x](https://github.com/user-attachments/assets/d22f92d5-8ddc-4a21-9b3b-c408c89b5579)

## Llama 3.1 instruct 70b comparison

![CleanShot 2024-08-17 at 15 00 08@2x](https://github.com/user-attachments/assets/9c587266-ebe2-4078-a6e3-2dff8cf9cf35)

[Source Providers](https://github.com/arc53/llm-price-compass/blob/main/LLM-Provider-comparison.csv)

[Source Self-hosted](https://github.com/arc53/llm-price-compass/blob/main/gpu-benchmarks.csv)

## Code Of Conduct

We as members, contributors, and leaders, pledge to make participation in our community a harassment-free experience for everyone, regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, level of experience, education, socio-economic status, nationality, personal appearance, race, religion, or sexual identity and orientation. Please refer to the [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md) file for more information about contributing.