https://github.com/charlywargnier/codellama-via-deepinfra

https://github.com/charlywargnier/codellama-via-deepinfra

Last synced: about 8 hours ago
JSON representation

• Host: GitHub
• URL: https://github.com/charlywargnier/codellama-via-deepinfra
• Owner: CharlyWargnier
• License: apache-2.0
• Created: 2023-08-26T22:12:18.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-19T09:34:45.000Z (7 months ago)
• Last Synced: 2024-04-19T10:47:18.895Z (7 months ago)
• Language: Python
• Size: 27.3 KB
• Stars: 26
• Watchers: 1
• Forks: 12
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# A Playground for 🦙 `CodeLlama` in Streamlit! 



  

  

  



## Overview

I've created a simple 🎈[Streamlit](https://streamlit.io/) app using [DeepInfra's inference API](https://deepinfra.com/docs/advanced/openai_api) to showcase the CodeLlama model that [Meta launched last Thursday](https://about.fb.com/news/2023/08/code-llama-ai-for-coding/).



  



## App Usage

The app is currently utilizing my DeepInfra key. This allows for free interactions producing responses up to 500 tokens. For more extended answers, users must input their own DeepInfra API key. If you need one, you can obtain it [here](https://deepinfra.com/dash/api_keys).

**Note**: [All Llama models are charged $1 per 1M tokens on DeepInfra](https://deepinfra.com/pricing)

## Code Llama Highlights:

- **Foundation**: Enhanced version of Llama 2 for coding.

- **Open Access**: Free for research and commercial use.

- **Capabilities**:

  - Generate and discuss code.

  - Code completion and debugging.

  - Supports languages like Python, C++, Java, and more.

- **Varieties**: Available in 7B, 13B, and 34B parameter sizes.

- **Special Variations**:

  - **Python**: Fine-tuned for Python code.

  - **Instruct**: Improved for natural language instructions.

- **Community Engagement**: Encourages public feedback and improvements.

- **Versatility**: Supports various sectors, from research to businesses.