Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/anirudhg07/pipeline-codemodels-huggingface
https://github.com/anirudhg07/pipeline-codemodels-huggingface
Last synced: 9 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/anirudhg07/pipeline-codemodels-huggingface
- Owner: AnirudhG07
- Created: 2023-10-29T07:27:18.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-01T17:19:44.000Z (10 months ago)
- Last Synced: 2024-02-01T19:01:57.581Z (10 months ago)
- Language: Python
- Size: 22.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
This repository contains basics of pipelines, Codemodels and Many more...
# CodeModels
I have added codes on how to use code models, for 1 code generation. These will be updated from time to time as well.
These are 10+ different models (Notes: 350M, 2B and 16B of codegen count as different). For these I have made functions of these so we can directly call ai model from .py file. For example
```bash
from ai-model import ai-model-function
```
We just need to give prompt as arguments and we are done.
Points to Note:
1. We need to see whether to use "cpu"(CPU)or "cuda"(GPU) for various models.
2. Some models code are long and a little scary(I felt so), but thats how these codes are run from their docs, although I have cleaned the bad ones quite a lot.
3. These functions outputs need to properly taken out based on what FORMAT of output they give. Some models like InCoder, StableLM have a different type of output style compared to CodeGen.
You can visit of various models in order to know more about them.
1. Wizard Coder.
2. StableLM-7B
3. StarCoder
4. SantaCoder HuggingFace OR SantaCoder GitHub
5. CodeGen SalesForce # OurFav
6. Magicoder-S-DS-6.7B HuggingFace or their GitHub
Many of them have playgrounds like Magicoder. It is pretty amazing and if it is not usable in our system ( which will figure It out), we can for the time being, use this in place. PRETTY amazing reviews for this one!