https://github.com/bessouat40/custom-phi2-use
Use of phi2 for custom use.
https://github.com/bessouat40/custom-phi2-use
generative-ai llm phi2 prompt-engineering recipe-app
Last synced: about 2 months ago
JSON representation
Use of phi2 for custom use.
- Host: GitHub
- URL: https://github.com/bessouat40/custom-phi2-use
- Owner: Bessouat40
- Created: 2023-11-18T16:09:35.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-07-26T08:17:31.000Z (almost 2 years ago)
- Last Synced: 2025-01-17T01:48:45.621Z (over 1 year ago)
- Topics: generative-ai, llm, phi2, prompt-engineering, recipe-app
- Language: Python
- Homepage:
- Size: 140 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Custom phi2 use
Custom use of Phi2 model wich is an open source LLM.
We use 2B version.
## Objectives
- POC : use Phi2 model and prove it's sufficient for our use (tips for creating dishes from various ingredients)
- Model quantization for performances improvement
- Offline use with acceptables performances
## Requirements
You need to install right `transformers` version :
```bash
python -m pip install git+https://github.com/huggingface/transformers
```
## Usage
### Launch POC
```bash
python main.py
```
#### Results
### TODO
- [x] First Phi-2 use
- [x] Try custom prompt
- [ ] Improve prompt
- [ ] Offline use
- [ ] Model quantization
## Resources
- [HuggingFace documentation](https://huggingface.co/microsoft/phi-2)
- [LLM courses](https://github.com/mlabonne/llm-course)