https://github.com/bessouat40/custom-phi2-use

Use of phi2 for custom use.
https://github.com/bessouat40/custom-phi2-use

generative-ai llm phi2 prompt-engineering recipe-app

Last synced: 1 day ago
JSON representation

Use of phi2 for custom use.

• Host: GitHub
• URL: https://github.com/bessouat40/custom-phi2-use
• Owner: Bessouat40
• Created: 2023-11-18T16:09:35.000Z (almost 1 year ago)
• Default Branch: main
• Last Pushed: 2024-07-26T08:17:31.000Z (4 months ago)
• Last Synced: 2024-07-26T09:39:07.870Z (4 months ago)
• Topics: generative-ai, llm, phi2, prompt-engineering, recipe-app
• Language: Python
• Homepage:
• Size: 140 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Custom phi2 use

Custom use of Phi2 model wich is an open source LLM.

We use 2B version.

## Objectives

- POC : use Phi2 model and prove it's sufficient for our use (tips for creating dishes from various ingredients)

- Model quantization for performances improvement

- Offline use with acceptables performances

## Requirements

You need to install right `transformers` version :

```bash

python -m pip install git+https://github.com/huggingface/transformers

```

## Usage

### Launch POC

```bash

python main.py

```

#### Results

![poc-result](./media/custom_prompt.png)

### TODO

- [x] First Phi-2 use

- [x] Try custom prompt

- [ ] Improve prompt

- [ ] Offline use

- [ ] Model quantization

## Resources

- [HuggingFace documentation](https://huggingface.co/microsoft/phi-2)

- [LLM courses](https://github.com/mlabonne/llm-course)