Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/elmiraghorbani/dynamic_prompting

Dynamic Few-Shot Prompting is a Python package that dynamically selects N samples that are contextually close to the user's task or query from a knowledge base (similar to RAG) to include in the prompt.
https://github.com/elmiraghorbani/dynamic_prompting

few-shot-classifcation few-shot-prompting generative-ai gpt information-retrieval knowledge-base llama llama3 llama3-prompts llm nlp prompt prompt-engineering prompt-tuning python rag retreival retrieval-augmented-generation

Last synced: about 1 month ago
JSON representation

Dynamic Few-Shot Prompting is a Python package that dynamically selects N samples that are contextually close to the user's task or query from a knowledge base (similar to RAG) to include in the prompt.

Awesome Lists containing this project

README 

        
# DynamicPrompting






Dynamic Few-Shot Prompting is a Python package that dynamically selects N samples that are contextually close to the user's task or query from a knowledge base (similar to RAG) to include in the prompt. This allows the provision of related and informative examples to the LLM without needing to fine-tune the LLM to learn and extract patterns from the dataset. This means lower computation costs and resources; you just need to collect samples that are related to your task and might not be very clear for the LLM.



## Key Features



- Faster than fine-tuning a LLM

- Better performance than static few-shot prompts

- Works with less data than fine-tuning a model



## Quick Start



With pip:



```

pip install dynamic_prompting

```

or install from source



```

git clone https://github.com/ElmiraGhorbani/dynamic_prompting



pip install -e .

```



## Inference



### First setup the model:



#### Llama3 Model



1) Visit the Meta Llama website(https://llama.meta.com/llama-downloads) and register to download the model/s.



2) Once registered, you will get an email with a URL to download the models. You will need this URL when you run the download.sh script.



3) Once you get the email, navigate to your downloaded llama repository and run the download.sh script.



    - Make sure to grant execution permissions to the download.sh script

    - During this process, you will be prompted to enter the URL from the email.

    - Do not use the “Copy Link” option; copy the link from the email manually.



**Once you have downloaded the models, put them in this folder.**



**otherwise you can use this way:**



    - Step 1: Go to your Hugging Face account “Settings” and then “Access Tokens” on the left column, and copy the token you need.



    - Step 2: On your terminal, export your token starting with “HF_”. Use a distinct name (for example, HF_TOKEN) for each token you export. 

    You may add this line to your ~/.bashrc if you do not want to export it every time you start a session.



```

export HF_TOKEN="HF_XXXXXXXXXXXXX"

```



#### Text embedding models



The Embeddings class is designed for interfacing with text embedding models. There are many embedding model providers (OpenAI, Cohere, Hugging Face, etc.). Currently, this class provides a standard interface for **mxbai-embed-large-v1**, **bge-small-en-v1.5**, and **nomic-embed-text-v1.5**.



##### Get started



To start, download the models and put them in this folder.



```



git lfs install



```



###### Nomic Model

```



git clone https://huggingface.co/nomic-ai/nomic-embed-text-v1.5



cd nomic-embed-text-v1.5



git lfs fetch



```



###### BGE Model

```



git clone https://huggingface.co/BAAI/bge-small-en-v1.5



cd bge-small-en-v1.5



git lfs fetch



```



###### Mxbai Model

```



git clone https://huggingface.co/mixedbread-ai/mxbai-embed-large-v1



cd mxbai-embed-large-v1



git lfs fetch



```



#### Demo



**Check example.ipynb**