https://github.com/hildam/llamaindex_learning
llamaIndex_learning notes. Based on Local Model
https://github.com/hildam/llamaindex_learning
Last synced: 5 months ago
JSON representation
llamaIndex_learning notes. Based on Local Model
- Host: GitHub
- URL: https://github.com/hildam/llamaindex_learning
- Owner: HildaM
- License: mit
- Created: 2024-02-11T05:22:41.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2024-02-12T10:16:00.000Z (over 1 year ago)
- Last Synced: 2024-11-14T03:38:33.402Z (7 months ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 555 KB
- Stars: 3
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# llamaIndex-learning
This is the repo for my llamaIndex learning notes
## Setup envrionment
I use miniconda to manage the learning envrionment, you can follow this instruction or simplely run on local python environment:
```
# conda env
conda create -n llamaindex-learning python=3.11
conda activate llamaindex-learning
```
After create the envrionment, intall the dependencies
```
pip install -r requirements.txt
```
Don't forget installing pytorch:
```
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
```
## LLM Seting
I will use OpenAI as the interface for access LLM, but that desn't mean I will use "openai".
Actually, I run LLM locally using LM Studio. LM Studio server can give 'OpenAI-Like' API interface for user.
The Local LLM I use mainly is the "mistral-7b-instruct-v0.2.Q6_K"