https://github.com/nathadriele/llm-zoomcamp

Project LLMs
https://github.com/nathadriele/llm-zoomcamp

elasticsearch grafana huggingface llms mageai ollama openai-api rag streamlit

Last synced: 26 days ago
JSON representation

Project LLMs

• Host: GitHub
• URL: https://github.com/nathadriele/llm-zoomcamp
• Owner: nathadriele
• Created: 2024-07-01T17:22:59.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-09-28T19:26:16.000Z (about 1 month ago)
• Last Synced: 2024-09-29T05:04:34.593Z (about 1 month ago)
• Topics: elasticsearch, grafana, huggingface, llms, mageai, ollama, openai-api, rag, streamlit
• Language: Jupyter Notebook
• Homepage:
• Size: 1.82 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Zoomcamp llm Course

[More details](https://github.com/DataTalksClub/llm-zoomcamp?tab=readme-ov-file)

![image](https://github.com/user-attachments/assets/73ed29fa-7c76-44dd-b579-277fe2a94956)

## 1. Introduction to LLMs and RAG

- 1.1 LLMs and RAG

- 1.2 Preparing the environment

- 1.3 Retrieval and the basics of search

- 1.4 OpenAI API

- 1.5 Simple RAG with Open AI

- 1.6 Text search with Elasticsearch

  

## 2. Open-source LLMs

- 2.1 Getting an environment with a GPU

- 2.2 Open-source models from HuggingFace Hub

- 2.3 Running LLMs on a CPU with Ollama

- 2.4 Creating a simple UI with Streamlit

## 3. Vector databases

- 3.1 Vector search

- 3.2 Creating and indexing embeddings

- 3.3 Vector search with Elasticsearch

## 4. Workshop: dlt

- 4.1 Monitoring

- 4.2 Computing metrics to monitor the quality of LLM answers

- 4.3 Tracking chat history and user feedback

- 4.4 Creating dashboards with Grafana for visualization

## 5. LLM orchestration and ingestion

- 5.1 Ingesting data with Mage

## 6. Best practices

- 6.1 Best practices