Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ariya/pico-jarvis
https://github.com/ariya/pico-jarvis
chatbot gpt llama llama2 mistral nlp openai
Last synced: 6 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/ariya/pico-jarvis
- Owner: ariya
- License: mit
- Created: 2023-10-05T05:13:31.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-07T03:05:42.000Z (9 months ago)
- Last Synced: 2024-05-02T01:07:55.232Z (7 months ago)
- Topics: chatbot, gpt, llama, llama2, mistral, nlp, openai
- Language: JavaScript
- Homepage:
- Size: 4.24 MB
- Stars: 52
- Watchers: 2
- Forks: 10
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Pico Jarvis
This repository contains the source code for the Retrieval-augmented Generation (RAG) technique, as described in the following articles:
* [Part 1: Getting started, Chain of Thought](https://www.linkedin.com/pulse/pico-jarvis-llm-based-chatbot-demo-rag-part-1-ariya-hidayat-pcygc/)
* [Part 2: Reason-Act, multi-turn conversation](https://www.linkedin.com/pulse/pico-jarvis-llm-based-chatbot-demo-rag-part-2-ariya-hidayat-plynf/)
* [Part 3: PDF ingestion, vector search](https://www.linkedin.com/pulse/pico-jarvis-llm-based-chatbot-demo-rag-part-3-ariya-hidayat-zchec)
* [Bonus: RAG with SLM (Small Language Model)](https://www.linkedin.com/pulse/phi-2-rag-emergence-small-language-model-slm-ariya-hidayat-2w6ac)
First, you need to run the [API server](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md) of [llama.cpp](https://github.com/ggerganov/llama.cpp) with [Phi 2](https://huggingface.co/TheBloke/phi-2-GGUF):
```
./server -m /path/to/phi-2.Q4_K_M.gguf
```
(For a slower response but with improved accuracy, consider using [Mistral 7B OpenOrca](https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF)).
To launch Pico Jarvis, you need [Node.js](https://nodejs.org/) v18 or later:
```
npm install
npm start
```
and then open `localhost:5000`.
Ask the following questions:
* Who wrote the Canon of Medicine?
* Is ramen typically eaten in Egypt?
* Who directed the Dark Knight movie?
* Name Indonesia #1 tourist destination!
(and some more to try)
* What is the native language of Mr. Spock?
* Which US state starts with G?
* What is the atomic number of Magnesium?
* Where do we find kangoroo?
* Who is the father of Luke Skywalker?
* In which country Mandarin is spoken?
* What is the longest river in Latin America?
* Who authored the special theory of relativity?
* Which fictional metal is infused into Wolverine body?
* Who sailed with the flagship Santa Maria?
* Name the big desert close to Mongolia
* Which is closer to Singapor: Vietnam or Australia?
* Who is the fictional spy 007?
* Which country is known for IKEA?
Meanwhile, questions related the solar system will be answered by searching the PDF document:
* What is a dwarf planet?
* Which planet known as the red one?
* What materials compose the gas giants?
* How about the ice giants?
* Explain the heliopause
* When did Voyager 2 enter the interstellar space?
* How about Voyager 1?
If you get an API key for [OpenWeatherMap](https://api.openweathermap.org) and supply it as `OPENWEATHERMAP_API_KEY` environment variable, try to ask the following:
* How is the weather in Jakarta?
* What is the current temperature in Palo Alto?
* Is it currently cloudy in Seattle?