https://github.com/philfung/perplexed

Open-source RAG app inspired by Perplexity.
https://github.com/philfung/perplexed

ai-search-engine groq llm perplexity perplexity-ai search-engine websearch websearch-agent

Last synced: about 14 hours ago
JSON representation

Open-source RAG app inspired by Perplexity.

• Host: GitHub
• URL: https://github.com/philfung/perplexed
• Owner: philfung
• Created: 2024-05-08T02:41:06.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-10-29T19:41:43.000Z (14 days ago)
• Last Synced: 2024-10-29T21:35:58.096Z (13 days ago)
• Topics: ai-search-engine, groq, llm, perplexity, perplexity-ai, search-engine, websearch, websearch-agent
• Language: JavaScript
• Homepage: https://philfung.github.io/perplexed
• Size: 1.02 MB
• Stars: 88
• Watchers: 1
• Forks: 9
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## Perplexed 

Open-source app inspired by the amazing web search product, Perplexity.

[Live Demo](https://d37ozmhmvu2kcg.cloudfront.net/)





## Implementation

Given a user query, the app conducts a web search,

downloads the top N resulting web pages, then analyzes those pages 

with an LLM.  

The LLM can be any smaller, consumer-grade with at least 5k context window (assuming each web page ~1k tokens)

## Deployment Instructions

### Python Server

1. ```

   cd backend

   copy config.json.sample config.json

   ```

3. In `config.json`, fill in `GOOGLE_SEARCH_API_KEY` and `GOOGLE_SEARCH_ENGINE_ID` credentials from [Google Custom Search API](https://developers.google.com/custom-search/v1/overview).

4. Fill in `GROQ_API_KEY` credentials from [Groq](https://console.groq.com/docs/quickstart).

5. Setup virtual environment, packages, and deploy the server

   ```

   virtualenv venv

   . venv/bin/activate

   pip install -r requirements.txt

   python app.py

   ```

   In the future, only need to do:

   ```

   . venv/bin/activate

   python app.py

   ````

### React Frontend

1. Update `API_URL` in `constants.js` to point to your server

2. ```

   npm install

   ```

3. In dev, to start the server:

   ```

   npm run start

   ```

   In production, to start the server:

   ```

   npm i -g npm@latest

   rm -rf node_modules

   rm -rf package-lock.json

   npm cache clean --force

   npm i --no-optional --omit=optional

   npm run build

   npm install -g serve

   server -s build

   ```