https://github.com/akhilsharmaa/reslm.site
Reslm.site Reasearch Assistant - AI-powered document chat platform: Upload PDFs to S3, extract text, generate embeddings (pgvector), stream LLM responses via SSE, with JWT auth, session saving, credit limits, and secure EC2 deployment.
https://github.com/akhilsharmaa/reslm.site
ci docker docker-compose langchain nodejs pdf pisma postgres rag reactjs s3-bucket vector-database
Last synced: 3 months ago
JSON representation
Reslm.site Reasearch Assistant - AI-powered document chat platform: Upload PDFs to S3, extract text, generate embeddings (pgvector), stream LLM responses via SSE, with JWT auth, session saving, credit limits, and secure EC2 deployment.
- Host: GitHub
- URL: https://github.com/akhilsharmaa/reslm.site
- Owner: akhilsharmaa
- Created: 2025-03-30T07:39:34.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-07-01T07:10:11.000Z (12 months ago)
- Last Synced: 2025-07-18T02:22:37.220Z (12 months ago)
- Topics: ci, docker, docker-compose, langchain, nodejs, pdf, pisma, postgres, rag, reactjs, s3-bucket, vector-database
- Language: TypeScript
- Homepage: http://reslm.site
- Size: 9.65 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Video demo [link](https://youtu.be/_u-zO0ltbqM)
## Key Features
- Ingestion & Process: Upload PDFs, store on S3, then extract text, generate embeddings for RAG system.
- Embeddings: Docs are chunked and embedded, stored in pgvector for fast ‘similarity and retrieval’.
- Chat+Stream: SSE for live LLM output, short-lived tokens, save chats sessions, also visualize chunks.
- Deployment: CI pipeline builds & deploys with Docker Compose on EC2, mapped domain (reslm.site).
- Security & Access: Features include Jwt authentication, user credit limits, and secure PDF deletion.
## TODOS:
- [x] Authentication: login/register system using JWT.
- [ ] All credit limits to the LLM.
- [ ] Add Auth2.0 (goggle)
- [ ] send email on signup to the user.
- [x] **PDF Upload:** file upload functionality using multer to accept PDF files
- [X] **Convert PDF to Image Thumbnail**: Convert uploaded PDFs into a single image as first page.
- [x] **Upload to S3 Bucket**: Store the image in S3 and get a viewable public URL.
- [x] save file data (metadata) in the database simultaneously.
- [ ] delete the image + pdf for local storage.
- [x] **Generate Embedding on Upload**: Use OpenAI embeddings for each uploaded document.
- [x] **Storing Embeddings in PostgreSQL**: Save embeddings using `pgvector` for fast similarity search.
- [x] **SSE with Live LLM Output**: Stream LLM responses in real-time using Server-Sent Events,
- [x] create Short live token, for SSE request (as they don't support bearear token)
- [x] save chats in the database simultaneously.
- [x] Create embedding for user prompt
- [x] Fetch nearest chunks from stored embeddings
- [x] Combine prompt + chunks
- [x] Send to LLM for grounded response
- [ ] User credit score: fuctionality to limit the chat per user.
- [ ] **Delete PDF**: allowing users to delete the PDF.
- [ ] delete the embedding+chunks of the upload.
- [ ] delete the image thumbnail from s3 bucket.
- [ ] delete complete metadata of upload.
### Important:
- [ ] **Deployment:**
- [x] Setup Docker for production:
- [x] CI pipeline
- [x] migrate local to cloud Postgre database
- [x] migrate cloud postgre to docker based postgres (using docker-compose).
---
**Server Setup**
1. Create EC2 instance atleat ()
[https://docs.docker.com/engine/install/ubuntu/](docker docs)
```
# Add Docker's official GPG key:
sudo apt-get update
sudo apt-get install ca-certificates curl
sudo install -m 0755 -d /etc/apt/keyrings
sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
sudo chmod a+r /etc/apt/keyrings/docker.asc
# Add the repository to Apt sources:
echo \
"deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
$(. /etc/os-release && echo "${UBUNTU_CODENAME:-$VERSION_CODENAME}") stable" | \
sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update
sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
sudo apt install docker-compose
```
2. Now assign the elastic-ip to the EC2 you have created.
3. Edit Inbound rule to allow 8000 from everywhere.