https://github.com/iadtya/web-summarizer

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price
https://github.com/iadtya/web-summarizer

expressjs nodejs openai-api puppeteer reactjs redis tailwindcss

Last synced: 7 days ago
JSON representation

Web-summarizer scrapes the specific url to pipes that text data into gpt-3.5-turbo model to generate summary of the url and uses redis to cache the summary to save overhead price

• Host: GitHub
• URL: https://github.com/iadtya/web-summarizer
• Owner: iAdtya
• Created: 2024-01-09T01:03:32.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-01-13T15:16:53.000Z (10 months ago)
• Last Synced: 2024-01-14T00:37:10.820Z (10 months ago)
• Topics: expressjs, nodejs, openai-api, puppeteer, reactjs, redis, tailwindcss
• Language: TypeScript
• Homepage:
• Size: 361 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## Web-summarizer

Web-summarizer generates summary of a given URL using a fine-tuned GPT-3.5 model and Puppeteer to scrape the DOM. It also utilizes Redis to cache summaries, reducing overhead costs and improving request speed from 4.4 seconds to 500 milliseconds The full backend is containerized and deployed on Railway with integrated Jest unit tests running on GitHub Actions for CI/CD and Winston for logging

## output

![Screenshot 2024-01-13 135704](https://github.com/iAdtya/Web-summarizer/assets/93979441/1d17b607-12c3-4041-aa5c-683f43dac78d)