Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/extrawest/ai-uni-summarizer

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.
https://github.com/extrawest/ai-uni-summarizer

ai groq groq-api nextjs openai puppeteer reactjs youtube

Last synced: 11 days ago
JSON representation

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

Awesome Lists containing this project

README

        

# Web and YouTube Video Summarizer

[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)]()
[![Maintaner](https://img.shields.io/static/v1?label=Nariman%20Mamutov&message=Maintainer&color=red)](mailto:[email protected])
[![Ask Me Anything !](https://img.shields.io/badge/Ask%20me-anything-1abc9c.svg)]()
![GitHub license](https://img.shields.io/github/license/Naereen/StrapDown.js.svg)
![GitHub release](https://img.shields.io/badge/release-v1.0.0-blue)

![](https://raw.githubusercontent.com/extrawest/ai-uni-summarizer/main/preview.gif)

This project is designed to scrape a website or YouTube video by URL link and provide a concise summary to the user. It utilizes the power of OpenAI and GROQ API for language processing and LangChain for text and document handling.

## Features

- Content Summarization: Provides a summary of the content from a given URL.
- YouTube and Web Support: Handles both YouTube video URLs and regular web page URLs.
- Customizable Temperature: Allows setting the temperature for the language model to control the creativity of the output.

## Technologies Used

- Next.js: Backend framework.
- OpenAI: For generating embeddings and language processing.
- GROQ API: For language model interaction.
- LangChain: For handling text splitting, document combination, and retrieval.
- Puppeteer: For web scraping.
- YouTube Data API: For YouTube video data retrieval.
- React: Frontend framework.
- Axios: For making HTTP requests.
- Lucide React: For icons.
- Tailwind CSS: For styling.

## Getting Started

### Prerequisites

- Node.js
- npm or yarn
- OpenAI API Key
- (Optional) GROQ API Key
- (Optional) Local LLM URL

## Contributing

Contributions are welcome! Please submit a pull request or open an issue to discuss any changes.

## License

This project is licensed under the MIT License. See the LICENSE file for details.

## Acknowledgements

- LangChain
- OpenAI
- Next.js
- Puppeteer
- React
- Axios
- Lucide React