Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/himalayaashish/text_summarizer
This project demonstrates how to leverage transformer-based models to perform text summarization on conversation data using the Hugging Face transformers library. A pre-trained BART-large-XSum model is utilized to summarize long conversations. The summarizer is optimized to run on a GPU, ensuring fast inference and efficient tokenization handling.
https://github.com/himalayaashish/text_summarizer
json-data nlu tensorflow2 transformer
Last synced: 28 days ago
JSON representation
This project demonstrates how to leverage transformer-based models to perform text summarization on conversation data using the Hugging Face transformers library. A pre-trained BART-large-XSum model is utilized to summarize long conversations. The summarizer is optimized to run on a GPU, ensuring fast inference and efficient tokenization handling.
- Host: GitHub
- URL: https://github.com/himalayaashish/text_summarizer
- Owner: himalayaashish
- Created: 2024-09-14T11:30:24.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-10-17T08:00:16.000Z (3 months ago)
- Last Synced: 2024-10-19T10:27:06.385Z (3 months ago)
- Topics: json-data, nlu, tensorflow2, transformer
- Language: Jupyter Notebook
- Homepage:
- Size: 49.8 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Hello World!
🚀 Welcome to my git repo :Text Summarization#####
#### Text Summarization Using Transformer Models
###### This project demonstrates how to leverage transformer-based models to perform text summarization on conversation data using the Hugging Face transformers library.A pre-trained BART-large-XSum model is utilized to summarize long conversations. The summarizer is optimized to run on a GPU, ensuring fast inference and efficient tokenization handling. The project showcases how to generate concise and meaningful summaries of dialogues.###### This project summarizes conversations using the Hugging Face `transformers` library and the BART model for summarization. The model used here is `"lidiya/bart-large-xsum-samsum"`.
---
## Installation
1. Clone this repository or download the script.
2. Install the required packages using pip:```bash
pip install -r requirements.txt
```
```bash
python main.py
```---
### Languages and Tools
### Languages
**Python**:
![Python](https://img.shields.io/badge/-Python-black?style=flat&logo=python)
![Keras](https://img.shields.io/badge/-Keras-D00000?style=flat&logo=Keras)
![Tensorflow](https://img.shields.io/badge/-Tensorflow-gray?style=flat&logo=tensorflow)
![PyTorch](https://img.shields.io/badge/-PyTorch-EE4C2C?style=flat&logo=PyTorch&logoColor=white)
![Pandas](https://img.shields.io/badge/-Pandas-150458?style=flat&logo=Pandas)
![Numpy](https://img.shields.io/badge/-Numpy-lightgray?style=flat&logo=Numpy&logoColor=white)
![Scipy](https://img.shields.io/badge/-Scipy-blue?style=flat&logo=Scipy&logoColor=white)
![Matplotlib](https://img.shields.io/badge/-Matplotlib-black?style=flat&logo=Matplotlib&logoColor=white)**JavaScript**:
![JavaScript](https://img.shields.io/badge/-JavaScript-black?style=flat&logo=javascript)
![HTML5](https://img.shields.io/badge/-HTML5-E34F26?style=flat&logo=html5&logoColor=white)
![CSS3](https://img.shields.io/badge/-CSS3-1572B6?style=flat&logo=css3)
![Bootstrap](https://img.shields.io/badge/-Bootstrap-purple?style=flat&logo=bootstrap)**SQL:**
![SQL](https://img.shields.io/badge/-SQL-orange?style=flat&logo=sql)
![MySQL](https://img.shields.io/badge/-MySQL-lightgray?style=flat&logo=mysql)
![PostgreSQL](https://img.shields.io/badge/-PostgreSQL-blue?style=flat&logo=postgresql)### Tools
**Software Development:**
![Pycharm IDE](https://img.shields.io/badge/PyCharm-000000?logo=PyCharm&logoColor=white)
![IntelliJ IDEA](https://img.shields.io/badge/-red?style=flat&logo=IntelliJ-IDEA&logoColor=white)
![Docker](https://img.shields.io/badge/-2496ED?style=flat&logo=Docker&logoColor=white)
![Jenkins](https://img.shields.io/badge/Jenkins-gray?style=flat&logo=jenkins)
![XML](https://img.shields.io/badge/-XML-orange?style=flat&logo=xml)
![JSON](https://img.shields.io/badge/-JSON-lightgray?style=flat&logo=json)
![Vim](https://img.shields.io/badge/-019733?style=flat&logo=Vim&logoColor=white)**SDLC:**
![Agile](https://img.shields.io/badge/Agile-blue?style=flat&logo=Agile&logoColor=white) ![Scrum](https://img.shields.io/badge/Scrum-green?style=flat&logo=Scrum&logoColor=white) ![Kanban](https://img.shields.io/badge/Kanban-red?style=flat&logo=Kanban&logoColor=white)**Software Engineering:**
[![Jira](https://img.shields.io/badge/-Jira-0052CC?style=flat&logo=jira&logoColor=white&link=https://github.com/Quananhle)](https://github.com/Quananhle)
[![Travis](https://img.shields.io/badge/-Travis-red?style=flat&logo=travis&logoColor=white&link=https://github.com/Quananhle)](https://github.com/Quananhle)**Version Control:**
![Bitbucket](https://img.shields.io/badge/-Bitbucket-blue?style=flat&logo=bitbucket)
![Git](https://img.shields.io/badge/-Git-black?style=flat&logo=git)
![GitHub](https://img.shields.io/badge/-GitHub-181717?style=flat&logo=github)---
---
Connect with me