https://github.com/md-emon-hasan/distilbert-model-with-hf-transformer
📝 DistilBERT, a lightweight Transformer model from Hugging Face, for various NLP tasks without requiring custom fine-tuning or datasets.
https://github.com/md-emon-hasan/distilbert-model-with-hf-transformer
ai-interface conversational-ai deep-learning distilbert huggingface-transformers language-model machine-learning named-entity-recognition nlp-models pretrained-models question-answering sentiment-analysis text-classification text-similarity text-summarization transformer
Last synced: 6 months ago
JSON representation
📝 DistilBERT, a lightweight Transformer model from Hugging Face, for various NLP tasks without requiring custom fine-tuning or datasets.
- Host: GitHub
- URL: https://github.com/md-emon-hasan/distilbert-model-with-hf-transformer
- Owner: Md-Emon-Hasan
- License: mit
- Created: 2025-01-20T10:18:01.000Z (9 months ago)
- Default Branch: master
- Last Pushed: 2025-01-20T10:43:45.000Z (9 months ago)
- Last Synced: 2025-02-10T09:19:04.599Z (8 months ago)
- Topics: ai-interface, conversational-ai, deep-learning, distilbert, huggingface-transformers, language-model, machine-learning, named-entity-recognition, nlp-models, pretrained-models, question-answering, sentiment-analysis, text-classification, text-similarity, text-summarization, transformer
- Language: Python
- Homepage:
- Size: 71.3 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
```markdown
# DistilBERT Model with Hugging Face Transformers
A basic implementation of **DistilBERT** using the Hugging Face Transformers library to demonstrate its capabilities for NLP tasks such as text classification, sentiment analysis, and more.
---
## Features
- Load and use pre-trained DistilBERT without custom fine-tuning.
- Perform text-based tasks out of the box.
- Simple and reusable implementation.
---
## Requirements
- Python >= 3.7
- Transformers
- PyTorch
---
## Usage
### **1. Text Classification**
Use the pre-trained DistilBERT model to classify text:
```bash
python app.py --text "Enter your text here."
```
### **2. Tokenization**
Process text using DistilBERT's text similarity:
```bash
python app.py --text "Entet your text here."
```
---
## Project Structure
- `classify.py`: Script to classify text using pre-trained DistilBERT.
- `similarity.py`: Script to similarity input text.
---
## License
This project is licensed under the MIT License.
```