Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/walidbosso/roberta_fine_tuning_sentiment_analysis
Welcome to our RoBERTa Sentiment Analysis project! In this repository, we explore the world of Natural Language Processing (NLP) by fine-tuning a RoBERTa Transformer for sentiment analysis.
https://github.com/walidbosso/roberta_fine_tuning_sentiment_analysis
bert classification fine-tuning huggingface machine machine-learning movies-reviews neural-network nlp-machine-learning numpy pandas pytorch roberta roberta-model roberta-tokenizer sentiment-analysis transformer
Last synced: about 2 months ago
JSON representation
Welcome to our RoBERTa Sentiment Analysis project! In this repository, we explore the world of Natural Language Processing (NLP) by fine-tuning a RoBERTa Transformer for sentiment analysis.
- Host: GitHub
- URL: https://github.com/walidbosso/roberta_fine_tuning_sentiment_analysis
- Owner: walidbosso
- License: mit
- Created: 2024-02-24T00:21:13.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-02-24T00:48:16.000Z (11 months ago)
- Last Synced: 2024-02-24T01:29:44.038Z (11 months ago)
- Topics: bert, classification, fine-tuning, huggingface, machine, machine-learning, movies-reviews, neural-network, nlp-machine-learning, numpy, pandas, pytorch, roberta, roberta-model, roberta-tokenizer, sentiment-analysis, transformer
- Language: Jupyter Notebook
- Homepage: https://github.com/walidbosso/Roberta_Fine_Tuning_Sentiment_Analysis/tree/main
- Size: 14.6 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://github.com/walidbosso/Roberta_Fine_Tuning_Sentiment_Analysis)
# RoBERTa Sentiment Analysis
## Introduction
Welcome to our RoBERTa Sentiment Analysis project! In this repository, we explore the world of Natural Language Processing (NLP) by fine-tuning a RoBERTa Transformer for sentiment analysis.
## Our Team
Our team, consisting of BOUSSOU Walid, HINDA Abdeljebar, ASTIGHFAR Ismail, KAIS Zakaria, and AYAD Mounir, excited to share our journey with you.
## About RoBERTa
RoBERTa, short for "Robustly optimized BERT approach," is an advanced natural language processing model developed by Facebook AI Research. Built on the Transformer architecture, RoBERTa enhances BERT (Bidirectional Encoder Representations from Transformers) by addressing limitations and improving the pre-training procedure.
## Project Structure
- **Application in Sentiment Analysis:** Explore how we applied RoBERTa to sentiment analysis, specifically on a dataset of movie reviews.
- **Environment Setup:** Learn about the libraries and tools we used, including PyTorch, Transformers, and the Hugging Face library.
- **Data Preparation:** Details on loading and preparing the training data from a provided file.
- **Defining Variables:** Key variables defined for training and validation.
- **Dataset and DataLoader:** Creation of a custom dataset class and corresponding data loaders.
- **Neural Network Architecture:** Introduction to the fine-tuning neural network based on RoBERTa.
- **Loss Function and Optimizer:** Information on the loss function and optimizer used during training.
- **Training Function:** Explanation of the training process and how the model learns from the data.
- **Validation Function:** Insights into the validation stage to evaluate the model's performance on unseen data.
### Prerequisites
- Ensure you have Python installed (preferably Python 3.x).
- Download the training data file `train.tsv.zip` from [Kaggle](https://www.kaggle.com/c/movie-review-sentiment-analysis-kernels-only/data) and place it in the project directory.
## Acknowledgments
We extend our gratitude to the open-source community, particularly the developers behind PyTorch, Transformers, and Hugging Face. Without their contributions, this project wouldn't be possible.
Feel free to explore the code, learn from our experiences, and adapt it for your own NLP projects! If you have any questions or suggestions, don't hesitate to reach out.
Happy coding! 🚀
## License
This project operates under the **MIT License**. Refer to the [LICENSE](LICENSE) file for detailed information.
## Feedback and Contributions
Your feedback and contributions are invaluable! Feel free to open issues, submit pull requests, or connect for discussions.
- If you'd like to contribute to the project, please follow these steps:
1. Fork the repository.
2. Create a new branch (`git checkout -b feature/your-feature`).
3. Commit your changes (`git commit -m 'Add some feature'`).
4. Push to the branch (`git push origin feature/your-feature`).
5. Open a pull request.
- If you encounter any issues or have suggestions, please open an issue on the [Issues](https://github.com/walidbosso/Roberta_Fine_Tuning_Sentiment_Analysis/issues) page.
- Contact me in [LinkedIn](https://www.linkedin.com/in/walidbosso) for questions.
-  
Thank you for exploring! 🚀
----------------------
> >
© *by Walid BOUSSOU, HINDA Abdeljebar, ASTIGHFAR Ismail, KAIS Zakaria, and AYAD Mounir* 🇲🇦 😄
> > 
----------------------
👏 Thanks for the support
## Stargazers
[](https://github.com/walidbosso/Roberta_Fine_Tuning_Sentiment_Analysis/stargazers)
## Forkers
[](https://github.com/walidbosso/Roberta_Fine_Tuning_Sentiment_Analysis/network/members)
## Contributors
𝚂𝚑𝚘𝚠 𝚜𝚘𝚖𝚎 💙 𝚋𝚢 𝚜𝚝𝚊𝚛𝚛𝚒𝚗𝚐 ⭐ 𝚝𝚑𝚎 𝚛𝚎𝚙𝚘𝚜𝚒𝚝𝚘𝚛𝚢!
