Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kristishqau/sentimentanalysis_nlp
A project for sentiment analysis of tweets using various NLP techniques and machine learning models.
https://github.com/kristishqau/sentimentanalysis_nlp
datascience jupyter-notebook machine-learning nlp nltk python scikit-learn sentiment-analysis xgboost
Last synced: 20 days ago
JSON representation
A project for sentiment analysis of tweets using various NLP techniques and machine learning models.
- Host: GitHub
- URL: https://github.com/kristishqau/sentimentanalysis_nlp
- Owner: kristishqau
- License: mit
- Created: 2024-05-30T22:10:35.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-08-04T09:33:19.000Z (5 months ago)
- Last Synced: 2024-08-04T10:43:42.321Z (5 months ago)
- Topics: datascience, jupyter-notebook, machine-learning, nlp, nltk, python, scikit-learn, sentiment-analysis, xgboost
- Language: Jupyter Notebook
- Homepage:
- Size: 2.86 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# SentimentAnalysisNLP
## Overview
Welcome to the SentimentAnalysisNLP project! This repository contains a comprehensive sentiment analysis pipeline that processes and classifies tweets into different sentiment categories using Natural Language Processing (NLP) techniques and machine learning models.
The goal of this project is to accurately classify tweets into one of four sentiment categories:
- Positive
- Negative
- Neutral
- Irrelevant
## Features
- **Data Preprocessing**: Tokenization, lowercasing, punctuation removal, stopword removal, and lemmatization.
- **Vectorization**: TF-IDF and Count Vectorizer methods.
- **Machine Learning Models**: Logistic Regression, Random Forest, and XGBoost.
- **Model Evaluation**: Accuracy, precision, recall, F1 score, ROC AUC score, and classification report.
- **Visualization**: Word cloud and bar plot of the most common words.
- **Saved Models**: Pre-trained models available for direct use.
## Installation
### Prerequisites
- Python 3.6 or higher
- pip (Python package installer)
### Clone the Repository
```sh
git clone https://github.com/Chralsh/SentimentAnalysisNLP.git
cd SentimentAnalysisNLP
```
### Install Dependencies
Install the required Python packages using the `requirements.txt` file.
```sh
pip install -r requirements.txt
```
## Usage
### Data Preparation
Ensure you have your datasets in the `data` directory. You should have two CSV files: `twitter_training.csv` and `twitter_validation.csv`.
### Running the Jupyter Notebook
Launch Jupyter Notebook and open the `SentimentAnalysisNLP.ipynb` file located in the `notebooks` directory.
```sh
jupyter notebook notebooks/SentimentAnalysisNLP.ipynb
```
### Training and Evaluating Models
Follow the steps in the notebook to:
- **Preprocess the data:** Clean and process the tweet text.
- **Visualize the data:** Generate word clouds and bar plots for common words.
- **Vectorize the text:** Transform text data using TF-IDF and Count Vectorizer.
- **Train and evaluate models:** Train Logistic Regression, Random Forest, and XGBoost models. Evaluate their performance using various metrics.
- **Save and load models:** Save the trained models to the models directory and load them for predictions.
### Making Predictions
Use the trained models to make predictions on new tweet data. Example tweets and their sentiment predictions are provided in the notebook.
## Output form the best model
## Additional Information
- **Code Comments:** Every step in the notebook is thoroughly commented. Each code cell contains comments explaining the purpose and functionality of the code.
- **Multiple models and dataset processing used:** I used more than one specific workflow and model just to demonstrate different solutions and methods.
## Contributing
I welcome contributions to the SentimentAnalysisNLP project! If you have any ideas, bug reports, or improvements, feel free to submit a pull request or open an issue.