https://github.com/timooo-thy/fake-real-news-classifier
News Classification (real and fake news dataset from kaggle)
https://github.com/timooo-thy/fake-real-news-classifier
Last synced: 8 months ago
JSON representation
News Classification (real and fake news dataset from kaggle)
- Host: GitHub
- URL: https://github.com/timooo-thy/fake-real-news-classifier
- Owner: timooo-thy
- Created: 2023-03-12T05:14:42.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2023-04-19T15:56:43.000Z (over 3 years ago)
- Last Synced: 2024-12-29T00:07:30.642Z (over 1 year ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 17.1 MB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: News_Classifier_Final.ipynb
Awesome Lists containing this project
README
# Fake News Classifier (Dataset from Kaggle)
## About
Our project is all about fighting fake news by building a system that can automatically tell if a news article is real or fake. In today's world of social media and online news, it's becoming harder to know what to believe.
To address this problem, we have built a machine learning model that uses natural language processing techniques to analyse the content of news articles and determine their credibility. We trained our model on a large dataset of labeled news articles, which we carefully curated to include examples of both real and fake news.
Our model uses a variety of features, such as the text and title, the length of the article, and the overall tone and sentiment, to make its classification decision. We also experimented with different machine learning algorithms and techniques, such as PyTorch and Keras, to improve the accuracy and robustness of our system.
We're hoping that our fake news classification system will be really useful for anyone who wants to stay on top of what's happening in the world without getting duped by fake news. It's gonna be a big help for journalists, fact-checkers, and anyone else who wants to know what's really going on out there.
## Problem Statement
"Is this news article real or fake?"
## Cleaning Methods
1) Identify information leaks
- Text leaks
- Date leaks
- URL leaks
2) Basic NLP data cleaning
- Contractions
- Punctuations
- Spaces
- Lowercase
- Duplicates
## Analysis Done
1) NLTK and WordCloud analysis
2) Distribution of news article length (log transformation)
3) Sentiment analysis using TextBlob
4) Subject analysis
## Models Used
### Machine Learning Models:
1) Logistic Regression (Sentiment Score and Bag of Words)
2) Binary Tree Classification
3) Random Forest with Cross Validation
4) XGBoost using TF-IDF to vectorise text (model included) with Cross Validation
### Deep Learning Models:
1) Pytorch using Bert Based Uncased Model (model not included in github due to large file size)
2) Keras ANN using Tokenizer for preprocessing text (model included)
## Further Testing (on an unseen dataset)
We tested our models (keras and xgboost) on a completely new dataset to test its perfomance against real world news.
## Conclusion
We concluded that deep learning models are the best for this problem since they excel at handling large amounts of data and can find nuanced patterns and complex features that are not immediately visible. Additionally, the ability to automatically extract hierarchical representations make these models excel at NLP applications.
## Takeaways
1) Text outperformed title in most cases.
2) NLP features like sentiment analysis help refine our models.
3) Deep learning models require a lot of computational power for large datasets.
4) Overfitting is a common issue and there is a tradeoff between "too much capacity" (overfitting) VS "too little capacity" (not converging).
## Future Improvements
1) Reduce overfitting by starting with a few layers and parameters and increase it until we see diminishing return with regard to validation loss.
2) Aim to include models that can detect sarcasm and irony based on context. Improved models can better capture and analyse context which can greatly improve the accuracy of our news classifier.
3) Build a working website with HTML, CSS and JS that can incorporate our model to detect fake news based on the article. This offers functionality and usability of the deep learning model we trained.
## Presentation Video
[Fake News Classifier](https://youtu.be/Elc5tNLbSpU)
## Contributors
| Name | Github Account |
|------------------|---------------------------------------------------------|
| Timothy Lee | [@timooo-thy](https://github.com/timooo-thy) |
| Jain Amitbikram | [@spinelessknave8](http://github.com/spinelessknave8) |
| Vivian Kho | [@svftbuns](http://github.com/svftbuns) |
## References
1) https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset
2) https://huggingface.co/bert-base-uncased
3) https://keras.io/api/keras_nlp/tokenizers/tokenizer/
4) https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.TfidfVectorizer.html
5) https://towardsdatascience.com/a-simple-explanation-of-the-bag-of-words-model-b88fc4f4971
6) https://monkeylearn.com/sentiment-analysis/
7) https://www.kaggle.com/datasets/saurabhshahane/fake-news-classification
8) https://unsplash.com/@obionyeador?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText