Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/andrerab/research-of-the-existing-spell-checking-tools-using-nlp


https://github.com/andrerab/research-of-the-existing-spell-checking-tools-using-nlp

Last synced: 23 days ago
JSON representation

Awesome Lists containing this project

README

        

# Research of the existing spell checking tools using NLP
![transformers](https://img.shields.io/badge/transformers-4.44.2-red)
![PyTorch](https://img.shields.io/badge/PyTorch-2.4.0-green)
![Torchvision](https://img.shields.io/badge/Pandas-2.2.2-orange)
![NLTK](https://img.shields.io/badge/NLTK-3.7-blue)
![Issues](https://img.shields.io/github/issues/AndreRab/Research-of-the-existing-spell-checking-tools-using-NLP)

### Description
Research Objective
This study aims to evaluate and compare three spell-checking tools, assessing their effectiveness and accuracy in correcting spelling errors. Using a diverse dataset, we analyze the performance of GPT-4, the language_tool_python library, and a fine-tuned T5 model. Through this study, we aim to identify the most effective tool for spell-checking tasks and explore areas for potential improvement.

The complete analysis and findings are documented in this Jupyter [notebook (jetBrains.ipynb)](https://github.com/AndreRab/Research-of-the-existing-spell-checking-tools-using-NLP/blob/main/jetBrains.ipynb).

### How to use this notebook
You have several options for using this notebook:

1. **View on GitHub**
You can open the notebook directly on GitHub to read the entire research content without making edits or running code.

2. **Open in Google Colab**
To interact with and edit the notebook, click on the “Open in Colab” button at the top of the notebook in the GitHub repository.

3. **Download and Open in Jupyter Notebook**
For local editing, download the notebook and open it using Jupyter Notebook. For installation instructions, visit the [Jupyter website](https://jupyter.org/)

### Table of the notebook content
| Section | Description |
|-------------------------------|---------------------------------------------------------------------|
| Abstract | A brief overview of the notebook’s purpose and main objectives.|
|Introduction |Introduction to the problem and the importance of spell-checking accuracy.|
|Data Preparation |Details on data sources, preprocessing steps, and dataset structure.|
|Metrics |Explanation of metrics used for evaluation and the rationale behind them.|
|Model Evaluation |Step-by-step process for evaluating the three different models.|
|Final Model Comparison| Comparative analysis with suggestions for performance improvement.|
|Conclusion |Summary of findings and key takeaways from the research.|