{"id":21983043,"url":"https://github.com/arsho/text-processing-with-nltk","last_synced_at":"2025-03-23T01:30:10.850Z","repository":{"id":79174273,"uuid":"90982215","full_name":"arsho/Text-Processing-with-NLTK","owner":"arsho","description":"Text processing using NLTK 3, practicing problems from Python 3 Text Processing with NLTK 3 by Jacob Perkins","archived":false,"fork":false,"pushed_at":"2017-05-11T14:26:24.000Z","size":2,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-01-28T04:46:11.461Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arsho.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-05-11T13:27:20.000Z","updated_at":"2020-03-24T11:40:52.000Z","dependencies_parsed_at":"2023-05-18T17:15:50.344Z","dependency_job_id":null,"html_url":"https://github.com/arsho/Text-Processing-with-NLTK","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arsho%2FText-Processing-with-NLTK","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arsho%2FText-Processing-with-NLTK/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arsho%2FText-Processing-with-NLTK/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arsho%2FText-Processing-with-NLTK/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arsho","download_url":"https://codeload.github.com/arsho/Text-Processing-with-NLTK/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245043718,"owners_count":20551831,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-29T17:34:15.432Z","updated_at":"2025-03-23T01:30:10.823Z","avatar_url":"https://github.com/arsho.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Text-Processing-with-NLTK\n\n### Installation procedure of NLTK (Natural Language Toolkit)\nThe following steps are performed in a ```Windows 10 (64 bit)``` machine with ```Python 3.5.2``` installed. \n\n* To check Python version open CMD and use this command:\n```python --version```\n* Create a folder. In my case I have created a folder named ```nltk```. Open CMD inside  it. Keep the CMD open for following steps.\n* Install necessary packages for ```nltk``` inside a virtual environment. If you don't have virtualenv installed, install it using ```pip install virtualenv```.\n* In CMD perform the following commands to create a virtual environment and to download packages inside it. Here ```D:\\pyPrac\\nltk``` is my path of current directory. It will differ in your case.\n  ```text\n  D:\\pyPrac\\nltk\u003evirtualenv venv\n  D:\\pyPrac\\nltk\u003evenv\\Scripts\\activate.bat\n  (venv) D:\\pyPrac\\nltk\u003epip install -U nltk\n  (venv) D:\\pyPrac\\nltk\u003epip install numpy\n  (venv) D:\\pyPrac\\nltk\u003epython -m idlelib\n  ```\n* The last command will open IDLE. We use IDLE inside the virtual environment each time we are going to use NLTK package. Using this IDLE (opened inside the virtual environment), create a ```Python``` file in the same folder and run the following snippet to check if ```nltk``` has been installed properly.\n  ```python\n  import nltk\n  print(nltk.__version__) #Output: 3.2.2\n  ```\n* To download ```nltk``` data, create a ```Python``` file in the same virtual environment and run the following snippet.\n  ```python\n  import nltk\n  nltk.download()\n  ```\n\tSelect all from menu to download and set directory to: ```C:\\nltk_data```. It will take around an hour to complete downloading the data. Ignore if it shows ```outdated``` for some fields.\n* That's it! :+1: Here are some CMD commands you need to remember:\n\t* Activating virtual environment that we have created earler: ```venv\\Scripts\\activate.bat```\n\t* Open IDLE inside this virtual environment: ```(venv) D:\\pyPrac\\nltk\u003epython -m idlelib```\n\n\n### Book Information\n* Python 3 Text Processing with NLTK 3 Cookbook by Jacob Perkins\n\n### Code List\n* Tokeinizing text into sentence: [tokenizing_text_into_sentence.py](https://github.com/arsho/Text-Processing-with-NLTK/blob/master/tokenizing_text_into_sentence.py)\n\n#### References:\n\n * [NLTK website](http://www.nltk.org/index.html)\n * [NLTK official documentation to install nltk (without using virtualenv)](http://www.nltk.org/install.html)\n * [NLTK official documentation to install nltk data](http://www.nltk.org/data.html)\n * [StackOverflow Question: Reading Bengali with python Natural Language Toolkit](http://stackoverflow.com/questions/42718792/reading-bengali-with-python-natural-language-toolkit)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farsho%2Ftext-processing-with-nltk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farsho%2Ftext-processing-with-nltk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farsho%2Ftext-processing-with-nltk/lists"}