https://github.com/h-fuzzy-logic/python-finding-nsf-award-themes

Using NLP to find themes and concepts in NSF Awards
https://github.com/h-fuzzy-logic/python-finding-nsf-award-themes

nltk pandas python scikit-learn

Last synced: 17 days ago
JSON representation

Using NLP to find themes and concepts in NSF Awards

• Host: GitHub
• URL: https://github.com/h-fuzzy-logic/python-finding-nsf-award-themes
• Owner: h-fuzzy-logic
• Created: 2020-07-05T21:27:19.000Z (over 4 years ago)
• Default Branch: trunk
• Last Pushed: 2020-07-05T21:28:07.000Z (over 4 years ago)
• Last Synced: 2023-08-27T20:09:14.698Z (over 1 year ago)
• Topics: nltk, pandas, python, scikit-learn
• Language: Jupyter Notebook
• Homepage:
• Size: 9.77 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Python-Finding-NSF-Award-Themes

 Natural language processing (NLP) can help make sense of large volumes of data, when there is too much data for a person to read.  This repo demonstrates how to find themes and concpets in the textual award data from the National Science Foundation.  Writing a proposal for an NSF award can be time consuming and the review process can seem mysterious.  To increase the chances of writing a winning proposal, natural language processing can uncover which phrases and topics have received funding.   It is also possible to determine if larger award amounts tend to be associated with certain words, phrases, and topics.  With this goal in mind, below are some insights about the NSF awards from 2019.

# Related Blog Post

https://h-fuzzy-logic.github.io/blog/nlp-nsf-awards

# Tools Used

* Jupyter Notebook

* Python, Pandas, NLTK, scikit-learn

# Technical Highlights

* Main branch is named trunk 

* Transformed publicly available XML files into a CSV file  

* Used NLTK for stopwords, tokenizing, and nGrams

* Used scikit-learn for Latent Semantic Analysis (LSA)  

* Used python def's to make the code easier to understand  

# Getting Started

* The data (CSV file) is not included in the repo due to GitHub storage limits.  (The file is 188 MB.)

* All required imports are in one cell at the top of the notebook.