https://github.com/ngageoint/nounalyzer
Analyze the nouns and entities in a rss feed
https://github.com/ngageoint/nounalyzer
Last synced: 6 months ago
JSON representation
Analyze the nouns and entities in a rss feed
- Host: GitHub
- URL: https://github.com/ngageoint/nounalyzer
- Owner: ngageoint
- License: unlicense
- Created: 2015-11-09T18:57:25.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2020-10-07T16:17:19.000Z (over 5 years ago)
- Last Synced: 2025-04-07T03:51:10.485Z (9 months ago)
- Language: HTML
- Size: 41.7 MB
- Stars: 21
- Watchers: 26
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## What it Does
Analysts were spending too much time monitoring RSS feeds of news articles. Nounalizer helps distill this information faster than reading and presents the data in a visually pleasing manner. The underlying idea that provides the theory for why this works is that important things are nouns and will be mentioned more (in aggregate) than things that are not important. Let's then show noun frequency for individual RSS feeds.
### Architecture
This tool is designed to sit on a web server with php. Users will come to the website, enter in text for an rss feed link, referenced as ```javascript $('#rss').val()``` in ```index.html``` and ```rss``` in ```python/rss.py```. An ajax call is then made to ```python.php``` which executes the python script. The script executes by writing temporary files to ```python tmp_dir``` and ```python data_dir``` as declared in ```python/rss.py```. After reading stdout, waiting for python to write the name of the files it wrote to the ```data/``` directory, ```python.php``` returns the string of comma-separated file names to ```index.html``` which redirects to ```results.html```.
### Directory Structure
* `css/` -- contains css files for `index.html`, `results.html`, and `rats.html`
* `data/` -- empty folder to which `python.php` writes files
* `js/` -- contains javascript files
* `python/` -- contains python file that `python.php` calls
* `README.md` -- development documentation
* `index.html` -- main welcome page for Nounalizer
* `python.php` -- file that is called by `index.html` to execute `python/rss.py`
* `rats.html` -- the best error page ever made
* `results.html` -- displays aggregate results of comma-separated files names in `data/` which are referenced following `q=` tag in the url of the file
* `seal.png` -- NGA seal referenced in `index.html` for introduction page
### Dependencies
Python:
* [spaCy](http://www.spacy.io) -- MIT
* [python-goose](https://github.com/grangier/python-goose) -- Apache 2.0
* [Feedparser](https://github.com/kurtmckee/feedparser) -- [Copyright](https://github.com/kurtmckee/feedparser/blob/develop/LICENSE) (c) 2010-2015, Kurt McKee
javascript:
* [d3js](https://github.com/mbostock/d3) -- [Copyright](https://github.com/mbostock/d3/blob/master/LICENSE) (c) 2010-2015, Michael Bostock
* [ScrollMagic](http://scrollmagic.io/) -- MIT
* [jquery](https://jquery.com/) -- [Copyright](https://github.com/jquery/jquery/blob/master/LICENSE.txt) jQuery Foundation and other contributors
## Origin
Nounalizer was developed at the National Geospatial-Intelligence Agency (NGA) by a federal government employee in the course of their employment, so it is not subject to copyright protection and is in the public domain in the United States.
### Pull Requests
If you'd like to contribute to this project, please make a pull request. We'll review the pull request and discuss the changes. This project is in the public domain within the United States and all changes to the core public domain portions will be released back into the public domain. By submitting a pull request, you are agreeing to comply with this waiver of copyright interest. Modifications to dependencies under copyright-based open source licenses are subject to the original license conditions.