Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ltfschoen/aind-nlp-bookworm
Term 2 Project 3 NLP using IBM Watson Discover and Conversation service and IBM Bluemix platform
https://github.com/ltfschoen/aind-nlp-bookworm
beautifulsoup bluemix natural-language-processing pillow sentiment-analysis watson-conversation watson-developer-cloud watson-discovery wordcloud wordcloud-library
Last synced: 11 days ago
JSON representation
Term 2 Project 3 NLP using IBM Watson Discover and Conversation service and IBM Bluemix platform
- Host: GitHub
- URL: https://github.com/ltfschoen/aind-nlp-bookworm
- Owner: ltfschoen
- Created: 2017-07-01T01:07:33.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2017-07-01T23:39:19.000Z (over 7 years ago)
- Last Synced: 2024-10-19T16:02:28.444Z (about 1 month ago)
- Topics: beautifulsoup, bluemix, natural-language-processing, pillow, sentiment-analysis, watson-conversation, watson-developer-cloud, watson-discovery, wordcloud, wordcloud-library
- Language: Jupyter Notebook
- Homepage:
- Size: 1.56 MB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Project: Bookworm
A simple question-answering system built using IBM Watson's NLP services.
## Overview
In this project, you will use IBM Watson's NLP Services to create a simple question-answering system. You will first use the Discovery service to pre-process a document collection and extract relevant information. Then you will use the Conversation service to build a natural language interface that can respond to questions.
## Getting Started
Clone this repository to your local computer.
If you have the AIND Anaconda environment prepared, now is a good time to activate it.
Open the notebook `bookworm.ipynb` from a terminal using the following command:
```
jupyter notebook bookworm.ipynb
```
Then follow the instructions in the notebook.
**Note**: You may have to install some packages (mentioned in the notebook). To do so, simply open another terminal and use pip.
`pip3 install -r requirements.txt`
## Bluemix
* Demo https://discovery-news-demo.mybluemix.net/
* Watson Discovery Python API https://www.ibm.com/watson/developercloud/discovery/api/v1/?python
* Watson Discovery Docs https://www.ibm.com/watson/developercloud/doc/discovery/index.html
* Watson Python SDK https://github.com/watson-developer-cloud/python-sdk
* Watson Discovery Guide https://www.ibm.com/watson/developercloud/doc/discovery/getting-started-tool.html
* Sign up to Bluemix 30 day free trial or eligible student https://console.bluemix.net/registration/
* Create Org Name and Space:
Org name:
Space name: dev
* Create Watson > Discovery service https://console.bluemix.net/dashboard/watson?env_id=ibm:yp:au-syd
## Troubleshooting
* Fix error `WatsonException: Error: Unsupported Media Type, Code: 415` by modifying the file mentioned [here](https://github.com/watson-developer-cloud/python-sdk/pull/223)
## Tasks
Complete each task in the notebook by implementing or modifying code wherever there is a `TODO` comment in a code cell, and answering any inline questions by modifying markdown cells. E.g.:
> **Q**: What is the overall sentiment detected in this text? Mention the type (positive/negative) and score.
>
> **A**: Negative, -0.798
Once you have completed all tasks, save the notebook, and then export it into a PDF or HTML. Remember to submit both the notebook (.ipynb) and the PDF/HTML, along with any other files that may be needed, e.g. data files, in case you use your own (sample files provided with the project don't need to be submitted).
**Note**: Please do not submit your `service-credentials.json` file - that is meant to be kept secret.
## Extensions
Feel free to work on the project with your own dataset. You can also turn it into a web-based application and deploy it on Bluemix.
## IBM Watson Resources
- [Watson Developer Cloud](https://www.ibm.com/watson/developercloud/) [[GitHub](https://github.com/watson-developer-cloud/)]
- [Starter Kits](https://www.ibm.com/watson/developercloud/starter-kits.html)
- [Discovery service](https://www.ibm.com/watson/developercloud/doc/discovery/index.html)
- [Conversation service](https://www.ibm.com/watson/developercloud/doc/conversation/index.html)
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Please refer to [Udacity Terms of Service](https://www.udacity.com/legal) for further information.