https://github.com/eddiewang/TwitterScrape

A Twitter scraping tool using Scrapy
https://github.com/eddiewang/TwitterScrape

Last synced: 3 months ago
JSON representation

A Twitter scraping tool using Scrapy

• Host: GitHub
• URL: https://github.com/eddiewang/TwitterScrape
• Owner: eddiewang
• License: mit
• Created: 2015-04-05T11:26:55.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2015-05-18T15:06:20.000Z (over 9 years ago)
• Last Synced: 2024-05-31T09:35:56.738Z (5 months ago)
• Language: Python
• Size: 266 KB
• Stars: 10
• Watchers: 3
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-hacking-lists - eddiewang/TwitterScrape - A Twitter scraping tool using Scrapy (Python)

README

        
# TwitterScrape

A Twitter scraping tool using Scrapy and Selenium. Requires knowledge of Python to edit starting url and tweet-aggregation amount. Easily extendable to similar websites. Does not crawl through links (still in development).

##Packages Used

- Scrapy

- Selenium

- PhantomJS

#In Progress - Websites

Current functions are in development stage and are not ready to use

##Rotten Tomatoes

##IMDB

##Facebook

##Twitter

##LinkedIn

#In Progress - Modules

##Sentiment Analysis

##MatPlotLib

##Exporting to MongoDB

## MOVIE SCRAPER

#IMDB

#RottenTomatoes - Scrape Reviews

#FB - Brand Webpage Scrape

#Twitter - Talking

#LinkedIn - 

#Sentiment Analysis