https://github.com/nickysemenza/message-analyzer

💬 📊 Facebook Messenger history scraper + analyzer
https://github.com/nickysemenza/message-analyzer

chats facebook scraper

Last synced: 20 days ago
JSON representation

💬 📊 Facebook Messenger history scraper + analyzer

• Host: GitHub
• URL: https://github.com/nickysemenza/message-analyzer
• Owner: nickysemenza
• License: mit
• Created: 2016-10-24T04:14:23.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-05-06T07:11:48.000Z (about 7 years ago)
• Last Synced: 2024-02-19T06:37:11.329Z (4 months ago)
• Topics: chats, facebook, scraper
• Language: JavaScript
• Homepage:
• Size: 227 KB
• Stars: 5
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-stars - message-analyzer
• my-awesome-starred - nickysemenza/message-analyzer - 💬 📊 Facebook Messenger history scraper + analyzer (JavaScript)
• my-awesome-stars - nickysemenza/message-analyzer - 💬 📊 Facebook Messenger history scraper + analyzer (JavaScript)

README

        
#Facebook Messenger Analyzer

> Download, Parse, and Analyze

This project consists of a few parts / 'modules'

* Scraper (node.js) that downloads facebook messages into MySQL

* Analyzer (node) that does data processing, storing intermediary values in redis

* Web (React.js) that displays data nicely

The Scraper code can work on its own if desired.

##Howto run the scraper

* Node & Yarn

* MySQL, with utf8mb4 support

* Redis

1. clone, cd into project repo, `yarn install`

2. `cp .env.example .env`, add your own credentials for Facebook and MySQL

4. `node auth.js` to auth with facebook and save the state in `appstate.json` (only need to do this once until the cookies expire)

6. Scroll down to the end of scraper.js and run your code from within login method!

#TODO

* [ ] make script automatically download all your threads in a loop

* [x] add support for other metadata (changing emoji/color/title) -requires tweaking facebook-chat-api

* [ ] stop downloading a thread when there are back to back sql duplicate errors, this can be a hacky way of getting a delta update of a thread since the last time we downloaded it

* [x] chat titles for 1:1 convos are blank, so maybe have a script hint them based on fbid->name lookup and update that title value for 1:1 threads