https://github.com/encoreshao/webdata-scraper

Use Flask API to wrap Facebook data. Grab the wapper of Facebook public pages without an API key. (Currently working 2021)
https://github.com/encoreshao/webdata-scraper

api facebook flask json json-api pipenv python

Last synced: 20 days ago
JSON representation

Use Flask API to wrap Facebook data. Grab the wapper of Facebook public pages without an API key. (Currently working 2021)

• Host: GitHub
• URL: https://github.com/encoreshao/webdata-scraper
• Owner: encoreshao
• Created: 2021-11-23T02:44:36.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2021-11-27T07:25:27.000Z (about 3 years ago)
• Last Synced: 2024-12-09T19:49:17.691Z (about 1 month ago)
• Topics: api, facebook, flask, json, json-api, pipenv, python
• Language: Python
• Homepage:
• Size: 21.5 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Facebook Scraper API

Use Flask API to wrap Facebook data. Grab the wapper of Facebook public pages without an API key. (Currently working 2021)

#### Setup

Before using this scraper API, please export the cookies of your facebook account and save them to `/tmp/cookies.text`

##### Cookies

The path to a file containing cookies in Netscape or JSON format. You can extract cookies from your browser after logging into Facebook with an extension like [EditThisCookie (Chrome)](https://chrome.google.com/webstore/detail/editthiscookie/fngmhnnpilhplaeedifhccceomclgfbg?hl=en) or [Cookie Quick Manager (Firefox)](https://addons.mozilla.org/en-US/firefox/addon/cookie-quick-manager/). Make sure that you include both the c_user cookie and the xs cookie, you will get an InvalidCookies exception if you don't.

##### Environment Management with Pipenv

Install from Pipfile

```shell

pipenv install

```

#### Start and run the script locally

```shell

export FLASK_ENV=development

export FLASK_APP=src/index.py

# now we just need to ask flask to run

flask run

```

#### Facebook API URL

- Get organization profile (http://127.0.0.1:5000/facebook/organization/ekohe.co)

- Get person profile (http://127.0.0.1:5000/facebook/person/encoreshao)