https://github.com/sabinbajracharya/Insta-crawler
Pulls data from instagram and saves it to Firebase for storage and Algolia for search
https://github.com/sabinbajracharya/Insta-crawler
accounts algolia algolia-search crawler firebase firebase-database instagram instagram-feed instagram-post javascript nodejs public scraper
Last synced: 6 months ago
JSON representation
Pulls data from instagram and saves it to Firebase for storage and Algolia for search
- Host: GitHub
- URL: https://github.com/sabinbajracharya/Insta-crawler
- Owner: sabinbajracharya
- License: mit
- Created: 2017-09-20T20:20:43.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2017-10-12T10:14:43.000Z (almost 8 years ago)
- Last Synced: 2024-11-07T12:52:07.213Z (11 months ago)
- Topics: accounts, algolia, algolia-search, crawler, firebase, firebase-database, instagram, instagram-feed, instagram-post, javascript, nodejs, public, scraper
- Language: JavaScript
- Size: 14.6 KB
- Stars: 7
- Watchers: 3
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Insta Crawler
Fetches public instagram posts of a given username and stores it in Firebase and Algolia
### Prerequisite
- Create firebase account (Free) - For storage
- Create Algolia account (Free) - For powering search
- Download firebase admin sdk private key (json file), rename it to ```serviceAccountKey.json``` and put it inside ```database``` folder along with ```firebase.js``` and ```insert.js```
- Create ```.env``` file in the root of the cloned project
| Content of .env file | Description |
| ------ | ------ |
| ALGOLIA_APP_ID="XXXXXXXXXX" | Your algolia app id |
| ALGOLIA_API_KEY="xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx" | Your algolia api key |
| FIREBASE_DATABASE_URL="https://xxxxxx.firebaseio.com" | Your firebase database url |
#### Note:
Each values inside .env file should be added in a new line.
### Running
- Clone the repository.
- CD to the cloned directory
- Run ```$ npm install```
- Open index.js file and replace the value in ```USERNAME``` variable with the one you want to crawl.
- ```$ node index.js```
- That's it! - You can view the crawled data in firebase database and algolia