https://github.com/arham09/gs-scraper
https://github.com/arham09/gs-scraper
Last synced: over 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/arham09/gs-scraper
- Owner: arham09
- Created: 2019-01-15T07:56:27.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-02-16T06:02:03.000Z (over 7 years ago)
- Last Synced: 2025-01-18T03:43:10.444Z (over 1 year ago)
- Language: Python
- Size: 88.9 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Google Scholar Scrapy
Scrapping for Google Scholar
## Requirement
### Prerequisites
- Python - Download and Install [Python](https://www.python.org/)
- Pip - Download and Install [Pip](https://pypi.org/project/pip/)
```
$ pip install -r requirements.txt
```
## Run Program
Jalankan command berikut untuk menjalankan scrapy
**Start application for firstime on production server**
```
$ cd folder
$ scrapy crawl
```
## Note
spider = profil(untuk mendapatkan semua data penelitian dari user)
Start Url (Diganti dengan user yang diinginkan)
```
start_urls = ['https://scholar.google.co.id/citations?user=oRWiRGQAAAAJ/']
```
Webdriver (Diganti dengan path yang sesuai)
```
driver = webdriver.Chrome('/home/arham/chromedriver_linux64/chromedriver')
```