https://github.com/ajthinking/laravel-ai
Scrape subsets of github repositories
https://github.com/ajthinking/laravel-ai
Last synced: 11 months ago
JSON representation
Scrape subsets of github repositories
- Host: GitHub
- URL: https://github.com/ajthinking/laravel-ai
- Owner: ajthinking
- Created: 2018-12-20T05:12:40.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-01-25T08:02:35.000Z (over 7 years ago)
- Last Synced: 2025-04-05T14:12:41.496Z (about 1 year ago)
- Language: Python
- Homepage:
- Size: 306 KB
- Stars: 2
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# github-selective-scraper
Scrape subsets of github repositories. Warning - this is a work in progress.
## Installation
First, make sure you have anaconda installed. Then
```
git clone git@github.com:ajthinking/github-selective-scraper.git
cd github-selective-scraper
conda env create
conda activate github-selective-scraper
source activate
python src/examples/migration-analysis/01_scrape.py
```
## Todo
[] Parametirize the query string
[] Fix try-except blocks to throw real errors
## Disclaimer
Please note to only use this repository in agreement with github API terms of service (scraping only ok for educational purposes).
## License
MIT