https://github.com/sungyeonu/animal-crossing-scraper
Web scraper for Animal Crossing - New Horizons data using bs4
https://github.com/sungyeonu/animal-crossing-scraper
animal-crossing-new-horizons bs4
Last synced: 3 months ago
JSON representation
Web scraper for Animal Crossing - New Horizons data using bs4
- Host: GitHub
- URL: https://github.com/sungyeonu/animal-crossing-scraper
- Owner: sungyeonu
- Created: 2020-02-22T22:14:02.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T03:43:35.000Z (almost 3 years ago)
- Last Synced: 2024-08-07T21:45:16.459Z (about 1 year ago)
- Topics: animal-crossing-new-horizons, bs4
- Language: Python
- Homepage:
- Size: 743 KB
- Stars: 37
- Watchers: 4
- Forks: 11
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# animal-crossing-scraper
Python webscraper to extract various data of the game Animal Crossing - New Horizons.
Data source: https://animalcrossing.fandom.com/wiki/
Feel free to use the JSON files! Some of the pages on the wiki are incomplete, so if some data is missing please check back later.
## Output
All JSON files are stored in /data
*-- Completed --*
/museums
- bugs.json
- fish.json
- fossils.json
- artwork.json
/characters
- villagers.json
/flowers
- availability.json
- genetics_others.json
- genetics_rose.json
- hybridization_advanced.json
- hybridization_simple.json
/music
*-- Incomplete --*
/crafting
- tools.json
- equipments.json
- housewares.json
- miscellaneous.json
- wallMounteds.json
- wallpaperRugsFloorings.json
- others.json
/clothing
- tops.json
- bottoms.json
- dresses.json
- hats.json
- accessories.json
- socks.json
- shoes.json
- bags.json
- umbrellas.json
## JSON fields
Price: -1 indicates the data is not available yet.
## Set Up
1. In the animal-crossing-scraper root directory, clone the project using
```
git clone https://github.com/sungyeonu/animal-crossing-scraper.git
```
2. Set up a virtual environment
```
python -m venv venv
```
3. Activate the virtual environment
- Windows: `venv\Scripts\activate`
- Linux/Mac: `source venv/bin/activate`
4. Install required packages
```
pip install -r requirements.txt
```
## Usage
To run:
```
python scrapy.py
```
To test:
```
python test_scrapy.py
```