https://github.com/nicorobo/mountainscrape

🌄 A python script for scraping Mountain Project (for educational purposes)
https://github.com/nicorobo/mountainscrape

climbing scraper

Last synced: 24 days ago
JSON representation

🌄 A python script for scraping Mountain Project (for educational purposes)

• Host: GitHub
• URL: https://github.com/nicorobo/mountainscrape
• Owner: nicorobo
• License: mit
• Created: 2017-03-09T00:33:43.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2017-03-09T16:08:54.000Z (almost 8 years ago)
• Last Synced: 2023-10-15T10:12:36.508Z (about 1 year ago)
• Topics: climbing, scraper
• Language: Python
• Size: 9.77 KB
• Stars: 2
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# MountainScrape

🌄 A python script for scraping Mountain Project (for educational purposes)

## Using MountainScrape



### Dependencies

While in the root directory, install dependencies with `pip3 install -r requirements.txt`.

### Running Scraper

Enter `python3 scrape.py` followed by the root area's URL identifier, starting with /v/ (ex: */v/echo-canyon/105868640*) and the root areas name as a string (ex: *"Echo Canyon"*). This is temporary, soon you won't have to explicitly enter the name.

Scraping just the areas *(but not sending it anywhere)* would look like this: `python3 scrape.py /v/echo-canyon/105868640 "Echo Canyon"`

If you'd like to scrape the routes, include the --route flag. `python3 scrape.py --route /v/red-rock/105731932 "Red Rock"`

If you want the scraper to make formatted HTTP **PUT** requests, set up your API endpoint in `scraper.py`, and include the --db flag. `python3 scrape.py --route --db /v/lovers-leap/105733959 "Lover's Leap"`