https://github.com/reteps/bpm-database-scraper
https://github.com/reteps/bpm-database-scraper
bpm database golang scraper song-bpm
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/reteps/bpm-database-scraper
- Owner: reteps
- License: mit
- Created: 2019-09-30T01:40:16.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2019-10-23T01:09:58.000Z (over 6 years ago)
- Last Synced: 2024-06-19T04:26:27.472Z (about 2 years ago)
- Topics: bpm, database, golang, scraper, song-bpm
- Language: Go
- Size: 15.6 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# bpm-database-scraper
* `main.old` : Scapes the website [bpmdatabase.com](http://bpmdatabase.com) For every songs BPM
* `main.go` : Uses the site beatport, does not work well.
## Language
- Golang for concurrent requests and high speed
## Database
- PostgreSQL
- Offers Golang support
- I have mostly structured data
## Notes
#### Change the thread limit
- `ulimit -n 10000`
#### Environment
- Have PostgreSQL db running in background
- See main.go for commands I ran to initialize table
- .env file containing `USER` and `PASSWORD`
## Success
- Totaled `79409` songs with this program