https://github.com/sarkartanmay393/imdb-scraper-golang
Contains a web scraper that crawls inside `www.imdb.com/name` and stores all celebrity data in given birthday inside a file.
https://github.com/sarkartanmay393/imdb-scraper-golang
go imdb-webscrapping web-scraper
Last synced: 8 months ago
JSON representation
Contains a web scraper that crawls inside `www.imdb.com/name` and stores all celebrity data in given birthday inside a file.
- Host: GitHub
- URL: https://github.com/sarkartanmay393/imdb-scraper-golang
- Owner: sarkartanmay393
- Created: 2022-10-19T16:02:28.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2022-10-20T21:14:14.000Z (almost 3 years ago)
- Last Synced: 2025-01-04T08:00:51.682Z (9 months ago)
- Topics: go, imdb-webscrapping, web-scraper
- Language: Go
- Homepage:
- Size: 11.6 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
### Simple IMDB Web Scraper
> Built using `go1.19.2`
#### What is does ?
This program scrapes `www.imdb.com/name` for celebreties of a given birthday where you provide a Date and Month and stores all data in a file `output.json` and this program stores cache in `.imdb_cache` and uses from here.
#### How it does ?
This Simple IMDB Web Scaper uses [`colly`](https://github.com/gocolly/colly) ans `os` package to perform the scraping and writing the json into a file.