https://github.com/fernandod1/producthunt-scraper

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
https://github.com/fernandod1/producthunt-scraper

crawler crawling crawling-sites data-mining datamining producthunt producthunt-api producthunt-users python python-script python3 scrape scraped-data scraper scraper-engine scraping scraping-bot scraping-python scraping-tool scraping-websites

Last synced: about 2 months ago
JSON representation

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

• Host: GitHub
• URL: https://github.com/fernandod1/producthunt-scraper
• Owner: fernandod1
• License: other
• Created: 2019-10-31T20:04:40.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2022-05-25T08:48:38.000Z (over 2 years ago)
• Last Synced: 2024-07-30T20:01:47.607Z (5 months ago)
• Topics: crawler, crawling, crawling-sites, data-mining, datamining, producthunt, producthunt-api, producthunt-users, python, python-script, python3, scrape, scraped-data, scraper, scraper-engine, scraping, scraping-bot, scraping-python, scraping-tool, scraping-websites
• Language: Python
• Homepage: https://www.fernando.info
• Size: 9.77 KB
• Stars: 19
• Watchers: 1
• Forks: 8
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# ProductHunt scraper

This script scraps all public data of famous website producthunt.com and saves it in spreadsheet excel file containing the following columns:

Title,	Short Description,	Category,	Logo URL,	Gallery Image URLs,	Upvote,	description,	Post Date,	Product website URL,	Badge,	Badge Date,	No. of reviews,	Reviews	Hunter URL,	Marker URL,	Product Hunt URL.

Product Hunt offers a daily listing of offers and of best new products. Discover the latest mobile apps, websites, and technology products that everyone's talking about.

REQUIREMENTS:

Python v3, BeautifulSoup and xlwt modules.

DISCLAIMER:

I am not responsible about how you use script. All scrapped data is public on producthunt.com website.

COLLABORATIONS:

Collaborations to improve script are always welcome.