https://github.com/schbenedikt/web-crawler

A simple web crawler using Python that stores the metadata of each web page in a database.
https://github.com/schbenedikt/web-crawler

crawler database mariadb mysql python python-crawler web

Last synced: 26 days ago
JSON representation

A simple web crawler using Python that stores the metadata of each web page in a database.

• Host: GitHub
• URL: https://github.com/schbenedikt/web-crawler
• Owner: SchBenedikt
• Created: 2024-06-09T05:49:27.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-07-11T11:00:53.000Z (4 months ago)
• Last Synced: 2024-09-28T11:03:50.014Z (about 1 month ago)
• Topics: crawler, database, mariadb, mysql, python, python-crawler, web
• Language: Python
• Homepage:
• Size: 14.6 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# web-crawler

A simple web crawler using Python that stores the metadata of each web page in a database.