https://github.com/victoralessander/smith

A toolkit to make easy web scraping the world.
https://github.com/victoralessander/smith

beautifulsoup bot extract-information python python3 telegram webcrawler webscraping

Last synced: 17 days ago
JSON representation

A toolkit to make easy web scraping the world.

• Host: GitHub
• URL: https://github.com/victoralessander/smith
• Owner: VictorAlessander
• License: gpl-3.0
• Created: 2017-01-02T00:18:39.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T01:25:18.000Z (about 2 years ago)
• Last Synced: 2024-12-11T17:06:50.151Z (17 days ago)
• Topics: beautifulsoup, bot, extract-information, python, python3, telegram, webcrawler, webscraping
• Language: Python
• Homepage:
• Size: 107 KB
• Stars: 3
• Watchers: 0
• Forks: 1
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Smith

[![Codacy Badge](https://app.codacy.com/project/badge/Grade/a43834b6697141ac80c739b028dedb38)](https://www.codacy.com/gh/VictorAlessander/Smith/dashboard?utm_source=github.com&utm_medium=referral&utm_content=VictorAlessander/Smith&utm_campaign=Badge_Grade)

# Project Description

Webscraper to get some informations of products in e-commerce, avoiding the user to enter in the website many times only to see if any product have special offer.

# Backlog

- API Gateway to get the requests and pass them to Smith (Asynchronous)

- Database connection

- Frontend to make easier handle with the data scraped (metrics, charts, comparisons)

- Improvement in program.py to avoid multiples "if" statements