https://github.com/tireon003/wb_parser
A fullstack application to parse cards from Wildberries to Google Tables by article number.
https://github.com/tireon003/wb_parser
aiogram flask fullstack microservices rabbitmq selenium
Last synced: about 2 months ago
JSON representation
A fullstack application to parse cards from Wildberries to Google Tables by article number.
- Host: GitHub
- URL: https://github.com/tireon003/wb_parser
- Owner: Tireon003
- Created: 2025-01-24T17:20:11.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-01-27T16:03:51.000Z (over 1 year ago)
- Last Synced: 2025-03-30T10:29:48.029Z (about 1 year ago)
- Topics: aiogram, flask, fullstack, microservices, rabbitmq, selenium
- Language: Python
- Homepage:
- Size: 24.4 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# wb_parser
A fullstack application to parse cards from Wildberries to Google Tables by article number.
The application consists of:
1. Client (telegram bot)
2. Gateway API
3. The parsing service
4. Logging service
### Project Stack:
- Flask (WSGI based framework for building API)
- Aiogram (User's Tg bot)
- Selenium (with Selenium standalone server, for WB scrapping)
- RabbitMQ (using aiormq)
- Pygsheets (for interaction with Google Sheets)
### How to run
1. Clone repository
```shell
git clone https://github.com/Tireon003/wb_parser.git
```
2. Browse to project directory
3. Create .env file in the root. It should contain the following:
```text
API_GATEWAY_PORT=5000
RMQ_USER="guest"
RMQ_PASS="guest"
SELENIUM_HOST="selenium_server" // do not touch
SELENIUM_PORT=4444
```
4. Configure other parts of application (client, parser service, logger service). Instuctions placed inside each of them root dir.
5. Run application:
```shell
docker-compose up -d --build
```