https://github.com/dr1n/abpparser
Web scrapper for https://www.ilcats.ru/
https://github.com/dr1n/abpparser
anglesharp clean-architecture code-first ddd efcore mssql net6 webscraper
Last synced: 10 months ago
JSON representation
Web scrapper for https://www.ilcats.ru/
- Host: GitHub
- URL: https://github.com/dr1n/abpparser
- Owner: Dr1N
- Created: 2022-12-25T21:32:22.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-12-27T23:14:23.000Z (about 3 years ago)
- Last Synced: 2025-02-16T02:46:45.264Z (11 months ago)
- Topics: anglesharp, clean-architecture, code-first, ddd, efcore, mssql, net6, webscraper
- Language: TSQL
- Homepage:
- Size: 773 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Abp Car Parser
Web scrapper for https://www.ilcats.ru/
### Repository
1. **[src]** - solution
2. **[sql]** - sql scripts (create db and test data)
3. **[assets]** - images
### Project
1. **Domain** - domain of parser, entities and base business logic
2. **Application** - application layer: use case (parse)
3. **Infrastructure** - infrastructure layer: sql server, parsers etc
4. **CarParser** - console application for parsing
### Architecture
#### Project
#### Database
### How Use
Run console application with argument
```
dotnet CarParser.dll Url="url_to_manufacturer_models_page"
```
Supported only Toyota manufacturer
### For Developers
#### Work with migrations
From Infrastructure directory
```
dotnet ef migrations add NAME --startup-project "..\CarParser\CarParser.csproj"
dotnet ef database update --startup-project "..\CarParser\CarParser.csproj"
```
#### Configuration (appsettings.json)
Near executable file (example below)
```json
{
"Logging": {
"LogLevel": {
"Default": "Debug",
"System": "Information",
"Microsoft": "Information",
"Microsoft.Hosting.Lifetime": "Warning"
}
},
"ConnectionStrings": {
"CarDbConnection": "YOUR_CONNECTION_STRING_TO_MSSQL"
}
}
```