{"id":30501201,"url":"https://github.com/hoosnick/olx-parser","last_synced_at":"2025-08-25T09:11:29.579Z","repository":{"id":310044885,"uuid":"1038491670","full_name":"hoosnick/olx-parser","owner":"hoosnick","description":"OLX Real Estate Parser","archived":false,"fork":false,"pushed_at":"2025-08-15T10:09:38.000Z","size":544,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-08-15T12:08:59.514Z","etag":null,"topics":["crawler","olx"],"latest_commit_sha":null,"homepage":"https://t.me/arzonroqkv","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hoosnick.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-08-15T09:49:57.000Z","updated_at":"2025-08-15T10:09:41.000Z","dependencies_parsed_at":"2025-08-15T12:09:05.377Z","dependency_job_id":"e6d77c24-f5f3-4778-8b30-6b6c2de02fce","html_url":"https://github.com/hoosnick/olx-parser","commit_stats":null,"previous_names":["hoosnick/olx-parser"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/hoosnick/olx-parser","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hoosnick%2Folx-parser","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hoosnick%2Folx-parser/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hoosnick%2Folx-parser/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hoosnick%2Folx-parser/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hoosnick","download_url":"https://codeload.github.com/hoosnick/olx-parser/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hoosnick%2Folx-parser/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":272035063,"owners_count":24862130,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-25T02:00:12.092Z","response_time":1107,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","olx"],"created_at":"2025-08-25T09:11:28.539Z","updated_at":"2025-08-25T09:11:29.569Z","avatar_url":"https://github.com/hoosnick.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# OLX Parser\n\n\u003cimg src=\"meta/image.png\" width=\"600\" alt=\"image\"\u003e\n\n## Architecture\n\n```bash\nsrc/\n├── core/                   # Core business logic and configuration\n│   ├── config.py           # Application configuration and constants\n│   ├── models.py           # Pydantic data models with full typing\n│   └── app_factory.py      # Dependency injection factory\n├── services/               # Business logic services\n│   ├── olx_service.py      # Main OLX scraping logic\n│   ├── telegram_service.py # Telegram bot messaging\n│   └── image_service.py    # Image processing and collages\n├── adapters/               # External service adapters\n│   └── database.py         # Database interface and SQLite implementation\n└── utils/                  # Utility functions\n    └── logging_utils.py    # Logging configuration\n```\n\n## Installation\n\n1. **Clone and setup the project:**\n\n   ```bash\n   python -m venv .venv\n   ```\n\n   ```bash\n   .venv\\Scripts\\activate  # Windows\n   ```\n\n   ```bash\n   source .venv/bin/activate  # Linux/Mac\n   ```\n\n2. **Install dependencies:**\n\n   ```bash\n   pip install -r requirements.txt\n   ```\n\n3. **Configure your Telegram bot:**\n   - Rename `sample.env` to `.env` with your bot token and channel ID\n   - And set environment variables\n   - Windows (PowerShell):\n     - `$env:TELEGRAM_BOT_TOKEN=YOUR_TOKEN`\n     - `$env:TELEGRAM_CHANNEL_ID=YOUR_CHANNEL_ID`\n   - Windows (Command Prompt):\n     - `set TELEGRAM_BOT_TOKEN=YOUR_TOKEN`\n     - `set TELEGRAM_CHANNEL_ID=YOUR_CHANNEL_ID`\n   - Linux/Mac:\n     - `export TELEGRAM_BOT_TOKEN=YOUR_TOKEN`\n     - `export TELEGRAM_CHANNEL_ID=YOUR_CHANNEL_ID`\n\n## Usage\n\n## Configuration\n\nKey configuration options in `src/core/config.py`:\n\n- `SCHEDULER_INTERVAL_MINUTES`: Scraping frequency\n- `SEARCH_PARAMS`: OLX search criteria\n\n```py\nSEARCH_PARAMS = {\n      \"offset\":      0,\n      \"limit\":       50,    # Results per page\n      \"category_id\": 1147,  # Real estate category ID\n      \"region_id\":   5,     # Tashkent region ID\n      \"district_id\": 26,    # Tashkent district ID\n      \"city_id\":     5,     # Tashkent city ID\n      \"distance\":    10,    # Radius in km\n      \"currency\": \"UYE\",    # Currency UZS/UYE\n      \"sort_by\": \"created_at:desc\",\n      \"filter_float_price:from\": 100,  # Min. price\n      \"filter_float_price:to\":   300,  # Max. price\n      \"filter_float_number_of_rooms:from\": 1,  # Min. rooms\n      \"filter_float_number_of_rooms:to\":   6,  # Max. rooms\n      \"filter_refiners\": \"\",\n  }\n```\n\n### Run the application\n\n```bash\npython app.py\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhoosnick%2Folx-parser","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhoosnick%2Folx-parser","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhoosnick%2Folx-parser/lists"}