{"id":46504030,"url":"https://github.com/andprov/krisha.kz","last_synced_at":"2026-03-06T14:28:14.485Z","repository":{"id":178404491,"uuid":"661690702","full_name":"andprov/krisha.kz","owner":"andprov","description":"Rental ad parser","archived":false,"fork":false,"pushed_at":"2025-05-21T00:54:22.000Z","size":127,"stargazers_count":20,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-21T01:51:35.014Z","etag":null,"topics":["beautifulsoup4","parser","parsing","python","request","sqlite3"],"latest_commit_sha":null,"homepage":"https://krisha.kz","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/andprov.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-07-03T12:36:11.000Z","updated_at":"2025-05-21T00:52:54.000Z","dependencies_parsed_at":null,"dependency_job_id":"55865938-a35e-45f1-822a-09762db1eeb5","html_url":"https://github.com/andprov/krisha.kz","commit_stats":null,"previous_names":["andprov/krisha.kz"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/andprov/krisha.kz","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andprov%2Fkrisha.kz","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andprov%2Fkrisha.kz/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andprov%2Fkrisha.kz/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andprov%2Fkrisha.kz/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/andprov","download_url":"https://codeload.github.com/andprov/krisha.kz/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andprov%2Fkrisha.kz/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30180670,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-06T12:39:21.703Z","status":"ssl_error","status_checked_at":"2026-03-06T12:36:09.819Z","response_time":250,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","parser","parsing","python","request","sqlite3"],"created_at":"2026-03-06T14:28:14.062Z","updated_at":"2026-03-06T14:28:14.477Z","avatar_url":"https://github.com/andprov.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![RU](https://img.shields.io/badge/README-RU-red.svg)](https://github.com/andprov/krisha.kz/blob/main/README.ru.md)\n\n# Real Estate Rental Site Parser krisha.kz\n\n[![License: MIT](https://img.shields.io/github/license/andprov/krisha.kz?color=blueviolet)](https://github.com/andprov/krisha.kz/blob/main/LICENSE.md)\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n[![Python versions](https://img.shields.io/badge/python-_3.10_|_3.11_|_3.12-blue)](https://www.python.org/)\n[![Main workflow](https://github.com/andprov/krisha.kz/actions/workflows/main.yml/badge.svg)](https://github.com/andprov/krisha.kz/actions/workflows/main.yml)\n\n# Description\n\nSearches and views listings based on the specified [parameters:](#params):\n\n- Requests data from preview pages of listings. Finds links to pages with detailed descriptions.\n- Visits the detailed description pages of each listing and collects data.\n- Stores results in SQLite database.\n\n\nSearch parameters selection replicates the website's functionality. To specify search parameters, use the `SEARCH_PARAMETERS.json` file in the project's root directory.\n\n### Third-party libraries used in the project\n\n- [BeautifulSoup4](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)\n- [requests](https://requests.readthedocs.io/en/latest/)\n\n# Installation and Running\n\nClone the repository:\n\n```shell\ngit clone \u003chttps or SSH URL\u003e\n```\n\nNavigate to the project folder:\n\n```shell\ncd krisha.kz\n```\n\nCreate a virtual environment:\n\n```shell\npython3 -m venv .venv\n```\n\nActivate the virtual environment:\n\n```shell\nsource .venv/bin/activate\n```\n\nInstall dependencies:\n\n- for use\n\n    ```shell\n    pip install .\n    ```\n\n- for dev in editable mode\n\n    ```shell\n    pip install -e .[test,lint] \n    ```\n\nSpecify search parameters in the [SEARCH_PARAMETERS.json](SEARCH_PARAMETERS.json) file. See [examples](#examples)\n\nRun the script:\n\n```shell\npython -m krisha\n```\n\n# Setting Up Scheduled Runs\n\nEdit the [cron.sh](cron.sh) file, adding your project path:\n\n```shell\n#!/bin/bash\ncd /\u003cPATH\u003e/krisha.kz\nsource .venv/bin/activate\npython -m krisha\n```\n\nIf necessary, add the rights to execute `cron.sh`:\n\n```shell\nchmod +x /\u003cPATH\u003e/krisha.kz/cron.sh\n```\n\nOpen cron settings:\n\n```shell\ncrontab -e\n```\n\nAdd a cron job entry:\n\n```shell\n# Daily run at 12 PM.\n0 12 * * * /\u003cPATH\u003e/krisha.kz/cron.sh\n```\n\n# \u003ca id=\"params\"\u003eSearch Parameters\u003c/a\u003e\n\n- `city` - Search city from 0 to 20;\n- `has_photo` - Listing has photos;\n- `furniture` - Apartment has furniture;\n- `rooms` - Number of rooms from 1 to 5;\n- `price_from` - Minimum price;\n- `price_to` - Maximum price;\n- `owner` - Listing posted by the owner;\n\n### City Values\n\n- 0 - All of Kazakhstan.\n- 1 - Almaty.\n- 2 - Astana.\n- 3 - Shymkent.\n- 4 - Abai Region.\n- 5 - Akmola Region.\n- 6 - Aktobe Region.\n- 7 - Almaty Region.\n- 8 - Atyrau Region.\n- 9 - East Kazakhstan Region.\n- 10 - Zhambyl Region.\n- 11 - Zhetysu Region.\n- 12 - West Kazakhstan Region.\n- 13 - Karaganda Region.\n- 14 - Kostanay Region.\n- 15 - Kyzylorda Region.\n- 16 - Mangystau Region.\n- 17 - Pavlodar Region.\n- 18 - North Kazakhstan Region.\n- 19 - Turkestan Region.\n- 20 - Ulytau Region.\n\n### \u003ca id=\"examples\"\u003eExamples of Search Parameter Specification:\u003c/a\u003e\n\n1. Find one-room apartments in Almaty.\nListings with photos.\nApartments with furniture.\nPrice from 100000 to 300000.\nListings from owners.\n\n```json\n{\n  \"city\": 1,\n  \"has_photo\": true,\n  \"furniture\": true,\n  \"rooms\": [1],\n  \"price_from\": 100000,\n  \"price_to\": 300000,\n  \"owner\": true\n}\n```\n\n2. Find two-room and three-room apartments in Astana.\nListings with photos.\nApartments without furniture.\nPrice up to 400000.\nListings from owners.\n\n```json\n{\n  \"city\": 2,\n  \"has_photo\": true,\n  \"rooms\": [2, 3],\n  \"price_to\": 400000,\n  \"owner\": true\n}\n```\n\n3. Find apartments with any number of rooms in Kazakhstan.\nListings without photos.\nApartments without furniture.\nPrice from 200000.\nListings from owners, agencies, and private realtors.\n\n```json\n{\n  \"price_from\": 200000\n}\n```\n\n4. Returns the same result as example No. 3.\n\n```json\n{\n  \"city\": 0,\n  \"has_photo\": false,\n  \"furniture\": false,\n  \"rooms\": [0],\n  \"price_from\": 200000,\n  \"price_to\": null,\n  \"owner\": false\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fandprov%2Fkrisha.kz","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fandprov%2Fkrisha.kz","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fandprov%2Fkrisha.kz/lists"}