{"id":16729896,"url":"https://github.com/dfdx/flatparser","last_synced_at":"2025-04-10T11:12:29.708Z","repository":{"id":138551762,"uuid":"5239846","full_name":"dfdx/flatparser","owner":"dfdx","description":"Flat feature extractor for some major real estate web sites in Moscow, St Petersburg and Minsk","archived":false,"fork":false,"pushed_at":"2012-10-20T00:27:06.000Z","size":48444,"stargazers_count":28,"open_issues_count":0,"forks_count":5,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-03-24T10:04:53.703Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Clojure","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dfdx.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2012-07-31T00:51:24.000Z","updated_at":"2024-03-05T15:26:23.000Z","dependencies_parsed_at":"2023-03-13T10:53:43.608Z","dependency_job_id":null,"html_url":"https://github.com/dfdx/flatparser","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dfdx%2Fflatparser","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dfdx%2Fflatparser/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dfdx%2Fflatparser/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dfdx%2Fflatparser/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dfdx","download_url":"https://codeload.github.com/dfdx/flatparser/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248208563,"owners_count":21065202,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-12T23:30:30.246Z","updated_at":"2025-04-10T11:12:29.682Z","avatar_url":"https://github.com/dfdx.png","language":"Clojure","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Flat Parser\n\nUtility to create dataset from some real estate web sites (see list below) \n\n## Usage\n\nFlat Parser has very simple **GUI** with self-descripting parameters. To run it, just double-click on flatparser.jar or type in command line:\n\n    java -jar flatparser.jar\n\nThere's also **command line interface**. Usage for it is as follows:\n\n    java -jar flatparser.jar http://\u003csearch-url\u003e \u003c#-of-pages-to-fetch\u003e \u003caddress-of-key-point\u003e \u003cpath-to-output-file\u003e\n\nExample: \n\n    java -jar flatparser.jar 'http://rent-and-sale.ru/moscow/rent-flat/results/roomsfrom=1\u0026roomsto=2\u0026apartmenttype=flat\u0026searcharea=city\u0026pricefrom=30000\u0026priceto=70000\u0026currency=rub\u0026pricespecification=monthly\u0026pagesize=10' 5 'Balchug, 7' /home/user/dataset.csv\n\nFlat Parser has also GUI for Hemnet site to search apartments in Sweden. Since Hemnet uses POST request to initialize search for apartments, it was impractical to use URLs.\nHowever, fake URL mode is also available, so it is possible to search on Hemnet from the command line. Just provide search parameters as a regular query string and Flat Parser will generate POST query from them.\n\n## Available web sites\n\n**Flat Parser** automatically determines what parser to use given URL of search result page. Following web sites and options are available: \n\n**IRR.BY / IRR.TUT.BY**\n\nBoth sale and rent of appartements in Minsk\n\n**HATA.BY**\n\nOffice rent\n\n**RENT-AND-SALE.RU**\n\nOnly rent for Moscow.\n\n**BN.RU**\n\nLong-term rent for Saint Petersburg\n\n**HEMNET.SE**\n\nApartments in Stockholm\n\n## License\n\nCopyright (c) Andrei Zhabinski. Distributed under the [MIT Licese](http://opensource.org/licenses/mit-license.php).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdfdx%2Fflatparser","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdfdx%2Fflatparser","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdfdx%2Fflatparser/lists"}