https://github.com/dfdx/flatparser
Flat feature extractor for some major real estate web sites in Moscow, St Petersburg and Minsk
https://github.com/dfdx/flatparser
Last synced: over 1 year ago
JSON representation
Flat feature extractor for some major real estate web sites in Moscow, St Petersburg and Minsk
- Host: GitHub
- URL: https://github.com/dfdx/flatparser
- Owner: dfdx
- Created: 2012-07-31T00:51:24.000Z (almost 14 years ago)
- Default Branch: master
- Last Pushed: 2012-10-20T00:27:06.000Z (almost 14 years ago)
- Last Synced: 2025-03-24T10:04:53.703Z (over 1 year ago)
- Language: Clojure
- Homepage:
- Size: 46.2 MB
- Stars: 28
- Watchers: 3
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Flat Parser
Utility to create dataset from some real estate web sites (see list below)
## Usage
Flat Parser has very simple **GUI** with self-descripting parameters. To run it, just double-click on flatparser.jar or type in command line:
java -jar flatparser.jar
There's also **command line interface**. Usage for it is as follows:
java -jar flatparser.jar http:// <#-of-pages-to-fetch>
Example:
java -jar flatparser.jar 'http://rent-and-sale.ru/moscow/rent-flat/results/roomsfrom=1&roomsto=2&apartmenttype=flat&searcharea=city&pricefrom=30000&priceto=70000¤cy=rub&pricespecification=monthly&pagesize=10' 5 'Balchug, 7' /home/user/dataset.csv
Flat Parser has also GUI for Hemnet site to search apartments in Sweden. Since Hemnet uses POST request to initialize search for apartments, it was impractical to use URLs.
However, fake URL mode is also available, so it is possible to search on Hemnet from the command line. Just provide search parameters as a regular query string and Flat Parser will generate POST query from them.
## Available web sites
**Flat Parser** automatically determines what parser to use given URL of search result page. Following web sites and options are available:
**IRR.BY / IRR.TUT.BY**
Both sale and rent of appartements in Minsk
**HATA.BY**
Office rent
**RENT-AND-SALE.RU**
Only rent for Moscow.
**BN.RU**
Long-term rent for Saint Petersburg
**HEMNET.SE**
Apartments in Stockholm
## License
Copyright (c) Andrei Zhabinski. Distributed under the [MIT Licese](http://opensource.org/licenses/mit-license.php).