Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/abawchen/sugar-apple
https://github.com/abawchen/sugar-apple
Last synced: 11 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/abawchen/sugar-apple
- Owner: abawchen
- Created: 2017-11-14T15:52:18.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2022-12-07T23:43:08.000Z (almost 2 years ago)
- Last Synced: 2024-10-12T04:09:46.809Z (28 days ago)
- Language: Python
- Size: 415 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 12
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Sugar-Apple
這是一個從[政府資料開放平臺](https://data.gov.tw/)抓取[不動產買賣實價登錄批次資料](https://data.gov.tw/dataset/6213)的專案，可將下載資料轉檔進資料庫。將持續開發以下功能：
- Backend
- [ ] Data query api by graphQL
- [ ] Integration with more meta / real estate data
- [x] Crawler task (refer to [crawler](https://github.com/abawchen/sugar-apple/wiki/Cralwer))
- [ ] Data integration
- [ ] Find out the bargaining space
- Frontend(Web)
- [ ] Friendly ui query
- [ ] Data visualization
---
### apple (backend)
On the terminal, create a new virtual python environment by [virtualenvwrapper](https://virtualenvwrapper.readthedocs.io/en/latest/), or refer [cheatsheet](https://github.com/abawchen/sugar-apple/wiki#cheatsheet) for more detail:
```shell
$ mkvirtualenv --python=$(which python3.5) venv
```
With the virtual environment activated, install related packages:
```shell
$ cd apple
$ pip install -r requirements.txt
```
Create `apple/app/instance/config.py`, and you can use either mysql or mongo whatever you like:
For mysql, by setting `SQLALCHEMY_DATABASE_URI`:
```
SQLALCHEMY_DATABASE_URI = 'mysql+mysqldb://root:[email protected]:3306/sugar-apple'
```
For mongo, by setting `MONGO_DATABASE_URI`:
```
MONGO_DATABASE_URI = 'mongodb://localhost:27017'
```
Install the interactive sugar-apple backend cli:
```shell
$ cd apple && pip install --editable .
```
Use cli to persist data to database:
```shell
$ sugar-apple
Version: 0.0.1
Syntax: apple [params] [options]
apple> apple download
apple> apple unzip
apple> apple transcode
apple> apple normalize
apple> apple persist -d mysql # for mysql
apple> apple persist -d mongo # for mongo
apple> exit
```
Start flask server:
```shell
$ export FLASK_APP=app/app.py && flask run -p 5001
```
Then you can visit `http://127.0.0.1:5001/graphql-mysql` with mysql, or `http://127.0.0.1:5001/graphql-mongo` with mongo.
---
### sugar (frontend)
Install dependencies:
```bash
$ cd sugar
$ yarn
```
Configure Webpack:
```bash
# for development
$ cp webpack.config.example.js webpack.config.dev.js
# for production
$ cp webpack.config.example.js webpack.config.prod.js
```
Output bundle:
```bash
# for development
$ yarn run build:dev
# for production
$ yarn run build
```
Start dev server:
```bash
$ yarn start
```
Now the client app is running at `http://{webpackDevServerHost}:{webpackdevServerPort}`
---
*Happy Coding!*