https://github.com/s045pd/lianjia

链家爬取器
https://github.com/s045pd/lianjia

Last synced: over 1 year ago
JSON representation

链家爬取器

• Host: GitHub
• URL: https://github.com/s045pd/lianjia
• Owner: s045pd
• License: mit
• Archived: true
• Created: 2019-01-23T06:50:39.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-06-21T22:43:25.000Z (about 4 years ago)
• Last Synced: 2025-02-18T11:38:03.834Z (over 1 year ago)
• Language: Python
• Size: 35.2 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
Lianjia Downloader 👋



  

    

  

  



> 通过命令行脚本快速下载地区信息

## 安装

首先你得确认你已经安装了`python3`,然后我们运行如下命令来安装依赖。

```sh

python3 -m pip install -r requirements.txt

```

## 用法

我们通过如下命令查看部分可用参数。

配置```config.py```

```sh

mongo_uri = '...'

```

```sh

python3 main.py --help

  -a, --run_all BOOLEAN  整站爬取

  -m, --more_details     获取详情

  --help                 Show this message and exit.

```

开启```celery```，将结果存至```mongodb```

```sh

celery -B -A task worker -l info

```

开始爬行,包含详情

```sh

python3 main.py -m

```

## 📝 License

This project is [MIT](https://github.com/kefranabg/readme-md-generator/blob/master/LICENSE) licensed.

***