https://github.com/wangy8961/python3-concurrency-aqi

并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn
https://github.com/wangy8961/python3-concurrency-aqi

aqi beautifulsoup4 concurrency concurrent-futures mongodb python3 requests spider

Last synced: 5 months ago
JSON representation

并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn

• Host: GitHub
• URL: https://github.com/wangy8961/python3-concurrency-aqi
• Owner: wangy8961
• Created: 2018-08-31T03:08:40.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2018-09-01T08:05:52.000Z (about 7 years ago)
• Last Synced: 2025-04-04T20:36:09.959Z (6 months ago)
• Topics: aqi, beautifulsoup4, concurrency, concurrent-futures, mongodb, python3, requests, spider
• Language: Python
• Size: 4.88 KB
• Stars: 10
• Watchers: 1
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# [python3-concurrency-aqi](http://www.madmalls.com/blog/category/python3-spider/)

[![Python](https://img.shields.io/badge/python-v3.4%2B-blue.svg)](https://www.python.org/)

[![aiohttp](https://img.shields.io/badge/aiohttp-v3.3.2-brightgreen.svg)](https://aiohttp.readthedocs.io/en/stable/)

[![BeautifulSoup4](https://img.shields.io/badge/BeautifulSoup4-v4.6.3-orange.svg)](https://pypi.org/project/beautifulsoup4/)

[![requests](https://img.shields.io/badge/requests-v2.19.1-yellow.svg)](http://docs.python-requests.org/en/master/)

[![pymongo](https://img.shields.io/badge/pymongo-v3.7.1-red.svg)](https://pypi.org/project/pymongo/)

[![progressbar2](https://img.shields.io/badge/progressbar2-v3.38.0-lightgrey.svg)](https://pypi.org/project/progressbar2/)

并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn