https://github.com/btlmd/asahi_nikkei_news_crawler

日本经济新闻、朝日新闻爬虫
https://github.com/btlmd/asahi_nikkei_news_crawler

crawler

Last synced: 1 day ago
JSON representation

日本经济新闻、朝日新闻爬虫

• Host: GitHub
• URL: https://github.com/btlmd/asahi_nikkei_news_crawler
• Owner: Btlmd
• Created: 2022-02-22T09:03:01.000Z (almost 3 years ago)
• Default Branch: master
• Last Pushed: 2022-02-22T09:07:43.000Z (almost 3 years ago)
• Last Synced: 2024-11-21T05:12:41.748Z (2 months ago)
• Topics: crawler
• Language: Python
• Homepage:
• Size: 4.88 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# 日本经济新闻、朝日新闻爬虫

- RJnews.py

  - 从清华大学数据库爬去日本经济新闻的相关内容

  - 使用selenium模拟点击和下载

  - 使用清华大学账号登录

- AsahiNews.py

  - 从朝日新闻官网按关键词爬去新闻

  - 需要购买朝日新闻会员，从浏览器登录后复制cookie到info.json