https://github.com/herrfeder/telegram-twitter-graph-crawling

This repo shows several attempts to crawl useful data for further processing and analysis in Graph Networks.
https://github.com/herrfeder/telegram-twitter-graph-crawling

Last synced: 3 months ago
JSON representation

This repo shows several attempts to crawl useful data for further processing and analysis in Graph Networks.

• Host: GitHub
• URL: https://github.com/herrfeder/telegram-twitter-graph-crawling
• Owner: herrfeder
• Created: 2022-01-11T19:17:24.000Z (almost 3 years ago)
• Default Branch: master
• Last Pushed: 2022-01-11T19:40:52.000Z (almost 3 years ago)
• Last Synced: 2023-09-17T19:42:24.873Z (over 1 year ago)
• Language: Python
• Size: 9.77 KB
• Stars: 5
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Telegram Twitter Graph Crawling

## How to run

  * in either `telegram_crawl` or `twitter_crawl` move `template.env` to `secrets.env` and fill with necessary information

  * now execute `./run `

## Telegram Crawl

  1. it's intended that you run `01_search_telegram.py` with a own search query for accessible PeerGroups on this location

```python

search = 'Crypto'

result = await client(functions.contacts.SearchRequest(

        q=search,

        limit=100

    ))

```

  2. After crawling some initial Groups run `02_crawl_telegram.py` to gather and crawl all links and forwarded groups that could be found in step 1