{"id":18418828,"url":"https://github.com/yash-kavaiya/telegram-url-scraper","last_synced_at":"2025-04-14T19:03:40.798Z","repository":{"id":204154329,"uuid":"711077974","full_name":"Yash-Kavaiya/telegram-url-scraper","owner":"Yash-Kavaiya","description":"You can use this tool to export your Telegram user, group, or chat history in JSON format, extract text messages, and it can help you extract all available URLs in Telegram and generate a CSV file for further analysis.","archived":false,"fork":false,"pushed_at":"2023-11-30T13:02:03.000Z","size":572,"stargazers_count":10,"open_issues_count":0,"forks_count":5,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-28T07:22:46.851Z","etag":null,"topics":["json","nlp","python","scrapy","telegram"],"latest_commit_sha":null,"homepage":"https://telegram-url-extracter-wuv6jff7zq-de.a.run.app/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Yash-Kavaiya.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-10-28T06:32:15.000Z","updated_at":"2025-02-23T05:31:04.000Z","dependencies_parsed_at":null,"dependency_job_id":"1b01fb6f-eeec-4980-8a19-185708ff5355","html_url":"https://github.com/Yash-Kavaiya/telegram-url-scraper","commit_stats":null,"previous_names":["yash-kavaiya/telegram-url-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yash-Kavaiya%2Ftelegram-url-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yash-Kavaiya%2Ftelegram-url-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yash-Kavaiya%2Ftelegram-url-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Yash-Kavaiya%2Ftelegram-url-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Yash-Kavaiya","download_url":"https://codeload.github.com/Yash-Kavaiya/telegram-url-scraper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248943443,"owners_count":21186958,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["json","nlp","python","scrapy","telegram"],"created_at":"2024-11-06T04:14:45.596Z","updated_at":"2025-04-14T19:03:40.792Z","avatar_url":"https://github.com/Yash-Kavaiya.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 📱 Telegram URL Scraper 🔍\n\n[![Python](https://img.shields.io/badge/Python-3.7+-blue?style=for-the-badge\u0026logo=python\u0026logoColor=white)](https://www.python.org/)\n[![Flask](https://img.shields.io/badge/Flask-3.0.0-lightgrey?style=for-the-badge\u0026logo=flask\u0026logoColor=white)](https://flask.palletsprojects.com/)\n[![Pandas](https://img.shields.io/badge/Pandas-Latest-150458?style=for-the-badge\u0026logo=pandas\u0026logoColor=white)](https://pandas.pydata.org/)\n\n\u003e **Try it online:** [Telegram URL Extractor](https://telegram-url-extracter-wuv6jff7zq-de.a.run.app/)\n\n## 📋 Overview\n\nThis repository provides a set of tools to extract URLs from your Telegram chat history. You can use this tool to:\n\n- 📤 Export your Telegram user, group, or chat history in JSON format\n- 📝 Extract text messages from your chat history\n- 🔗 Extract all available URLs in your Telegram chats\n- 📊 Generate a CSV file for further analysis\n\n![Telegram URL Scraper Flow](https://via.placeholder.com/800x300?text=Telegram+URL+Scraper+Workflow)\n\n## 📑 Table of Contents\n\n- [Prerequisites](#prerequisites)\n- [Getting Started](#getting-started)\n  - [Exporting Telegram Data](#exporting-telegram-data)\n- [Usage](#usage)\n  - [Extracting URLs and Creating a CSV](#extracting-urls-and-creating-a-csv)\n- [Contributing](#contributing)\n- [License](#license)\n\n## 🔧 Prerequisites\n\nBefore using this tool, ensure you have the following installed on your system:\n\n| Requirement | Version | Purpose |\n|-------------|---------|---------|\n| [Telegram Desktop](https://desktop.telegram.org/) | Latest | For exporting chat history |\n| [Python](https://www.python.org/) | 3.7+ | Runtime environment |\n| pandas | Latest | Data handling and CSV creation |\n| Flask | 3.0.0 | Web interface (optional) |\n\n## 🚀 Getting Started\n\n### Exporting Telegram Data\n\n```mermaid\ngraph TD\n    A[Install Telegram Desktop] --\u003e B[Open Telegram Desktop]\n    B --\u003e C[Go to target chat]\n    C --\u003e D[Click profile picture]\n    D --\u003e E[Click three dots ⋮]\n    E --\u003e F[Select Export chat history]\n    F --\u003e G[Choose JSON format]\n    G --\u003e H[Save .json file]\n```\n\nTo export your Telegram chat history, follow these steps:\n\n1. **Install Telegram Desktop** on your computer if you haven't already.\n\n2. **Open Telegram Desktop** and log in with your account.\n\n3. **Go to the chat or group** you want to export and click on the profile picture.\n\n4. **In the chat/group profile**, click on the three vertical dots (⋮) in the top-right corner and select \"Export chat history.\"\n\n5. **Choose the \"JSON\" format** for exporting the chat history. Save the resulting `.json` file to a location on your computer.\n\n### 📊 Analyzing Telegram Data\n\nClone this repository to your local machine and navigate to the repository directory.\n\n```bash\ngit clone https://github.com/Yash-Kavaiya/telegram-url-scraper\ncd telegram-url-scraper\n```\n\n## 💻 Usage\n\n### Extracting URLs\n\nTo extract URLs from the exported Telegram data and create a CSV file, run the following command:\n\n```bash\npython app.py -i result.json\n```\n\nReplace `result.json` with the path to your exported Telegram chat history JSON file. This command will:\n\n1. 📂 Load your Telegram chat history\n2. 🔍 Extract all URLs from messages\n3. 🧹 Clean and format the URLs\n4. 📊 Generate a CSV file with the results\n\n### 🌐 Web Interface\n\nThis tool also provides a web interface for easier use:\n\n1. **Start the web server**:\n   ```bash\n   python app.py\n   ```\n\n2. **Open your browser** and go to `http://localhost:5000`\n\n3. **Upload your JSON file** and follow the on-screen instructions\n\n## 🔄 Data Processing Flow\n\n```mermaid\nflowchart LR\n    A[Telegram JSON] --\u003e B[Extract Messages]\n    B --\u003e C[Filter URLs]\n    C --\u003e D[Clean Data]\n    D --\u003e E[Generate CSV]\n    E --\u003e F[Download Results]\n```\n\n## 🧩 Key Components\n\n| Component | Description |\n|-----------|-------------|\n| **JSON Parser** | Processes the exported Telegram JSON file |\n| **URL Extractor** | Uses regex patterns to identify and extract URLs |\n| **Data Cleaner** | Removes unwanted characters and formats URLs |\n| **CSV Generator** | Creates structured output files for analysis |\n| **Web Interface** | Provides a user-friendly way to use the tool |\n\n## 🤝 Contributing\n\nIf you have improvements or additional features to add to this project, feel free to contribute:\n\n1. **Fork the repository**\n2. **Create a feature branch**:\n   ```bash\n   git checkout -b feature/amazing-feature\n   ```\n3. **Commit your changes**:\n   ```bash\n   git commit -m \"Add some amazing feature\"\n   ```\n4. **Push to the branch**:\n   ```bash\n   git push origin feature/amazing-feature\n   ```\n5. **Open a Pull Request**\n\n## 📄 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n\n---\n\n\u003cdiv align=\"center\"\u003e\n  \u003cp\u003e🔍 \u003cb\u003eTelegram URL Scraper\u003c/b\u003e - Extract, analyze, and utilize links from your Telegram chats with ease! 📊\u003c/p\u003e\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyash-kavaiya%2Ftelegram-url-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyash-kavaiya%2Ftelegram-url-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyash-kavaiya%2Ftelegram-url-scraper/lists"}