{"id":25929803,"url":"https://github.com/dan3002/tiktok-crawler","last_synced_at":"2026-05-07T23:06:22.423Z","repository":{"id":280304391,"uuid":"941414339","full_name":"DAN3002/Tiktok-Crawler","owner":"DAN3002","description":"This is a simple Tiktok crawler that can be used to download videos from Tiktok. It uses the Tiktok API to get the video URL and then downloads the video using the requests library. It can download video from multiple hashtags or download by sound.","archived":false,"fork":false,"pushed_at":"2025-03-02T15:47:00.000Z","size":6,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-02T16:33:26.134Z","etag":null,"topics":["crawler-python","data-engineer","playwright","python","tiktok"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DAN3002.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-02T08:25:39.000Z","updated_at":"2025-03-02T15:49:06.000Z","dependencies_parsed_at":"2025-03-02T16:33:28.716Z","dependency_job_id":"70f6eda9-19bb-4cd2-97af-db5552d2f4d4","html_url":"https://github.com/DAN3002/Tiktok-Crawler","commit_stats":null,"previous_names":["dan3002/tiktok-crawler"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAN3002%2FTiktok-Crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAN3002%2FTiktok-Crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAN3002%2FTiktok-Crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DAN3002%2FTiktok-Crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DAN3002","download_url":"https://codeload.github.com/DAN3002/Tiktok-Crawler/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241753171,"owners_count":20014251,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler-python","data-engineer","playwright","python","tiktok"],"created_at":"2025-03-03T23:00:05.044Z","updated_at":"2026-05-07T23:06:22.391Z","avatar_url":"https://github.com/DAN3002.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Tiktok Crawler\nThis is a simple Tiktok crawler that can be used to download videos from Tiktok. It uses the Tiktok API to get the video URL and then downloads the video using the requests library. It can download video from multiple hashtags or download by sound.\n\n## Prerequisites\n- Python 3.11\n\n## Installation\nTo install the required libraries, run the following command:\n```bash\n# Create a virtual environment and install the required libraries\npython -m venv venv\nsource venv/bin/activate\npip install -r requirements.txt\n# Install playwright\nplaywright install\n```\n\nThen add the following environment variables to your `.env` file:\n```\nMS_TOKEN=\u003cyour \"ms_token\" value from your tiktok cookie\u003e\n```\n\n## Usage\nBefore running the script, makesure to update `configs.py` with the tiktok hashtags you want to download videos from and time range.\n\nTo run the script, simply run the following command:\n```bash\npython main.py\n```\n## Some issues\n1. If you get the following error:\n```\nplaywright._impl._errors.Error: Page.evaluate: ReferenceError: opts is not defined\n```\n=\u003e Makesure to use Python 3.11 and re-run the installation steps.\n\n2. If you get the following error:\n```\nImportError: No module named '_ctypes' when using Value from module multiprocessing\n```\n\n=\u003e Install the following package:\n```bash\nsudo apt-get install libffi-dev\npyenv uninstall 3.11.9\npyenv install 3.11\n```\n\n## Author\nThis project is created by [@DAN3002](https://github.com/DAN3002). If you have any questions or suggestions, please feel free to contact me.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdan3002%2Ftiktok-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdan3002%2Ftiktok-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdan3002%2Ftiktok-crawler/lists"}