https://github.com/moseseth/tiktok-scraper
TikTok Scraper®
https://github.com/moseseth/tiktok-scraper
lumen-framework mysql-database php71 tiktok-scraper
Last synced: 11 months ago
JSON representation
TikTok Scraper®
- Host: GitHub
- URL: https://github.com/moseseth/tiktok-scraper
- Owner: moseseth
- Created: 2019-08-26T21:55:42.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2023-07-17T13:12:00.000Z (over 2 years ago)
- Last Synced: 2025-04-09T20:04:27.761Z (11 months ago)
- Topics: lumen-framework, mysql-database, php71, tiktok-scraper
- Language: PHP
- Size: 193 KB
- Stars: 23
- Watchers: 5
- Forks: 6
- Open Issues: 2
-
Metadata Files:
- Readme: readme.md
- Changelog: CHANGELOG.md
Awesome Lists containing this project
README
### TikTok Scraper™
The following project implements domcrawler and concurrent data retrival from tiktok website. Once promises are
resolved, parses user and video related information and stores it to database for later consumption.
Inorder to mitigate scraping process, all database related operations run in the background as jobs.
##### Installation:
```
git clone https://github.com/moseseth/tiktok-scraper.git
cd tiktok-scraper
cp .env.example .env // update DB_USERNAME , DB_PASSWORD & CREATE 'tiktok' database
composer install
php artisan migrate
php artisan serve
php artisan queue:work --tries=3
```
##### Run Test:
```$xslt
composer run-script test
```
##### Usage Example:
* http://localhost:8000/api/users?id=@wilczewska,@realmadrid
* http://localhost:8000/api/users/@wilczewska/videos?id=6727979845919214853,6722754487129246982
### Ongoing updates:
https://github.com/moseseth/tiktok-scraper/blob/master/CHANGELOG.md
Glossary : `#PHP 7.2, #MySQL, #Queue, #Guzzle 6.0, #Lumen`