https://github.com/kaspercools/bright-data-collector
https://github.com/kaspercools/bright-data-collector
Last synced: 12 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/kaspercools/bright-data-collector
- Owner: kaspercools
- License: mit
- Created: 2023-04-07T08:33:51.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2023-04-29T10:43:19.000Z (about 3 years ago)
- Last Synced: 2025-10-29T00:29:21.941Z (8 months ago)
- Language: Python
- Size: 4.88 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# bright-data-collector
This quick and rather dirty script, including others, was written to help with autamatically invoking a Bright Data colletor as part of my Master's thesis. Further details can be found at [github.com/kaspercools/bert-binary-classifier](https://github.com/kaspercools/bert-binary-classifier)
### Developers discretion is advised
Note that this script may not be all that well written or conform to Python conventions. We quickly wrote this code to meet our needs for automatically collecting data. This script was one of a few that contributed in continuous and automated collection and processing all the information hence why we start off by writing an endless while loop.
## License
All source code is made available under a MIT license. You can freely use and modify the code, without warranty, so long as you provide attribution to the authors. See LICENSE for the full license text.