https://github.com/httparchive/wptarchive
Test archiving logic
https://github.com/httparchive/wptarchive
Last synced: 11 months ago
JSON representation
Test archiving logic
- Host: GitHub
- URL: https://github.com/httparchive/wptarchive
- Owner: HTTPArchive
- License: mit
- Created: 2015-11-10T15:07:12.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2022-03-31T18:15:11.000Z (about 4 years ago)
- Last Synced: 2025-07-25T13:43:30.629Z (11 months ago)
- Language: PHP
- Size: 28.3 KB
- Stars: 3
- Watchers: 8
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# wptarchive
This is the (new) archiving logic for the main HTTP Archive instance that:
* Zips the individual tests and stores them in the Google cloud storage bucket
* Extracts HAR files (with bodies) for all of the tests
* Uploads the extracted HARs to Google storage for data flow processing/Big Query access
* Uploads the SQL dump files to Google cloud storage
* Deletes local test data that has already been processed and archived and have not been accessed recently
It is comprised of several php scripts that get scheduled in cron and run concurrently (serialized operation can not keep up with the testing).
All account information and settings is configured in a settings.inc.php file (based on the included settings.inc.php.sample).