https://github.com/pypi/linehaul-cloud-function

Implementation of linehaul to feed the PyPI public BigQuery dataset via Google Cloud Functions
https://github.com/pypi/linehaul-cloud-function

Last synced: 9 months ago
JSON representation

Implementation of linehaul to feed the PyPI public BigQuery dataset via Google Cloud Functions

• Host: GitHub
• URL: https://github.com/pypi/linehaul-cloud-function
• Owner: pypi
• License: apache-2.0
• Created: 2020-11-10T18:43:14.000Z (about 5 years ago)
• Default Branch: main
• Last Pushed: 2024-04-26T22:12:30.000Z (over 1 year ago)
• Last Synced: 2024-04-26T23:59:59.261Z (over 1 year ago)
• Language: Python
• Size: 247 KB
• Stars: 37
• Watchers: 7
• Forks: 15
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# About

Implementation of linehaul to feed the PyPI public BigQuery dataset via Google Cloud Functions.

The function is triggerd by the CDN logs created in a Cloud Storage bucket. It parses the logs and streams them to the BigQuery public dataset.

# Deploy

These functions auto-deploy on merge to the `main` branch via a Cloud Build trigger on this repository.