{"id":31211464,"url":"https://github.com/dpguthrie/braintrust-exports-snowflake","last_synced_at":"2026-02-21T09:02:46.164Z","repository":{"id":310894909,"uuid":"1041661212","full_name":"dpguthrie/braintrust-exports-snowflake","owner":"dpguthrie","description":"Instructions to export braintrust logs to snowflake","archived":false,"fork":false,"pushed_at":"2025-08-20T20:37:44.000Z","size":22,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-09-21T05:32:55.187Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dpguthrie.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-08-20T20:27:36.000Z","updated_at":"2025-08-20T20:37:47.000Z","dependencies_parsed_at":"2025-08-20T22:28:58.169Z","dependency_job_id":"6b772461-467e-40ce-8c42-4a46f9304868","html_url":"https://github.com/dpguthrie/braintrust-exports-snowflake","commit_stats":null,"previous_names":["dpguthrie/braintrust-exports-snowflake"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dpguthrie/braintrust-exports-snowflake","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dpguthrie%2Fbraintrust-exports-snowflake","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dpguthrie%2Fbraintrust-exports-snowflake/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dpguthrie%2Fbraintrust-exports-snowflake/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dpguthrie%2Fbraintrust-exports-snowflake/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dpguthrie","download_url":"https://codeload.github.com/dpguthrie/braintrust-exports-snowflake/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dpguthrie%2Fbraintrust-exports-snowflake/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29677881,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-21T06:23:40.028Z","status":"ssl_error","status_checked_at":"2026-02-21T06:23:39.222Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-09-21T05:20:16.953Z","updated_at":"2026-02-21T09:02:46.112Z","avatar_url":"https://github.com/dpguthrie.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# Braintrust to Snowflake Export Pipeline\n\nThis repository contains documentation and configuration files for setting up an automated data pipeline that exports data from Braintrust to AWS S3 and then ingests it into Snowflake using Snowpipe.\n\n## Overview\n\nThe pipeline consists of two main components:\n\n1. **Braintrust S3 Export Automation**: Automatically exports Braintrust data (logs, traces, spans) to an AWS S3 bucket\n2. **Snowflake Snowpipe**: Continuously monitors the S3 bucket and automatically ingests new data into Snowflake tables\n\n## Architecture\n\n```\nBraintrust → S3 Bucket → Snowpipe → Snowflake\n```\n\n- **Braintrust**: Source system containing logs, traces, and evaluation data\n- **S3 Bucket**: Intermediate storage for exported data files (JSON or Parquet format)\n- **Snowpipe**: Snowflake's continuous data ingestion service\n- **Snowflake**: Target data warehouse for analytics and reporting\n\n## Documentation\n\n- [`docs/braintrust-setup.md`](./docs/braintrust-setup.md) - Complete guide for setting up Braintrust S3 exports\n- [`docs/snowflake-setup.md`](./docs/snowflake-setup.md) - Snowflake and Snowpipe configuration\n- [`docs/aws-setup.md`](./docs/aws-setup.md) - AWS IAM roles and S3 bucket configuration\n- [`docs/testing.md`](./docs/testing.md) - Testing and validation procedures\n- [`docs/troubleshooting.md`](./docs/troubleshooting.md) - Common issues and solutions\n\n## Prerequisites\n\n- Braintrust account with access to automations\n- AWS account with S3 and IAM permissions\n- Snowflake account with appropriate privileges\n- Basic understanding of SQL and cloud services\n\n## Support\n\nFor issues related to:\n- **Braintrust**: [Braintrust Support](mailto:support@braintrust.dev)\n- **Snowflake**: [Snowflake Documentation](https://docs.snowflake.com/)\n- **AWS**: [AWS Support](https://aws.amazon.com/support/)\n\n## License\n\nThis documentation is provided as-is for educational and implementation purposes.\n\n---\n\n## 📖 Documentation Navigation\n\n**Next:** [AWS Infrastructure Setup →](./docs/aws-setup.md)\n\n### Complete Setup Guide:\n1. **Getting Started** (You are here)\n2. [AWS Infrastructure Setup](./docs/aws-setup.md)\n3. [Braintrust S3 Export Setup](./docs/braintrust-setup.md)\n4. [Snowflake and Snowpipe Setup](./docs/snowflake-setup.md)\n5. [Testing the Complete Pipeline](./docs/testing.md)\n6. [Troubleshooting Guide](./docs/troubleshooting.md) ","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdpguthrie%2Fbraintrust-exports-snowflake","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdpguthrie%2Fbraintrust-exports-snowflake","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdpguthrie%2Fbraintrust-exports-snowflake/lists"}