Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/pior/mixpanel-s3
Extract Mixpanel raw events and upload to S3
https://github.com/pior/mixpanel-s3
Last synced: 2 days ago
JSON representation
Extract Mixpanel raw events and upload to S3
- Host: GitHub
- URL: https://github.com/pior/mixpanel-s3
- Owner: pior
- License: gpl-2.0
- Created: 2015-03-22T16:50:49.000Z (almost 10 years ago)
- Default Branch: master
- Last Pushed: 2015-03-29T23:27:04.000Z (almost 10 years ago)
- Last Synced: 2024-12-04T18:41:32.715Z (about 2 months ago)
- Language: Go
- Size: 2.31 MB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# mixpanel-s3
> Extract Mixpanel raw events and upload to S3
## Features
- Static binary (Go)
- Download raw events from the Mixpanel data api
- Upload on S3
- On the fly Gzip compression
- Event selection
- Split by events
- Retry download (5 times, wait 60s before retrying)
## Install
go install github.com/pior/mixpanel-s3/mixpanel-s3
## Usage
usage: mixpanel-s3 --key=XXXXXX --secret=XXXXXX --bucket=BUCKET []
Extract Mixpanel raw events and upload to S3
Flags:
--help Show help.
-f, --from="2015-03-25"
Extract from this date
-t, --to="2015-03-25"
Extract to this date
-e, --event=EVENT Extract only this event
-k, --key=XXXXXX Mixpanel api key
-s, --secret=XXXXXX Mixpanel secret key
-b, --bucket=BUCKET S3 bucket name
-p, --prefix=PREFIX S3 key prefix
--split Split by event name
--version Show application version.
> Note: use the TMPDIR environment variable to control where mixpanel-s3 will
> stage the raw events
## Configuration
Mixpanel and AWS credentials can be provided as command line arguments or environment variables
### Environment Variables
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- MIXPANEL_API_KEY
- MIXPANEL_SECRET_KEY
- S3_BUCKET
- S3_PREFIX
- TMPDIR