Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/davidcavazos/air-quality-datasets


https://github.com/davidcavazos/air-quality-datasets

Last synced: 22 days ago
JSON representation

Awesome Lists containing this project

README

        

# Setup

```sh
PROJECT="my-google-cloud-project"
BUCKET_EU="my-us-gcs-bucket"
BUCKET_EU="my-eu-gcs-bucket"
SERVICE_ACCOUNT="[email protected]"

MAX_EE_REQUESTS=20
REGION_US="us-central1"
REGION_EU="eu-north1"
```

## California

```sh
python create-dataset.py \
"california" \
"gs://$BUCKET_US/air-quality/data" \
--max-ee-requests=$MAX_EE_REQUESTS \
--max-rows=1000 \
--runner="DataflowRunner" \
--project="$PROJECT" \
--region="$REGION_US" \
--temp_location="gs://$BUCKET_US/temp" \
--service_account_email="[email protected]"
```

## Houston

```sh
python create-dataset.py \
"houston" \
"gs://$BUCKET_US/air-quality/data" \
--max-ee-requests=$MAX_EE_REQUESTS \
--max-rows=1000 \
--runner="DataflowRunner" \
--project="$PROJECT" \
--region="$REGION_US" \
--temp_location="gs://$BUCKET_US/temp" \
--service_account_email="[email protected]"
```

## Amsterdam

```sh
python create-dataset.py \
"amsterdam" \
"gs://$BUCKET_EU/air-quality/data" \
--max-ee-requests=$MAX_EE_REQUESTS \
--max-rows=1000 \
--runner="DataflowRunner" \
--project="$PROJECT" \
--region="$REGION_EU" \
--temp_location="gs://$BUCKET_EU/temp" \
--service_account_email="[email protected]"
```

## Copenhagen

```sh
python create-dataset.py \
"copenhagen" \
"gs://$BUCKET_EU/air-quality/data" \
--max-ee-requests=$MAX_EE_REQUESTS \
--max-rows=1000 \
--runner="DataflowRunner" \
--project="$PROJECT" \
--region="$REGION_EU" \
--temp_location="gs://$BUCKET_EU/temp" \
--service_account_email="[email protected]"
```