Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/waley-z/dpm-wearable-backend

Server backend for DPM Wearable project.
https://github.com/waley-z/dpm-wearable-backend

flask gcp mysql

Last synced: 10 days ago
JSON representation

Server backend for DPM Wearable project.

Awesome Lists containing this project

README 

        
# Connecting to Cloud SQL - MySQL



## Before you begin



1. If you haven't already, set up a Python Development Environment by following the [python setup guide](https://cloud.google.com/python/setup) and 

[create a project](https://cloud.google.com/resource-manager/docs/creating-managing-projects#creating_a_project).



1. Create a 2nd Gen Cloud SQL Instance by following these 

[instructions](https://cloud.google.com/sql/docs/mysql/create-instance). Note the connection string,

database user, and database password that you create.



1. Create a database for your application by following these 

[instructions](https://cloud.google.com/sql/docs/mysql/create-manage-databases). Note the database

name. 



1. Create a service account with the 'Cloud SQL Client' permissions by following these 

[instructions](https://cloud.google.com/sql/docs/mysql/connect-external-app#4_if_required_by_your_authentication_method_create_a_service_account).

Download a JSON key to use to authenticate your connection. 



## Running locally



To run this application locally, download and install the `cloud_sql_proxy` by

following the instructions

[here](https://cloud.google.com/sql/docs/mysql/sql-proxy#install).



Instructions are provided below for using the proxy with a TCP connection or a Unix Domain Socket.

On Linux or Mac OS you can use either option, but on Windows the proxy currently requires a TCP

connection.



### Launch proxy with TCP



To run the sample locally with a TCP connection, set environment variables and launch the proxy as

shown below.



#### Linux / Mac OS

Use these terminal commands to initialize environment variables:

```bash

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service/account/key.json

export INSTANCE_HOST='127.0.0.1'

export DB_PORT='3306'

export DB_USER=''

export DB_PASS=''

export DB_NAME=''

```

Note: Saving credentials in environment variables is convenient, but not secure - consider a more

secure solution such as [Secret Manager](https://cloud.google.com/secret-manager/docs/overview) to

help keep secrets safe.



Then use this command to launch the proxy in the background:

```bash

./cloud_sql_proxy -instances=::=tcp:3306 -credential_file=$GOOGLE_APPLICATION_CREDENTIALS &

```



#### Windows/PowerShell

Use these PowerShell commands to initialize environment variables:

```powershell

$env:GOOGLE_APPLICATION_CREDENTIALS=""

$env:INSTANCE_HOST="127.0.0.1"

$env:DB_PORT="3306"

$env:DB_USER=""

$env:DB_PASS=""

$env:DB_NAME=""

```

Note: Saving credentials in environment variables is convenient, but not secure - consider a more

secure solution such as [Secret Manager](https://cloud.google.com/secret-manager/docs/overview) to

help keep secrets safe.



Then use this command to launch the proxy in a separate PowerShell session:

```powershell

Start-Process -filepath "C:\" -ArgumentList "-instances=::=tcp:3306 -credential_file="

```



### Launch proxy with Unix Domain Socket

NOTE: this option is currently only supported on Linux and Mac OS. Windows users should use the

[Launch proxy with TCP](#launch-proxy-with-tcp) option.



To use a Unix socket, you'll need to create a directory and give write access to the user running

the proxy. For example:



```bash

sudo mkdir /cloudsql

sudo chown -R $USER /cloudsql

```



Use these terminal commands to initialize other environment variables as well:

```bash

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service/account/key.json

export INSTANCE_UNIX_SOCKET='./cloudsql/::'

export DB_USER=''

export DB_PASS=''

export DB_NAME=''

```

Note: Saving credentials in environment variables is convenient, but not secure - consider a more

secure solution such as [Secret Manager](https://cloud.google.com/secret-manager/docs/overview) to

help keep secrets safe.



Then use this command to launch the proxy in the background:

```bash

./cloud_sql_proxy -dir=./cloudsql --instances=:: --credential_file=$GOOGLE_APPLICATION_CREDENTIALS &

```



### Testing the application



Next, setup install the requirements into a virtual environment:

```bash

virtualenv --python python3 env

source env/bin/activate

pip install -r requirements.txt

```



Finally, start the application:

```bash

python app.py

```



Navigate towards `http://127.0.0.1:8080` to verify your application is running correctly.



## Deploy to App Engine Standard



To run on GAE-Standard, create an App Engine project by following the setup for these 

[instructions](https://cloud.google.com/appengine/docs/standard/python3/quickstart#before-you-begin).



First, update `app.standard.yaml` with the correct values to pass the environment 

variables into the runtime. Your `app.standard.yaml` file should look like this:



```yaml

runtime: python37

entrypoint: gunicorn -b :$PORT app:app



env_variables:

  INSTANCE_UNIX_SOCKET: /cloudsql/::

  DB_USER: 

  DB_PASS: 

  DB_NAME: 

```



Note: Saving credentials in environment variables is convenient, but not secure - consider a more

secure solution such as [Secret Manager](https://cloud.google.com/secret-manager/docs/overview) to

help keep secrets safe.



Next, the following command will deploy the application to your Google Cloud project:



```bash

gcloud app deploy app.standard.yaml

```



## Deploy to App Engine Flexible



To run on GAE-Flexible, create an App Engine project by following the setup for these 

[instructions](https://cloud.google.com/appengine/docs/flexible/python/quickstart#before-you-begin).



First, update `app.flexible.yaml` with the correct values to pass the environment 

variables into the runtime. Your `app.flexible.yaml` file should look like this:



```yaml

runtime: custom

env: flex

entrypoint: gunicorn -b :$PORT app:app



env_variables:

  INSTANCE_UNIX_SOCKET: /cloudsql/::

  DB_USER: 

  DB_PASS: 

  DB_NAME: 



beta_settings:

  cloud_sql_instances: ::

```



Note: Saving credentials in environment variables is convenient, but not secure - consider a more

secure solution such as [Secret Manager](https://cloud.google.com/secret-manager/docs/overview) to

help keep secrets safe.



Next, the following command will deploy the application to your Google Cloud project:



```bash

gcloud app deploy app.flexible.yaml

```



## Deploy to Cloud Run



See the [Cloud Run documentation](https://cloud.google.com/sql/docs/mysql/connect-run)

for more details on connecting a Cloud Run service to Cloud SQL.



1. Build the container image:



```sh

gcloud builds submit --tag gcr.io//run-mysql

```



2. Deploy the service to Cloud Run:



```sh

gcloud run deploy run-mysql --image gcr.io//run-mysql \

  --add-cloudsql-instances '::' \

  --set-env-vars INSTANCE_UNIX_SOCKET='/cloudsql/::' \

  --set-env-vars DB_USER='' \

  --set-env-vars DB_PASS='' \

  --set-env-vars DB_NAME=''

```



Take note of the URL output at the end of the deployment process.



Replace environment variables with the correct values for your Cloud SQL

instance configuration.



It is recommended to use the [Secret Manager integration](https://cloud.google.com/run/docs/configuring/secrets) for Cloud Run instead

of using environment variables for the SQL configuration. The service injects the SQL credentials from

Secret Manager at runtime via an environment variable.



Create secrets via the command line:

```sh

echo -n $INSTANCE_UNIX_SOCKET | \

    gcloud secrets create [INSTANCE_UNIX_SOCKET_SECRET] --data-file=-

```



Deploy the service to Cloud Run specifying the env var name and secret name:

```sh

gcloud beta run deploy SERVICE --image gcr.io//run-sql \

    --add-cloudsql-instances :: \

    --update-secrets INSTANCE_UNIX_SOCKET=[INSTANCE_UNIX_SOCKET_SECRET]:latest,\

      DB_USER=[DB_USER_SECRET]:latest, \

      DB_PASS=[DB_PASS_SECRET]:latest, \

      DB_NAME=[DB_NAME_SECRET]:latest

```



3. Navigate your browser to the URL noted in step 2.



For more details about using Cloud Run see http://cloud.run.

Review other [Python on Cloud Run samples](../../../run/).



## Deploy to Cloud Functions



To deploy the service to [Cloud Functions](https://cloud.google.com/functions/docs) run the following command:



```sh

gcloud functions deploy votes --runtime python39 --trigger-http --allow-unauthenticated \

--set-env-vars INSTANCE_UNIX_SOCKET=/cloudsql/:: \

--set-env-vars DB_USER=$DB_USER \

--set-env-vars DB_PASS=$DB_PASS \

 --set-env-vars DB_NAME=$DB_NAME

```



Take note of the URL output at the end of the deployment process or run the following to view your function:



```sh

gcloud app browse

```