https://github.com/googlecloudplatform/cloudsql-jump-start-solution-for-genai

A jump start solution using GKE or Cloud Run with Cloud SQL and VertexAI
https://github.com/googlecloudplatform/cloudsql-jump-start-solution-for-genai

cloud-run gke google-cloud

Last synced: 3 months ago
JSON representation

A jump start solution using GKE or Cloud Run with Cloud SQL and VertexAI

• Host: GitHub
• URL: https://github.com/googlecloudplatform/cloudsql-jump-start-solution-for-genai
• Owner: GoogleCloudPlatform
• License: apache-2.0
• Created: 2024-01-26T20:35:18.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-06-26T13:36:08.000Z (6 months ago)
• Last Synced: 2024-06-26T16:45:06.738Z (6 months ago)
• Topics: cloud-run, gke, google-cloud
• Language: HCL
• Homepage:
• Size: 1.54 MB
• Stars: 23
• Watchers: 15
• Forks: 11
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

        
# Deploy a production ready GenAI app in less than 30 minutes

Here is a jump start solution of how to build a basic chatbot API that:

- Leverages GKE or Cloud Run with Cloud SQL, VertexAI, and pgvector

- Demonstrates connectivity to Cloud SQL using Private Service Connect in a VPC

- Codifies all infrastructure including using Terraform

- Uses Python with asyncpg and FastAPI

- (optional) Supports cross-project setups with Cloud SQL and GKE or Cloud Run

  in separate projects

This solution is an operationalized version of a previously published colab,

[Building AI-powered data-driven applications using pgvector, LangChain and

LLMs][colab].

[colab]: https://colab.sandbox.google.com/github/GoogleCloudPlatform/python-docs-samples/blob/main/cloud-sql/postgres/pgvector/notebooks/pgvector_gen_ai_demo.ipynb

## Choose your Architecture

This app can be deployed with two different flavors:

- Cloud Run

- Google Kubernetes Engine (GKE)

### Cloud Run ([README](run/README.md))

![image](run/system-diagram.png)

To deploy the app using Cloud Run head to the [run](run/README.md) folder.

### GKE ([README](gke/README.md))

![image](gke/system-diagram.png)

To deploy the app using GKE head to the [gke](gke/README.md) folder.