https://github.com/riolaf05/langchain-fastapi-rag-platform

A platform to test multiple LLM models inside a RAG workflow to choose the best model for embedding and retrieval and the best prompt according to the use case
https://github.com/riolaf05/langchain-fastapi-rag-platform

artificial-intelligence aws cloud iac iac-terraform infrastructure langchain langchain-python llm llm-inference llms python rag serverless terraform

Last synced: about 2 months ago
JSON representation

A platform to test multiple LLM models inside a RAG workflow to choose the best model for embedding and retrieval and the best prompt according to the use case

• Host: GitHub
• URL: https://github.com/riolaf05/langchain-fastapi-rag-platform
• Owner: riolaf05
• Created: 2023-12-20T17:38:21.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-06-21T16:32:02.000Z (7 months ago)
• Last Synced: 2024-06-23T08:05:14.445Z (7 months ago)
• Topics: artificial-intelligence, aws, cloud, iac, iac-terraform, infrastructure, langchain, langchain-python, llm, llm-inference, llms, python, rag, serverless, terraform
• Language: Jupyter Notebook
• Homepage:
• Size: 46.2 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Setup on GCP Cloud RUN 

1. Create exports

```console

export PROJECT_ID=progetti-poc

export APP=langchain-fastapi-rag-platform 

export PORT=3000

export REGION=europe-west8

export BRANCH=main

export TAG=${REGION}-docker.pkg.dev/${PROJECT_ID}/${APP}/${APP}:${BRANCH}

```

2. Create Artifact Repo

```console

gcloud artifacts repositories create langchain-fastapi-rag-platform --repository-format Docker --location europe-west8 --project progetti-poc

```

3. Create Build

```console

gcloud builds submit --tag  europe-west8-docker.pkg.dev/progetti-poc/langchain-fastapi-rag-platform/langchain-fastapi-rag-platform:main --project progetti-poc

```

4. Deploy 

```console

gcloud run deploy $APP --image $TAG --platform managed --region $REGION --port $PORT --allow-unauthenticated --env-vars-file=.env

```

5. Clean 

```console

gcloud run services delete $APP --region $REGION 

gcloud run services list

```