https://github.com/alterakey/haversack
SAM template to deploy the bedrock-access-gateway quickly and neatly -- in the form of a simple Lambda function with response streaming support enabled, i.e. without ALB, dedicated VPC, subnets, etc.
https://github.com/alterakey/haversack
bedrock llm openai-api serverless
Last synced: 3 months ago
JSON representation
SAM template to deploy the bedrock-access-gateway quickly and neatly -- in the form of a simple Lambda function with response streaming support enabled, i.e. without ALB, dedicated VPC, subnets, etc.
- Host: GitHub
- URL: https://github.com/alterakey/haversack
- Owner: alterakey
- License: mit
- Created: 2025-03-01T16:47:35.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-01T17:32:36.000Z (about 1 year ago)
- Last Synced: 2025-04-07T10:58:54.531Z (about 1 year ago)
- Topics: bedrock, llm, openai-api, serverless
- Language: Dockerfile
- Homepage:
- Size: 1.95 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Haversack: Bedrock on SAM
This is the SAM template to deploy the [bedrock-access-gateway](https://github.com/aws-samples/bedrock-access-gateway/) quickly and neatly -- in the form of a simple Lambda function with response streaming support enabled, i.e. without ALB, dedicated VPC, subnets, etc.
## Quickstart
You need SAM CLI installed.
```
export REGION=$(aws configure get region)
aws ecr --region=${REGION} get-login-password | docker login --username=AWS --password-stdin 366590864501.dkr.ecr.${REGION}.amazonaws.com
sam build --region=${REGION}
sam deploy -g --region=${REGION}
```
That's it! You should now have an OpenAI-compatible API endpoint to your Bedrock infrastructure.