https://github.com/amlana21/llm-stream-publish

How to stream LLM responses using AWS API Gateway Websockets and Lambda
https://github.com/amlana21/llm-stream-publish

aws devops llm-inference terraform

Last synced: about 1 year ago
JSON representation

How to stream LLM responses using AWS API Gateway Websockets and Lambda

• Host: GitHub
• URL: https://github.com/amlana21/llm-stream-publish
• Owner: amlana21
• Created: 2024-04-24T02:40:04.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-05-10T05:19:50.000Z (about 2 years ago)
• Last Synced: 2025-03-29T01:51:39.075Z (over 1 year ago)
• Topics: aws, devops, llm-inference, terraform
• Language: HCL
• Homepage: https://amlanscloud.com/llmstreampost/
• Size: 5.81 MB
• Stars: 5
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

README

          
# How to stream LLM responses using AWS API Gateway Websocket and Lambda  

For more details: https://amlanscloud.com/llmstreampost/