{"id":13788442,"url":"https://github.com/aws-samples/aws-genai-llm-chatbot","last_synced_at":"2025-05-14T11:10:48.589Z","repository":{"id":179429623,"uuid":"654683979","full_name":"aws-samples/aws-genai-llm-chatbot","owner":"aws-samples","description":"A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS","archived":false,"fork":false,"pushed_at":"2025-05-02T08:29:10.000Z","size":86588,"stargazers_count":1232,"open_issues_count":41,"forks_count":373,"subscribers_count":27,"default_branch":"main","last_synced_at":"2025-05-02T09:39:35.944Z","etag":null,"topics":["amazon-bedrock","aurora","aws","bedrock","cdk","chatbot","claude","genai","huggingface","idefics","kendra","langchain","llm","opensearch","opensearch-serverless","pgvector","sagemaker","semantic-search","vectordb"],"latest_commit_sha":null,"homepage":"https://aws-samples.github.io/aws-genai-llm-chatbot/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit-0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/aws-samples.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-06-16T17:27:27.000Z","updated_at":"2025-05-02T08:29:16.000Z","dependencies_parsed_at":"2025-04-11T15:53:24.013Z","dependency_job_id":null,"html_url":"https://github.com/aws-samples/aws-genai-llm-chatbot","commit_stats":{"total_commits":578,"total_committers":50,"mean_commits":11.56,"dds":0.7664359861591695,"last_synced_commit":"6a18d877ca64371381c0b2e4fc45e26adccdc4ab"},"previous_names":["aws-samples/aws-genai-llm-chatbot"],"tags_count":32,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aws-samples%2Faws-genai-llm-chatbot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aws-samples%2Faws-genai-llm-chatbot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aws-samples%2Faws-genai-llm-chatbot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aws-samples%2Faws-genai-llm-chatbot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/aws-samples","download_url":"https://codeload.github.com/aws-samples/aws-genai-llm-chatbot/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254129489,"owners_count":22019628,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amazon-bedrock","aurora","aws","bedrock","cdk","chatbot","claude","genai","huggingface","idefics","kendra","langchain","llm","opensearch","opensearch-serverless","pgvector","sagemaker","semantic-search","vectordb"],"created_at":"2024-08-03T21:00:46.543Z","updated_at":"2025-05-14T11:10:48.548Z","avatar_url":"https://github.com/aws-samples.png","language":"TypeScript","funding_links":[],"categories":["A01_文本生成_文本对话","Project Submissions","Chatbots","chatbot"],"sub_categories":["大语言对话模型及数据"],"readme":"# Building RAG use cases with GenAI Chatbot on AWS\n\n[![Release Notes](https://img.shields.io/github/v/release/aws-samples/aws-genai-llm-chatbot)](https://github.com/aws-samples/aws-genai-llm-chatbot/releases)\n[![GitHub star chart](https://img.shields.io/github/stars/aws-samples/aws-genai-llm-chatbot?style=social)](https://star-history.com/#aws-samples/aws-genai-llm-chatbot)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\n[![Deploy with GitHub Codespaces](https://github.com/codespaces/badge.svg)](https://aws-samples.github.io/aws-genai-llm-chatbot/guide/deploy.html#deploy-with-github-codespaces)\n\n[![Full Documentation](https://img.shields.io/badge/Full%20Documentation-blue?style=for-the-badge\u0026logo=Vite\u0026logoColor=white)](https://aws-samples.github.io/aws-genai-llm-chatbot/)\n\n![sample](docs/about/assets/chabot-sample.gif \"GenAI Chatbot on AWS\")\n\n\n## 🚀 NEW! Support for new Amazon Nova Models 🚀\n### Deploy this chatbot to use the recently announced [Amazon Nova models](https://aws.amazon.com/blogs/aws/introducing-amazon-nova-frontier-intelligence-and-industry-leading-price-performance/)!\n### These powerful models can __understand__ and __generate__ images and videos.\n\nDeploy this chatbot to experiment with:\n- `Amazon Nova Micro`\n- `Amazon Nova Lite`\n- `Amazon Nova Pro`\n- `Amazon Nova Canvas`\n- `Amazon Nova Reels`\n\n\n\nMake sure to request access to the new models [here](https://aws-samples.github.io/aws-genai-llm-chatbot/documentation/model-requirements.html#amazon-bedrock-requirements)\n\nRead more about the new models [here](https://www.aboutamazon.com/news/aws/amazon-nova-artificial-intelligence-bedrock-aws)\n\n---\n\n\nThis solution provides ready-to-use code so you can start **experimenting with a variety of Large Language Models and Multimodal Language Models, settings and prompts** in your own AWS account.\n\nSupported model providers:\n\n- [Amazon Bedrock](https://aws.amazon.com/bedrock/) which supports a wide range of models from AWS, Anthropic, Cohere and Mistral including the latest models from Amazon Nova. See [Recent announcements](https://aws.amazon.com/blogs/aws/introducing-amazon-nova-frontier-intelligence-and-industry-leading-price-performance/) for more details.\n- [Amazon SageMaker](https://aws.amazon.com/sagemaker/) self-hosted models from Foundation, Jumpstart and HuggingFace.\n- Third-party providers via API such as Anthropic, Cohere, AI21 Labs, OpenAI, etc. [See available langchain integrations](https://python.langchain.com/docs/integrations/llms/) for a comprehensive list.\n\n# Additional Resources\n\n| Resource |Description|\n|:-------------|:-------------|\n| [Secure Messenger GenAI Chatbot](https://github.com/aws-samples/secure-messenger-genai-chatbot) | A messenger built on Wickr that can interface with this chatbot to provide Q\u0026A service in tightly regulated environments (i.e. HIPAA). |\n| [Project Lakechain](https://github.com/awslabs/project-lakechain) | A powerful cloud-native, AI-powered, document (docs, images, audios, videos) processing framework built on top of the AWS CDK. |\n| [AWS Generative AI CDK Constructs](https://github.com/awslabs/generative-ai-cdk-constructs/) | Open-source library extension of the [AWS Cloud Development Kit (AWS CDK)](https://docs.aws.amazon.com/cdk/v2/guide/home.html)  aimed to help developers build generative AI solutions using pattern-based definitions for their architecture. |\n| [Artifacts and Tools for Bedrock](https://github.com/aws-samples/artifacts-and-tools-for-bedrock) | An innovative chat-based user interface with support for tools and artifacts. It can create graphs and diagrams, analyze data, write games, create web pages, generate files, and much more.  |\n\n# Roadmap\n\nRoadmap is available through the [GitHub Project](https://github.com/orgs/aws-samples/projects/69)\n\n# Authors\n\n- [Bigad Soleiman](https://www.linkedin.com/in/bigadsoleiman/)\n- [Sergey Pugachev](https://www.linkedin.com/in/spugachev/)\n\n# Contributors\n[![contributors](https://contrib.rocks/image?repo=aws-samples/aws-genai-llm-chatbot\u0026max=2000)](https://github.com/aws-samples/aws-genai-llm-chatbot/graphs/contributors)\n\n# License\n\nThis library is licensed under the MIT-0 License. See the LICENSE file.\n\n- [Changelog](CHANGELOG.md) of the project.\n- [License](LICENSE) of the project.\n- [Code of Conduct](CODE_OF_CONDUCT.md) of the project.\n- [CONTRIBUTING](CONTRIBUTING.md#security-issue-notifications) for more information.\n\nAlthough this repository is released under the  MIT-0 license, its front-end and SQL implementation use the following third party projects:\n- [psycopg2-binary](https://github.com/psycopg/psycopg2)\n- [jackspeak](https://github.com/isaacs/jackspeak)\n- [package-json-from-dist](https://github.com/isaacs/package-json-from-dist)\n- [path-scurry](https://github.com/isaacs/path-scurry)\n\nThese projects' licensing includes the LGPL v3 and  BlueOak-1.0.0 licenses.\n\n# Legal Disclaimer\n\nYou should consider doing your own independent assessment before using the content in this sample for production purposes. This may include (amongst other things) testing, securing, and optimizing the content provided in this sample, based on your specific quality control practices and standards.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faws-samples%2Faws-genai-llm-chatbot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faws-samples%2Faws-genai-llm-chatbot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faws-samples%2Faws-genai-llm-chatbot/lists"}