aws-genai-llm-chatbot

aws-genai-llm-chatbot

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

Stars: 1319

Visit
 screenshot

This repository provides code to deploy a chatbot powered by Multi-Model and Multi-RAG using AWS CDK on AWS. Users can experiment with various Large Language Models and Multimodal Language Models from different providers. The solution supports Amazon Bedrock, Amazon SageMaker self-hosted models, and third-party providers via API. It also offers additional resources like AWS Generative AI CDK Constructs and Project Lakechain for building generative AI solutions and document processing. The roadmap and authors are listed, along with contributors. The library is licensed under the MIT-0 License with information on changelog, code of conduct, and contributing guidelines. A legal disclaimer advises users to conduct their own assessment before using the content for production purposes.

README:

AWS GenAI LLM Chatbot

Enterprise-ready generative AI chatbot with RAG capabilities.

Overview

The AWS GenAI LLM Chatbot is a production-ready solution that enables organizations to deploy a secure, feature-rich chatbot powered by large language models (LLMs) with Retrieval Augmented Generation (RAG) capabilities.

Key Features

  • Multiple LLM Support: Amazon Bedrock (Claude, Llama 2), SageMaker, and custom model endpoints
  • Nexus Gateway Integration: Connect to Nexus Gateway for additional model access
  • Comprehensive RAG Implementation: Connect to various data sources for context-aware responses
  • Enterprise Security: Fine-grained access controls, audit logging, and data encryption
  • Conversation Memory: Full conversation history with persistent storage
  • Web UI and API Access: Modern React interface and API endpoints for integration
  • Cost Optimization: Token usage tracking and cost management features
  • Deployment Flexibility: Multiple deployment options to fit your needs

Getting Started

This blueprint deploys the complete AWS GenAI LLM Chatbot solution in your AWS account.

Prerequisites

  • AWS Account with appropriate permissions
  • AWS CLI configured with credentials
  • Node.js 18+ and npm
  • Python 3.8+
  • AWS CDK CLI version compatible with aws-cdk-lib 2.206.0 or later
    # Install or update the CDK CLI globally
    npm install -g aws-cdk@latest
    
    # Verify the installed version
    cdk --version

Important: The CDK CLI version must be compatible with the aws-cdk-lib version used in this project (currently 2.206.0). If you encounter a "Cloud assembly schema version mismatch" error during deployment, update your CDK CLI to the latest version using the command above.

Deployment

The deployment process is fully automated using AWS CDK and SeedFarmer.

Architecture

The solution architecture includes:

  • Amazon Bedrock for LLM access
  • Amazon OpenSearch for vector storage
  • Amazon S3 for document storage
  • Amazon Cognito for authentication
  • AWS Lambda for serverless processing
  • Amazon API Gateway for API access
  • React-based web interface

Documentation

For complete documentation, visit the GitHub repository.

License

This project is licensed under the MIT-0 License.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for aws-genai-llm-chatbot

Similar Open Source Tools

For similar tasks

For similar jobs