
OpenChat
Every AI model, one blazing fast workspace - see how they think, schedule what you need
Stars: 90

OS Chat is a free, open-source AI personal assistant that combines 40+ language models with powerful automation capabilities. It allows users to deploy background agents, connect services like Gmail, Calendar, Notion, GitHub, and Slack, and get things done through natural conversation. With features like smart automation, service connectors, AI models, chat management, interface customization, and premium features, OS Chat offers a comprehensive solution for managing digital life and workflows. It prioritizes privacy by being open source and self-hostable, with encrypted API key storage.
README:
OS Chat is a free, open-source AI personal assistant that combines 40+ language models with powerful automation capabilities. Deploy background agents, connect your favorite services (Gmail, Calendar, Notion, GitHub), and get things done through natural conversation.
- π Open Source T3 Chat Alternative - Get all the speed and multi-model access of T3 Chat, but open source, self-hostable, and enhanced with background agents and service integrations
- π€ Your AI Personal Assistant - More than chat - deploy background agents, automate workflows, and manage your digital life
- π Connect Everything - Direct integration with Gmail, Calendar, Notion, GitHub, Slack, and 10+ more services
- β° Smart Automation - Deploy background agents with email notifications - let your assistant work while you sleep
- π§ 40+ AI Models - Access the latest from OpenAI, Anthropic, Google, Meta, and more in one interface
- π― Truly Personal - Customize personality traits, personal context, and preferences for tailored interactions
- π Privacy-First - Open source, self-hostable, with encrypted API key storage
- Smart Background Agents - Deploy AI agents to run one-time, daily, or weekly with timezone awareness
- Email Notifications - Get notified when your background agents complete successfully
- Automated Workflows - Let your AI assistant handle routine work while you focus on what matters
- Execution History - Track and monitor all your background agent runs with detailed logs
- Flexible Scheduling - Pause, resume, or archive agents as your needs change
- Gmail Integration - Access, read, and manage your email messages directly through chat
- Google Calendar - View, create, and schedule calendar events seamlessly
- Google Drive & Docs - Access files, create documents, and collaborate on projects
- Notion Workspace - Read and write to your Notion pages and databases
- GitHub Management - Manage repositories, issues, and pull requests
- Slack Communication - Send messages and interact with your workspace
- Linear Project Management - Track and manage issues and projects
- X (Twitter) - Post tweets and manage your social media presence
- 10+ More Services - Expanding ecosystem of productivity integrations
- 40+ AI Models - Access OpenAI, Anthropic, Google, Meta, Mistral, DeepSeek, xAI, Moonshot, zAI, and Qwen models
- Multi-modal Support - Text, images, and reasoning across all supported models
- Image Generation - Create high-quality images with GPT Image 1, Imagen 4, and Flux Schnell
- Reasoning Models - View AI thinking process with o3, Claude 4, Gemini Thinking, and DeepSeek R1
- Model Switching - Seamlessly switch between models within conversations
- Web Search Integration - Real-time internet search using Exa, Tavily, and Brave APIs
- Smart Organization - Automatic grouping by Today, Yesterday, Last 7 Days, etc.
- Pinned Chats - Keep important conversations at the top
- Chat Branching - Create alternative conversation paths from any assistant message
- Advanced Search - Full-text search across chat history with content snippets
- Bulk Operations - Export, delete, or manage multiple chats at once
- Data Portability - Export/import chat history with full data control
- Responsive Design - Beautiful interface that works on desktop and mobile
- Advanced Sidebar - Collapsible chat sidebar with search, pinning, and organization
- Theme System - Beautiful light and dark modes with smooth transitions
- Keyboard Shortcuts - Quick access with β+K (search), β+Shift+O (new chat), β+B (toggle sidebar)
- Real-time Streaming - Instant message streaming for immediate responses
- Mobile Optimized - Drawer-based navigation for seamless mobile experience
- User Personalization - Set name, occupation, and personality traits for AI interactions
- Comprehensive Settings - Dedicated pages for account, customization, history, and attachments
- Message Usage Tracking - Clear visibility into daily/monthly limits and premium credits
- API Key Management - Secure encryption and management of user-provided API keys
- Prompt Suggestions - Contextual prompt ideas to inspire conversations
- Payments & Subscriptions - Integrated billing with Polar for premium model access
- Premium Credits - Access to advanced models like GPT-5, Claude 4 Sonnet, o3 and more
OS Chat supports 40+ AI models across multiple providers:
- OpenAI: GPT-5, GPT-5 Mini, GPT-5 Nano, GPT OSS 20B, GPT OSS 120B, GPT-4o, GPT-4o Mini, o4 Mini, o3, o3 Pro, GPT-4.1, GPT-4.1 Mini, GPT-4.1 Nano, GPT-4.5
- Anthropic: Claude 4 Opus, Claude 4 Sonnet (with reasoning), Claude 3.7 Sonnet (with reasoning), Claude 3.5 Sonnet
- Google: Gemini 2.5 Pro, Gemini 2.5 Flash (with thinking), Gemini 2.5 Flash Lite (with thinking), Gemini 2.0 Flash, Gemini 2.0 Flash Lite
- Meta: Llama 4 Maverick, Llama 4 Scout
- Mistral: Pixtral Large, Mistral Large
- DeepSeek: DeepSeek V3.1 (with reasoning), DeepSeek V3 0324, DeepSeek R1 (0528), DeepSeek R1 Distill Llama 70B
- xAI: Grok 4, Grok 3, Grok 3 Mini
- Moonshot: Kimi K2
- zAI: GLM 4.5, GLM 4.5 Air, GLM 4.5V
- Qwen: Qwen3 Coder, Qwen3 235B (with thinking), Qwen3 235B
- OpenAI: GPT Image 1
- Google: Imagen 4, Imagen 4 Ultra
- Fal: Flux Schnell
- Next.js - React framework for the frontend
- prompt-kit - Beautiful AI components and primitives
- shadcn/ui - Modern component library for UI
- motion-primitives - Smooth animations and transitions
- Vercel AI SDK - Model integration and streaming
- Convex - Real-time backend, authentication, and database
- Cloudflare R2 - Object storage for file attachments
- Polar - Payments and subscriptions
- Phosphor Icons - Beautiful icon system
- Tailwind CSS - Utility-first CSS framework
- Projects & Workspaces - Organize your chats into projects and workspaces
- MCP integration - Model Context Protocol support for enhanced AI capabilities
- Background Agents - Deploy agents that work autonomously and deliver results via email.
- Image Generation - Create images with GPT Image 1, Imagen 4, and Flux Schnell
- Advanced Search - Full-text search across chat history with content snippets
- Payments Integration - Polar-powered subscriptions for premium model access
- Enhanced Settings Panel - Comprehensive settings with account management and API key encryption
- Chat Branching - Create alternative conversation paths from any assistant message
- Reasoning Models - Visual thinking process for o3, Claude 4 Opus, and DeepSeek R1
- Mobile Optimization - Improved mobile experience with drawer-based navigation
- Node.js 18+ or Bun (recommended)
- Git
- A Convex account (free tier available)
- API keys for the AI models you want to use
# Clone the repository
git clone https://github.com/ajanraj/OpenChat.git
cd OpenChat
# Install dependencies (using Bun - recommended)
bun install
OS Chat uses Convex for real-time backend, authentication, and database management.
# Login to Convex (creates account if needed)
bunx convex login
# Set up a new Convex project (this creates .env.local with Convex URLs)
bunx convex dev --once
This will:
- Create a new Convex project in your dashboard
- Generate a
convex/
directory with your schema - Create a
.env.local
file with your Convex deployment URLs
Important: Convex creates .env.local
with deployment URLs. Don't overwrite it!
Instead, copy the example file to see what other variables you need:
# View the example to see what API keys you need
cat .env.example
# Add the additional variables to your existing .env.local
# (Don't copy over - this would delete your Convex URLs!)
Manually add these to your existing .env.local
file:
- AI model API keys (OpenAI, Google, Anthropic, xAI, etc.)
- Analytics keys (PostHog, Umami)
- Search provider keys (Exa)
- Other configuration from
.env.example
Configure the required and optional Convex environment variables for your application.
OS Chat uses Convex Auth for authentication with Google OAuth.
-
Initialize Convex Auth:
# Initialize Convex Auth setup bunx @convex-dev/auth
-
Set up Google OAuth:
- Follow the Google OAuth Setup Guide
- Set your Google OAuth credentials in Convex:
# Set Google OAuth credentials bunx convex env set AUTH_GOOGLE_ID your-google-client-id bunx convex env set AUTH_GOOGLE_SECRET your-google-client-secret
-
Set Required Environment Variables:
# Generate and set API key encryption secret in Convex (REQUIRED) bunx convex env set API_KEY_SECRET $(openssl rand -hex 64) # Set site URL for development bunx convex env set SITE_URL http://localhost:3000
OS Chat uses Cloudflare R2 for file attachments and image storage.
-
Create a Public Cloudflare R2 Bucket:
- Sign up for a Cloudflare account
- Navigate to R2 Object Storage in your dashboard
- Create a new bucket (e.g.,
oschat-files
) -
Important: Configure the bucket for public access:
- Go to Settings > Public Access
- Enable "Allow public access"
- Set up a custom domain or use the R2.dev subdomain
- Configure CORS to allow GET and PUT requests from your domain
-
Generate R2 API Credentials:
- Go to R2 > Manage R2 API tokens
- Create a new API token with Object Read & Write permissions
- Save the Access Key ID and Secret Access Key
-
Set R2 Environment Variables in Convex:
# Required R2 configuration bunx convex env set R2_BUCKET your-bucket-name bunx convex env set R2_TOKEN your-r2-api-token bunx convex env set R2_ACCESS_KEY_ID your-access-key-id bunx convex env set R2_SECRET_ACCESS_KEY your-secret-access-key bunx convex env set R2_ENDPOINT https://your-account-id.r2.cloudflarestorage.com # Required: Public URL for serving files # Use your custom domain or R2.dev subdomain bunx convex env set R2_PUBLIC_URL_BASE https://your-bucket.your-domain.com/ # or # bunx convex env set R2_PUBLIC_URL_BASE https://pub-xxxxx.r2.dev/
# Set Polar environment variables (optional)
bunx convex env set POLAR_ORGANIZATION_TOKEN your-polar-organization-token
bunx convex env set POLAR_PREMIUM_PRODUCT_ID your-product-id
bunx convex env set POLAR_WEBHOOK_SECRET your-polar-webhook-secret
Reference Documentation:
- Convex Auth Setup Guide
- Google OAuth Configuration
- Cloudflare R2 Component
- Polar Component Documentation
Deploy your Convex schema and functions:
# Deploy to Convex (this pushes your functions and schema)
bunx convex deploy
# Or for development with hot reload
bunx convex dev
# Start the Next.js development server
bun dev
Visit http://localhost:3000 to see oschat running locally!
For production deployment:
-
Deploy Convex:
bunx convex deploy --prod
-
Deploy Frontend (Vercel recommended):
# Install Vercel CLI bun add -g vercel # Deploy to Vercel vercel --prod
-
Update Environment Variables:
- Add your production API keys to Vercel
- Update
SITE_URL
in Convex production dashboard to your production URL
Convex Connection Issues:
- Ensure you're logged into Convex:
bunx convex login
- Check your deployment URL in
.env.local
- Run
bunx convex dev
to sync functions
Authentication Issues:
- Verify OAuth credentials in Convex dashboard
- Check
SITE_URL
matches your development/production URL - Ensure Convex Auth is properly configured
API Key Issues:
- Verify API keys are correctly set in
.env.local
- Check API key permissions and quotas
File Upload Issues:
- Ensure R2 bucket is configured for public access
- Verify R2_PUBLIC_URL_BASE is set correctly with trailing slash
- Check CORS settings allow your domain
- Confirm all R2 environment variables are set in Convex
Need Help?
- Check the Convex Documentation
- Review the Convex Auth Setup Guide
- See Google OAuth Configuration for authentication
- Configure Cloudflare R2 for file storage
- Get an Exa API key for web search functionality
- Set up Polar payments for premium features
- Open an issue in this repository
We welcome contributions! OS Chat is built with modern web technologies and follows best practices for maintainability and performance.
- Fork the repository
- Follow the Getting Started guide above to set up your development environment
- Create your feature branch (
git checkout -b feature/amazing-feature
)
- Follow the existing code style and patterns
- Add tests for new features when applicable
- Update documentation for user-facing changes
- Ensure responsive design works across devices
- Test keyboard shortcuts and accessibility features
- Commit your changes (
git commit -m 'Add some amazing feature'
) - Push to the branch (
git push origin feature/amazing-feature
) - Open a Pull Request with a clear description of changes
- Stream resuming using Redis
- Performance optimizations
Current Status: Beta Release - OS Chat is actively developed with regular feature updates and improvements.
Compatibility: This codebase represents a significant evolution from earlier versions, with substantial architectural improvements and new features added throughout 2025.
Performance: Built for scale with real-time features, efficient data management, and optimized for both desktop and mobile experiences.
Privacy: All data is processed securely with user control over exports, imports, and data management.
This code is a heavily modified version of work by Julien Thibeaut, originally licensed under the Apache License 2.0. All significant changes, improvements, and new features were implemented by Ajan Raj in 2025.
For Tasks:
Click tags to check more tools for each tasksFor Jobs:
Alternative AI tools for OpenChat
Similar Open Source Tools

OpenChat
OS Chat is a free, open-source AI personal assistant that combines 40+ language models with powerful automation capabilities. It allows users to deploy background agents, connect services like Gmail, Calendar, Notion, GitHub, and Slack, and get things done through natural conversation. With features like smart automation, service connectors, AI models, chat management, interface customization, and premium features, OS Chat offers a comprehensive solution for managing digital life and workflows. It prioritizes privacy by being open source and self-hostable, with encrypted API key storage.

persistent-ai-memory
Persistent AI Memory System is a comprehensive tool that offers persistent, searchable storage for AI assistants. It includes features like conversation tracking, MCP tool call logging, and intelligent scheduling. The system supports multiple databases, provides enhanced memory management, and offers various tools for memory operations, schedule management, and system health checks. It also integrates with various platforms like LM Studio, VS Code, Koboldcpp, Ollama, and more. The system is designed to be modular, platform-agnostic, and scalable, allowing users to handle large conversation histories efficiently.

layra
LAYRA is the world's first visual-native AI automation engine that sees documents like a human, preserves layout and graphical elements, and executes arbitrarily complex workflows with full Python control. It empowers users to build next-generation intelligent systems with no limits or compromises. Built for Enterprise-Grade deployment, LAYRA features a modern frontend, high-performance backend, decoupled service architecture, visual-native multimodal document understanding, and a powerful workflow engine.

llmchat
LLMChat is an all-in-one AI chat interface that supports multiple language models, offers a plugin library for enhanced functionality, enables web search capabilities, allows customization of AI assistants, provides text-to-speech conversion, ensures secure local data storage, and facilitates data import/export. It also includes features like knowledge spaces, prompt library, personalization, and can be installed as a Progressive Web App (PWA). The tech stack includes Next.js, TypeScript, Pglite, LangChain, Zustand, React Query, Supabase, Tailwind CSS, Framer Motion, Shadcn, and Tiptap. The roadmap includes upcoming features like speech-to-text and knowledge spaces.

gemini-cli
Gemini CLI is an open-source AI agent that provides lightweight access to Gemini, offering powerful capabilities like code understanding, generation, automation, integration, and advanced features. It is designed for developers who prefer working in the command line and offers extensibility through MCP support. The tool integrates directly into GitHub workflows and offers various authentication options for individual developers, enterprise teams, and production workloads. With features like code querying, editing, app generation, debugging, and GitHub integration, Gemini CLI aims to streamline development workflows and enhance productivity.

DreamLayer
DreamLayer AI is an open-source Stable Diffusion WebUI designed for AI researchers, labs, and developers. It automates prompts, seeds, and metrics for benchmarking models, datasets, and samplers, enabling reproducible evaluations across multiple seeds and configurations. The tool integrates custom metrics and evaluation pipelines, providing a streamlined workflow for AI research. With features like automated benchmarking, reproducibility, built-in metrics, multi-modal readiness, and researcher-friendly interface, DreamLayer AI aims to simplify and accelerate the model evaluation process.

mcp-pointer
MCP Pointer is a local tool that combines an MCP Server with a Chrome Extension to allow users to visually select DOM elements in the browser and make textual context available to agentic coding tools like Claude Code. It bridges between the browser and AI tools via the Model Context Protocol, enabling real-time communication and compatibility with various AI tools. The tool extracts detailed information about selected elements, including text content, CSS properties, React component detection, and more, making it a valuable asset for developers working with AI-powered web development.

pocketpal-ai
PocketPal AI is a versatile virtual assistant tool designed to streamline daily tasks and enhance productivity. It leverages artificial intelligence technology to provide personalized assistance in managing schedules, organizing information, setting reminders, and more. With its intuitive interface and smart features, PocketPal AI aims to simplify users' lives by automating routine activities and offering proactive suggestions for optimal time management and task prioritization.

scira
Scira is a powerful open-source tool for analyzing and visualizing data. It provides a user-friendly interface for data exploration, cleaning, and modeling. With Scira, users can easily import datasets, perform statistical analysis, create insightful visualizations, and generate reports. The tool supports various data formats and offers a wide range of statistical functions and visualization options. Whether you are a data scientist, researcher, or student, Scira can help you uncover valuable insights from your data and communicate your findings effectively.

curiso
Curiso AI is an infinite canvas platform that connects nodes and AI services to explore ideas without repetition. It empowers advanced users to unlock richer AI interactions. Features include multi OS support, infinite canvas, multiple AI provider integration, local AI inference provider integration, custom model support, model metrics, RAG support, local Transformers.js embedding models, inference parameters customization, multiple boards, vision model support, customizable interface, node-based conversations, and secure local encrypted storage. Curiso also offers a Solana token for exclusive access to premium features and enhanced AI capabilities.

DeepSeekAI
DeepSeekAI is a browser extension plugin that allows users to interact with AI by selecting text on web pages and invoking the DeepSeek large model to provide AI responses. The extension enhances browsing experience by enabling users to get summaries or answers for selected text directly on the webpage. It features context text selection, API key integration, draggable and resizable window, AI streaming replies, Markdown rendering, one-click copy, re-answer option, code copy functionality, language switching, and multi-turn dialogue support. Users can install the extension from Chrome Web Store or Edge Add-ons, or manually clone the repository, install dependencies, and build the extension. Configuration involves entering the DeepSeek API key in the extension popup window to start using the AI-driven responses.

lyraios
LYRAIOS (LLM-based Your Reliable AI Operating System) is an advanced AI assistant platform built with FastAPI and Streamlit, designed to serve as an operating system for AI applications. It offers core features such as AI process management, memory system, and I/O system. The platform includes built-in tools like Calculator, Web Search, Financial Analysis, File Management, and Research Tools. It also provides specialized assistant teams for Python and research tasks. LYRAIOS is built on a technical architecture comprising FastAPI backend, Streamlit frontend, Vector Database, PostgreSQL storage, and Docker support. It offers features like knowledge management, process control, and security & access control. The roadmap includes enhancements in core platform, AI process management, memory system, tools & integrations, security & access control, open protocol architecture, multi-agent collaboration, and cross-platform support.

AionUi
AionUi is a user interface library for building modern and responsive web applications. It provides a set of customizable components and styles to create visually appealing user interfaces. With AionUi, developers can easily design and implement interactive web interfaces that are both functional and aesthetically pleasing. The library is built using the latest web technologies and follows best practices for performance and accessibility. Whether you are working on a personal project or a professional application, AionUi can help you streamline the UI development process and deliver a seamless user experience.

aigne-hub
AIGNE Hub is a unified AI gateway that manages connections to multiple LLM and AIGC providers, eliminating the complexity of handling API keys, usage tracking, and billing across different AI services. It provides self-hosting capabilities, multi-provider management, unified security, usage analytics, flexible billing, and seamless integration with the AIGNE framework. The tool supports various AI providers and deployment scenarios, catering to both enterprise self-hosting and service provider modes. Users can easily deploy and configure AI providers, enable billing, and utilize core capabilities such as chat completions, image generation, embeddings, and RESTful APIs. AIGNE Hub ensures secure access, encrypted API key management, user permissions, and audit logging. Built with modern technologies like AIGNE Framework, Node.js, TypeScript, React, SQLite, and Blocklet for cloud-native deployment.

word-GPT-Plus
Word GPT Plus seamlessly integrates AI models into Microsoft Word, allowing users to generate, translate, summarize, and polish text directly within their documents. The tool supports multiple AI models, offers built-in templates for various text-related tasks, and provides customization options for user preferences. Users can install the tool through a hosted service, Docker deployment, or self-hosting, and can easily fill in API keys to access different AI services. Word GPT Plus enhances writing workflows by providing AI-powered assistance without leaving the Word environment.

WatermarkRemover-AI
WatermarkRemover-AI is an advanced application that utilizes AI models for precise watermark detection and seamless removal. It leverages Florence-2 for watermark identification and LaMA for inpainting. The tool offers both a command-line interface (CLI) and a PyQt6-based graphical user interface (GUI), making it accessible to users of all levels. It supports dual modes for processing images, advanced watermark detection, seamless inpainting, customizable output settings, real-time progress tracking, dark mode support, and efficient GPU acceleration using CUDA.
For similar tasks

Nocode-Wep
Nocode/WEP is a forward-looking office visualization platform that includes modules for document building, web application creation, presentation design, and AI capabilities for office scenarios. It supports features such as configuring bullet comments, global article comments, multimedia content, custom drawing boards, flowchart editor, form designer, keyword annotations, article statistics, custom appreciation settings, JSON import/export, content block copying, and unlimited hierarchical directories. The platform is compatible with major browsers and aims to deliver content value, iterate products, share technology, and promote open-source collaboration.

plate
Plate is a rich-text editor framework designed for simplicity and efficiency. It consists of core plugin system, various plugin packages, primitive hooks and components, and pre-built components. Plate offers templates for different use cases like Notion-like template, Plate playground template, and Plate minimal template. Users can refer to the documentation for more information on Plate. Contributors are welcome to join the project by giving stars, making pull requests, or sharing plugins.

godoos
GodoOS is an efficient intranet office operating system that includes various office tools such as word/excel/ppt/pdf/internal chat/whiteboard/mind map, with native file storage support. The platform interface mimics the Windows style, making it easy to operate while maintaining low resource consumption and high performance. It automatically connects to intranet users without registration, enabling instant communication and file sharing. The flexible and highly configurable app store allows for unlimited expansion.

open-deep-research
Open Deep Research is an open-source tool designed to generate AI-powered reports from web search results efficiently. It combines Bing Search API for search results retrieval, JinaAI for content extraction, and customizable report generation. Users can customize settings, export reports in multiple formats, and benefit from rate limiting for stability. The tool aims to streamline research and report creation in a user-friendly platform.

OpenChat
OS Chat is a free, open-source AI personal assistant that combines 40+ language models with powerful automation capabilities. It allows users to deploy background agents, connect services like Gmail, Calendar, Notion, GitHub, and Slack, and get things done through natural conversation. With features like smart automation, service connectors, AI models, chat management, interface customization, and premium features, OS Chat offers a comprehensive solution for managing digital life and workflows. It prioritizes privacy by being open source and self-hostable, with encrypted API key storage.

dbgpts
The dbgpts repository contains data apps, AWEL operators, AWEL workflow templates, and agents that are built upon DB-GPT. Users can install and manage these components within their DB-GPT environment. The repository offers functionalities such as listing available flows, installing dbgpts from the official repository, viewing installed dbgpts, running flows, and managing repositories. Users can create new workflow templates and operators using the provided commands. The repository aims to enhance the capabilities of DB-GPT by providing a collection of useful tools and resources for data processing and workflow management.

lightfriend
Lightfriend is a lightweight and user-friendly tool designed to assist developers in managing their GitHub repositories efficiently. It provides a simple and intuitive interface for users to perform various repository-related tasks, such as creating new repositories, managing branches, and reviewing pull requests. With Lightfriend, developers can streamline their workflow and collaborate more effectively with team members. The tool is designed to be easy to use and requires minimal setup, making it ideal for developers of all skill levels. Whether you are a beginner looking to get started with GitHub or an experienced developer seeking a more efficient way to manage your repositories, Lightfriend is the perfect companion for your GitHub workflow.

uAgents
uAgents is a Python library developed by Fetch.ai that allows for the creation of autonomous AI agents. These agents can perform various tasks on a schedule or take action on various events. uAgents are easy to create and manage, and they are connected to a fast-growing network of other uAgents. They are also secure, with cryptographically secured messages and wallets.
For similar jobs

promptflow
**Prompt flow** is a suite of development tools designed to streamline the end-to-end development cycle of LLM-based AI applications, from ideation, prototyping, testing, evaluation to production deployment and monitoring. It makes prompt engineering much easier and enables you to build LLM apps with production quality.

deepeval
DeepEval is a simple-to-use, open-source LLM evaluation framework specialized for unit testing LLM outputs. It incorporates various metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., and runs locally on your machine for evaluation. It provides a wide range of ready-to-use evaluation metrics, allows for creating custom metrics, integrates with any CI/CD environment, and enables benchmarking LLMs on popular benchmarks. DeepEval is designed for evaluating RAG and fine-tuning applications, helping users optimize hyperparameters, prevent prompt drifting, and transition from OpenAI to hosting their own Llama2 with confidence.

MegaDetector
MegaDetector is an AI model that identifies animals, people, and vehicles in camera trap images (which also makes it useful for eliminating blank images). This model is trained on several million images from a variety of ecosystems. MegaDetector is just one of many tools that aims to make conservation biologists more efficient with AI. If you want to learn about other ways to use AI to accelerate camera trap workflows, check out our of the field, affectionately titled "Everything I know about machine learning and camera traps".

leapfrogai
LeapfrogAI is a self-hosted AI platform designed to be deployed in air-gapped resource-constrained environments. It brings sophisticated AI solutions to these environments by hosting all the necessary components of an AI stack, including vector databases, model backends, API, and UI. LeapfrogAI's API closely matches that of OpenAI, allowing tools built for OpenAI/ChatGPT to function seamlessly with a LeapfrogAI backend. It provides several backends for various use cases, including llama-cpp-python, whisper, text-embeddings, and vllm. LeapfrogAI leverages Chainguard's apko to harden base python images, ensuring the latest supported Python versions are used by the other components of the stack. The LeapfrogAI SDK provides a standard set of protobuffs and python utilities for implementing backends and gRPC. LeapfrogAI offers UI options for common use-cases like chat, summarization, and transcription. It can be deployed and run locally via UDS and Kubernetes, built out using Zarf packages. LeapfrogAI is supported by a community of users and contributors, including Defense Unicorns, Beast Code, Chainguard, Exovera, Hypergiant, Pulze, SOSi, United States Navy, United States Air Force, and United States Space Force.

llava-docker
This Docker image for LLaVA (Large Language and Vision Assistant) provides a convenient way to run LLaVA locally or on RunPod. LLaVA is a powerful AI tool that combines natural language processing and computer vision capabilities. With this Docker image, you can easily access LLaVA's functionalities for various tasks, including image captioning, visual question answering, text summarization, and more. The image comes pre-installed with LLaVA v1.2.0, Torch 2.1.2, xformers 0.0.23.post1, and other necessary dependencies. You can customize the model used by setting the MODEL environment variable. The image also includes a Jupyter Lab environment for interactive development and exploration. Overall, this Docker image offers a comprehensive and user-friendly platform for leveraging LLaVA's capabilities.

carrot
The 'carrot' repository on GitHub provides a list of free and user-friendly ChatGPT mirror sites for easy access. The repository includes sponsored sites offering various GPT models and services. Users can find and share sites, report errors, and access stable and recommended sites for ChatGPT usage. The repository also includes a detailed list of ChatGPT sites, their features, and accessibility options, making it a valuable resource for ChatGPT users seeking free and unlimited GPT services.

TrustLLM
TrustLLM is a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for mainstream LLMs, and discussion of open challenges and future directions. Specifically, we first propose a set of principles for trustworthy LLMs that span eight different dimensions. Based on these principles, we further establish a benchmark across six dimensions including truthfulness, safety, fairness, robustness, privacy, and machine ethics. We then present a study evaluating 16 mainstream LLMs in TrustLLM, consisting of over 30 datasets. The document explains how to use the trustllm python package to help you assess the performance of your LLM in trustworthiness more quickly. For more details about TrustLLM, please refer to project website.

AI-YinMei
AI-YinMei is an AI virtual anchor Vtuber development tool (N card version). It supports fastgpt knowledge base chat dialogue, a complete set of solutions for LLM large language models: [fastgpt] + [one-api] + [Xinference], supports docking bilibili live broadcast barrage reply and entering live broadcast welcome speech, supports Microsoft edge-tts speech synthesis, supports Bert-VITS2 speech synthesis, supports GPT-SoVITS speech synthesis, supports expression control Vtuber Studio, supports painting stable-diffusion-webui output OBS live broadcast room, supports painting picture pornography public-NSFW-y-distinguish, supports search and image search service duckduckgo (requires magic Internet access), supports image search service Baidu image search (no magic Internet access), supports AI reply chat box [html plug-in], supports AI singing Auto-Convert-Music, supports playlist [html plug-in], supports dancing function, supports expression video playback, supports head touching action, supports gift smashing action, supports singing automatic start dancing function, chat and singing automatic cycle swing action, supports multi scene switching, background music switching, day and night automatic switching scene, supports open singing and painting, let AI automatically judge the content.