Best AI tools for< Self-hosted Model Deployment >
Infographic
20 - AI tool Sites

SiteRetriever
SiteRetriever is a self-hosted AI chatbot platform that allows users to build powerful chatbots without monthly fees. It offers a completely self-contained and self-hosted solution, providing full control over data and costs. With optimized speed and advanced language models, SiteRetriever enables users to create smart AI chatbots that understand context and provide accurate responses. The platform ensures full privacy and security by keeping data on users' servers, with no external API calls or data sharing. Users can easily embed the chatbot on any website using a simple JavaScript snippet, and customize its appearance, behavior, and responses. SiteRetriever simplifies the setup process, allowing users to upload content, configure the bot, and embed it on their site within minutes.

Refact.ai
Refact.ai is an open-source AI coding assistant that offers a range of features including code completion, refactoring, and chat. It supports various LLMs such as GPT-4 and Code LLama, allowing users to choose the model that best suits their needs. Refact understands the context of the codebase using a fill-in-the-middle technique, providing relevant suggestions. Users can opt for a self-hosted version or adjust privacy settings for the plugin.

Athina AI
Athina AI is a comprehensive platform designed to monitor, debug, analyze, and improve the performance of Large Language Models (LLMs) in production environments. It provides a suite of tools and features that enable users to detect and fix hallucinations, evaluate output quality, analyze usage patterns, and optimize prompt management. Athina AI supports integration with various LLMs and offers a range of evaluation metrics, including context relevancy, harmfulness, summarization accuracy, and custom evaluations. It also provides a self-hosted solution for complete privacy and control, a GraphQL API for programmatic access to logs and evaluations, and support for multiple users and teams. Athina AI's mission is to empower organizations to harness the full potential of LLMs by ensuring their reliability, accuracy, and alignment with business objectives.

AI Placeholder
AI Placeholder is a free AI-Powered Fake or Dummy Data API for testing and prototyping. It leverages OpenAI's GPT-3.5-Turbo Model API to generate fake content. Users can directly use the hosted version or self-host it. The API allows users to generate any data they can think of, with the ability to specify rules for data retrieval. It supports various content types like tweets, posts, Instagram posts, and more. The application is designed to assist developers and testers in creating realistic but non-sensitive data for their projects.

Aim
Aim is an open-source, self-hosted AI Metadata tracking tool designed to handle 100,000s of tracked metadata sequences. Two most famous AI metadata applications are: experiment tracking and prompt engineering. Aim provides a performant and beautiful UI for exploring and comparing training runs, prompt sessions.

CollaborativeAI
CollaborativeAI is an open-source AI assistant platform that offers self-hosted AI assistants to optimize workflows and interdepartmental teamwork. It provides a wide selection of AI models, including GPT-4, Gemini, and Claude, to help businesses drive innovation and address bespoke problems. The platform prioritizes on-site data security, allowing users to keep their critical data exclusively within their servers. CollaborativeAI aims to boost employee productivity and innovation by automating mundane tasks and simplifying complex processes.

Lokal.so
Lokal.so is an AI-powered tool designed to supercharge your localhost development experience. It offers features like sharing your localhost with the public, debugging incoming requests, and developing with the assistance of an AI assistant. With Lokal.so, you can leverage Cloudflare's network for faster site delivery, use a built-in S3 server for easy file debugging, and automatically convert JSON payloads into different programming language models. The tool aims to simplify local development by providing a self-hosted tunnel server, unlimited .local domain access, and endpoint management with memorable names.

PhotoPrism
PhotoPrism is an AI-Powered Photos App for the Decentralized Web that utilizes cutting-edge technologies to automatically tag and find pictures. It allows users to organize and access their photos effortlessly, without compromising privacy. The application offers features like browsing all photos and videos, powerful search filters, world maps for trip memories, live photo playback, facial recognition, and automatic picture classification based on content and location. PhotoPrism is self-funded and independent, ensuring data privacy and transparency. Users can run the app on a private server, in the cloud, or at home.

Volamail
Volamail is an AI-powered email platform that simplifies the email writing process for everyone. It offers AI-assisted editing to help users compose email templates effortlessly. The platform supports importing existing emails in plain HTML format and allows self-hosting for easy deployment. With Volamail, users can send transactional emails via a simple HTTP call without the need for dependencies. The platform is constantly evolving with new features like AI template generation, inline AI editing, and custom domains. Volamail provides simple and scalable pricing options, including a free plan for small projects and affordable custom plans for larger teams.

CodeComplete
CodeComplete is an AI-powered coding assistant designed specifically for enterprise needs. It is efficient, reliable, and equipped with cutting-edge technology to improve developer productivity. CodeComplete offers a comprehensive suite of coding tools to improve end-to-end developer workflow, including code generation, code chat, automated unit test generation, automated documentation, and refactoring & migrations.

Gunbot
Gunbot is a powerful AI-driven crypto trading bot that offers advanced automation features for trading on various exchanges. It provides privacy-friendly trading options, pre-tuned strategies, and customization capabilities. Gunbot runs directly on users' devices, ensuring data security and privacy. Users can choose from subscription or lifetime license options, with free software updates included. The platform supports Windows, Linux, macOS, and Raspberry Pi. Gunbot AI allows users to create custom trading strategies effortlessly, powered by ChatGPT technology.

Activepieces
Activepieces is an open-source no-code business automation tool that allows users to securely deploy automation for various departments such as marketing, sales, operations, HR, finance, and IT teams. It offers a customizable and self-hosted solution, enabling users to put their work on autopilot. Activepieces stands out for its user experience, ease of integration, and control over hosting. The tool leverages AI automation to streamline tasks like content strategy, security compliance, sales outreach, and customer support. With a community-driven approach, Activepieces aims to make the automation world more open and accessible.

n8n
n8n is a powerful workflow automation software and tools that offer advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-driven processes. The tool supports self-hosting, external libraries, and offers enterprise-ready solutions for scaling operations. n8n empowers users to code iteratively, explore advanced AI features, and create complex workflows with ease.

n8n
n8n is a powerful workflow automation software and tool that offers advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-powered solutions. The tool supports self-hosting, external libraries, and a user-friendly interface for both coding and non-coding users.

Collato
Collato is an AI assistant designed to help product teams save time on writing documents, answering questions, and generating new content. It can find, summarize, and generate new content based on your own product knowledge, saving you hours in manual work. Collato is also self-hosted, so you can keep your data private and secure.

Ikigai
Ikigai is an AI-powered Open Assignment System that allows users to generate assignments quickly and draft feedback using AI. It offers seamless access via a single link and can be embedded in websites or learning management systems. The system features various quiz types and a flexible layout adaptable to different exam formats. Users can experience Ikigai through the cloud for free or opt for a self-hosted option for more privacy.

Hatchet
Hatchet is an AI companion designed to assist on-call engineers in incident response by providing intelligent insights and suggestions based on logs, communications channels, and code analysis. It helps save time and money by automating the triaging and investigation process during critical incidents. The tool is built by engineers with a focus on data security, offering self-hosted deployments, permissions, audit trails, SSO, and version control. Hatchet aims to streamline incident resolution for tier-1 services, enabling faster response and potential problem resolution.

PageWise AI
PageWise AI is an AI application that provides instant insight into Confluence data by turning tedious searches and repetitive questions into intuitive AI-powered conversations directly in Slack. It offers effortless integration with Slack and Confluence accounts, eliminates the need for sifting through pages, reduces repetitive queries, connects hidden insights within Confluence pages, boosts communication, and scales with business needs. PageWise AI offers flexible pricing plans catering to different team sizes and requirements, with the option for custom integrations, data sources, and self-hosted solutions for enterprise users.

Yoodocs
Yoodocs is an AI-powered documentation service that simplifies document creation, management, and collaboration. It offers features such as document hierarchy organization, open-source documentation creation, export to various formats, workspace diversity, language management, version control, seamless migration, AI-powered editor assistant, comprehensive search, automated sync with GitLab and GitHub, self-hosted solution, collaborative development, customization styles and themes, and integrations. Yoodocs aims to enhance productivity and efficiency in projects by providing a comprehensive solution for documentation needs.

Warestack
Warestack is an AI-powered cloud workflow automation platform that helps users manage all daily workflow operations with AI-powered observability. It allows users to monitor workflow runs from a single dashboard, speed up releases with one-click resolutions, and gain actionable insights. Warestack streamlines workflow runs, eliminates manual processes complexity, automates workflow operations with a copilot, and boosts runs with self-hosted runners at infrastructure cost. The platform leverages generative AI and deep-tech to enhance and automate workflow processes, ensuring consistent documentation and team productivity.
1 - Open Source Tools

log10
Log10 is a one-line Python integration to manage your LLM data. It helps you log both closed and open-source LLM calls, compare and identify the best models and prompts, store feedback for fine-tuning, collect performance metrics such as latency and usage, and perform analytics and monitor compliance for LLM powered applications. Log10 offers various integration methods, including a python LLM library wrapper, the Log10 LLM abstraction, and callbacks, to facilitate its use in both existing production environments and new projects. Pick the one that works best for you. Log10 also provides a copilot that can help you with suggestions on how to optimize your prompt, and a feedback feature that allows you to add feedback to your completions. Additionally, Log10 provides prompt provenance, session tracking and call stack functionality to help debug prompt chains. With Log10, you can use your data and feedback from users to fine-tune custom models with RLHF, and build and deploy more reliable, accurate and efficient self-hosted models. Log10 also supports collaboration, allowing you to create flexible groups to share and collaborate over all of the above features.
20 - OpenAI Gpts

Awesome-Selfhosted
Recommends self-hosted IT solutions, tailored for professionals (from https://awesome-selfhosted.net/)

Employer Self-Funded Health Plan Strategist
Expert in self-funded health plans, focusing on finance, stop loss, and data analytics.

AI Self-Esteem Coach
I turn negative thoughts into positive outlooks and suggest growth goals.

psy_self
Welcome to 'SelfEsteemSculptor' – your digital guide for enhancing self-esteem. Discover strategies to build your confidence, overcome self-doubt, and cultivate a strong, positive self-image.

Self Builder
I automate GPT creation, saving + 99% time and securing data, preventing someone steal your idea.

EDC Self Defense Weapons
EDC Self Defense Weapons: Information or guidance on what constitutes EDC self-defense weapons. This can include lists of recommended items, explanations of their practicality, legality, and effectiveness.

Mythical Self-Portrait
Transform yourself with this step-by-step guide to creating a mythical self-portrait with DALL-E.

Language Proficiency Level Self-Assessment
A language self-assessment guide with mobile app voice interaction support.

AI for Business
Self-updating, comprehensive AI business guide. "Your Personal Ai Integration Assistant"

Brag Buddy
Helping you self-promote. Without sounding like an asshole. Click 'I'm ready' to begin.

Abundance
A guide for self-sufficiency and nature awareness, with internet search and image generation.