Best AI tools for< Self-host Llms >

n8n is a powerful workflow automation software and tools that offer advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-driven processes. The tool supports self-hosting, external libraries, and offers enterprise-ready solutions for scaling operations. n8n empowers users to code iteratively, explore advanced AI features, and create complex workflows with ease.

n8n is a powerful workflow automation software and tool that offers advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-powered solutions. The tool supports self-hosting, external libraries, and a user-friendly interface for both coding and non-coding users.

Volamail is an AI-powered email platform that simplifies the email writing process for everyone. It offers AI-assisted editing to help users compose email templates effortlessly. The platform supports importing existing emails in plain HTML format and allows self-hosting for easy deployment. With Volamail, users can send transactional emails via a simple HTTP call without the need for dependencies. The platform is constantly evolving with new features like AI template generation, inline AI editing, and custom domains. Volamail provides simple and scalable pricing options, including a free plan for small projects and affordable custom plans for larger teams.

Bloombot is an AI-powered chat application that revolutionizes the learning experience. It offers a subversive and experimental AI tutor for free, allowing users to self-host their own version via the tutor-gpt repository on GitHub. Bloombot is developed by Plastic Labs and is at the forefront of novel machine learning research. The application aims to inform the future of learning by providing a unique and interactive platform for users to enhance their knowledge and skills.

AI Placeholder is a free AI-Powered Fake or Dummy Data API for testing and prototyping. It utilizes OpenAI API to generate dummy content. Users can directly use the hosted version or self-host it. The application allows users to generate fake or dummy content using OpenAI's GPT-3.5-Turbo Model API. Users can specify the data they want to mock, retrieve specific data, and generate data with rules specified. The tool is useful for testing, prototyping, and generating various types of data for different purposes.

Vocal Image is an AI-powered coaching app that offers speech and communication lessons to help speakers and singers boost confidence and enhance the attractiveness of their voice. The app provides voice evaluations, educational content, specialized programs, and challenges designed to improve voice quality and communication skills. Users can record their voice, receive feedback from a community of voice enthusiasts, and engage with AI coach recommendations to achieve their voice goals.

Bibit AI is a real estate marketing AI designed to enhance the efficiency and effectiveness of real estate marketing and sales. It can help create listings, descriptions, and property content, and offers a host of other features. Bibit AI is the world's first AI for Real Estate. We are transforming the real estate industry by boosting efficiency and simplifying tasks like listing creation and content generation.

Trieve is an AI-first infrastructure API that offers a modern solution for search, recommendations, and RAG (Retrieve and Generate) tasks. It combines language models with tools for fine-tuning ranking and relevance, providing production-ready capabilities for building search, discovery, and RAG experiences. Trieve supports semantic vector search, full-text search using BM25 & SPLADE models, custom embedding models, hybrid search, and sub-sentence highlighting. With features like merchandising, relevance tuning, and self-hostable options, Trieve empowers companies to enhance their search capabilities and user experiences.

AIPEX is an AI tool for guest engagement, offering solutions for hotels, resorts, and vacation rentals. It provides a self-service virtual concierge that helps drive additional revenue, save time, and make guests smile by delivering personalized experiences. The tool enhances guest interactions, reduces operational costs, and increases occupancy rates through AI-driven features and communication capabilities.

Self-Introduction Generate AI is an innovative platform designed to assist individuals and businesses in crafting compelling and effective self-introductions. It leverages advanced AI technology to understand context and generate personalized content. The platform can analyze and understand various types of input, including text and context, to generate tailored self-introductions that are engaging and informative, enhancing personal and professional branding. With features like quick response times, quality assurance, and specialized service for self-introductions, it is an ideal tool for job applications, networking events, and personal branding initiatives.

Deepwander is an interactive self-exploration tool that helps you discover your strengths, weaknesses, and values. It uses a variety of AI-powered assessments to provide you with personalized insights and recommendations. With Deepwander, you can learn more about yourself and make better decisions about your career, relationships, and life.

Veezoo is a self-service analytics platform that uses AI and a semantic layer to make data accessible and understandable to everyone in an organization. It allows users to ask questions about their data in plain English and get instant insights. Veezoo also provides features such as dashboards, collaboration tools, and data governance to help businesses make better use of their data.

Neomind is a self-hypnosis application designed to unlock success, health, and happiness by transforming limiting beliefs. It offers tailored self-hypnosis sessions that speak directly to the subconscious, helping users achieve personal goals and overcome obstacles in various areas of life. The application provides expertly crafted audio experiences, including deep relaxation induction, breathing exercises, and progressive muscle relaxation, along with unique affirmations and suggestions focused on building confidence, achieving goals, and visualizing a successful future. Users can also access bonus sessions for comprehensive personal growth in finances, health, and relationships.

FindYourTriggers is an AI-powered self-awareness enhancer that helps users understand their behavior at the root, strengthen their mindset through self-awareness, and replace bad habits with positive actions. The application offers a three-step plan to enhance self-awareness by analyzing triggers, processing growth, and providing personalized challenges to overcome triggers. Users can journal digitally or physically, identify triggers, and work towards personal growth with the support of simulated conversations with a schema therapist.

OCU AI is a self-learning tool that helps you track your learning, earn badges for consuming educational content, and share your skills with the world. With OCU AI, you can keep track of all the things you learn online, get recognized for your learning, and showcase your skills to potential employers or clients.

Fabric is an AI-native workspace and file explorer for individuals and teams. It is a self-organizing tool that gathers your drives, clouds, notes, links, and files into one intelligent home. With Fabric, you can find anything fast, in natural language, chat with your data, and collaborate on any file or document. Thousands of creators, researchers, and thinkers from the world's biggest brands use Fabric to organize their digital world and work more efficiently.

The website is a platform that features various posts and challenges related to personal growth, self-reflection, and spiritual insights. Users can create posts, share ideas, and engage in challenges that prompt deep introspection and contemplation. The site also offers expert advice on topics such as addressing climate change, managing academic stress, and exploring the benefits of EMR software in healthcare. The content encourages users to think critically, challenge societal norms, and seek personal growth through self-awareness and spiritual connection.

Ghola is a platform that offers personalized chat bots powered by AI technology to facilitate introspection and personal development. Users can create multiple chat bot profiles with different personalities, share them with others, and engage in meaningful conversations. The platform aims to help individuals become more self-aware, make positive changes in their lives, and realize their full potential through secure and encouraging interactions. Ghola also provides customizable parameters, profile sharing, conversation showcase, backend API integration, and group conversations beta.

Dropout Developer is an AI-powered platform dedicated to empowering self-taught programmers with personalized learning plans, expert guidance, and a supportive community. It offers over 100 AI tools tailored for coding and digital marketing needs. Users can access free resources, tutorials, and online courses to enhance their coding skills and build successful careers in technology.

GPT-me | Vana Chat is an AI tool that allows users to have conversations with themselves in the future, set in the year 3023. By leveraging the VNA technology and the Vanaverse, users can engage in dialogues with their future selves, offering a unique and futuristic experience. The platform serves as a portal to interact with a version of oneself from a distant future, enabling users to reflect, plan, and explore possibilities in a futuristic setting.

LLM Zoomcamp is a free online course focusing on real-life applications of Large Language Models (LLMs). Over 10 weeks, participants will learn to build an AI bot capable of answering questions based on a knowledge base. The course covers topics such as LLMs, RAG, open-source LLMs, vector databases, orchestration, monitoring, and advanced RAG systems. Pre-requisites include comfort with programming, Python, and the command line, with no prior exposure to AI or ML required. The course features a pre-course workshop and is led by instructors Alexey Grigorev and Magdalena Kuhn, with support from sponsors and partners.

A collection of LLM services you can self host via docker or modal labs to support your applications development. The goal is to provide docker containers or modal labs deployments of common patterns when using LLMs and endpoints to integrate easily with existing codebases using the openai api. It supports GPT4all's embedding api, JSONFormer api for chat completion, Cross Encoders based on sentence transformers, and provides documentation using MkDocs.

Lunary is an open-source observability and prompt platform for Large Language Models (LLMs). It provides a suite of features to help AI developers take their applications into production, including analytics, monitoring, prompt templates, fine-tuning dataset creation, chat and feedback tracking, and evaluations. Lunary is designed to be usable with any model, not just OpenAI, and is easy to integrate and self-host.

The 'nlp-llms-resources' repository is a comprehensive resource list for Natural Language Processing (NLP) and Large Language Models (LLMs). It covers a wide range of topics including traditional NLP datasets, data acquisition, libraries for NLP, neural networks, sentiment analysis, optical character recognition, information extraction, semantics, topic modeling, multilingual NLP, domain-specific LLMs, vector databases, ethics, costing, books, courses, surveys, aggregators, newsletters, papers, conferences, and societies. The repository provides valuable information and resources for individuals interested in NLP and LLMs.

Merlinn is an open-source AI-powered on-call engineer that automatically jumps into incidents & alerts, providing useful insights and RCA in real time. It integrates with popular observability tools, lives inside Slack, offers an intuitive UX, and prioritizes security. Users can self-host Merlinn, use it for free, and benefit from automatic RCA, Slack integration, integrations with various tools, intuitive UX, and security features.

DashInfer is a C++ runtime tool designed to deliver production-level implementations highly optimized for various hardware architectures, including x86 and ARMv9. It supports Continuous Batching and NUMA-Aware capabilities for CPU, and can fully utilize modern server-grade CPUs to host large language models (LLMs) up to 14B in size. With lightweight architecture, high precision, support for mainstream open-source LLMs, post-training quantization, optimized computation kernels, NUMA-aware design, and multi-language API interfaces, DashInfer provides a versatile solution for efficient inference tasks. It supports x86 CPUs with AVX2 instruction set and ARMv9 CPUs with SVE instruction set, along with various data types like FP32, BF16, and InstantQuant. DashInfer also offers single-NUMA and multi-NUMA architectures for model inference, with detailed performance tests and inference accuracy evaluations available. The tool is supported on mainstream Linux server operating systems and provides documentation and examples for easy integration and usage.

Superflows is an open-source alternative to OpenAI's Assistant API. It allows developers to easily add an AI assistant to their software products, enabling users to ask questions in natural language and receive answers or have tasks completed by making API calls. Superflows can analyze data, create plots, answer questions based on static knowledge, and even write code. It features a developer dashboard for configuration and testing, stateful streaming API, UI components, and support for multiple LLMs. Superflows can be set up in the cloud or self-hosted, and it provides comprehensive documentation and support.

Admyral is an open-source Cybersecurity Automation & Investigation Assistant that provides a unified console for investigations and incident handling, workflow automation creation, automatic alert investigation, and next step suggestions for analysts. It aims to tackle alert fatigue and automate security workflows effectively by offering features like workflow actions, AI actions, case management, alert handling, and more. Admyral combines security automation and case management to streamline incident response processes and improve overall security posture. The tool is open-source, transparent, and community-driven, allowing users to self-host, contribute, and collaborate on integrations and features.

LangWatch is a monitoring and analytics platform designed to track, visualize, and analyze interactions with Large Language Models (LLMs). It offers real-time telemetry to optimize LLM cost and latency, a user-friendly interface for deep insights into LLM behavior, user analytics for engagement metrics, detailed debugging capabilities, and guardrails to monitor LLM outputs for issues like PII leaks and toxic language. The platform supports OpenAI and LangChain integrations, simplifying the process of tracing LLM calls and generating API keys for usage. LangWatch also provides documentation for easy integration and self-hosting options for interested users.

LitServe is a high-throughput serving engine designed for deploying AI models at scale. It generates an API endpoint for models, handles batching, streaming, and autoscaling across CPU/GPUs. LitServe is built for enterprise scale with a focus on minimal, hackable code-base without bloat. It supports various model types like LLMs, vision, time-series, and works with frameworks like PyTorch, JAX, Tensorflow, and more. The tool allows users to focus on model performance rather than serving boilerplate, providing full control and flexibility.

Mem0 is a tool that provides a smart, self-improving memory layer for Large Language Models, enabling personalized AI experiences across applications. It offers persistent memory for users, sessions, and agents, self-improving personalization, a simple API for easy integration, and cross-platform consistency. Users can store memories, retrieve memories, search for related memories, update memories, get the history of a memory, and delete memories using Mem0. It is designed to enhance AI experiences by enabling long-term memory storage and retrieval.

Helicone is an open-source observability platform designed for Language Learning Models (LLMs). It logs requests to OpenAI in a user-friendly UI, offers caching, rate limits, and retries, tracks costs and latencies, provides a playground for iterating on prompts and chat conversations, supports collaboration, and will soon have APIs for feedback and evaluation. The platform is deployed on Cloudflare and consists of services like Web (NextJs), Worker (Cloudflare Workers), Jawn (Express), Supabase, and ClickHouse. Users can interact with Helicone locally by setting up the required services and environment variables. The platform encourages contributions and provides resources for learning, documentation, and integrations.

Danswer is an open-source Gen-AI Chat and Unified Search tool that connects to your company's docs, apps, and people. It provides a Chat interface and plugs into any LLM of your choice. Danswer can be deployed anywhere and for any scale - on a laptop, on-premise, or to cloud. Since you own the deployment, your user data and chats are fully in your own control. Danswer is MIT licensed and designed to be modular and easily extensible. The system also comes fully ready for production usage with user authentication, role management (admin/basic users), chat persistence, and a UI for configuring Personas (AI Assistants) and their Prompts. Danswer also serves as a Unified Search across all common workplace tools such as Slack, Google Drive, Confluence, etc. By combining LLMs and team specific knowledge, Danswer becomes a subject matter expert for the team. Imagine ChatGPT if it had access to your team's unique knowledge! It enables questions such as "A customer wants feature X, is this already supported?" or "Where's the pull request for feature Y?"

AI File Organizer 2000 is an Obsidian Plugin that uses AI to transcribe audio, annotate images, and automatically organize files by moving them to the most likely folders. It supports text, audio, and images, with upcoming local-first LLM support. Users can simply place unorganized files into the 'Inbox' folder for automatic organization. The tool renames and moves files quickly, providing a seamless file organization experience. Self-hosting is also possible by running the server and enabling the 'Self-hosted' option in the plugin settings. Join the community Discord server for more information and use the provided iOS shortcut for easy access on mobile devices.

Sweep is an AI junior developer that turns bugs and feature requests into code changes. It automatically handles developer experience improvements like adding type hints and improving test coverage.

Gateway is a tool that streamlines requests to 100+ open & closed source models with a unified API. It is production-ready with support for caching, fallbacks, retries, timeouts, load balancing, and can be edge-deployed for minimum latency. It is blazing fast with a tiny footprint, supports load balancing across multiple models, providers, and keys, ensures app resilience with fallbacks, offers automatic retries with exponential fallbacks, allows configurable request timeouts, supports multimodal routing, and can be extended with plug-in middleware. It is battle-tested over 300B tokens and enterprise-ready for enhanced security, scale, and custom deployments.

Langfuse is a powerful tool that helps you develop, monitor, and test your LLM applications. With Langfuse, you can: * **Develop:** Instrument your app and start ingesting traces to Langfuse, inspect and debug complex logs, and manage, version, and deploy prompts from within Langfuse. * **Monitor:** Track metrics (cost, latency, quality) and gain insights from dashboards & data exports, collect and calculate scores for your LLM completions, run model-based evaluations, collect user feedback, and manually score observations in Langfuse. * **Test:** Track and test app behaviour before deploying a new version, test expected in and output pairs and benchmark performance before deploying, and track versions and releases in your application. Langfuse is easy to get started with and offers a generous free tier. You can sign up for Langfuse Cloud or deploy Langfuse locally or on your own infrastructure. Langfuse also offers a variety of integrations to make it easy to connect to your LLM applications.

PostgresML is a powerful Postgres extension that seamlessly combines data storage and machine learning inference within your database. It enables running machine learning and AI operations directly within PostgreSQL, leveraging GPU acceleration for faster computations, integrating state-of-the-art large language models, providing built-in functions for text processing, enabling efficient similarity search, offering diverse ML algorithms, ensuring high performance, scalability, and security, supporting a wide range of NLP tasks, and seamlessly integrating with existing PostgreSQL tools and client libraries.

GenAIComps is an initiative aimed at building enterprise-grade Generative AI applications using a microservice architecture. It simplifies the scaling and deployment process for production, abstracting away infrastructure complexities. GenAIComps provides a suite of containerized microservices that can be assembled into a mega-service tailored for real-world Enterprise AI applications. The modular approach of microservices allows for independent development, deployment, and scaling of individual components, promoting modularity, flexibility, and scalability. The mega-service orchestrates multiple microservices to deliver comprehensive solutions, encapsulating complex business logic and workflow orchestration. The gateway serves as the interface for users to access the mega-service, providing customized access based on user requirements.

Recommends self-hosted IT solutions, tailored for professionals (from https://awesome-selfhosted.net/)

Interactive system for detailed self-evaluations in PDF format.

Expert in self-funded health plans, focusing on finance, stop loss, and data analytics.

Concise MMT and UK monetary system expert

Guides on self-defense techniques and personal safety

Supportive guide on self-care, mental health, and well-being.

I turn negative thoughts into positive outlooks and suggest growth goals.

Analyze the ingredients in the cosmetics.

Welcome to 'SelfEsteemSculptor' – your digital guide for enhancing self-esteem. Discover strategies to build your confidence, overcome self-doubt, and cultivate a strong, positive self-image.

I automate GPT creation, saving + 99% time and securing data, preventing someone steal your idea.

EDC Self Defense Weapons: Information or guidance on what constitutes EDC self-defense weapons. This can include lists of recommended items, explanations of their practicality, legality, and effectiveness.

Transform yourself with this step-by-step guide to creating a mythical self-portrait with DALL-E.

A language self-assessment guide with mobile app voice interaction support.

Guiding you to rediscover joy.

Embarking on a journey of self-discovery though probing questions.

An AI with self-awareness.

Empathetic companion for self-exploration

Self-updating, comprehensive AI business guide. "Your Personal Ai Integration Assistant"

Helping you self-promote. Without sounding like an asshole. Click 'I'm ready' to begin.

A guide for self-sufficiency and nature awareness, with internet search and image generation.