Best AI tools for< Self-host Llms >

n8n is a powerful workflow automation software and tools that offer advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-driven processes. The tool supports self-hosting, external libraries, and offers enterprise-ready solutions for scaling operations. n8n empowers users to code iteratively, explore advanced AI features, and create complex workflows with ease.

n8n is a powerful workflow automation software and tool that offers advanced AI capabilities. It is a popular platform for technical teams to automate workflows, integrate various services, and build autonomous agents. With over 400 integrations, n8n enables users to save time, streamline operations, and enhance security through AI-powered solutions. The tool supports self-hosting, external libraries, and a user-friendly interface for both coding and non-coding users.

Volamail is an AI-powered email platform that simplifies the email writing process for everyone. It offers AI-assisted editing to help users compose email templates effortlessly. The platform supports importing existing emails in plain HTML format and allows self-hosting for easy deployment. With Volamail, users can send transactional emails via a simple HTTP call without the need for dependencies. The platform is constantly evolving with new features like AI template generation, inline AI editing, and custom domains. Volamail provides simple and scalable pricing options, including a free plan for small projects and affordable custom plans for larger teams.

Bloombot is an AI-powered chat application that revolutionizes the learning experience. It offers a subversive and experimental AI tutor for free, allowing users to self-host their own version via the tutor-gpt repository on GitHub. Bloombot is developed by Plastic Labs and is at the forefront of novel machine learning research. The application aims to inform the future of learning by providing a unique and interactive platform for users to enhance their knowledge and skills.

AI Placeholder is a free AI-Powered Fake or Dummy Data API for testing and prototyping. It uses OpenAI API to generate dummy content. Users can directly use the hosted version or self-host it. The API allows users to generate fake or dummy content based on specific rules and retrieve data in various formats. It supports generating data for different content types like tweets, posts, and more, with customizable fields and number of records.

Vocal Image is an AI-powered coaching app that offers speech and communication lessons to help speakers and singers boost confidence and enhance the attractiveness of their voice. The app provides voice evaluations, educational content, specialized programs, and challenges designed to improve voice quality and communication skills. Users can record their voice, receive feedback from a community of voice enthusiasts, and engage with AI coach recommendations to achieve their voice goals.

Bibit AI is a real estate marketing AI designed to enhance the efficiency and effectiveness of real estate marketing and sales. It can help create listings, descriptions, and property content, and offers a host of other features. Bibit AI is the world's first AI for Real Estate. We are transforming the real estate industry by boosting efficiency and simplifying tasks like listing creation and content generation.

AIPEX is an AI tool for guest engagement, offering solutions for hotels, resorts, and vacation rentals. It provides a self-service virtual concierge that helps drive additional revenue, save time, and make guests smile by delivering personalized experiences. The tool enhances guest interactions, reduces operational costs, and increases occupancy rates through AI-driven features and communication capabilities.

Self-Introduction Generate AI is an innovative platform designed to assist individuals and businesses in crafting compelling and effective self-introductions. It leverages advanced AI technology to understand context and generate personalized content. The platform can analyze and understand various types of input, including text and context, to generate tailored self-introductions that are engaging and informative, enhancing personal and professional branding. With features like quick response times, quality assurance, and specialized service for self-introductions, it is an ideal tool for job applications, networking events, and personal branding initiatives.

Deepwander is an interactive self-exploration tool that helps you discover your strengths, weaknesses, and values. It uses a variety of AI-powered assessments to provide you with personalized insights and recommendations. With Deepwander, you can learn more about yourself and make better decisions about your career, relationships, and life.

Veezoo is a self-service analytics platform that uses AI and a semantic layer to make data accessible and understandable to everyone in an organization. It allows users to ask questions about their data in plain English and get instant insights. Veezoo also provides features such as dashboards, collaboration tools, and data governance to help businesses make better use of their data.

Neomind is a self-hypnosis application designed to unlock success, health, and happiness by transforming limiting beliefs. It offers tailored self-hypnosis sessions that speak directly to the subconscious, helping users achieve personal goals and overcome obstacles in various areas of life. The application provides expertly crafted audio experiences, including deep relaxation induction, breathing exercises, and progressive muscle relaxation, along with unique affirmations and suggestions focused on building confidence, achieving goals, and visualizing a successful future. Users can also access bonus sessions for comprehensive personal growth in finances, health, and relationships.

FindYourTriggers is an AI-powered self-awareness enhancer that helps users understand their behavior at the root, strengthen their mindset through self-awareness, and replace bad habits with positive actions. The application offers a three-step plan to enhance self-awareness by analyzing triggers, processing growth, and providing personalized challenges to overcome triggers. Users can journal digitally or physically, identify triggers, and work towards personal growth with the support of simulated conversations with a schema therapist.

OCU AI is a self-learning tool that helps you track your learning, earn badges for consuming educational content, and share your skills with the world. With OCU AI, you can keep track of all the things you learn online, get recognized for your learning, and showcase your skills to potential employers or clients.

Fabric is an AI-native workspace and file explorer for individuals and teams. It is a self-organizing tool that gathers your drives, clouds, notes, links, and files into one intelligent home. With Fabric, you can find anything fast, in natural language, chat with your data, and collaborate on any file or document. Thousands of creators, researchers, and thinkers from the world's biggest brands use Fabric to organize their digital world and work more efficiently.

GPT-me | Vana Chat is an AI tool that allows users to have conversations with themselves in the future, set in the year 3023. By leveraging the VNA technology and the Vanaverse, users can engage in dialogues with their future selves, offering a unique and futuristic experience. The platform serves as a portal to interact with a version of oneself from a distant future, enabling users to reflect, plan, and explore possibilities in a futuristic setting.

Ghola is a platform that leverages chatbot AI technology to facilitate introspection and personal development through personalized chat bots. Users can create multiple chat bots with different personalities, share them with others, and engage in group conversations. The platform aims to help individuals become more self-aware, make positive changes in their lives, and realize their full potential by providing a secure space for exploring thoughts and feelings. Ghola also offers customizable parameters, conversation showcase, backend API integration, and profile documents for a comprehensive chat bot experience.

Dropout Developer is an AI-powered platform dedicated to empowering self-taught programmers with personalized learning plans, expert guidance, and a supportive community. It offers over 100 AI tools tailored for coding and digital marketing needs. Users can access free resources, tutorials, and online courses to enhance their coding skills and build successful careers in technology.

ProWritingAid is an AI-powered writing assistant that helps writers improve their writing. It offers a range of features, including a grammar checker, plagiarism checker, and story critique tool. ProWritingAid is used by writers of all levels, from beginners to bestselling authors. It is available as a web app, desktop app, and browser extension.

ad:personam is an AI-powered Self Serve DSP platform for programmatic advertising, designed to empower businesses of any size to thrive in the programmatic advertising space. It offers a comprehensive suite of programmatic advertising solutions, cutting-edge AI-driven insights and planning tools, and transparent pricing. With features like multi-format ad uploads, cookieless targeting, and in-depth reporting, ad:personam aims to simplify programmatic advertising with AI efficiency and effectiveness.

LLM Zoomcamp is a free online course focusing on real-life applications of Large Language Models (LLMs). Over 10 weeks, participants will learn to build an AI bot capable of answering questions based on a knowledge base. The course covers topics such as LLMs, RAG, open-source LLMs, vector databases, orchestration, monitoring, and advanced RAG systems. Pre-requisites include comfort with programming, Python, and the command line, with no prior exposure to AI or ML required. The course features a pre-course workshop and is led by instructors Alexey Grigorev and Magdalena Kuhn, with support from sponsors and partners.

A collection of LLM services you can self host via docker or modal labs to support your applications development. The goal is to provide docker containers or modal labs deployments of common patterns when using LLMs and endpoints to integrate easily with existing codebases using the openai api. It supports GPT4all's embedding api, JSONFormer api for chat completion, Cross Encoders based on sentence transformers, and provides documentation using MkDocs.

Lunary is an open-source observability and prompt platform for Large Language Models (LLMs). It provides a suite of features to help AI developers take their applications into production, including analytics, monitoring, prompt templates, fine-tuning dataset creation, chat and feedback tracking, and evaluations. Lunary is designed to be usable with any model, not just OpenAI, and is easy to integrate and self-host.

GitIngest is a tool that allows users to turn any Git repository into a prompt-friendly text ingest for LLMs. It provides easy code context by generating a text digest from a git repository URL or directory. The tool offers smart formatting for optimized output format for LLM prompts and provides statistics about file and directory structure, size of the extract, and token count. GitIngest can be used as a CLI tool on Linux and as a Python package for code integration. The tool is built using Tailwind CSS for frontend, FastAPI for backend framework, tiktoken for token estimation, and apianalytics.dev for simple analytics. Users can self-host GitIngest by building the Docker image and running the container. Contributions to the project are welcome, and the tool aims to be beginner-friendly for first-time contributors with a simple Python and HTML codebase.

The 'nlp-llms-resources' repository is a comprehensive resource list for Natural Language Processing (NLP) and Large Language Models (LLMs). It covers a wide range of topics including traditional NLP datasets, data acquisition, libraries for NLP, neural networks, sentiment analysis, optical character recognition, information extraction, semantics, topic modeling, multilingual NLP, domain-specific LLMs, vector databases, ethics, costing, books, courses, surveys, aggregators, newsletters, papers, conferences, and societies. The repository provides valuable information and resources for individuals interested in NLP and LLMs.

Merlinn is an open-source AI-powered on-call engineer that automatically jumps into incidents & alerts, providing useful insights and RCA in real time. It integrates with popular observability tools, lives inside Slack, offers an intuitive UX, and prioritizes security. Users can self-host Merlinn, use it for free, and benefit from automatic RCA, Slack integration, integrations with various tools, intuitive UX, and security features.

Superflows is an open-source alternative to OpenAI's Assistant API. It allows developers to easily add an AI assistant to their software products, enabling users to ask questions in natural language and receive answers or have tasks completed by making API calls. Superflows can analyze data, create plots, answer questions based on static knowledge, and even write code. It features a developer dashboard for configuration and testing, stateful streaming API, UI components, and support for multiple LLMs. Superflows can be set up in the cloud or self-hosted, and it provides comprehensive documentation and support.

Admyral is an open-source Cybersecurity Automation & Investigation Assistant that provides a unified console for investigations and incident handling, workflow automation creation, automatic alert investigation, and next step suggestions for analysts. It aims to tackle alert fatigue and automate security workflows effectively by offering features like workflow actions, AI actions, case management, alert handling, and more. Admyral combines security automation and case management to streamline incident response processes and improve overall security posture. The tool is open-source, transparent, and community-driven, allowing users to self-host, contribute, and collaborate on integrations and features.

ChatGPT Next Web is a well-designed cross-platform ChatGPT web UI tool that supports Claude, GPT4, and Gemini Pro models. It allows users to deploy their private ChatGPT applications with ease. The tool offers features like one-click deployment, compact client for Linux/Windows/MacOS, compatibility with self-deployed LLMs, privacy-first approach with local data storage, markdown support, responsive design, fast loading speed, prompt templates, awesome prompts, chat history compression, multilingual support, and more.

Feeds Fun is a self-hosted news reader tool that automatically assigns tags to news entries. Users can create rules to score news based on tags, filter and sort news as needed, and track read news. The tool offers multi/single-user support, feeds management, and various features for personalized news consumption. Users can access the tool's backend as the ffun package on PyPI and the frontend as the feeds-fun package on NPM. Feeds Fun requires setting up OpenAI or Gemini API keys for full tag generation capabilities. The tool uses tag processors to detect tags for news entries, with options for simple and complex processors. Feeds Fun primarily relies on LLM tag processors from OpenAI and Google for tag generation.

Lecca.io is an AI platform that enables users to configure and deploy Large Language Models (LLMs) with customizable tools and workflows. Users can easily build, customize, and automate AI agents for various tasks. The platform offers features like custom LLM configuration, tool integration, workflow builder, built-in RAG functionalities, and the ability to create custom apps and triggers. Users can also automate LLMs by setting up triggers for autonomous operation. Lecca.io provides documentation for concepts, local development, creating custom apps, adding AI providers, and running Ollama locally. Contributions are welcome, and the platform is distributed under the Apache-2.0 License with Commons Clause, with enterprise features available under a Commercial License.

LitServe is a high-throughput serving engine designed for deploying AI models at scale. It generates an API endpoint for models, handles batching, streaming, and autoscaling across CPU/GPUs. LitServe is built for enterprise scale with a focus on minimal, hackable code-base without bloat. It supports various model types like LLMs, vision, time-series, and works with frameworks like PyTorch, JAX, Tensorflow, and more. The tool allows users to focus on model performance rather than serving boilerplate, providing full control and flexibility.

Helicone is an open-source observability platform designed for Language Learning Models (LLMs). It logs requests to OpenAI in a user-friendly UI, offers caching, rate limits, and retries, tracks costs and latencies, provides a playground for iterating on prompts and chat conversations, supports collaboration, and will soon have APIs for feedback and evaluation. The platform is deployed on Cloudflare and consists of services like Web (NextJs), Worker (Cloudflare Workers), Jawn (Express), Supabase, and ClickHouse. Users can interact with Helicone locally by setting up the required services and environment variables. The platform encourages contributions and provides resources for learning, documentation, and integrations.

Mem0 is a tool that provides a smart, self-improving memory layer for Large Language Models, enabling personalized AI experiences across applications. It offers persistent memory for users, sessions, and agents, self-improving personalization, a simple API for easy integration, and cross-platform consistency. Users can store memories, retrieve memories, search for related memories, update memories, get the history of a memory, and delete memories using Mem0. It is designed to enhance AI experiences by enabling long-term memory storage and retrieval.

Danswer is an open-source Gen-AI Chat and Unified Search tool that connects to your company's docs, apps, and people. It provides a Chat interface and plugs into any LLM of your choice. Danswer can be deployed anywhere and for any scale - on a laptop, on-premise, or to cloud. Since you own the deployment, your user data and chats are fully in your own control. Danswer is MIT licensed and designed to be modular and easily extensible. The system also comes fully ready for production usage with user authentication, role management (admin/basic users), chat persistence, and a UI for configuring Personas (AI Assistants) and their Prompts. Danswer also serves as a Unified Search across all common workplace tools such as Slack, Google Drive, Confluence, etc. By combining LLMs and team specific knowledge, Danswer becomes a subject matter expert for the team. Imagine ChatGPT if it had access to your team's unique knowledge! It enables questions such as "A customer wants feature X, is this already supported?" or "Where's the pull request for feature Y?"

AI File Organizer 2000 is an Obsidian Plugin that uses AI to transcribe audio, annotate images, and automatically organize files by moving them to the most likely folders. It supports text, audio, and images, with upcoming local-first LLM support. Users can simply place unorganized files into the 'Inbox' folder for automatic organization. The tool renames and moves files quickly, providing a seamless file organization experience. Self-hosting is also possible by running the server and enabling the 'Self-hosted' option in the plugin settings. Join the community Discord server for more information and use the provided iOS shortcut for easy access on mobile devices.

A curated list of 50+ resources to help you become a Generative AI Data Scientist. This repository includes resources on building GenAI applications with Large Language Models (LLMs), and deploying LLMs and GenAI with Cloud-based solutions.

Sweep is an AI junior developer that turns bugs and feature requests into code changes. It automatically handles developer experience improvements like adding type hints and improving test coverage.

Langfuse is a powerful tool that helps you develop, monitor, and test your LLM applications. With Langfuse, you can: * **Develop:** Instrument your app and start ingesting traces to Langfuse, inspect and debug complex logs, and manage, version, and deploy prompts from within Langfuse. * **Monitor:** Track metrics (cost, latency, quality) and gain insights from dashboards & data exports, collect and calculate scores for your LLM completions, run model-based evaluations, collect user feedback, and manually score observations in Langfuse. * **Test:** Track and test app behaviour before deploying a new version, test expected in and output pairs and benchmark performance before deploying, and track versions and releases in your application. Langfuse is easy to get started with and offers a generous free tier. You can sign up for Langfuse Cloud or deploy Langfuse locally or on your own infrastructure. Langfuse also offers a variety of integrations to make it easy to connect to your LLM applications.

PostgresML is a powerful Postgres extension that seamlessly combines data storage and machine learning inference within your database. It enables running machine learning and AI operations directly within PostgreSQL, leveraging GPU acceleration for faster computations, integrating state-of-the-art large language models, providing built-in functions for text processing, enabling efficient similarity search, offering diverse ML algorithms, ensuring high performance, scalability, and security, supporting a wide range of NLP tasks, and seamlessly integrating with existing PostgreSQL tools and client libraries.

Recommends self-hosted IT solutions, tailored for professionals (from https://awesome-selfhosted.net/)

Interactive system for detailed self-evaluations in PDF format.

Expert in self-funded health plans, focusing on finance, stop loss, and data analytics.

Concise MMT and UK monetary system expert

Guides on self-defense techniques and personal safety

Supportive guide on self-care, mental health, and well-being.

I turn negative thoughts into positive outlooks and suggest growth goals.

Analyze the ingredients in the cosmetics.

Welcome to 'SelfEsteemSculptor' – your digital guide for enhancing self-esteem. Discover strategies to build your confidence, overcome self-doubt, and cultivate a strong, positive self-image.

I automate GPT creation, saving + 99% time and securing data, preventing someone steal your idea.

EDC Self Defense Weapons: Information or guidance on what constitutes EDC self-defense weapons. This can include lists of recommended items, explanations of their practicality, legality, and effectiveness.

Transform yourself with this step-by-step guide to creating a mythical self-portrait with DALL-E.

A language self-assessment guide with mobile app voice interaction support.

Guiding you to rediscover joy.

Embarking on a journey of self-discovery though probing questions.

An AI with self-awareness.

Empathetic companion for self-exploration

Self-updating, comprehensive AI business guide. "Your Personal Ai Integration Assistant"

Helping you self-promote. Without sounding like an asshole. Click 'I'm ready' to begin.

A guide for self-sufficiency and nature awareness, with internet search and image generation.