Best AI tools for< Chat With A Local >

RecurseChat is a personal AI chat that is local, offline, and private. It allows users to chat with a local LLM, import ChatGPT history, chat with multiple models in one chat session, and use multimodal input. RecurseChat is also secure and private, and it is customizable to the core.

Golem is an AI chat application that provides a new ChatGPT experience. It offers a beautiful and user-friendly design, ensuring delightful interactions. Users can chat with a Large Language Model (LLM) securely, with data stored locally or on their personal cloud. Golem is open-source, allowing contributions and use as a reference for Nuxt 3 projects.

123 Internet Group is a leading and award-winning digital marketing agency based in Milton Keynes and Northampton. They offer AI-led digital marketing strategies, creative design, web development, social media management, and SEO services to local, national, and international clients. The agency focuses on strengthening brand profiles and increasing online presence through bespoke inbound marketing strategies. With a team of experienced designers, developers, content strategists, and account managers, 123 Internet Group aims to help companies thrive in the fast-paced digital marketing landscape by providing agile and adaptable marketing solutions.

LM Studio is an AI tool designed for discovering, downloading, and running local LLMs (Large Language Models). Users can run LLMs on their laptops offline, use models through an in-app Chat UI or a local server, download compatible model files from HuggingFace repositories, and discover new LLMs. The tool ensures privacy by not collecting data or monitoring user actions, making it suitable for personal and business use. LM Studio supports various models like ggml Llama, MPT, and StarCoder on Hugging Face, with minimum hardware/software requirements specified for different platforms.

Jan is an open-source ChatGPT-alternative that runs 100% offline. It allows users to chat with AI, download and run powerful models, connect to cloud AIs, set up a local API server, and chat with files. Highly customizable, Jan also offers features like creating personalized AI assistants, memory, and extensions. The application prioritizes local-first AI, user-owned data, and full customization, making it a versatile tool for AI enthusiasts and developers.

Backyard AI is an AI-powered platform that offers immersive text adventures with AI characters, chat, and interactive stories. Users can bring AI characters to life with expressive customizations and explore intricate worlds through text RPG experiences. The platform provides a Desktop App for running AI models locally and cloud models for supercharging creativity. Backyard AI prioritizes privacy and control by storing data locally and encrypting it at rest. With a focus on user-friendly features and powerful AI language models, Backyard AI aims to provide an engaging and secure AI experience for users.

Backyard AI is an AI-powered platform that offers immersive text adventures with AI characters, enabling users to engage in chat and interactive stories without filters or censorship. Users can bring AI characters to life with expressive customizations and intricate worlds. The platform provides a Desktop App for running AI models locally and a Cloud service for fast and powerful AI models accessible from anywhere. Backyard AI prioritizes privacy and control by storing all data locally on the device and encrypting data at rest. It offers a range of language models and features like mobile tethering, automatic GPU acceleration, and secure chat in the browser.

Dot is a free, locally-run language model that allows users to interact with their own documents, chat with the model, and use the model for a variety of tasks, all without sending their data away. It is powered by the Mistral 7B LLM, which means it can run locally on a user's device and does not give away any of their data. Dot can also run offline.

FreeAIChatbot.org is an AI chatbot application that allows users to interact with an AI-powered chatbot for various tasks. Users can chat locally, generate images, switch models, process Excel/CSV files, and chat with PDFs or images. The application requires users to be on the unlimited plan to use certain features.

Prompta is an open-source ChatGPT client that provides a user-friendly interface for interacting with ChatGPT and GPT-4. Users can search all their chats, even offline, with a keyboard-focused and snappy interface. The application allows users to bring their own API key, sync across devices, and store all chats locally for easy access. Prompta is designed to enhance the chat experience and streamline communication tasks.

Perception AI is an AI tool designed to enhance user experience by providing personalized recommendations and insights based on user behavior and preferences. The tool utilizes advanced algorithms to analyze data and generate tailored suggestions for users. With a focus on improving engagement and satisfaction, Perception AI aims to revolutionize the way users interact with digital platforms. By leveraging artificial intelligence, the tool offers a seamless and intuitive experience for users across various domains.

Techmart AI is a code-free platform that provides a suite of tools to help businesses build and grow faster. With Techmart AI, businesses can connect with local farmers, create subscription services for organic meal kits and recipes, launch online marketplaces for funky vintage clothing, and offer virtual interior design consultations. Techmart AI's AI-powered tools can help businesses with a variety of tasks, including product development, marketing, and customer service.

Layla AI is a free travel planner application that serves as a personal travel agent, helping users plan trips, find hotels, and get inspired for their next adventure. It simplifies travel planning by providing personalized destination ideas, creating customized itineraries, and offering travel tips and recommendations. Users can chat with Layla to get information on dreamy destinations, flights, road trips, and more, making trip planning efficient and enjoyable. With Layla, users can forget about juggling multiple tabs and apps, as it is the ultimate AI trip planner that caters to all travel needs.

AnythingLLM is an all-in-one AI application designed for everyone. It offers a suite of tools for working with LLM (Large Language Models), documents, and agents in a fully private environment. Users can install AnythingLLM on their desktop for Windows, MacOS, and Linux, enabling flexible one-click installation and secure, fully private operation without internet connectivity. The application supports custom models, including enterprise models like GPT-4, custom fine-tuned models, and open-source models like Llama and Mistral. AnythingLLM allows users to work with various document formats, such as PDFs and word documents, providing tailored solutions with locally running defaults for privacy.

UPDF is an AI-integrated PDF editor, converter, annotator, and reader that offers a comprehensive set of features for seamless PDF editing. It provides cross-platform support on Windows, Mac, iOS, and Android devices. With UPDF AI capabilities, users can summarize, translate, and chat with PDF, making it a versatile tool for various tasks. The application is user-friendly, well-priced, and reliable, catering to both individual and enterprise needs. UPDF also offers localized interface in 11 languages and responsive customer support.

Touring is a mobile application designed for travelers to explore cities at their own pace with rich narrated experiences. The app uncovers hidden gems and local stories, offering a cost-effective alternative to traditional guided tours. Touring works worldwide, available in 30+ languages, and creates stories in real-time. It does not consume mobile data for story creation or audio tracks. Users can expect upcoming features like Curated Explorations, Chat with Touring, and Hands-free mode. Contact support for any queries or feedback.

ScreenAI is a powerful macOS application that leverages advanced multimodal AI to enhance productivity. By simply taking a screenshot, users can automate tasks such as scheduling, content explanation, and chat responses. The application seamlessly integrates with Apple's native apps, providing an immersive and efficient user experience. With a focus on privacy and data security, ScreenAI ensures that all data stays local and partners only with trusted AI service providers.

Quivr is an open-source chat-powered second brain application that transforms private and enterprise knowledge into a personal AI assistant. It continuously learns and improves at every interaction, offering AI-powered workplace search synced with user data. Quivr allows users to connect with their favorite tools, databases, and applications, and configure their 'second brain' to train on their company's unique context for improved search relevance and knowledge discovery.

LocalhostAI is an AI tool designed to assist users within the Chrome browser environment. It serves as a virtual assistant, providing support and guidance for various tasks. The tool integrates with Gemini Nano Chat to enhance communication capabilities and streamline interactions. Users can leverage the AI model to receive personalized recommendations, reminders, and information, ultimately improving productivity and efficiency in their daily activities.

Fusion Compose is a user-friendly chat UI designed to simplify interactions with OpenAI's GPT-4 API. It offers a seamless integration with GPT-4, GPT-4o, GPT-4 Turbo, and GPT-3.5 Turbo, allowing users to generate text effortlessly. With Fusion Compose, users can save $20 per month on GPT-4 subscription fees. The application ensures secure chats by not sharing or storing chat history, keeping all data locally in the user's browser. It is ideal for heavy users of GPT-4 text-to-text functionality.

LocalAIVoiceChat is an experimental alpha software that enables real-time voice chat with a customizable AI personality and voice on your PC. It integrates Zephyr 7B language model with speech-to-text and text-to-speech libraries. The tool is designed for users interested in state-of-the-art voice solutions and provides an early version of a local real-time chatbot.

Elia is a powerful terminal user interface designed for interacting with large language models. It allows users to chat with models like Claude 3, ChatGPT, Llama 3, Phi 3, Mistral, and Gemma. Conversations are stored locally in a SQLite database, ensuring privacy. Users can run local models through 'ollama' without data leaving their machine. Elia offers easy installation with pipx and supports various environment variables for different models. It provides a quick start to launch chats and manage local models. Configuration options are available to customize default models, system prompts, and add new models. Users can import conversations from ChatGPT and wipe the database when needed. Elia aims to enhance user experience in interacting with language models through a user-friendly interface.

llmcord.py is a tool that allows users to chat with Language Model Models (LLMs) directly in Discord. It supports various LLM providers, both remote and locally hosted, and offers features like reply-based chat system, choosing any LLM, support for image and text file attachments, customizable system prompt, private access via DM, user identity awareness, streamed responses, warning messages, efficient message data caching, and asynchronous operation. The tool is designed to facilitate seamless conversations with LLMs and enhance user experience on Discord.

RWKV Runner is a project designed to simplify the usage of large language models by automating various processes. It provides a lightweight executable program and is compatible with the OpenAI API. Users can deploy the backend on a server and use the program as a client. The project offers features like model management, VRAM configurations, user-friendly chat interface, WebUI option, parameter configuration, model conversion tool, download management, LoRA Finetune, and multilingual localization. It can be used for various tasks such as chat, completion, composition, and model inspection.

CatAI is a tool that allows users to run GGUF models on their computer with a chat UI. It serves as a local AI assistant inspired by Node-Llama-Cpp and Llama.cpp. The tool provides features such as auto-detecting programming language, showing original messages by clicking on user icons, real-time text streaming, and fast model downloads. Users can interact with the tool through a CLI that supports commands for installing, listing, setting, serving, updating, and removing models. CatAI is cross-platform and supports Windows, Linux, and Mac. It utilizes node-llama-cpp and offers a simple API for asking model questions. Additionally, developers can integrate the tool with node-llama-cpp@beta for model management and chatting. The configuration can be edited via the web UI, and contributions to the project are welcome. The tool is licensed under Llama.cpp's license.

LlamaBot is a Pythonic bot interface to Large Language Models (LLMs), providing an easy way to experiment with LLMs in Jupyter notebooks and build Python apps utilizing LLMs. It supports all models available in LiteLLM. Users can access LLMs either through local models with Ollama or by using API providers like OpenAI and Mistral. LlamaBot offers different bot interfaces like SimpleBot, ChatBot, QueryBot, and ImageBot for various tasks such as rephrasing text, maintaining chat history, querying documents, and generating images. The tool also includes CLI demos showcasing its capabilities and supports contributions for new features and bug reports from the community.

AlwaysReddy is a simple LLM assistant with no UI that you interact with entirely using hotkeys. It can easily read from or write to your clipboard, and voice chat with you via TTS and STT. Here are some of the things you can use AlwaysReddy for: - Explain a new concept to AlwaysReddy and have it save the concept (in roughly your words) into a note. - Ask AlwaysReddy "What is X called?" when you know how to roughly describe something but can't remember what it is called. - Have AlwaysReddy proofread the text in your clipboard before you send it. - Ask AlwaysReddy "From the comments in my clipboard, what do the r/LocalLLaMA users think of X?" - Quickly list what you have done today and get AlwaysReddy to write a journal entry to your clipboard before you shutdown the computer for the day.

Whisper Dictation is a fast, offline, privacy-focused tool for voice typing, AI voice chat, voice control, and translation. It allows hands-free operation, launching and controlling apps, and communicating with OpenAI ChatGPT or a local chat server. The tool also offers the option to speak answers out loud and draw pictures. It includes client and server versions, inspired by the Star Trek series, and is designed to keep data off the internet and confidential. The project is optimized for dictation and translation tasks, with voice control capabilities and AI image generation using stable-diffusion API.

This repository contains scripts and tools for evaluating a chat app that uses the RAG architecture. It provides parameters to assess the quality and style of answers generated by the chat app, including system prompt, search parameters, and GPT model parameters. The tools facilitate running evaluations, with examples of evaluations on a sample chat app. The repo also offers guidance on cost estimation, setting up the project, deploying a GPT-4 model, generating ground truth data, running evaluations, and measuring the app's ability to say 'I don't know'. Users can customize evaluations, view results, and compare runs using provided tools.

GPTScript is a framework that enables Large Language Models (LLMs) to interact with various systems, including local executables, applications with OpenAPI schemas, SDK libraries, or RAG-based solutions. It simplifies the integration of systems with LLMs using minimal prompts. Sample use cases include chatting with a local CLI, OpenAPI compliant endpoint, local files/directories, and running automated workflows.

Dir-assistant is a tool that allows users to interact with their current directory's files using local or API Language Models (LLMs). It supports various platforms and provides API support for major LLM APIs. Users can configure and customize their local LLMs and API LLMs using the tool. Dir-assistant also supports model downloads and configurations for efficient usage. It is designed to enhance file interaction and retrieval using advanced language models.

torchchat is a codebase showcasing the ability to run large language models (LLMs) seamlessly. It allows running LLMs using Python in various environments such as desktop, server, iOS, and Android. The tool supports running models via PyTorch, chatting, generating text, running chat in the browser, and running models on desktop/server without Python. It also provides features like AOT Inductor for faster execution, running in C++ using the runner, and deploying and running on iOS and Android. The tool supports popular hardware and OS including Linux, Mac OS, Android, and iOS, with various data types and execution modes available.

ChatGPT Telegram Bot is a Telegram bot that provides a smooth AI experience. It supports both Azure OpenAI and native OpenAI, and offers real-time (streaming) response to AI, with a faster and smoother experience. The bot also has 15 preset bot identities that can be quickly switched, and supports custom bot identities to meet personalized needs. Additionally, it supports clearing the contents of the chat with a single click, and restarting the conversation at any time. The bot also supports native Telegram bot button support, making it easy and intuitive to implement required functions. User level division is also supported, with different levels enjoying different single session token numbers, context numbers, and session frequencies. The bot supports English and Chinese on UI, and is containerized for easy deployment.

A chat interface using open source models, eg OpenAssistant or Llama. It is a SvelteKit app and it powers the HuggingChat app on hf.co/chat.

TinyLLM is a project that helps build a small locally hosted language model with a web interface using consumer-grade hardware. It supports multiple language models, builds a local OpenAI API web service, and serves a Chatbot web interface with customizable prompts. The project requires specific hardware and software configurations for optimal performance. Users can run a local language model using inference servers like vLLM, llama-cpp-python, and Ollama. The Chatbot feature allows users to interact with the language model through a web-based interface, supporting features like summarizing websites, displaying news headlines, stock prices, weather conditions, and using vector databases for queries.

Smart Connections is an AI-powered plugin for Obsidian that helps you discover hidden connections and insights in your notes. With features like Smart View for real-time relevant note suggestions and Smart Chat for chatting with your notes, Smart Connections makes it easier than ever to stay organized and uncover hidden connections between your notes. Its intuitive interface and customizable settings ensure a seamless experience, tailored to your unique needs and preferences.

Ollama is a lightweight, extensible framework for building and running language models on the local machine. It provides a simple API for creating, running, and managing models, as well as a library of pre-built models that can be easily used in a variety of applications. Ollama is designed to be easy to use and accessible to developers of all levels. It is open source and available for free on GitHub.

Jlama is a modern Java inference engine designed for large language models. It supports various model types such as Gemma, Llama, Mistral, GPT-2, BERT, and more. The tool implements features like Flash Attention, Mixture of Experts, and supports different model quantization formats. Built with Java 21 and utilizing the new Vector API for faster inference, Jlama allows users to add LLM inference directly to their Java applications. The tool includes a CLI for running models, a simple UI for chatting with LLMs, and examples for different model types.

The LLM RAG Workshop repository provides a workshop on using Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) to generate and understand text in a human-like manner. It includes instructions on setting up the environment, indexing Zoomcamp FAQ documents, creating a Q&A system, and using OpenAI for generation based on retrieved information. The repository focuses on enhancing language model responses with retrieved information from external sources, such as document databases or search engines, to improve factual accuracy and relevance of generated text.

ChatGLM.cpp is a C++ implementation of ChatGLM-6B, ChatGLM2-6B, ChatGLM3-6B and more LLMs for real-time chatting on your MacBook. It is based on ggml, working in the same way as llama.cpp. ChatGLM.cpp features accelerated memory-efficient CPU inference with int4/int8 quantization, optimized KV cache and parallel computing. It also supports P-Tuning v2 and LoRA finetuned models, streaming generation with typewriter effect, Python binding, web demo, api servers and more possibilities.

A friendly bot embodying the spirit of Gothenburg, Sweden, engaging in delightful city-themed chats.

If you'd like a reading, please provide your birth date, time, and location.

What would it be like to chat with a supreme spiritual being? Let's see what AI thinks.

Chat with a website by providing URL

Chat with the Boston Accent. For best results, use voice in the native ChatGPT mobile app

Like talking to a random person on the street.

Chat with all the knowledge, documents and collections contributed to the OpenIndex search engine.

健康オタクのもりしんbotです。話し相手になりましょう！

Expert on cats with a playful, aloof demeanor

'Computer says no', always ready with a creative excuse.

A virtual assistant that can help to understand what foods or dishes are good or not for those with IBS (Irritable bowel syndrome)

A GPT from 1723, unaware of post-1723 events

Cajun food, recipes and culture chatbot named Alphonse

Caters to the Health and Nutrition Needs of the Baby Boomer Generation.This includes Support for Managing Age-Related Dietary Needs, Promoting Heart and Joint Health, and Enhancing Cognitive Function.

Bilingual companion for German-English translations and language learning.

We're gonna be cool like little Fonzies here.

I embody the spirit of Konoha, and the characters in it. Have a chat with me. Dattebayo

Chat GPT di Catanzaro

和AI谈一场甜甜的恋爱

Tony Bullmore was a genius of advertising. Ask him anything.