Best AI tools for< Customize Local Models >

Jan is an open-source ChatGPT-alternative that runs 100% offline. It allows users to chat with AI, download and run powerful models, connect to cloud AIs, set up a local API server, and chat with files. Highly customizable, Jan also offers features like creating personalized AI assistants, memory, and extensions. The application prioritizes local-first AI, user-owned data, and full customization, making it a versatile tool for AI enthusiasts and developers.

Picovoice is an on-device Voice AI and local LLM platform designed for enterprises. It offers a range of voice AI and LLM solutions, including speech-to-text, noise suppression, speaker recognition, speech-to-index, wake word detection, and more. Picovoice empowers developers to build virtual assistants and AI-powered products with compliance, reliability, and scalability in mind. The platform allows enterprises to process data locally without relying on third-party remote servers, ensuring data privacy and security. With a focus on cutting-edge AI technology, Picovoice enables users to stay ahead of the curve and adapt quickly to changing customer needs.

Frigate is an open source NVR application that focuses on locally processed AI object detection for security camera monitoring. It allows users to run advanced analysis on their camera feeds without sending data to the cloud, reducing false positives and providing precise notifications. Frigate offers custom models with Frigate+ and integrates with popular home automation platforms for enhanced functionality.

CursorLens is an open-source dashboard designed to provide insights for AI-assisted coding within the Cursor.sh IDE. It allows users to log AI code generations, track usage, and control AI models, including local ones. Users can run CursorLens locally or utilize the upcoming hosted version for enhanced convenience and efficiency.

Xmind is an AI-powered mind mapping tool that offers seamless team collaboration. It provides a full-featured platform for creating mind maps and brainstorming, with intuitive features to spark creativity. Users can jot down ideas, organize thoughts, and customize mind maps with ease. Xmind also offers unique structures like Fishbone, Org Chart, and Timeline, along with features such as Outliner, ZEN Mode, and Pitch Mode for enhanced productivity. The tool prioritizes user privacy, with no monitoring or tracking of private data, ad-free experience, and local file storage for enhanced security. Xmind has garnered positive feedback from users worldwide, including educators, professionals, and students, who praise its simplicity, power, and effectiveness in various tasks.

Stable Diffusion is an AI art generation tool that allows users to create high-quality images from text descriptions. It offers a user-friendly platform for both beginners and experts to explore AI art creation without deep technical knowledge. The tool excels in producing complex, detailed, and customizable images, making it ideal for artists, designers, and anyone looking to integrate AI into their creative process. Stable Diffusion provides unprecedented creative freedom through features like image generation, inpainting, outpainting, and text-guided image-to-image translation.

Restack is a developer tool and cloud infrastructure platform that enables users to build, launch, and scale AI products quickly and efficiently. With Restack, developers can go from local development to production in seconds, leveraging a variety of languages and frameworks. The platform offers templates, repository connections, and Dockerfile customization for seamless deployment. Restack Cloud provides cost-efficient scaling and GitHub integration for instant deployment. The platform simplifies the complexity of building and scaling AI applications, allowing users to move from code to production faster than ever before.

AI Trip Expert is an AI-powered travel planning application that helps users easily plan and book their trips with personalized itineraries. The platform offers efficient itineraries, local insights, and flexible planning, enhancing travel experiences with less stress and more discovery. Users can skip extensive research and planning by letting the AI quickly generate comprehensive itineraries tailored to their interests and preferences. With diverse trip options and hassle-free planning, AI Trip Expert aims to provide users with a seamless and enjoyable travel experience.

Planitly is an AI-driven travel planning application that allows users to effortlessly create personalized travel itineraries in seconds. By inputting preferences such as destinations, budget, and activities, users can generate tailor-made travel plans with the help of Planitly's AI technology. The platform offers customizable preferences, personalized recommendations for accommodations and dining, and cost and rating suggestions to guide decision-making. Planitly aims to simplify the travel planning process and eliminate the overwhelm associated with traditional methods, providing users with expert local insights and hidden gems for a seamless travel experience.

Locales.ai is a fast and accurate AI-driven website and app localization service that simplifies global expansion for businesses. It offers instant translations, supreme accuracy, and exceptional cost savings by leveraging AI technology. The platform allows users to translate into 30+ languages without the need for a localization team, update translations in minutes, and achieve 99% accuracy with AI and industry databases. Locales.ai also provides a 3-step process for seamless localization, cross-platform sync, onboarding support, and easy migration of localization files. Users can customize terms, import translations efficiently, and set a reference language for multilingual accuracy. The platform is designed to help businesses unlock global sales potential with multilingual e-commerce solutions that resonate with local markets.

Travelicious is a user-friendly app that transforms how you experience cities. By integrating AI with your travel preferences, Travelicious creates personalized itineraries that promise authentic adventures, hidden gems, and the best culinary delights. Simply enter your destination, dates, budget, and interests, and Travelicious will recommend a personalized journey just for you.

Layla is an AI trip planner and travel itinerary application that helps users plan their vacations with personalized destination ideas, itinerary creation, and travel recommendations. Users can chat with Layla to get inspiration for their trips, watch inspiring video content, and create customized itineraries to make the most of their vacation days. Layla simplifies travel planning by providing a one-stop solution for trip organization and recommendations.

Echurn is an AI-driven tool designed to help SaaS businesses reduce churn and increase customer retention. It provides insights, suggestions, and customizable offers to prevent customer cancellations. With effortless integration and affordable pricing, Echurn aims to enhance SaaS MRR and CLV by leveraging advanced technology and data-driven decisions.

Hopbz is an AI-powered business ideas and opportunities generator that helps users generate tailored and unique business ideas based on local data. The platform leverages AI to provide customized insights and innovative solutions for users to make informed decisions and thrive in their market. With location-based insights and enhanced security features, Hopbz offers a comprehensive toolkit for users to refine, evaluate, and implement their business ideas. Whether you are an aspiring entrepreneur or an established business owner, Hopbz is designed to support you in identifying and realizing successful business opportunities.

OneAI's GPT Agent is a website enhancement tool that utilizes AI technology to transform a website into a proactive GPT agent, boosting engagement and sales. It empowers businesses to customize their agent, set goals and behaviors, and gain insights into user queries through powerful analytics. The agent is designed to guide users proactively, providing personalized responses based on the website's content and built-in fact-checking capabilities. It enables businesses to collect hot leads, understand customer interactions, and refine their offerings. With its ease of use, brands can effortlessly craft their AI, ensuring alignment with their brand voice and style. The GPT Agent is particularly valuable for eCommerce, SaaS companies, and enterprises, helping them convert website visitors into loyal buyers, qualified leads, and high-value prospects.

FlexClip is a powerful yet easy-to-use online video editing tool. With its extensive templates and resources, you can easily create high-quality videos for personal or business purposes without any learning curve.

SnapSite is an AI-powered website service that allows users to customize their website effortlessly. With its flat-rate all-in-one solution, there's no need for design, development, or marketing expertise. Users can simply send their request in natural language and SnapSite will deliver a stunning, highly functional website tailored to their specific needs.

My Hacker News is an AI-powered platform that offers a personalized daily dose of Hacker News through a customized newsletter. The platform utilizes AI algorithms, including Claude3.5 Sonnet and GPT-4o, to semantically index HN stories and comments daily, finding new stories matching users' interests and reranking them. Users receive a tailored newsletter directly in their inbox, saving time and keeping them informed. The platform allows users to shape their digest and offers a free digest email service without the need for sign up.

ChartAI is an AI tool that allows users to customize bar charts from screenshots. Users can upload their chart images, and ChartAI's visual recognition technology extracts the data to recreate the chart. Users can adjust the style, add or remove data, and change the chart type effortlessly. The tool simplifies the process of creating charts and provides quick updates based on user requests.

Triggs AI is an advanced AI tool designed to provide users with a seamless experience in customizing scrollbars. With its intuitive interface and powerful algorithms, Triggs AI allows users to personalize scrollbar designs effortlessly. Whether you are a web developer, designer, or enthusiast, Triggs AI offers a range of customization options to enhance the visual appeal of your websites. Say goodbye to standard scrollbars and hello to a new level of creativity with Triggs AI.

The ai-chat-local repository is a project that implements a local model customization using ollama, allowing data privacy and bypassing detection. It integrates with the esp32 development board to create a simple chat assistant. The project includes features like database integration for chat persistence, user recognition, and AI-based document processing. It also offers a graphical configuration tool for Dify.AI implementation.

model.nvim is a tool designed for Neovim users who want to utilize AI models for completions or chat within their text editor. It allows users to build prompts programmatically with Lua, customize prompts, experiment with multiple providers, and use both hosted and local models. The tool supports features like provider agnosticism, programmatic prompts in Lua, async and multistep prompts, streaming completions, and chat functionality in 'mchat' filetype buffer. Users can customize prompts, manage responses, and context, and utilize various providers like OpenAI ChatGPT, Google PaLM, llama.cpp, ollama, and more. The tool also supports treesitter highlights and folds for chat buffers.

GraphRAG Local with Interactive UI is an adaptation of Microsoft's GraphRAG, tailored to support local models and featuring a comprehensive interactive user interface. It allows users to leverage local models for LLM and embeddings, visualize knowledge graphs in 2D or 3D, manage files, settings, and queries, and explore indexing outputs. The tool aims to be cost-effective by eliminating dependency on costly cloud-based models and offers flexible querying options for global, local, and direct chat queries.

Elia is a powerful terminal user interface designed for interacting with large language models. It allows users to chat with models like Claude 3, ChatGPT, Llama 3, Phi 3, Mistral, and Gemma. Conversations are stored locally in a SQLite database, ensuring privacy. Users can run local models through 'ollama' without data leaving their machine. Elia offers easy installation with pipx and supports various environment variables for different models. It provides a quick start to launch chats and manage local models. Configuration options are available to customize default models, system prompts, and add new models. Users can import conversations from ChatGPT and wipe the database when needed. Elia aims to enhance user experience in interacting with language models through a user-friendly interface.

llm-colosseum is a tool designed to evaluate Language Model Models (LLMs) in real-time by making them fight each other in Street Fighter III. The tool assesses LLMs based on speed, strategic thinking, adaptability, out-of-the-box thinking, and resilience. It provides a benchmark for LLMs to understand their environment and take context-based actions. Users can analyze the performance of different LLMs through ELO rankings and win rate matrices. The tool allows users to run experiments, test different LLM models, and customize prompts for LLM interactions. It offers installation instructions, test mode options, logging configurations, and the ability to run the tool with local models. Users can also contribute their own LLM models for evaluation and ranking.

Local Multimodal AI Chat is a hands-on project that teaches you how to build a multimodal chat application. It integrates different AI models to handle audio, images, and PDFs in a single chat interface. This project is perfect for anyone interested in AI and software development who wants to gain practical experience with these technologies.

PowerPointer For Local LLMs is a PowerPoint generator that uses python-pptx and local llm's via the Oobabooga Text Generation WebUI api to create beautiful and informative presentations. It runs locally on your computer, eliminating privacy concerns. The tool allows users to select from 7 designs, make placeholders for images, and easily customize presentations within PowerPoint. Users provide information for the PowerPoint, which is then used to generate text using optimized prompts and the text generation webui api. The generated text is converted into a PowerPoint presentation using the python-pptx library.

LLM-Term is a Rust-based CLI tool that generates and executes terminal commands using OpenAI's language models or local Ollama models. It offers configurable model and token limits, works on both PowerShell and Unix-like shells, and provides a seamless user experience for generating commands based on prompts. Users can easily set up the tool, customize configurations, and leverage different models for command generation.

SystemSculpt AI is a comprehensive AI-powered plugin for Obsidian, integrating advanced AI capabilities into note-taking, task management, knowledge organization, and content creation. It offers modules for brain integration, chat conversations, audio recording and transcription, note templates, and task generation and management. Users can customize settings, utilize AI services like OpenAI and Groq, and access documentation for detailed guidance. The plugin prioritizes data privacy by storing sensitive information locally and offering the option to use local AI models for enhanced privacy.

GPTLint is a tool that utilizes Large Language Models (LLMs) to enforce higher-level best practices across a codebase. It offers features such as enforcing rules that are impossible with AST-based approaches, simple markdown format for rules, easy customization of rules, support for custom project-specific rules, content-based caching, and outputting LLM stats per run. GPTLint supports all major LLM providers and local models, augments ESLint instead of replacing it, and includes guidelines for creating custom rules. However, the MVP rules are currently limited to JS/TS only, single-file context only, and do not support autofixing.

The 'awesome-local-llms' repository is a curated list of open-source tools for local Large Language Model (LLM) inference, covering both proprietary and open weights LLMs. The repository categorizes these tools into LLM inference backend engines, LLM front end UIs, and all-in-one desktop applications. It collects GitHub repository metrics as proxies for popularity and active maintenance. Contributions are encouraged, and users can suggest additional open-source repositories through the Issues section or by running a provided script to update the README and make a pull request. The repository aims to provide a comprehensive resource for exploring and utilizing local LLM tools.

Ollama is a lightweight, extensible framework for building and running language models on the local machine. It provides a simple API for creating, running, and managing models, as well as a library of pre-built models that can be easily used in a variety of applications. Ollama is designed to be easy to use and accessible to developers of all levels. It is open source and available for free on GitHub.

Vision Parse is a tool that leverages Vision Language Models to parse PDF documents into beautifully formatted markdown content. It offers smart content extraction, content formatting, multi-LLM support, PDF document support, and local model hosting using Ollama. Users can easily convert PDFs to markdown with high precision and preserve document hierarchy and styling. The tool supports multiple Vision LLM providers like OpenAI, LLama, and Gemini for accuracy and speed, making document processing efficient and effortless.

VacAIgent is an AI tool that automates and enhances trip planning by leveraging the CrewAI framework. It integrates a user-friendly Streamlit interface for interactive travel planning. Users can input preferences and receive tailored travel plans with the help of autonomous AI agents. The tool allows for collaborative decision-making on cities and crafting complete itineraries based on specified preferences, all accessible via a streamlined Streamlit user interface. VacAIgent can be customized to use different AI models like GPT-3.5 or local models like Ollama for enhanced privacy and customization.

LlamaBot is a Pythonic bot interface to Large Language Models (LLMs), providing an easy way to experiment with LLMs in Jupyter notebooks and build Python apps utilizing LLMs. It supports all models available in LiteLLM. Users can access LLMs either through local models with Ollama or by using API providers like OpenAI and Mistral. LlamaBot offers different bot interfaces like SimpleBot, ChatBot, QueryBot, and ImageBot for various tasks such as rephrasing text, maintaining chat history, querying documents, and generating images. The tool also includes CLI demos showcasing its capabilities and supports contributions for new features and bug reports from the community.

ExtractThinker is a library designed for extracting data from files and documents using Language Model Models (LLMs). It offers ORM-style interaction between files and LLMs, supporting multiple document loaders such as Tesseract OCR, Azure Form Recognizer, AWS TextExtract, and Google Document AI. Users can customize extraction using contract definitions, process documents asynchronously, handle various document formats efficiently, and split and process documents. The project is inspired by the LangChain ecosystem and focuses on Intelligent Document Processing (IDP) using LLMs to achieve high accuracy in document extraction tasks.

PySpur is a graph-based editor designed for LLM (Large Language Models) workflows. It offers modular building blocks, node-level debugging, and performance evaluation. The tool is easy to hack, supports JSON configs for workflow graphs, and is lightweight with minimal dependencies. Users can quickly set up PySpur by cloning the repository, creating a .env file, starting docker services, and accessing the portal. PySpur can also work with local models served using Ollama, with steps provided for configuration. The roadmap includes features like canvas, async/batch execution, support for Ollama, new nodes, pipeline optimization, templates, code compilation, multimodal support, and more.

Burpference is an open-source extension designed to capture in-scope HTTP requests and responses from Burp's proxy history and send them to a remote LLM API in JSON format. It automates response capture, integrates with APIs, optimizes resource usage, provides color-coded findings visualization, offers comprehensive logging, supports native Burp reporting, and allows flexible configuration. Users can customize system prompts, API keys, and remote hosts, and host models locally to prevent high inference costs. The tool is ideal for offensive web application engagements to surface findings and vulnerabilities.

llmcord.py enables collaborative LLM prompting in your Discord server. It works with practically any LLM, remote or locally hosted. ### Features ### Reply-based chat system Just @ the bot to start a conversation and reply to continue. Build conversations with reply chains! You can do things like: - Build conversations together with your friends - "Rewind" a conversation simply by replying to an older message - @ the bot while replying to any message in your server to ask a question about it Additionally: - Back-to-back messages from the same user are automatically chained together. Just reply to the latest one and the bot will see all of them. - You can seamlessly move any conversation into a thread. Just create a thread from any message and @ the bot inside to continue. ### Choose any LLM Supports remote models from OpenAI API, Mistral API, Anthropic API and many more thanks to LiteLLM. Or run a local model with ollama, oobabooga, Jan, LM Studio or any other OpenAI compatible API server. ### And more: - Supports image attachments when using a vision model - Customizable system prompt - DM for private access (no @ required) - User identity aware (OpenAI API only) - Streamed responses (turns green when complete, automatically splits into separate messages when too long, throttled to prevent Discord ratelimiting) - Displays helpful user warnings when appropriate (like "Only using last 20 messages", "Max 5 images per message", etc.) - Caches message data in a size-managed (no memory leaks) and per-message mutex-protected (no race conditions) global dictionary to maximize efficiency and minimize Discord API calls - Fully asynchronous - 1 Python file, ~200 lines of code

PDFMathTranslate is a tool designed for translating scientific papers and conducting bilingual comparisons. It preserves formulas, charts, table of contents, and annotations. The tool supports multiple languages and diverse translation services. It provides a command-line tool, interactive user interface, and Docker deployment. Users can try the application through online demos. The tool offers various installation methods including command-line, portable, graphic user interface, and Docker. Advanced options allow users to customize translation settings. Additionally, the tool supports secondary development through APIs for Python and HTTP. Future plans include parsing layout with DocLayNet based models, fixing page rotation and format issues, supporting non-PDF/A files, and integrating plugins for Zotero and Obsidian.

A customized GPT model for price comparison would search and compare product prices on websites in Kuwait, tailored to local markets and languages.

Your go-to AI for a customized local news briefing. 🗞️ Stay informed with tailored updates, web searches, and digestible summaries!

Helps design and customize tattoos, recommends artists, and provides aftercare advice.

Create, Customize, and Track Stunning QR Codes Art with Our Free QR Code AI Art Generator. Seamlessly integrate these artistic codes into your marketing materials, packaging, and digital platforms.

I will help you develop, customize and launch your custom GPTs!

Executes tasks via short commands instantly, using a single seesion to customize commands.

Welcome to GAPP Store: Chat, create, customize—your all-in-one AI app universe

I generate themed video call backgrounds with a central focus.

Avatar customizer GPT

定制张家界旅行计划的旅游指南助手

Expert in sneaker customization, buying, collecting, and offering detailed advice on painting techniques and design inspiration

A virtual chef expert in customizing recipes, drink pairings, and cooking advice.

Adaptable Dead by Daylight expert, tailoring responses to player styles.

Adapts news tone for demographics

I create 3D doll head models from photos or descriptions.

Generates detailed orthopedic surgery cards using uploaded formats.

I create artistic EDM visuals and assist with video customization.

Customizes website project plans for various industries.

Guides in creating, customizing Airtable scripts with user-friendly explanations.

Create a QR code in 30 seconds + add a cool design effect or overlay it on top of any image. Free, no watermarks, no email required, and we don't store your messages/images.