Best AI tools for< Customize Inference Options >
20 - AI tool Sites

MonsterImage.AI
MonsterImage.AI is an AI-powered tool that allows users to create cool pattern images using Artificial Intelligence. Users can sign in to the platform and receive a link via email to log in. They can write a prompt to describe the image they want to create, select a pattern, specify negative prompts, use a seed for reproduction, adjust guidance scale, controlnet conditioning scale, and inference steps. The tool offers advanced options for creating images and allows users to save their creations in a public collection.

Glambase
Glambase is an AI Influencer Creation Platform that allows users to create personalized AI influencers with advanced customization options. Users can build virtual personas, interact with AI characters, and monetize their AI influencers. The platform offers a wide range of AI influencer models with diverse personalities and characteristics, catering to various preferences and needs of users. Glambase revolutionizes the way individuals engage with AI relationships and social media, providing a seamless and efficient solution for content creation and audience engagement.

Rebellions
Rebellions is an AI technology company specializing in AI chips and systems-on-chip for various applications. They focus on energy-efficient solutions and have secured significant investments to drive innovation in the field of Generative AI. Rebellions aims to reshape the future by providing versatile and efficient AI computing solutions.

Thirdai
Thirdai.com is an AI tool that offers a robot challenge screen for checking site connection security. The tool helps users assess the security of their website by requiring cookies to be enabled in the browser settings. It ensures that the connection is secure and provides recommendations for improving security measures.

vHub.ai
vHub.ai is an AI-powered Influencer Marketing SaaS Platform that offers a comprehensive suite of tools to streamline influencer marketing campaigns. With features like in-depth influencer insights, authenticity assurance, instant campaign analytics, effortless influencer coordination, and tailor-made campaign strategies, vHub.ai aims to revolutionize the way brands collaborate with influencers. The platform boasts a database of 5 million influencers and 100's of influencer marketing agencies, providing users with the perfect influencer at optimal pricing. By leveraging AI search engine capabilities and VQS (vHub Quality Score), vHub.ai ensures genuine connections and successful influencer partnerships. Users can track campaign performance in real-time, manage all types of campaigns, and customize strategies with precision. With a focus on data-driven influencer discovery, authentic campaigns, custom success campaigns, ROI-driven marketing, and streamlined campaign management, vHub.ai empowers brands to maximize their influencer marketing ROI and reach.

Journey.ai
Journey.ai is an AI application that offers personalized travel experiences through AI companions. Users can create their own AI travel agents with distinct personalities, receive tailored recommendations, and craft dynamic trip plans. The platform allows users to join a community of fellow travelers and shape their adventures. Journey.ai aims to revolutionize travel customization by providing exclusive privileges and rewards to its users.

FlexClip
FlexClip is a powerful yet easy-to-use online video editing tool. With its extensive templates and resources, you can easily create high-quality videos for personal or business purposes without any learning curve.

SnapSite
SnapSite is an AI-powered website service that allows users to customize their website effortlessly. With its flat-rate all-in-one solution, there's no need for design, development, or marketing expertise. Users can simply send their request in natural language and SnapSite will deliver a stunning, highly functional website tailored to their specific needs.

My Hacker News
My Hacker News is an AI-powered platform that offers a personalized daily dose of Hacker News through a customized newsletter. The platform utilizes AI algorithms, including Claude3.5 Sonnet and GPT-4o, to semantically index HN stories and comments daily, finding new stories matching users' interests and reranking them. Users receive a tailored newsletter directly in their inbox, saving time and keeping them informed. The platform allows users to shape their digest and offers a free digest email service without the need for sign up.

ChartAI
ChartAI is an AI tool that allows users to customize bar charts from screenshots. Users can upload their chart images, and ChartAI's visual recognition technology extracts the data to recreate the chart. Users can adjust the style, add or remove data, and change the chart type effortlessly. The tool simplifies the process of creating charts and provides quick updates based on user requests.

Triggs AI
Triggs AI is an advanced AI tool designed to provide users with a seamless experience in customizing scrollbars. With its intuitive interface and powerful algorithms, Triggs AI allows users to personalize scrollbar designs effortlessly. Whether you are a web developer, designer, or enthusiast, Triggs AI offers a range of customization options to enhance the visual appeal of your websites. Say goodbye to standard scrollbars and hello to a new level of creativity with Triggs AI.

OffRobe
OffRobe is a powerful NSFW AI image generator and editor that allows users to create and edit realistic and high-quality NSFW images with ease. The platform is designed with strong privacy and security measures to ensure that users' activities and data remain confidential. OffRobe's AI models offer a high level of customization, enabling users to bring their unique fantasies to life. With its user-friendly interface and advanced features, OffRobe is the perfect tool for anyone looking to explore the world of NSFW AI art.

Oda Moodboard
Oda Moodboard is an AI-powered tool that allows users to create mood boards for their home decor. With Oda Moodboard, users can choose their style and color preferences, and the AI will generate a mood board with matching images. Users can also upload their own photos to create a mood board. Oda Moodboard is a great way to get inspiration for your home decor, and it can help you to create a cohesive look for your home.

VERSA
VERSA is a text-based adventure game that allows users to choose their own adventure and customize their companion. Users can choose from a variety of settings, including sci-fi, wild-west, horror, drama, war, university, or fantasy. They can also choose a male, female, or non-binary companion to be their friend, romance, or enemy. VERSA is designed to push the limits of what's possible with a 1-gem model, while keeping it as entertaining as possible.

Quick QR Art
Quick QR Art is a free QR Code AI Art Generator that allows users to create, customize, and track stunning QR Codes Art. With Quick QR Art, users can easily generate QR Codes Art that are fully customizable, dynamic, and trackable. Quick QR Art also offers a comprehensive suite of link management tools, making it easy to manage and track all of your links in one place. Whether you're looking to create QR Codes Art for marketing, branding, or personal use, Quick QR Art has you covered.

Greetsapp
Greetsapp is an online platform that allows users to create and send personalized ecards for various occasions. It uses AI-powered writing tools to suggest the perfect words and phrases for each message, making it easy for users to create heartfelt and meaningful greetings. With Greetsapp, users can select from dozens of styles and generate a completely original work of art in seconds. They can also customize their greetings with their own images and messages. Greetsapp's ecards can be delivered via text or email within moments, making it a convenient way to stay connected with loved ones no matter the distance.

AI Song Generator
AI Song Generator is an AI-powered platform that simplifies the process of creating, customizing, and sharing unique songs. Users can define song parameters, generate music using AI capabilities, personalize tracks, and download/share their creations. The tool offers features like text-to-song conversion, lyrics generation, cover creation, voice cloning, and more. With a wide range of genres and moods available, users can easily create royalty-free music for various projects. AI Song Generator is designed to be user-friendly, accessible to all, and provides a seamless music creation experience.

Snowpixel
Snowpixel is a powerful AI-powered tool that allows users to create stunning images, videos, music, and more from just text. With Snowpixel, you can bring your imagination to life with ease. Whether you're a creative professional, a marketer, or simply someone who loves to express themselves, Snowpixel has something to offer you. With its user-friendly interface and wide range of features, Snowpixel makes it easy to create high-quality content that will captivate your audience.

AIPage.dev
AIPage.dev is an AI-powered landing page generator that simplifies web development by utilizing cutting-edge AI technology. It allows users to create stunning landing pages with just a single prompt, eliminating the need for hours of coding and designing. The platform offers features like AI-driven design, intuitive editing interface, seamless cloud deployment, rapid development, effortless blog post creation, unlimited hosting for blog posts, lead collection, and seamless integration with leading providers. AIPage.dev aims to transform ideas into reality and empower users to showcase their projects and products effectively.

HeadshotBooth.ai
HeadshotBooth.ai is a professional AI tool that offers AI-generated headshots in just a few hours, eliminating the need for in-person photoshoots. It provides a cost-effective and time-saving solution for social media, resumes, and professional portfolios. The application uses advanced AI technology to create high-quality headshots with various clothing, backgrounds, and poses to choose from, catering to professionals worldwide.
20 - Open Source AI Tools

LLMFarm
LLMFarm is an iOS and MacOS app designed to work with large language models (LLM). It allows users to load different LLMs with specific parameters, test the performance of various LLMs on iOS and macOS, and identify the most suitable model for their projects. The tool is based on ggml and llama.cpp by Georgi Gerganov and incorporates sources from rwkv.cpp by saharNooby, Mia by byroneverson, and LlamaChat by alexrozanski. LLMFarm features support for MacOS (13+) and iOS (16+), various inferences and sampling methods, Metal compatibility (not supported on Intel Mac), model setting templates, LoRA adapters support, LoRA finetune support, LoRA export as model support, and more. It also offers a range of inferences including LLaMA, GPTNeoX, Replit, GPT2, Starcoder, RWKV, Falcon, MPT, Bloom, and others. Additionally, it supports multimodal models like LLaVA, Obsidian, and MobileVLM. Users can customize inference options through JSON files and access supported models for download.

workbench-example-hybrid-rag
This NVIDIA AI Workbench project is designed for developing a Retrieval Augmented Generation application with a customizable Gradio Chat app. It allows users to embed documents into a locally running vector database and run inference locally on a Hugging Face TGI server, in the cloud using NVIDIA inference endpoints, or using microservices via NVIDIA Inference Microservices (NIMs). The project supports various models with different quantization options and provides tutorials for using different inference modes. Users can troubleshoot issues, customize the Gradio app, and access advanced tutorials for specific tasks.

TPI-LLM
TPI-LLM (Tensor Parallelism Inference for Large Language Models) is a system designed to bring LLM functions to low-resource edge devices, addressing privacy concerns by enabling LLM inference on edge devices with limited resources. It leverages multiple edge devices for inference through tensor parallelism and a sliding window memory scheduler to minimize memory usage. TPI-LLM demonstrates significant improvements in TTFT and token latency compared to other models, and plans to support infinitely large models with low token latency in the future.

llm_client
llm_client is a Rust interface designed for Local Large Language Models (LLMs) that offers automated build support for CPU, CUDA, MacOS, easy model presets, and a novel cascading prompt workflow for controlled generation. It provides a breadth of configuration options and API support for various OpenAI compatible APIs. The tool is primarily focused on deterministic signals from probabilistic LLM vibes, enabling specialized workflows for specific tasks and reproducible outcomes.

SecureAI-Tools
SecureAI Tools is a private and secure AI tool that allows users to chat with AI models, chat with documents (PDFs), and run AI models locally. It comes with built-in authentication and user management, making it suitable for family members or coworkers. The tool is self-hosting optimized and provides necessary scripts and docker-compose files for easy setup in under 5 minutes. Users can customize the tool by editing the .env file and enabling GPU support for faster inference. SecureAI Tools also supports remote OpenAI-compatible APIs, with lower hardware requirements for using remote APIs only. The tool's features wishlist includes chat sharing, mobile-friendly UI, and support for more file types and markdown rendering.

Lumos
Lumos is a Chrome extension powered by a local LLM co-pilot for browsing the web. It allows users to summarize long threads, news articles, and technical documentation. Users can ask questions about reviews and product pages. The tool requires a local Ollama server for LLM inference and embedding database. Lumos supports multimodal models and file attachments for processing text and image content. It also provides options to customize models, hosts, and content parsers. The extension can be easily accessed through keyboard shortcuts and offers tools for automatic invocation based on prompts.

Open-LLM-VTuber
Open-LLM-VTuber is a voice-interactive AI companion supporting real-time voice conversations and featuring a Live2D avatar. It can run offline on Windows, macOS, and Linux, offering web and desktop client modes. Users can customize appearance and persona, with rich LLM inference, text-to-speech, and speech recognition support. The project is highly customizable, extensible, and actively developed with exciting features planned. It provides privacy with offline mode, persistent chat logs, and various interaction features like voice interruption, touch feedback, Live2D expressions, pet mode, and more.

LLMUnity
LLM for Unity enables seamless integration of Large Language Models (LLMs) within the Unity engine, allowing users to create intelligent characters for immersive player interactions. The tool supports major LLM models, runs locally without internet access, offers fast inference on CPU and GPU, and is easy to set up with a single line of code. It is free for both personal and commercial use, tested on Unity 2021 LTS, 2022 LTS, and 2023. Users can build multiple AI characters efficiently, use remote servers for processing, and customize model settings for text generation.

LeanCopilot
Lean Copilot is a tool that enables the use of large language models (LLMs) in Lean for proof automation. It provides features such as suggesting tactics/premises, searching for proofs, and running inference of LLMs. Users can utilize built-in models from LeanDojo or bring their own models to run locally or on the cloud. The tool supports platforms like Linux, macOS, and Windows WSL, with optional CUDA and cuDNN for GPU acceleration. Advanced users can customize behavior using Tactic APIs and Model APIs. Lean Copilot also allows users to bring their own models through ExternalGenerator or ExternalEncoder. The tool comes with caveats such as occasional crashes and issues with premise selection and proof search. Users can get in touch through GitHub Discussions for questions, bug reports, feature requests, and suggestions. The tool is designed to enhance theorem proving in Lean using LLMs.

burpference
Burpference is an open-source extension designed to capture in-scope HTTP requests and responses from Burp's proxy history and send them to a remote LLM API in JSON format. It automates response capture, integrates with APIs, optimizes resource usage, provides color-coded findings visualization, offers comprehensive logging, supports native Burp reporting, and allows flexible configuration. Users can customize system prompts, API keys, and remote hosts, and host models locally to prevent high inference costs. The tool is ideal for offensive web application engagements to surface findings and vulnerabilities.

ai-town
AI Town is a virtual town where AI characters live, chat, and socialize. This project provides a deployable starter kit for building and customizing your own version of AI Town. It features a game engine, database, vector search, auth, text model, deployment, pixel art generation, background music generation, and local inference. You can customize your own simulation by creating characters and stories, updating spritesheets, changing the background, and modifying the background music.

PDFMathTranslate
PDFMathTranslate is a tool designed for translating scientific papers and conducting bilingual comparisons. It preserves formulas, charts, table of contents, and annotations. The tool supports multiple languages and diverse translation services. It provides a command-line tool, interactive user interface, and Docker deployment. Users can try the application through online demos. The tool offers various installation methods including command-line, portable, graphic user interface, and Docker. Advanced options allow users to customize translation settings. Additionally, the tool supports secondary development through APIs for Python and HTTP. Future plans include parsing layout with DocLayNet based models, fixing page rotation and format issues, supporting non-PDF/A files, and integrating plugins for Zotero and Obsidian.

ck
Collective Mind (CM) is a collection of portable, extensible, technology-agnostic and ready-to-use automation recipes with a human-friendly interface (aka CM scripts) to unify and automate all the manual steps required to compose, run, benchmark and optimize complex ML/AI applications on any platform with any software and hardware: see online catalog and source code. CM scripts require Python 3.7+ with minimal dependencies and are continuously extended by the community and MLCommons members to run natively on Ubuntu, MacOS, Windows, RHEL, Debian, Amazon Linux and any other operating system, in a cloud or inside automatically generated containers while keeping backward compatibility - please don't hesitate to report encountered issues here and contact us via public Discord Server to help this collaborative engineering effort! CM scripts were originally developed based on the following requirements from the MLCommons members to help them automatically compose and optimize complex MLPerf benchmarks, applications and systems across diverse and continuously changing models, data sets, software and hardware from Nvidia, Intel, AMD, Google, Qualcomm, Amazon and other vendors: * must work out of the box with the default options and without the need to edit some paths, environment variables and configuration files; * must be non-intrusive, easy to debug and must reuse existing user scripts and automation tools (such as cmake, make, ML workflows, python poetry and containers) rather than substituting them; * must have a very simple and human-friendly command line with a Python API and minimal dependencies; * must require minimal or zero learning curve by using plain Python, native scripts, environment variables and simple JSON/YAML descriptions instead of inventing new workflow languages; * must have the same interface to run all automations natively, in a cloud or inside containers. CM scripts were successfully validated by MLCommons to modularize MLPerf inference benchmarks and help the community automate more than 95% of all performance and power submissions in the v3.1 round across more than 120 system configurations (models, frameworks, hardware) while reducing development and maintenance costs.

evalscope
Eval-Scope is a framework designed to support the evaluation of large language models (LLMs) by providing pre-configured benchmark datasets, common evaluation metrics, model integration, automatic evaluation for objective questions, complex task evaluation using expert models, reports generation, visualization tools, and model inference performance evaluation. It is lightweight, easy to customize, supports new dataset integration, model hosting on ModelScope, deployment of locally hosted models, and rich evaluation metrics. Eval-Scope also supports various evaluation modes like single mode, pairwise-baseline mode, and pairwise (all) mode, making it suitable for assessing and improving LLMs.

minuet-ai.el
Minuet AI is a tool that brings the grace and harmony of a minuet to your coding process. It offers AI-powered code completion with specialized prompts and enhancements for chat-based LLMs, as well as Fill-in-the-middle (FIM) completion for compatible models. The tool supports multiple AI providers such as OpenAI, Claude, Gemini, Codestral, Ollama, and OpenAI-compatible providers. It provides customizable configuration options and streaming support for completion delivery even with slower LLMs.

model.nvim
model.nvim is a tool designed for Neovim users who want to utilize AI models for completions or chat within their text editor. It allows users to build prompts programmatically with Lua, customize prompts, experiment with multiple providers, and use both hosted and local models. The tool supports features like provider agnosticism, programmatic prompts in Lua, async and multistep prompts, streaming completions, and chat functionality in 'mchat' filetype buffer. Users can customize prompts, manage responses, and context, and utilize various providers like OpenAI ChatGPT, Google PaLM, llama.cpp, ollama, and more. The tool also supports treesitter highlights and folds for chat buffers.

llm.nvim
llm.nvim is a plugin for Neovim that enables code completion using LLM models. It supports 'ghost-text' code completion similar to Copilot and allows users to choose their model for code generation via HTTP requests. The plugin interfaces with multiple backends like Hugging Face, Ollama, Open AI, and TGI, providing flexibility in model selection and configuration. Users can customize the behavior of suggestions, tokenization, and model parameters to enhance their coding experience. llm.nvim also includes commands for toggling auto-suggestions and manually requesting suggestions, making it a versatile tool for developers using Neovim.

LlamaEdge
The LlamaEdge project makes it easy to run LLM inference apps and create OpenAI-compatible API services for the Llama2 series of LLMs locally. It provides a Rust+Wasm stack for fast, portable, and secure LLM inference on heterogeneous edge devices. The project includes source code for text generation, chatbot, and API server applications, supporting all LLMs based on the llama2 framework in the GGUF format. LlamaEdge is committed to continuously testing and validating new open-source models and offers a list of supported models with download links and startup commands. It is cross-platform, supporting various OSes, CPUs, and GPUs, and provides troubleshooting tips for common errors.

minuet-ai.nvim
Minuet AI is a Neovim plugin that integrates with nvim-cmp to provide AI-powered code completion using multiple AI providers such as OpenAI, Claude, Gemini, Codestral, and Huggingface. It offers customizable configuration options and streaming support for completion delivery. Users can manually invoke completion or use cost-effective models for auto-completion. The plugin requires API keys for supported AI providers and allows customization of system prompts. Minuet AI also supports changing providers, toggling auto-completion, and provides solutions for input delay issues. Integration with lazyvim is possible, and future plans include implementing RAG on the codebase and virtual text UI support.

monacopilot
Monacopilot is a powerful and customizable AI auto-completion plugin for the Monaco Editor. It supports multiple AI providers such as Anthropic, OpenAI, Groq, and Google, providing real-time code completions with an efficient caching system. The plugin offers context-aware suggestions, customizable completion behavior, and framework agnostic features. Users can also customize the model support and trigger completions manually. Monacopilot is designed to enhance coding productivity by providing accurate and contextually appropriate completions in daily spoken language.
20 - OpenAI Gpts

Tattoo Ideas GPT
Helps design and customize tattoos, recommends artists, and provides aftercare advice.

Quick QR Art - QR Code AI Art Generator
Create, Customize, and Track Stunning QR Codes Art with Our Free QR Code AI Art Generator. Seamlessly integrate these artistic codes into your marketing materials, packaging, and digital platforms.

Instant Command GPT
Executes tasks via short commands instantly, using a single seesion to customize commands.

GAPP STORE
Welcome to GAPP Store: Chat, create, customize—your all-in-one AI app universe

Sneaker Genius
Expert in sneaker customization, buying, collecting, and offering detailed advice on painting techniques and design inspiration

Preference Card Estimator
Generates detailed orthopedic surgery cards using uploaded formats.

Vikas' Scripting Helper
Guides in creating, customizing Airtable scripts with user-friendly explanations.

QR Code Creator & Customizer
Create a QR code in 30 seconds + add a cool design effect or overlay it on top of any image. Free, no watermarks, no email required, and we don't store your messages/images.

Corporate Trainer
Develops training programs, customizing content to fit corporate culture and objectives.