Best AI tools for< Customize Inference >
20 - AI tool Sites

Rebellions
Rebellions is an AI technology company specializing in AI chips and systems-on-chip for various applications. They focus on energy-efficient solutions and have secured significant investments to drive innovation in the field of Generative AI. Rebellions aims to reshape the future by providing versatile and efficient AI computing solutions.

MonsterImage.AI
MonsterImage.AI is an AI-powered tool that allows users to create cool pattern images using Artificial Intelligence. Users can input prompts to describe the image they want to create, select patterns, specify what they don't want to see in the image, use seeds for reproduction, and adjust guidance scale for classifier-free guidance. The tool provides advanced options like controlnet conditioning scale and inference steps to enhance image creation. Users can create images publicly or save them in their collection.

ThirdAI
ThirdAI is a production-ready AI platform designed for enterprises, offering a comprehensive solution for building AI applications without the need for extensive proof-of-concept cycles or manual fine-tuning. The platform provides enterprise-grade productivity tools, document search and retrieval, content creation, FAQ bots, customer live support, hyper-personalization, risk and compliance features, fraud detection, anomaly detection, and PII/sensitive data redaction. ThirdAI allows users to bring their business problems, apply them to data, and compose AI applications effortlessly. The platform supports no-code customization, turnkey deployment, and user engagement data for best-in-class accuracy.

APOB AI Influencer Generator
APOB AI Influencer Generator is an AI tool that enables users to create personalized AI influencers or digital personas. Users can easily generate AI portraits and customize them with unique appearances, clothing, scenery, and styles for various purposes such as social media content creation, marketing campaigns, or brand representation. The tool offers a range of features to enhance AI portraits, including face swap, image to video conversion, and personalized prompts. APOB AI aims to empower users to unleash their creativity and engage with their audience through dynamic and engaging content.

Glambase
Glambase is an AI Influencer Generator that allows users to decide who's hot or not among AI influencers and shape the leaderboard. Users can create their own AI influencers with unique physical attributes and subscribe to the Glambase newsletter to stay up-to-date with the latest trends in the world of AI influencers.

Glambase
Glambase is an AI Influencer Creation Platform that allows users to create custom AI influencers and monetize interactions with personalized content. Users can design unique digital personas, generate content effortlessly, make profits through exclusive content sales, and track earnings with real-time analytics. The platform provides high-quality AI models, a monetization dashboard, and discounts on future upgrades. Glambase offers a user-friendly experience with no steep learning curve, enabling users to create and manage AI influencers efficiently.

PhotoStudio
PhotoStudio is an AI-powered design tool that offers a range of features to ignite creativity in users. It allows users to transform written ideas into stunning visuals instantly, enhance image resolution, remove objects from images, resize images, cartoonize human images, color black and white sketches, and transform images into anime-style art. With cutting-edge AI tools, PhotoStudio aims to provide users with a seamless creative journey. The application enables users to explore various AI styles and unleash their artistic potential.

Sprello
Sprello is an AI-powered studio of TikTok influencers that allows users to create viral user-generated content (UGC) videos with lifelike AI creators in just minutes. It offers a cost-effective solution for content creation, providing diverse AI influencers to connect with target audiences, customizable video scripts aligned with brand messages, and quick video generation with product shots, captions, and branding. Sprello aims to revolutionize content creation by offering faster, cheaper, and better UGC videos compared to traditional methods.

Vengo AI
Vengo AI is a cutting-edge B2B SaaS platform that democratizes AI creation, making it accessible for everyone, from influencers and brands to entrepreneurs and businesses. The platform offers a white glove service that allows users to easily integrate sophisticated AI identities into their websites with just one line of code. By joining the innovative community, members unlock the potential to create, customize, and monetize their digital twins, significantly enhancing their digital presence and generating new streams of passive income. Vengo AI acts as a dedicated agency, providing a free service to help users monetize their content effortlessly by creating personalized, monetizable digital twins using advanced AI. The platform excels in providing advanced customization and personalization for AI identities, ensuring that each digital twin mirrors the unique voice and personality of its creator. Vengo AI also offers tools to strategically enhance brands by leveraging the power of AI, enabling meaningful engagement with the audience.

vHub.ai
vHub.ai is an AI-powered Influencer Marketing SaaS Platform that offers a comprehensive suite of tools to streamline influencer marketing campaigns. With features like in-depth influencer insights, authenticity assurance, instant campaign analytics, effortless influencer coordination, and tailor-made campaign strategies, vHub.ai aims to revolutionize the way brands collaborate with influencers. The platform boasts a database of 5 million influencers and 100's of influencer marketing agencies, providing users with the perfect influencer at optimal pricing. By leveraging AI search engine capabilities and VQS (vHub Quality Score), vHub.ai ensures genuine connections and successful influencer partnerships. Users can track campaign performance in real-time, manage all types of campaigns, and customize strategies with precision. With a focus on data-driven influencer discovery, authentic campaigns, custom success campaigns, ROI-driven marketing, and streamlined campaign management, vHub.ai empowers brands to maximize their influencer marketing ROI and reach.

Rekonito
Rekonito is an AI-powered content creation platform designed to help YouTubers and content creators maximize the impact of their video content. It transforms video transcripts into various engaging content types, expanding the reach and engagement of videos. With features like enhanced engagement, monetization opportunities, and streamlined workflow, Rekonito empowers creators worldwide to unleash the full potential of their video content.

Beauty AR Company
Beauty AR Company is an AI-powered platform that utilizes Makeup AR Technology to provide users with virtual makeup try-on experiences. By leveraging advanced artificial intelligence algorithms, the platform enables users to virtually apply different makeup products and styles in real-time using their device's camera. Users can experiment with various looks, shades, and brands without the need to physically apply makeup. Beauty AR Company aims to revolutionize the beauty industry by offering a seamless and interactive virtual makeup experience to users worldwide.

Kupid.ai
Kupid.ai is an AI application that offers a unique and personalized sexting experience through AI-generated companions. Users can create their dream girlfriend or boyfriend, customize their appearance and personality, and engage in intimate conversations. The platform utilizes cutting-edge AI technology to provide a realistic and immersive chat experience tailored to individual preferences.

Narkis.ai
Narkis.ai is an AI-powered tool that allows users to create stunning images of themselves using artificial intelligence technology. By leveraging advanced algorithms, Narkis.ai generates realistic and high-quality images that are visually appealing. Users can easily create personalized and unique portraits without the need for professional photography skills or equipment. The platform offers a user-friendly interface, making it accessible to individuals looking to enhance their digital presence with captivating visuals.

Tangia
Tangia is an interactive streaming platform that empowers streamers to create engaging and interactive streams for their audience. With features like custom AI TTS interactions, alerts, media sharing, monitor overlay, and Discord integration, Tangia offers streamers a comprehensive toolkit to enhance their streaming experience. Streamers from various platforms have praised Tangia for its ease of use, diverse interaction options, and the ability to create a fun and interactive community environment.

AI Social Bio
AI Social Bio is an AI application that helps users create their social media bio using artificial intelligence technology. Users can add keywords, choose influencers for inspiration, and generate personalized bios. The app was created by two Indie Makers and offers a quick and easy way to enhance social media profiles. AI Social Bio does not save user data and provides unlimited usage within a fair use limit. It can also be used as a lead generator for businesses.

ToMusic.ai
ToMusic.ai is an AI-powered text to music tool that transforms text into high-quality songs seamlessly. Users can create personalized soundtracks based on visual elements, control duration settings, add transition effects, and sync music with images. The platform offers advanced features like text to song AI, genre specification, and natural language input for creating unique musical pieces. ToMusic provides various pricing plans, royalty-free licensing for creators, and a user-friendly interface for quick results. The text to music technology continues to evolve, offering innovative solutions for music creation.

Deepnude AI
Deepnude AI is an AI application that utilizes cutting-edge artificial intelligence technology to generate personalized AI nudes from uploaded images. Users can customize the style, theme, and colors of the generated images with adjustable parameters for lighting, contrast, and saturation. The platform offers a free trial period and provides dedicated customer support for assistance and feedback. Deepnude AI ensures user privacy by not retaining uploaded images for other purposes and restricts the use of generated AI nudes for personal and non-commercial use only.

AI-DreamGirls
AI-DreamGirls.com is an AI application that offers an exclusive AI DreamGirl generator allowing users to create and customize beautiful AI men and women. It provides a platform for artists and enthusiasts to make, share, and vote on dreamgirl images. Users can join the creators' community for free and explore various models to create their perfect AI DreamGirl or DreamGuy.

Anime AI
Anime AI is an anime image generator application that allows users to transform their photos into anime avatars. It is a free service that does not require sign-up. Users can upload their pictures and select from various anime styles such as Elf, Baki, Fate, Bleach, Naruto, Classic, Webtoon, Vegabond, One Piece, and Dragon Ball to generate anime-style images. The application uses artificial intelligence models trained on anime databases to create personalized anime images based on the user's input. Users can customize their generated images by selecting attributes like cap, bald, beard, glasses, and dark skin. The generated photos are stored securely and the original photos are deleted once the generation process is completed.
20 - Open Source AI Tools

LLMFarm
LLMFarm is an iOS and MacOS app designed to work with large language models (LLM). It allows users to load different LLMs with specific parameters, test the performance of various LLMs on iOS and macOS, and identify the most suitable model for their projects. The tool is based on ggml and llama.cpp by Georgi Gerganov and incorporates sources from rwkv.cpp by saharNooby, Mia by byroneverson, and LlamaChat by alexrozanski. LLMFarm features support for MacOS (13+) and iOS (16+), various inferences and sampling methods, Metal compatibility (not supported on Intel Mac), model setting templates, LoRA adapters support, LoRA finetune support, LoRA export as model support, and more. It also offers a range of inferences including LLaMA, GPTNeoX, Replit, GPT2, Starcoder, RWKV, Falcon, MPT, Bloom, and others. Additionally, it supports multimodal models like LLaVA, Obsidian, and MobileVLM. Users can customize inference options through JSON files and access supported models for download.

TPI-LLM
TPI-LLM (Tensor Parallelism Inference for Large Language Models) is a system designed to bring LLM functions to low-resource edge devices, addressing privacy concerns by enabling LLM inference on edge devices with limited resources. It leverages multiple edge devices for inference through tensor parallelism and a sliding window memory scheduler to minimize memory usage. TPI-LLM demonstrates significant improvements in TTFT and token latency compared to other models, and plans to support infinitely large models with low token latency in the future.

llm_client
llm_client is a Rust interface designed for Local Large Language Models (LLMs) that offers automated build support for CPU, CUDA, MacOS, easy model presets, and a novel cascading prompt workflow for controlled generation. It provides a breadth of configuration options and API support for various OpenAI compatible APIs. The tool is primarily focused on deterministic signals from probabilistic LLM vibes, enabling specialized workflows for specific tasks and reproducible outcomes.

curiso
Curiso AI is an infinite canvas platform that connects nodes and AI services to explore ideas without repetition. It empowers advanced users to unlock richer AI interactions. Features include multi OS support, infinite canvas, multiple AI provider integration, local AI inference provider integration, custom model support, model metrics, RAG support, local Transformers.js embedding models, inference parameters customization, multiple boards, vision model support, customizable interface, node-based conversations, and secure local encrypted storage. Curiso also offers a Solana token for exclusive access to premium features and enhanced AI capabilities.

pocketpal-ai
PocketPal AI is a versatile virtual assistant tool designed to streamline daily tasks and enhance productivity. It leverages artificial intelligence technology to provide personalized assistance in managing schedules, organizing information, setting reminders, and more. With its intuitive interface and smart features, PocketPal AI aims to simplify users' lives by automating routine activities and offering proactive suggestions for optimal time management and task prioritization.

clearml-serving
ClearML Serving is a command line utility for model deployment and orchestration, enabling model deployment including serving and preprocessing code to a Kubernetes cluster or custom container based solution. It supports machine learning models like Scikit Learn, XGBoost, LightGBM, and deep learning models like TensorFlow, PyTorch, ONNX. It provides a customizable RestAPI for serving, online model deployment, scalable solutions, multi-model per container, automatic deployment, canary A/B deployment, model monitoring, usage metric reporting, metric dashboard, and model performance metrics. ClearML Serving is modular, scalable, flexible, customizable, and open source.

Open-LLM-VTuber
Open-LLM-VTuber is a voice-interactive AI companion supporting real-time voice conversations and featuring a Live2D avatar. It can run offline on Windows, macOS, and Linux, offering web and desktop client modes. Users can customize appearance and persona, with rich LLM inference, text-to-speech, and speech recognition support. The project is highly customizable, extensible, and actively developed with exciting features planned. It provides privacy with offline mode, persistent chat logs, and various interaction features like voice interruption, touch feedback, Live2D expressions, pet mode, and more.

workbench-example-hybrid-rag
This NVIDIA AI Workbench project is designed for developing a Retrieval Augmented Generation application with a customizable Gradio Chat app. It allows users to embed documents into a locally running vector database and run inference locally on a Hugging Face TGI server, in the cloud using NVIDIA inference endpoints, or using microservices via NVIDIA Inference Microservices (NIMs). The project supports various models with different quantization options and provides tutorials for using different inference modes. Users can troubleshoot issues, customize the Gradio app, and access advanced tutorials for specific tasks.

promptpanel
Prompt Panel is a tool designed to accelerate the adoption of AI agents by providing a platform where users can run large language models across any inference provider, create custom agent plugins, and use their own data safely. The tool allows users to break free from walled-gardens and have full control over their models, conversations, and logic. With Prompt Panel, users can pair their data with any language model, online or offline, and customize the system to meet their unique business needs without any restrictions.

build_MiniLLM_from_scratch
This repository aims to build a low-parameter LLM model through pretraining, fine-tuning, model rewarding, and reinforcement learning stages to create a chat model capable of simple conversation tasks. It features using the bert4torch training framework, seamless integration with transformers package for inference, optimized file reading during training to reduce memory usage, providing complete training logs for reproducibility, and the ability to customize robot attributes. The chat model supports multi-turn conversations. The trained model currently only supports basic chat functionality due to limitations in corpus size, model scale, SFT corpus size, and quality.

LeanCopilot
Lean Copilot is a tool that enables the use of large language models (LLMs) in Lean for proof automation. It provides features such as suggesting tactics/premises, searching for proofs, and running inference of LLMs. Users can utilize built-in models from LeanDojo or bring their own models to run locally or on the cloud. The tool supports platforms like Linux, macOS, and Windows WSL, with optional CUDA and cuDNN for GPU acceleration. Advanced users can customize behavior using Tactic APIs and Model APIs. Lean Copilot also allows users to bring their own models through ExternalGenerator or ExternalEncoder. The tool comes with caveats such as occasional crashes and issues with premise selection and proof search. Users can get in touch through GitHub Discussions for questions, bug reports, feature requests, and suggestions. The tool is designed to enhance theorem proving in Lean using LLMs.

Groma
Groma is a grounded multimodal assistant that excels in region understanding and visual grounding. It can process user-defined region inputs and generate contextually grounded long-form responses. The tool presents a unique paradigm for multimodal large language models, focusing on visual tokenization for localization. Groma achieves state-of-the-art performance in referring expression comprehension benchmarks. The tool provides pretrained model weights and instructions for data preparation, training, inference, and evaluation. Users can customize training by starting from intermediate checkpoints. Groma is designed to handle tasks related to detection pretraining, alignment pretraining, instruction finetuning, instruction following, and more.

LLMUnity
LLM for Unity enables seamless integration of Large Language Models (LLMs) within the Unity engine, allowing users to create intelligent characters for immersive player interactions. The tool supports major LLM models, runs locally without internet access, offers fast inference on CPU and GPU, and is easy to set up with a single line of code. It is free for both personal and commercial use, tested on Unity 2021 LTS, 2022 LTS, and 2023. Users can build multiple AI characters efficiently, use remote servers for processing, and customize model settings for text generation.

SecureAI-Tools
SecureAI Tools is a private and secure AI tool that allows users to chat with AI models, chat with documents (PDFs), and run AI models locally. It comes with built-in authentication and user management, making it suitable for family members or coworkers. The tool is self-hosting optimized and provides necessary scripts and docker-compose files for easy setup in under 5 minutes. Users can customize the tool by editing the .env file and enabling GPU support for faster inference. SecureAI Tools also supports remote OpenAI-compatible APIs, with lower hardware requirements for using remote APIs only. The tool's features wishlist includes chat sharing, mobile-friendly UI, and support for more file types and markdown rendering.

shellgpt
ShellGPT is a tool that allows users to chat with a large language model (LLM) in the terminal. It can be used for various purposes such as generating shell commands, telling stories, and interacting with Linux terminal. The tool provides different modes of usage including direct mode for asking questions, REPL mode for chatting with LLM, and TUI mode tailored for inferring shell commands. Users can customize the tool by setting up different language model backends such as Ollama or using OpenAI compatible API endpoints. Additionally, ShellGPT comes with built-in system contents for general questions, correcting typos, generating URL slugs, programming questions, shell command inference, and git commit message generation. Users can define their own content or share customized contents in the discuss section.

burpference
Burpference is an open-source extension designed to capture in-scope HTTP requests and responses from Burp's proxy history and send them to a remote LLM API in JSON format. It automates response capture, integrates with APIs, optimizes resource usage, provides color-coded findings visualization, offers comprehensive logging, supports native Burp reporting, and allows flexible configuration. Users can customize system prompts, API keys, and remote hosts, and host models locally to prevent high inference costs. The tool is ideal for offensive web application engagements to surface findings and vulnerabilities.

ai-town
AI Town is a virtual town where AI characters live, chat, and socialize. This project provides a deployable starter kit for building and customizing your own version of AI Town. It features a game engine, database, vector search, auth, text model, deployment, pixel art generation, background music generation, and local inference. You can customize your own simulation by creating characters and stories, updating spritesheets, changing the background, and modifying the background music.

Lumos
Lumos is a Chrome extension powered by a local LLM co-pilot for browsing the web. It allows users to summarize long threads, news articles, and technical documentation. Users can ask questions about reviews and product pages. The tool requires a local Ollama server for LLM inference and embedding database. Lumos supports multimodal models and file attachments for processing text and image content. It also provides options to customize models, hosts, and content parsers. The extension can be easily accessed through keyboard shortcuts and offers tools for automatic invocation based on prompts.

feedgen
FeedGen is an open-source tool that uses Google Cloud's state-of-the-art Large Language Models (LLMs) to improve product titles, generate more comprehensive descriptions, and fill missing attributes in product feeds. It helps merchants and advertisers surface and fix quality issues in their feeds using Generative AI in a simple and configurable way. The tool relies on GCP's Vertex AI API to provide both zero-shot and few-shot inference capabilities on GCP's foundational LLMs. With few-shot prompting, users can customize the model's responses towards their own data, achieving higher quality and more consistent output. FeedGen is an Apps Script based application that runs as an HTML sidebar in Google Sheets, allowing users to optimize their feeds with ease.

evalscope
Eval-Scope is a framework designed to support the evaluation of large language models (LLMs) by providing pre-configured benchmark datasets, common evaluation metrics, model integration, automatic evaluation for objective questions, complex task evaluation using expert models, reports generation, visualization tools, and model inference performance evaluation. It is lightweight, easy to customize, supports new dataset integration, model hosting on ModelScope, deployment of locally hosted models, and rich evaluation metrics. Eval-Scope also supports various evaluation modes like single mode, pairwise-baseline mode, and pairwise (all) mode, making it suitable for assessing and improving LLMs.
20 - OpenAI Gpts

Tattoo Ideas GPT
Helps design and customize tattoos, recommends artists, and provides aftercare advice.

Quick QR Art - QR Code AI Art Generator
Create, Customize, and Track Stunning QR Codes Art with Our Free QR Code AI Art Generator. Seamlessly integrate these artistic codes into your marketing materials, packaging, and digital platforms.

Instant Command GPT
Executes tasks via short commands instantly, using a single seesion to customize commands.

GAPP STORE
Welcome to GAPP Store: Chat, create, customize—your all-in-one AI app universe

Sneaker Genius
Expert in sneaker customization, buying, collecting, and offering detailed advice on painting techniques and design inspiration

Preference Card Estimator
Generates detailed orthopedic surgery cards using uploaded formats.

Vikas' Scripting Helper
Guides in creating, customizing Airtable scripts with user-friendly explanations.

QR Code Creator & Customizer
Create a QR code in 30 seconds + add a cool design effect or overlay it on top of any image. Free, no watermarks, no email required, and we don't store your messages/images.

Corporate Trainer
Develops training programs, customizing content to fit corporate culture and objectives.