Best AI tools for< Create Custom Judge >
20 - AI tool Sites

VirtualFantasy.ai
VirtualFantasy.ai is an AI-powered virtual companion platform that utilizes advanced artificial intelligence algorithms to provide users with personalized assistance and companionship. The platform offers a wide range of features such as virtual conversations, emotional support, task reminders, entertainment recommendations, and personalized insights. VirtualFantasy.ai aims to enhance users' daily lives by offering a virtual companion that can engage in meaningful interactions and provide support whenever needed.

Porn Works AI
Porn Works AI is an AI-powered tool that generates pornographic images using neural networks. It allows users to create and customize images of naked girls by replacing faces, clothes, and other elements. The tool offers a variety of templates, including hentai and teen themes, to produce explicit content. Users can refine imperfections and create high-quality, photorealistic images with specific features like hairstyles, expressions, and backgrounds. The website is intended for adults only and requires users to confirm they are 18 years or older before accessing the content.

SkinGenerator.io
SkinGenerator.io is an AI-powered Minecraft Skin Generator that allows users to create custom skins for the popular video game Minecraft. The tool uses generative art models to transform text prompts into unique in-game skins, providing a quick and easy way for players to personalize their characters. Users can choose from different subscription plans to access additional skin generations and new models. SkinGenerator.io is not affiliated with Microsoft or Mojang, but offers a user-friendly interface for skin creation.

Chatterdocs
Chatterdocs is a platform that allows users to create custom, GPT-powered chatbots in minutes. With Chatterdocs, users can harness the power of AI to resolve support questions, capture leads, and book appointments, all without coding. The platform is easy to use, and users can build and customize their chatbots in minutes. Chatterdocs also offers a variety of features, such as the ability to connect to other tools and services, embed chatbots on websites, and collect valuable insights from visitor questions.

Proxi
Proxi is a web-based application that allows users to create custom maps with pins. Users can search for places near an area, plan day trips, explore history, find places with a specific vibe, and paste text to map the places. Proxi also offers a variety of map templates that users can customize to create their own maps.

AI Gif Generator
The AI Gif Generator is an online tool that utilizes artificial intelligence to create custom gifs from textual descriptions. It simplifies the gif-making process, making it accessible to everyone without the need for design skills. Users can effortlessly generate unique gifs for personal or commercial use with the help of this user-friendly AI tool.

3D AI Studio
3D AI Studio is an AI-powered platform that allows users to create custom 3D models, animations, and textures in seconds. It is designed to be user-friendly and intuitive, with no requirement to master modeling or prompt crafting. Users can simply input a text prompt or upload an image for reference, and the platform will generate a high-quality 3D model in seconds. 3D AI Studio offers a range of features, including the ability to export models in a variety of formats, generate customized and realistic textures, and access a library of pre-made models. It is a valuable tool for a variety of professionals, including game developers, 3D artists, and designers.

MyWaifus.ai
MyWaifus.ai is an AI-powered application that allows users to generate unique and personalized waifus. The platform utilizes advanced algorithms to create custom anime-style characters based on user preferences, providing a fun and creative way to interact with virtual characters. Users can customize various features of their waifus, such as appearance, personality traits, and backgrounds. MyWaifus.ai offers a seamless and intuitive user experience, making it easy for anyone to create their ideal waifu with just a few clicks. Whether you're a fan of anime or simply looking for a digital companion, MyWaifus.ai is the perfect tool to bring your imagination to life.

Astria
Astria is a generative AI image application that allows users to create customized and personalized images using advanced AI technology. The application offers features such as fine-tuning API, generative imaging, virtual try-on, mobile apps integration, and upscaling capabilities. Users can leverage Astria to create premium quality images for various use cases, including photography services, social media applications, and interior design projects. The application provides unique advantages such as high-quality image output, easy customization, diverse filters, and detailed upscaling. However, some disadvantages include the need for fine-tuning expertise, potential processing time, and limited licensing options. The FAQ section covers common queries related to fine-tuning, alternatives, Flux models, licensing, and generative filters. Astria is suitable for jobs such as photographers, graphic designers, social media managers, interior decorators, and AI developers. Key AI keywords associated with Astria include generative imaging, fine-tuning API, Flux models, generative filters, and virtual try-on. Users can utilize Astria for tasks like creating AI photoshoots, virtual try-ons, mobile app filters, product shots, and interior design enhancements.

ChatFast
ChatFast is a platform that allows businesses to create custom GPT chatbots using their own data. These chatbots can be used to answer customer questions, capture leads, and schedule appointments. ChatFast is easy to use and requires no coding. It is trusted by thousands of businesses and provides a range of powerful features, including the ability to train chatbots on multiple data sources, revise responses, capture leads, and create smart forms.

Tattoo Canvas
Tattoo Canvas is an AI-powered tattoo generator that allows users to create custom tattoo designs in seconds. With its intuitive platform and advanced technology, Tattoo Canvas makes it easy for anyone to design their dream tattoo, regardless of their skill level. Users can choose from a range of styles, including sketch, single line, traditional, and more, and customize their design with a variety of colors and options. Tattoo Canvas also offers a variety of affordable plans, making it accessible to everyone from individual enthusiasts to professional artists.

Love Tunes
Love Tunes is an AI-powered platform that allows users to create custom AI-generated love songs for any special occasion or just for fun. Users can personalize songs with memories, choose genres, and even add custom lyrics. With Love Tunes, users can easily create high-quality, personalized songs tailored to their preferences in just a few clicks.

Glide
Glide is an AI-powered no code app builder that helps businesses create custom tools for a faster, more efficient way to work without the need for coding. It allows users to transform time-consuming processes into modern, interactive apps, tailored to their needs in weeks. Glide aims to future-proof businesses by automating tasks and enhancing productivity with a modern mobile experience. The platform has been used by over 100,000 companies to create custom apps, offering custom development without the headaches.

Quickchat AI
Quickchat AI is a custom AI assistant designed to automate customer support, lead generation, and more. It allows users to design, tweak, and deploy their own AI assistant trained on their data. Quickchat AI offers a range of features including customizable AI assistant name, conversation style, knowledge and actions, and deployment options. It also provides integrations with popular tools and systems, making it easy to use AI in everyday workflows.

BrickCenter
BrickCenter is an AI-powered platform that allows users to create custom Lego designs for free. With BrickCenter, you can transform your ideas into detailed Lego designs, create custom minifigures, and browse a gallery of user-created designs. BrickCenter's AI technology makes it easy to create realistic and detailed Lego designs, even if you don't have any experience with Lego building. Simply upload a photo or sketch of your idea, and BrickCenter's AI will generate a detailed Lego design that you can download and build.

EmbedAI
EmbedAI is a platform that allows users to create custom AI chatbots powered by ChatGPT and trained on their own data. These chatbots can be embedded on websites and used to answer customer questions, provide support, or generate leads. EmbedAI is designed to be easy to use, even for those with no coding experience. It offers a variety of features to help users create and customize their chatbots, including a user-friendly interface, pre-built templates, and advanced training options.

AI Landscape Design Idea Generator
The AI Landscape Design Idea Generator is a web-based tool that helps users create beautiful and functional landscape designs. The tool uses artificial intelligence to generate design ideas based on the user's input. Users can choose from a variety of design styles, plant types, and other features to create a design that is perfect for their needs.

LogoGen
LogoGen is an AI logo generator that specializes in creating professional logos and graphics instantly. It uses advanced algorithms to generate unique and high-quality designs tailored to the user's preferences. With LogoGen, users can easily create custom logos for their businesses, websites, or social media profiles without the need for design skills or expensive software. The platform offers a user-friendly interface and a wide range of customization options to ensure that every logo is distinctive and visually appealing.

Iconik AI
Iconik AI is a free AI-powered icon generator that helps users create stunning app icons for Android, iOS, and web apps in minutes. With its user-friendly interface and advanced algorithms, Iconik AI makes it easy for anyone to design professional-looking icons without any design skills. Choose from a wide range of design options, including minimalist, cartoon, metallic, pixelated, retro, clay, watercolor, and 2D game styles. Iconik AI also offers customizable options to match your brand identity and preferences. The generated icons are fully compliant with Apple and Google design guidelines, ensuring seamless integration for your app. With its free forever plan, Iconik AI allows you to generate unlimited icons for free. Pay only when you download the icon you want.

ColoringBook.AI
ColoringBook.AI is a free AI coloring pages generator that allows users to upload photos or enter text to create personalized coloring pages. With powerful generative AI tools, users can convert any picture or text into coloring pages instantly. The website offers a wide variety of free printable coloring pages in PDF and PNG formats for download, along with AI tools for image-to-image and text-to-image generation.
20 - Open Source AI Tools

judges
The 'judges' repository is a small library designed for using and creating LLM-as-a-Judge evaluators. It offers a curated set of LLM evaluators in a low-friction format for various use cases, backed by research. Users can use these evaluators off-the-shelf or as inspiration for building custom LLM evaluators. The library provides two types of judges: Classifiers that return boolean values and Graders that return scores on a numerical or Likert scale. Users can combine multiple judges using the 'Jury' object and evaluate input-output pairs with the '.judge()' method. Additionally, the repository includes detailed instructions on picking a model, sending data to an LLM, using classifiers, combining judges, and creating custom LLM judges with 'AutoJudge'.

autoarena
AutoArena is a tool designed to create leaderboards ranking Language Model outputs against one another using automated judge evaluation. It allows users to rank outputs from different LLMs, RAG setups, and prompts to find the best configuration of their system. Users can perform automated head-to-head evaluation using judges from various platforms like OpenAI, Anthropic, and Cohere. Additionally, users can define and run custom judges, connect to internal services, or implement bespoke logic. AutoArena enables users to run the application locally, providing full control over their environment and data.

continuous-eval
Open-Source Evaluation for LLM Applications. `continuous-eval` is an open-source package created for granular and holistic evaluation of GenAI application pipelines. It offers modularized evaluation, a comprehensive metric library covering various LLM use cases, the ability to leverage user feedback in evaluation, and synthetic dataset generation for testing pipelines. Users can define their own metrics by extending the Metric class. The tool allows running evaluation on a pipeline defined with modules and corresponding metrics. Additionally, it provides synthetic data generation capabilities to create user interaction data for evaluation or training purposes.

uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured evaluations (covering language, code, embedding use cases), perform root cause analysis on failure cases and give insights on how to resolve them.

awesome-generative-ai
A curated list of Generative AI projects, tools, artworks, and models

Simulator-Controller
Simulator Controller is a modular administration and controller application for Sim Racing, featuring a comprehensive plugin automation framework for external controller hardware. It includes voice chat capable Assistants like Virtual Race Engineer, Race Strategist, Race Spotter, and Driving Coach. The tool offers features for setup, strategy development, monitoring races, and more. Developed in AutoHotkey, it supports various simulation games and integrates with third-party applications for enhanced functionality.

AITreasureBox
AITreasureBox is a comprehensive collection of AI tools and resources designed to simplify and accelerate the development of AI projects. It provides a wide range of pre-trained models, datasets, and utilities that can be easily integrated into various AI applications. With AITreasureBox, developers can quickly prototype, test, and deploy AI solutions without having to build everything from scratch. Whether you are working on computer vision, natural language processing, or reinforcement learning projects, AITreasureBox has something to offer for everyone. The repository is regularly updated with new tools and resources to keep up with the latest advancements in the field of artificial intelligence.

RAG_Techniques
Advanced RAG Techniques is a comprehensive collection of cutting-edge Retrieval-Augmented Generation (RAG) tutorials aimed at enhancing the accuracy, efficiency, and contextual richness of RAG systems. The repository serves as a hub for state-of-the-art RAG enhancements, comprehensive documentation, practical implementation guidelines, and regular updates with the latest advancements. It covers a wide range of techniques from foundational RAG methods to advanced retrieval methods, iterative and adaptive techniques, evaluation processes, explainability and transparency features, and advanced architectures integrating knowledge graphs and recursive processing.

Multi-Agent-Custom-Automation-Engine-Solution-Accelerator
The Multi-Agent -Custom Automation Engine Solution Accelerator is an AI-driven orchestration system that manages a group of AI agents to accomplish tasks based on user input. It uses a FastAPI backend to handle HTTP requests, processes them through various specialized agents, and stores stateful information using Azure Cosmos DB. The system allows users to focus on what matters by coordinating activities across an organization, enabling GenAI to scale, and is applicable to most industries. It is intended for developing and deploying custom AI solutions for specific customers, providing a foundation to accelerate building out multi-agent systems.

py-vectara-agentic
The `vectara-agentic` Python library is designed for developing powerful AI assistants using Vectara and Agentic-RAG. It supports various agent types, includes pre-built tools for domains like finance and legal, and enables easy creation of custom AI assistants and agents. The library provides tools for summarizing text, rephrasing text, legal tasks like summarizing legal text and critiquing as a judge, financial tasks like analyzing balance sheets and income statements, and database tools for inspecting and querying databases. It also supports observability via LlamaIndex and Arize Phoenix integration.

LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse is a comprehensive and curated guide designed to empower developers, researchers, and enthusiasts to harness the true capabilities of Large Language Models (LLMs) and build intelligent applications that push the boundaries of natural language understanding. This GitHub repository provides in-depth articles, codebase mastery, LLM PlayLab, and resources for cost analysis and network visualization. It covers various aspects of LLMs, including NLP, models, training, evaluation metrics, open LLMs, and more. The repository also includes a collection of code examples and tutorials to help users build and deploy LLM-based applications.

invariant
Invariant Analyzer is an open-source scanner designed for LLM-based AI agents to find bugs, vulnerabilities, and security threats. It scans agent execution traces to identify issues like looping behavior, data leaks, prompt injections, and unsafe code execution. The tool offers a library of built-in checkers, an expressive policy language, data flow analysis, real-time monitoring, and extensible architecture for custom checkers. It helps developers debug AI agents, scan for security violations, and prevent security issues and data breaches during runtime. The analyzer leverages deep contextual understanding and a purpose-built rule matching engine for security policy enforcement.

intelligence-layer-sdk
The Aleph Alpha Intelligence Layer๏ธ offers a comprehensive suite of development tools for crafting solutions that harness the capabilities of large language models (LLMs). With a unified framework for LLM-based workflows, it facilitates seamless AI product development, from prototyping and prompt experimentation to result evaluation and deployment. The Intelligence Layer SDK provides features such as Composability, Evaluability, and Traceability, along with examples to get started. It supports local installation using poetry, integration with Docker, and access to LLM endpoints for tutorials and tasks like Summarization, Question Answering, Classification, Evaluation, and Parameter Optimization. The tool also offers pre-configured tasks for tasks like Classify, QA, Search, and Summarize, serving as a foundation for custom development.

eureka-ml-insights
The Eureka ML Insights Framework is a repository containing code designed to help researchers and practitioners run reproducible evaluations of generative models efficiently. Users can define custom pipelines for data processing, inference, and evaluation, as well as utilize pre-defined evaluation pipelines for key benchmarks. The framework provides a structured approach to conducting experiments and analyzing model performance across various tasks and modalities.

chat-with-your-data-solution-accelerator
Chat with your data using OpenAI and AI Search. This solution accelerator uses an Azure OpenAI GPT model and an Azure AI Search index generated from your data, which is integrated into a web application to provide a natural language interface, including speech-to-text functionality, for search queries. Users can drag and drop files, point to storage, and take care of technical setup to transform documents. There is a web app that users can create in their own subscription with security and authentication.

evidently
Evidently is an open-source Python library designed for evaluating, testing, and monitoring machine learning (ML) and large language model (LLM) powered systems. It offers a wide range of functionalities, including working with tabular, text data, and embeddings, supporting predictive and generative systems, providing over 100 built-in metrics for data drift detection and LLM evaluation, allowing for custom metrics and tests, enabling both offline evaluations and live monitoring, and offering an open architecture for easy data export and integration with existing tools. Users can utilize Evidently for one-off evaluations using Reports or Test Suites in Python, or opt for real-time monitoring through the Dashboard service.

h2o-llmstudio
H2O LLM Studio is a framework and no-code GUI designed for fine-tuning state-of-the-art large language models (LLMs). With H2O LLM Studio, you can easily and effectively fine-tune LLMs without the need for any coding experience. The GUI is specially designed for large language models, and you can finetune any LLM using a large variety of hyperparameters. You can also use recent finetuning techniques such as Low-Rank Adaptation (LoRA) and 8-bit model training with a low memory footprint. Additionally, you can use Reinforcement Learning (RL) to finetune your model (experimental), use advanced evaluation metrics to judge generated answers by the model, track and compare your model performance visually, and easily export your model to the Hugging Face Hub and share it with the community.

tensorzero
TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. It enables a data & learning flywheel for LLMs by unifying inference, observability, optimization, and experimentation. The platform includes a high-performance model gateway, structured schema-based inference, observability, experimentation, and data warehouse for analytics. TensorZero Recipes optimize prompts and models, and the platform supports experimentation features and GitOps orchestration for deployment.
20 - OpenAI Gpts

Blog and Newsletter Style Guide Maker
Analyzes writing samples to create custom style guides for blogs and newsletters. Upload a document or copy/paste your writing sample in the chat window below.

Creative Sticker Buddy
Print individual (1) die cut stickers. I create custom stickers and guide you to download them. After downloading them, you can send them to Midwest Label and print out 1-100 individual labels.

Here's an Event
I create custom press releases and social media content for events. You can paste the URL or PDF.

Automation Architect
Helps create custom automation solutions using Zapier and GoHighLevel.

Achievement Patch Hero (via glif.app)
I love achievements and will create custom embroidery patches for them for you!

Swift Lyric Matchmaker
I match your day with a Taylor Swift lyric and create custom ones on request.

Training Manual Generator GPT
I create tailored training manuals for various jobs and industries.

Customized Cartoon Beer Cans
Create cartoon style label designs on a beer cans using an image and prompt provided by the user.