Best AI tools for< Add New Evaluation Tools >
20 - AI tool Sites
Retoucher Online
Retoucher Online is a free online background remover tool that allows users to remove the background from images quickly and easily. The tool is powered by artificial intelligence (AI) and can be used to remove the background from images of people, products, graphics, and cars. Retoucher Online is a great tool for creating professional-looking images for use on websites, social media, and other marketing materials.
BookAI.chat
BookAI.chat is an AI-powered application that allows users to chat with their books using Artificial Intelligence technology. Users can interact with any book by providing just the title and author's name. The application leverages the advanced capabilities of GPT-3 and GPT-4 to provide a seamless and engaging chat experience. With support for over 30 languages, users can communicate with their books in their native language or the language they are learning. BookAI.chat simplifies the process of adding new books to the library by requiring only basic information. It also offers the option to add book covers, enhancing the overall experience.
Aruarian
Aruarian is an AI-powered task management tool that makes task management easy. It can add new todos for you, create lists for you, and find you specific information on the fly. Aruarian is still in its early days, but it is already a powerful tool that can help you save time and be more productive.
iFoto
iFoto is an AI-powered photo editing tool that helps e-commerce businesses create high-quality product images. With iFoto, you can remove backgrounds, add new backgrounds, change clothing colors, and more. iFoto is easy to use and affordable, making it a great option for businesses of all sizes.
Raw Query
Raw Query is a revolutionary tool that allows you to interact with your database using natural language, just like you would chat with a colleague. It's designed to save you time and effort, and make it easier than ever to access and manage your data. With Raw Query, you can query your data, add new data, and update your data, all through a simple chat interface. It's the perfect tool for anyone who wants to get more out of their data, without having to learn complex SQL queries or spend hours building custom tools.
LipDub AI
LipDub AI is an advanced AI tool that offers the most realistic AI lip sync and video translation capabilities. It allows users to add new audio to any video and perfectly lip syncs to match, delivering high-quality results. The tool is developed by an experienced in-house research team, led by Chief Scientist Daniel Cohen-Or, ensuring unmatched realism and quality in video content production. LipDub AI also enables users to localize video content into any language, replace dialogue effortlessly, and personalize content for various audiences, making it a versatile and powerful tool for creators and marketers alike.
Cheerlink AI Inbox & Sales
Cheerlink is an AI application that offers a proactive AI shop assistant to help businesses convert and delight customers effortlessly. It provides conversational AI capabilities, AI product recommendations, and personalized support to enhance customer experience. Cheerlink integrates seamlessly with Shopify, supports multiple languages, and offers features like AI notes, customizable widgets, and built-in Shopify actions. The application is praised for its ease of use, quick setup, and continuous updates to add new functionalities.
GitWit
GitWit is an online tool that helps you build web apps quickly and easily, even if you don't have any coding experience. With GitWit, you can create a React app in minutes, and you can use AI to augment your own coding skills. GitWit supports React, Tailwind, and NodeJS, and it has generated over 1000 projects to date. GitWit can help you build any type of web app, from simple landing pages to complex e-commerce stores.
Alva Solutions
Alva Solutions is an AI-powered browser extension application that aims to simplify browsing experience by providing a range of AI browser extensions. The application offers diverse browser extensions such as Alva AI, Alva Network, and Snap AI, each designed to enhance productivity and streamline tasks. Users can benefit from features like AI-powered assistance, network insights, and voice recording capabilities. Alva Solutions prioritizes user privacy and data security, offering a safe environment with premium protection features. With a user-friendly interface and intuitive dashboard, users can easily manage and control their extensions. The application also fosters a community environment through various social media platforms, providing users with updates, tutorials, and engaging discussions.
Facts Generator AI
Facts Generator AI is a free innovative online tool designed to quench the thirst for knowledge of curious minds across the globe. This cutting-edge platform harnesses the power of artificial intelligence to generate accurate, interesting, and diverse facts about a wide array of subjects ranging from the mysteries of the universe to historical events, scientific discoveries, cultural nuances, and much more. Whether you're a student seeking to broaden your horizons, a teacher looking to enrich your lessons, a content creator in search of inspiration, or simply a trivia enthusiast eager to learn something new every day, Facts Generator AI is tailored to meet your needs. With an intuitive interface and a sophisticated AI at its core, this tool offers a seamless and engaging experience, making the exploration of knowledge both effortless and fascinating.
PS2filter.me
PS2filter.me is an AI-powered tool that allows users to transform their photos into images that resemble PS2 video game graphics. It is powered by the same AI technology as Replicate's Face to Many filter, but with some improvements to make it more fun and engaging. Users can simply select a photo from their camera roll or snap a new one, and the AI will apply the PS2 effect to their image seamlessly. They can then share their new look on social media or with their friends to show off their retro style.
WebPilot
WebPilot is an AI tool designed to enhance your GPTs by enabling them to perform various tasks such as opening URL/file links, using multiple search engines, accessing all types of websites, loading dynamic web content, and providing enhanced answers. It offers a super easy way to interact with webpages, assisting in tasks like responding to emails, writing in forms, and solving quizzes. WebPilot is free, open-source, and has been featured by Google Extension Store as an established publisher.
WritePanda
WritePanda is an innovative SaaS solution designed to streamline communication and optimize team collaboration, all while preserving the personal touch that fuels creativity and fosters camaraderie. Its cutting-edge AI technology transforms videos and podcasts into engaging and shareable content across various platforms, including blogs, newsletters, tweets, and viral clips. With WritePanda, users can save time, expand their reach, and captivate new audiences with the help of intelligent algorithms that ensure quality and relevance.
ChatGPT for Outlook
ChatGPT for Outlook is an AI tool that integrates the power of ChatGPT into Microsoft Outlook, allowing users to run ChatGPT on emails to generate summaries or highlights based on custom prompts. Users can manage multiple configurations, process specific parts of emails, and update email importance based on generated output. Blueberry Consultants, the developer, offers custom versions for businesses to resell with unique prompts, turning ideas into profitable ventures.
Peqaboo
Peqaboo is an AI-powered pet social app designed to help pet owners with various aspects of pet care. The app allows users to ask Boo AI questions about their pets, identify toxic plants or foods, and receive instant answers based on their pet's profile. Peqaboo also offers a feature to train a new Boo AI, enabling users to transform their knowledge into AI tools. The app aims to make pet life easier and more enjoyable by providing personalized pet care advice and fostering a global pet community.
Crayo
Crayo is an AI-powered tool that helps users create short videos quickly and easily. With Crayo, users can generate captions, effects, background music, and even voiceovers for their videos, all with just a few clicks. Crayo is perfect for users who want to create engaging and shareable videos for social media, marketing, or any other purpose.
Quick Dreamviz
Quick Dreamviz is an instant dream home visualization tool that allows users to redesign their rooms using AI technology. With just a few clicks, users can upload a photo of their room, select a room type and theme, and watch as the AI generates a new design. Quick Dreamviz is perfect for anyone who wants to see how their dream home will look before it becomes a reality.
Toodle
Toodle is a productivity tool designed to help users efficiently manage their tasks and schedules. With Toodle, users can create to-do lists, set reminders, and prioritize tasks to stay organized and on track. The user-friendly interface makes it easy to add, edit, and delete tasks, while the calendar view provides a clear overview of upcoming deadlines and events. Toodle also offers collaboration features, allowing users to share tasks and projects with team members or family members. Whether you're a student, professional, or busy parent, Toodle can help you stay productive and focused.
My AskAI
My AskAI is an AI-powered customer support tool that integrates with Intercom. It offers a more affordable alternative to Intercom's Fin AI chatbot, costing only $0.19 per AI resolution compared to Intercom's $0.99. My AskAI allows businesses to add AI customer support to their Intercom workspace without replacing their existing widget or training their team on a new tool. Businesses can choose how they want their AI chatbot to reply, either directly to customers or as 'notes' for their agents. My AskAI also supports human handover for when a human touch is needed.
Times of My Life
The 'Times of My Life' app is an AI-powered storytelling tool designed to help users capture, share, and preserve their life stories. Users can be interviewed about important life events, milestones, and memories, and the virtual biographer will write and edit the stories in minutes, complete with photos and video clips. The app allows users to add narration and music, and instantly publish the stories in various formats. It aims to celebrate meaningful life experiences, preserve legacies, and offer a unique way to share stories with loved ones.
20 - Open Source AI Tools
evalverse
Evalverse is an open-source project designed to support Large Language Model (LLM) evaluation needs. It provides a standardized and user-friendly solution for processing and managing LLM evaluations, catering to AI research engineers and scientists. Evalverse supports various evaluation methods, insightful reports, and no-code evaluation processes. Users can access unified evaluation with submodules, request evaluations without code via Slack bot, and obtain comprehensive reports with scores, rankings, and visuals. The tool allows for easy comparison of scores across different models and swift addition of new evaluation tools.
llms-tools
The 'llms-tools' repository is a comprehensive collection of AI tools, open-source projects, and research related to Large Language Models (LLMs) and Chatbots. It covers a wide range of topics such as AI in various domains, open-source models, chats & assistants, visual language models, evaluation tools, libraries, devices, income models, text-to-image, computer vision, audio & speech, code & math, games, robotics, typography, bio & med, military, climate, finance, and presentation. The repository provides valuable resources for researchers, developers, and enthusiasts interested in exploring the capabilities of LLMs and related technologies.
opencompass
OpenCompass is a one-stop platform for large model evaluation, aiming to provide a fair, open, and reproducible benchmark for large model evaluation. Its main features include: * Comprehensive support for models and datasets: Pre-support for 20+ HuggingFace and API models, a model evaluation scheme of 70+ datasets with about 400,000 questions, comprehensively evaluating the capabilities of the models in five dimensions. * Efficient distributed evaluation: One line command to implement task division and distributed evaluation, completing the full evaluation of billion-scale models in just a few hours. * Diversified evaluation paradigms: Support for zero-shot, few-shot, and chain-of-thought evaluations, combined with standard or dialogue-type prompt templates, to easily stimulate the maximum performance of various models. * Modular design with high extensibility: Want to add new models or datasets, customize an advanced task division strategy, or even support a new cluster management system? Everything about OpenCompass can be easily expanded! * Experiment management and reporting mechanism: Use config files to fully record each experiment, and support real-time reporting of results.
Simplifine
Simplifine is an open-source library designed for easy LLM finetuning, enabling users to perform tasks such as supervised fine tuning, question-answer finetuning, contrastive loss for embedding tasks, multi-label classification finetuning, and more. It provides features like WandB logging, in-built evaluation tools, automated finetuning parameters, and state-of-the-art optimization techniques. The library offers bug fixes, new features, and documentation updates in its latest version. Users can install Simplifine via pip or directly from GitHub. The project welcomes contributors and provides comprehensive documentation and support for users.
slideflow
Slideflow is a deep learning library for digital pathology, offering a user-friendly interface for model development. It is designed for medical researchers and AI enthusiasts, providing an accessible platform for developing state-of-the-art pathology models. Slideflow offers customizable training pipelines, robust slide processing and stain normalization toolkit, support for weakly-supervised or strongly-supervised labels, built-in foundation models, multiple-instance learning, self-supervised learning, generative adversarial networks, explainability tools, layer activation analysis tools, uncertainty quantification, interactive user interface for model deployment, and more. It supports both PyTorch and Tensorflow, with optional support for Libvips for slide reading. Slideflow can be installed via pip, Docker container, or from source, and includes non-commercial add-ons for additional tools and pretrained models. It allows users to create projects, extract tiles from slides, train models, and provides evaluation tools like heatmaps and mosaic maps.
Awesome-LLM-Eval
Awesome-LLM-Eval: a curated list of tools, benchmarks, demos, papers for Large Language Models (like ChatGPT, LLaMA, GLM, Baichuan, etc) Evaluation on Language capabilities, Knowledge, Reasoning, Fairness and Safety.
Tools4AI
Tools4AI is a Java-based Agentic Framework for building AI agents to integrate with enterprise Java applications. It enables the conversion of natural language prompts into actionable behaviors, streamlining user interactions with complex systems. By leveraging AI capabilities, it enhances productivity and innovation across diverse applications. The framework allows for seamless integration of AI with various systems, such as customer service applications, to interpret user requests, trigger actions, and streamline workflows. Prompt prediction anticipates user actions based on input prompts, enhancing user experience by proactively suggesting relevant actions or services based on context.
MarkLLM
MarkLLM is an open-source toolkit designed for watermarking technologies within large language models (LLMs). It simplifies access, understanding, and assessment of watermarking technologies, supporting various algorithms, visualization tools, and evaluation modules. The toolkit aids researchers and the community in ensuring the authenticity and origin of machine-generated text.
eval-dev-quality
DevQualityEval is an evaluation benchmark and framework designed to compare and improve the quality of code generation of Language Model Models (LLMs). It provides developers with a standardized benchmark to enhance real-world usage in software development and offers users metrics and comparisons to assess the usefulness of LLMs for their tasks. The tool evaluates LLMs' performance in solving software development tasks and measures the quality of their results through a point-based system. Users can run specific tasks, such as test generation, across different programming languages to evaluate LLMs' language understanding and code generation capabilities.
eval-scope
Eval-Scope is a framework for evaluating and improving large language models (LLMs). It provides a set of commonly used test datasets, metrics, and a unified model interface for generating and evaluating LLM responses. Eval-Scope also includes an automatic evaluator that can score objective questions and use expert models to evaluate complex tasks. Additionally, it offers a visual report generator, an arena mode for comparing multiple models, and a variety of other features to support LLM evaluation and development.
data-juicer
Data-Juicer is a one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs. It is a systematic & reusable library of 80+ core OPs, 20+ reusable config recipes, and 20+ feature-rich dedicated toolkits, designed to function independently of specific LLM datasets and processing pipelines. Data-Juicer allows detailed data analyses with an automated report generation feature for a deeper understanding of your dataset. Coupled with multi-dimension automatic evaluation capabilities, it supports a timely feedback loop at multiple stages in the LLM development process. Data-Juicer offers tens of pre-built data processing recipes for pre-training, fine-tuning, en, zh, and more scenarios. It provides a speedy data processing pipeline requiring less memory and CPU usage, optimized for maximum productivity. Data-Juicer is flexible & extensible, accommodating most types of data formats and allowing flexible combinations of OPs. It is designed for simplicity, with comprehensive documentation, easy start guides and demo configs, and intuitive configuration with simple adding/removing OPs from existing configs.
stm32ai-modelzoo
The STM32 AI model zoo is a collection of reference machine learning models optimized to run on STM32 microcontrollers. It provides a large collection of application-oriented models ready for re-training, scripts for easy retraining from user datasets, pre-trained models on reference datasets, and application code examples generated from user AI models. The project offers training scripts for transfer learning or training custom models from scratch. It includes performances on reference STM32 MCU and MPU for float and quantized models. The project is organized by application, providing step-by-step guides for training and deploying models.
gptme
GPTMe is a tool that allows users to interact with an LLM assistant directly in their terminal in a chat-style interface. The tool provides features for the assistant to run shell commands, execute code, read/write files, and more, making it suitable for various development and terminal-based tasks. It serves as a local alternative to ChatGPT's 'Code Interpreter,' offering flexibility and privacy when using a local model. GPTMe supports code execution, file manipulation, context passing, self-correction, and works with various AI models like GPT-4. It also includes a GitHub Bot for requesting changes and operates entirely in GitHub Actions. In progress features include handling long contexts intelligently, a web UI and API for conversations, web and desktop vision, and a tree-based conversation structure.
holmesgpt
HolmesGPT is an open-source DevOps assistant powered by OpenAI or any tool-calling LLM of your choice. It helps in troubleshooting Kubernetes, incident response, ticket management, automated investigation, and runbook automation in plain English. The tool connects to existing observability data, is compliance-friendly, provides transparent results, supports extensible data sources, runbook automation, and integrates with existing workflows. Users can install HolmesGPT using Brew, prebuilt Docker container, Python Poetry, or Docker. The tool requires an API key for functioning and supports OpenAI, Azure AI, and self-hosted LLMs.
20 - OpenAI Gpts
Factorio Modding
A factorio moder that creates mods for you and improves your functions and makes helpful functions from the game api
Diagrams: Show Me | charts, presentations, code
Diagram creation: flowcharts, mindmaps, UML, chart, PlotUML, workflow, sequence, ERD, database & architecture visualization for code, presentations and documentation. [New] Add a logo or any image to graph diagrams. Easy Download & Edit
StackStorm Pack Enhancer
Assists in enhancing StackStorm packs with new actions and features.
Book Summarizer
The Book Summarizer, provided by Library 2.0 and Hepler Consulting, summarizes any book desired by any user in the context of information they provide. You can also ask for summaries of books you may like but have not read yet to obtain some new books for your reading list!
Git Basics Trainer
Trains you basic GIT console commands: creating GIT commits and using branches.
Leonardo da Vinci - Image Recreator
Expert in recreating images with photorealistic precision based on user uploads.
AIProductGPT: Add AI to your Product and get a PRD
With simple prompts, AIProductGPT instantly crafts detailed AI-powered requirements (PRD) and mocks so that you team can hit the ground running
GroceriesGPT
I manage your grocery lists to help you stay organized. *1/ Tell me what to add to a list. 2/ Ask me to add all ingredients for a receipe. 3/ Upload a receipt to remove items from your lists 4/ Add an item by simply uploading a picture. 5/ Ask me what items I would recommend you add to your lists.*
SpintaxGPT
I add spintax to emails for Instantly.ai. For more cold email tips, follow me on Twitter/𝕏 at @kenautoup
Meal Planner + Home Delivery
Find your next favorite recipe and instantly add fresh, affordable ingredients to your Walmart cart. Enjoy the convenience of home delivery or pickup. Delicious, healthy, and budget-friendly.
QR Code Creator & Customizer
Create a QR code in 30 seconds + add a cool design effect or overlay it on top of any image. Free, no watermarks, no email required, and we don't store your messages/images.