Best AI tools for< Create Leaderboard >

Versy.ai is a text-to-space generative AI solution that allows users to create virtual experiences from a text prompt. It is designed to be cost-effective, customizable, data-driven, and scalable. Versy.ai can be used to create a variety of interactive experiences, including product configurations, events, escape rooms, leaderboards, treasure hunts, and more.

Glambase is an AI Influencer Generator that allows users to decide who's hot or not among AI influencers and shape the leaderboard. Users can create their own AI influencers with unique physical attributes and subscribe to the Glambase newsletter to stay up-to-date with the latest trends in the world of AI influencers.

v3RPG is an AI-powered RPG adventure platform that allows users to create stories, characters, and embark on thrilling adventures. With decentralized AI judging powered by the Ora Protocol, players can climb leaderboards, earn rewards, and participate in community battles. The platform offers unique gameplay mechanics where players interact with an AI dungeon master, choose characters, make decisions, and roll dice to determine outcomes. Players can communicate with the AI dungeon master to ask questions and make adjustments to the adventure. v3RPG provides a dynamic and engaging RPG experience for players seeking immersive storytelling and strategic gameplay.

Booom is an AI-powered platform that offers a variety of trivia and social games generated with artificial intelligence. Users can play limitless content with friends, create their own games, and customize trivia games using the AI Editor. Booom provides a fun and interactive gaming experience with features like multiplayer mode, GIF and video support, leaderboard, and the ability to stream the game screen. The platform is ad-free and allows users to express their creativity while engaging in competitive gameplay.

MonkeeMath is an AI tool designed to scrape comments from Reddit and Stocktwits that mention stock tickers. It utilizes ChatGPT to analyze the sentiment of these comments, determining whether they are bullish or bearish on the outlook of the mentioned stocks. The data collected is then used to generate charts and tables displayed on the website. Users can create an account to view predictions and participate in a prediction mini-game to earn a spot on the MonkeeMath user leaderboard.

Create is a free-to-use AI app builder that lets you code using plain text and images. With Create, you can design and build apps like a pro, without having to write a single line of code. Create is perfect for building internal tools, prototypes, and even full-fledged applications.

This website allows users to create AI characters and chat with them. Users can customize their characters' appearance, personality, and interests. They can also choose from a variety of topics to chat about. The website uses artificial intelligence to generate the characters' responses, which are designed to be realistic and engaging.

RE:Create is an AI-powered app that provides endless content ideas and recreates any Instagram/Tiktok video in your style, tone, language, and even your voice! Our application streamlines the content creation process, eliminating the need for extensive planning and strategy. Save time and effort while achieving effective results. No need to hire a separate voiceover artist. Our application offers customizable voice options, ensuring your videos have the perfect audio to complement the visuals. No need to hire a professional scriptwriter. Our platform assists in creating engaging video scripts, guiding you through the process and ensuring your content flows seamlessly.

Create A Meme (C.A.M) is an AI-powered platform that allows users to easily create personalized and unique memes. With features like Magic, Custom, Template, and Classic modes, users can unleash their creativity and make viral memes online for free. C.A.M offers basic functionalities for free and a Plus tier for enhanced meme capabilities. The platform supports multiple languages and AI technology ensures that memes are always funny and relevant.

Create AI Voiceovers is an online text-to-speech generator that allows users to convert text into realistic-sounding AI voices. With over 530 AI voices available in 220+ languages and dialects, users can create voiceovers for various purposes, including marketing, eLearning, explainer videos, and animations. The platform offers a range of features, including the ability to adjust voice attributes such as pitch, emphasis, and speed, as well as add background music and sound effects. Create AI Voiceovers also provides a library of pre-recorded sound effects and music that users can incorporate into their voiceovers.

Create a Meme is a website that allows users to create and share memes. It offers a variety of features, including a library of pre-made memes, the ability to upload your own images, and a variety of editing tools. Create a Meme is a popular website with over 100 million users. It is a great way to create and share funny and entertaining memes with your friends and family.

This website provides a tool that allows users to create ebooks in seconds. It is a simple and easy-to-use tool that can be used by anyone, regardless of their technical expertise. The tool provides a variety of templates and features that can be used to create professional-looking ebooks.

Freepik is a website that provides high-quality stock content for creatives. It offers a wide range of assets, including images, vectors, videos, PSDs, AI images, and icons. Freepik also has a number of tools that can help creatives with their projects, such as an AI image generator, a mockup generator, and a photo editor.

Google Workspace is a suite of business apps and collaboration tools designed to enhance productivity and streamline communication for individuals, small businesses, enterprises, and frontline workers. With popular applications like Gmail, Calendar, Drive, Meet, and more, Google Workspace integrates AI-powered features through Gemini for Workspace to provide users with advanced capabilities for creating, connecting, and collaborating. The platform offers various plans tailored to meet diverse business needs, ensuring data control and productivity enhancement.

Photoroom is an AI photo editor application that offers a wide range of tools to enhance and edit images. It allows users to remove backgrounds, create product pictures, and generate professional visuals for various purposes. With features like AI Background Remover, AI Retouch, and AI Shadows, Photoroom simplifies the editing process and helps users create stunning images effortlessly. The application caters to individuals, small businesses, and creative teams, offering different subscription plans to suit varying needs. Photoroom is known for its user-friendly interface, affordable pricing, and efficient editing capabilities, making it a popular choice among online sellers, content creators, and small businesses.

VEED.IO is an online video editor that uses AI to help users create professional-quality videos quickly and easily. With VEED.IO, users can add subtitles, remove background noise, and more. VEED.IO is also a great tool for creating videos for social media, marketing, and education.

Yodayo is an AI-enabled creative platform for anime fandom. It is a place where anime fans can share and create more of what they love. The platform includes an AI Art Tavern, where users can create and share AI-generated anime art. Yodayo also hosts contests and provides guides for creating anime art.

Slidesgo is an online platform that provides free and premium Google Slides and PowerPoint templates. With Slidesgo, you can create presentations in minutes using AI presentation maker or choose from a variety of editable templates. Slidesgo also offers a variety of resources to help you learn how to use Google Slides and PowerPoint, including tutorials, blog articles, and presentation tips.

NightCafe Creator is an AI Art Generator app with multiple methods of AI art generation. Using neural style transfer, you can turn your photo into a masterpiece. Using text-to-image AI, you can create an artwork from nothing but words on a page. Enter a text prompt, and the generator will make stunning images. With modern diffusion technology, creating art couldn't be simpler (or more fun). Your creations belong to you, and you can do whatever you like with them (provided you are - or have permission from - the copyright owner of any input images, and subject to Copyright laws in your jurisdiction).

Vidnoz AI is a free online AI video generator that allows users to create engaging videos quickly and easily. With over 600 AI avatars, 470 realistic AI voices, and 600 templates to choose from, users can create videos for a variety of purposes, including marketing, education, and communication. Vidnoz AI is also easy to use, with a simple drag-and-drop interface and no prior video editing experience required.

AutoArena is a tool designed to create leaderboards ranking Language Model outputs against one another using automated judge evaluation. It allows users to rank outputs from different LLMs, RAG setups, and prompts to find the best configuration of their system. Users can perform automated head-to-head evaluation using judges from various platforms like OpenAI, Anthropic, and Cohere. Additionally, users can define and run custom judges, connect to internal services, or implement bespoke logic. AutoArena enables users to run the application locally, providing full control over their environment and data.

Clash Royale Build-A-Bot is a project that allows users to build their own bot to play Clash Royale. It provides an advanced state generator that accurately returns detailed information using cutting-edge technologies. The project includes tutorials for setting up the environment, building a basic bot, and understanding state generation. It also offers updates such as replacing YOLOv5 with YOLOv8 unit model and enhancing performance features like placement and elixir management. The future roadmap includes plans to label more images of diverse cards, add a tracking layer for unit predictions, publish tutorials on Q-learning and imitation learning, release the YOLOv5 training notebook, implement chest opening and card upgrading features, and create a leaderboard for the best bots developed with this repository.

The Octopus-v4 project aims to build the world's largest graph of language models, integrating specialized models and training Octopus models to connect nodes efficiently. The project focuses on identifying, training, and connecting specialized models. The repository includes scripts for running the Octopus v4 model, methods for managing the graph, training code for specialized models, and inference code. Environment setup instructions are provided for Linux with NVIDIA GPU. The Octopus v4 model helps users find suitable models for tasks and reformats queries for effective processing. The project leverages Language Large Models for various domains and provides benchmark results. Users are encouraged to train and add specialized models following recommended procedures.

SuperKnowa is a fast framework to build Enterprise RAG (Retriever Augmented Generation) Pipelines at Scale, powered by watsonx. It accelerates Enterprise Generative AI applications to get prod-ready solutions quickly on private data. The framework provides pluggable components for tackling various Generative AI use cases using Large Language Models (LLMs), allowing users to assemble building blocks to address challenges in AI-driven text generation. SuperKnowa is battle-tested from 1M to 200M private knowledge base & scaled to billions of retriever tokens.

OptScale is an open-source FinOps and MLOps platform that provides cloud cost optimization for all types of organizations and MLOps capabilities like experiment tracking, model versioning, ML leaderboards.

This leaderboard evaluates the hallucination rate of various Large Language Models (LLMs) when summarizing documents. It uses a model trained by Vectara to detect hallucinations in LLM outputs. The leaderboard includes models from OpenAI, Anthropic, Google, Microsoft, Amazon, and others. The evaluation is based on 831 documents that were summarized by all the models. The leaderboard shows the hallucination rate, factual consistency rate, answer rate, and average summary length for each model.

Nejumi Leaderboard 3 is a comprehensive evaluation platform for large language models, assessing general language capabilities and alignment aspects. The evaluation framework includes metrics for language processing, translation, summarization, information extraction, reasoning, mathematical reasoning, entity extraction, knowledge/question answering, English, semantic analysis, syntactic analysis, alignment, ethics/moral, toxicity, bias, truthfulness, and robustness. The repository provides an implementation guide for environment setup, dataset preparation, configuration, model configurations, and chat template creation. Users can run evaluation processes using specified configuration files and log results to the Weights & Biases project.

This repository is an awesome list dedicated to resources for using Large Language Models (LLMs) to generate JSON or other structured outputs. It includes terminology explanations, hosted and local models, Python libraries, blog articles, videos, Jupyter notebooks, and leaderboards related to LLMs and JSON generation. The repository covers various aspects such as function calling, JSON mode, guided generation, and tool usage with different providers and models.

This public repository contains the paper 'Comprehensive Assessment of Jailbreak Attacks Against LLMs'. It provides a labeling method to label results using Python and offers the opportunity to submit evaluation results to the leaderboard. Full codes will be released after the paper is accepted.

Welcome to `OPEN ODYSSEY 1.0` - an Open-source extravaganza for Python and AI/ML Projects. Collaborating with MLH (Major League Hacking), this repository welcomes contributions in the form of fixing outstanding issues, submitting bug reports or new feature requests, adding new projects, implementing new models, and encouraging creativity. Follow the instructions to contribute by forking the repository, cloning it to your PC, creating a new folder for your project, and making a pull request. The repository also features a special Leaderboard for top contributors and offers certificates for all participants and mentors. Follow `OPEN ODYSSEY 1.0` on social media for swift approval of your quest.

This competition is organized by Javier Rando and Florian Tramèr from the ETH AI Center and SPY Lab at ETH Zurich. The goal of the competition is to create a method that can detect universal backdoors in aligned language models. A universal backdoor is a secret suffix that, when appended to any prompt, enables the model to answer harmful instructions. The competition provides a set of poisoned generation models, a reward model that measures how safe a completion is, and a dataset with prompts to run experiments. Participants are encouraged to use novel methods for red-teaming, automated approaches with low human oversight, and interpretability tools to find the trojans. The best submissions will be offered the chance to present their work at an event during the SaTML 2024 conference and may be invited to co-author a publication summarizing the competition results.

This repository contains code for training reward models for Deep Reinforcement Learning-based Reward-modulated Hierarchical Fine-tuning (DRL-based RLHF), Iterative Selection Fine-tuning (Rejection sampling fine-tuning), and iterative Decision Policy Optimization (DPO). The reward models are trained using a Bradley-Terry model based on the Gemma and Mistral language models. The resulting reward models achieve state-of-the-art performance on the RewardBench leaderboard for reward models with base models of up to 13B parameters.

LLM AutoEval is a tool that simplifies the process of evaluating Large Language Models (LLMs) using a convenient Colab notebook. It automates the setup and execution of evaluations using RunPod, allowing users to customize evaluation parameters and generate summaries that can be uploaded to GitHub Gist for easy sharing and reference. LLM AutoEval supports various benchmark suites, including Nous, Lighteval, and Open LLM, enabling users to compare their results with existing models and leaderboards.

LLM-Blender is a framework for ensembling large language models (LLMs) to achieve superior performance. It consists of two modules: PairRanker and GenFuser. PairRanker uses pairwise comparisons to distinguish between candidate outputs, while GenFuser merges the top-ranked candidates to create an improved output. LLM-Blender has been shown to significantly surpass the best LLMs and baseline ensembling methods across various metrics on the MixInstruct benchmark dataset.

AiOS is a tool for human pose and shape estimation, performing human localization and SMPL-X estimation in a progressive manner. It consists of body localization, body refinement, and whole-body refinement stages. Users can download datasets for evaluation, SMPL-X body models, and AiOS checkpoint. Installation involves creating a conda virtual environment, installing PyTorch, torchvision, Pytorch3D, MMCV, and other dependencies. Inference requires placing the video for inference and pretrained models in specific directories. Test results are provided for NMVE, NMJE, MVE, and MPJPE on datasets like BEDLAM and AGORA. Users can run scripts for AGORA validation, AGORA test leaderboard, and BEDLAM leaderboard. The tool acknowledges codes from MMHuman3D, ED-Pose, and SMPLer-X.

Bench is a tool for evaluating LLMs for production use cases. It provides a standardized workflow for LLM evaluation with a common interface across tasks and use cases. Bench can be used to test whether open source LLMs can do as well as the top closed-source LLM API providers on specific data, and to translate the rankings on LLM leaderboards and benchmarks into scores that are relevant for actual use cases.

The AI Scientist is a comprehensive system for fully automatic scientific discovery, enabling Foundation Models to perform research independently. It aims to tackle the grand challenge of developing agents capable of conducting scientific research and discovering new knowledge. The tool generates papers on various topics using Large Language Models (LLMs) and provides a platform for exploring new research ideas. Users can create their own templates for specific areas of study and run experiments to generate papers. However, caution is advised as the codebase executes LLM-written code, which may pose risks such as the use of potentially dangerous packages and web access.

Functionary is a language model that interprets and executes functions/plugins. It determines when to execute functions, whether in parallel or serially, and understands their outputs. Function definitions are given as JSON Schema Objects, similar to OpenAI GPT function calls. It offers documentation and examples on functionary.meetkai.com. The newest model, meetkai/functionary-medium-v3.1, is ranked 2nd in the Berkeley Function-Calling Leaderboard. Functionary supports models with different context lengths and capabilities for function calling and code interpretation. It also provides grammar sampling for accurate function and parameter names. Users can deploy Functionary models serverlessly using Modal.com.

The LLM course is divided into three parts: 1. 🧩 **LLM Fundamentals** covers essential knowledge about mathematics, Python, and neural networks. 2. 🧑‍🔬 **The LLM Scientist** focuses on building the best possible LLMs using the latest techniques. 3. 👷 **The LLM Engineer** focuses on creating LLM-based applications and deploying them. For an interactive version of this course, I created two **LLM assistants** that will answer questions and test your knowledge in a personalized way: * 🤗 **HuggingChat Assistant**: Free version using Mixtral-8x7B. * 🤖 **ChatGPT Assistant**: Requires a premium account. ## 📝 Notebooks A list of notebooks and articles related to large language models. ### Tools | Notebook | Description | Notebook | |----------|-------------|----------| | 🧐 LLM AutoEval | Automatically evaluate your LLMs using RunPod |  | | 🥱 LazyMergekit | Easily merge models using MergeKit in one click. |  | | 🦎 LazyAxolotl | Fine-tune models in the cloud using Axolotl in one click. |  | | ⚡ AutoQuant | Quantize LLMs in GGUF, GPTQ, EXL2, AWQ, and HQQ formats in one click. |  | | 🌳 Model Family Tree | Visualize the family tree of merged models. |  | | 🚀 ZeroSpace | Automatically create a Gradio chat interface using a free ZeroGPU. |  |

The 'llms-tools' repository is a comprehensive collection of AI tools, open-source projects, and research related to Large Language Models (LLMs) and Chatbots. It covers a wide range of topics such as AI in various domains, open-source models, chats & assistants, visual language models, evaluation tools, libraries, devices, income models, text-to-image, computer vision, audio & speech, code & math, games, robotics, typography, bio & med, military, climate, finance, and presentation. The repository provides valuable resources for researchers, developers, and enthusiasts interested in exploring the capabilities of LLMs and related technologies.

First, please say "Create an agent team to do 〇〇." / 最初に「〇〇をするためのエージェントチームを作成してください」とお伝え下さい

Let's get started by telling me about your business: What do you offer? Who do you serve? ------------------------------------------------------- Need help Prompt Engineering? Reach out on LinkedIn: StephenHnilica

AI tool for designing engaging, trendy Pinterest pins.

Generates 3D stereogram pairs for parallel viewing.

2500+ word stories in target language with images, for language learning.

Level up Now. Upload a selfie for some superhero flair. Create a backstory. Select a superpower, arch-villain, and crew. Answer trivia. Pow!

Tell me about your situation and the type of prayer you would like

利用专业的周易知识和命理知识进行头像设计 Generates and explains lucky profile pictures based on I Ching, zodiac.

创建你自己的数字人形象，Sponsor：小红书“ItsJoe就出行”

I'll recreate a competitor website for your business

Create a very detailed prompt from the image. 画像からめっちゃ詳細なプロンプトを作成します。まずは解析して欲しい画像を送ってみてください。

1) Input a URL, attachment, or copy/paste a bunch of info about your biz. 2) I will return a summary of what's important. 3) Use what I give you for other prompts, e.g.: marketing strategy, content ideas, competitive analysis, etc

Create a Mythological Creature for playing with imagination and possibilities

Autonomously creates complete TikTok scenarios with images.

Simulates advisory board meetings with investors. Get generated advice for your startup from a GPT educated by domain experts.

Advisor for hairstyles, top products, and salon recommendations matched with your hair type and location.

Replicate Image, Images Mergeve, Imaginative Edit, Style Transfer. Use "Help" for more info. 20+ features of the source image will be transferred. You also can call this GPT via @ in any chat (desktop only).

I create soothing cat images.

Create business processes using Flowscript markup

I create nursing care plans based on triage info.