Best AI tools for< Generate Token >
20 - AI tool Sites

Awan LLM
Awan LLM is an AI tool that offers an Unlimited Tokens, Unrestricted, and Cost-Effective LLM Inference API Platform for Power Users and Developers. It allows users to generate unlimited tokens, use LLM models without constraints, and pay per month instead of per token. The platform features an AI Assistant, AI Agents, Roleplay with AI companions, Data Processing, Code Completion, and Applications for profitable AI-powered applications.

Phenaki
Phenaki is a model capable of generating realistic videos from a sequence of textual prompts. It is particularly challenging to generate videos from text due to the computational cost, limited quantities of high-quality text-video data, and variable length of videos. To address these issues, Phenaki introduces a new causal model for learning video representation, which compresses the video to a small representation of discrete tokens. This tokenizer uses causal attention in time, which allows it to work with variable-length videos. To generate video tokens from text, Phenaki uses a bidirectional masked transformer conditioned on pre-computed text tokens. The generated video tokens are subsequently de-tokenized to create the actual video. To address data issues, Phenaki demonstrates how joint training on a large corpus of image-text pairs as well as a smaller number of video-text examples can result in generalization beyond what is available in the video datasets. Compared to previous video generation methods, Phenaki can generate arbitrarily long videos conditioned on a sequence of prompts (i.e., time-variable text or a story) in an open domain. To the best of our knowledge, this is the first time a paper studies generating videos from time-variable prompts. In addition, the proposed video encoder-decoder outperforms all per-frame baselines currently used in the literature in terms of spatio-temporal quality and the number of tokens per video.

FACE AI
FACE AI is a pioneering token project that combines blockchain technology and artificial intelligence to revolutionize video production. It offers a suite of AI-powered tools that enable users to create high-quality videos with ease, including text-to-video, image-to-video, face singing, and dance image generation.

AIChat
AIChat is an AI-powered chatbot that allows users to have conversations, generate images, and access information through text messages. It is designed to be easy to use, with no apps to download or passwords to remember. Users can customize their bot's personality, tone, and response style, and the bot can remember previous conversations. AIChat can be used for a variety of purposes, including companionship, motivation, unbiased advice, health and wellness support, bedtime stories, and life hacks.

MakeTheDocs
MakeTheDocs is an AI-powered documentation tool that allows users to create quality documentation quickly by simply uploading a video. The tool leverages AI technology to analyze and generate documentation in less than a minute, saving users time and effort. MakeTheDocs offers various pricing plans with different features such as token usage, video length, export options, and support levels. Users can customize their documentation pages by adding branding and setting goals. The tool ensures data privacy by not collecting user data without consent.

ChatX
ChatX is a free prompt marketplace that offers ChatGPT, DALL·E, Stable Diffusion, and Midjourney AI tools. It provides a platform for users to easily find generative AI prompts for their projects, helping to enhance creativity and productivity. The marketplace also offers a variety of AI-inspired gifts and products for individuals passionate about AI.

DeepSeek v3
DeepSeek v3 is an advanced AI language model that represents a major breakthrough in AI language models. It features a groundbreaking Mixture-of-Experts (MoE) architecture with 671B total parameters, delivering state-of-the-art performance across various benchmarks while maintaining efficient inference capabilities. DeepSeek v3 is pre-trained on 14.8 trillion high-quality tokens and excels in tasks such as text generation, code completion, and mathematical reasoning. With a 128K context window and advanced Multi-Token Prediction, DeepSeek v3 sets new standards in AI language modeling.

Lore macOS GPT-LLM Playground
Lore macOS GPT-LLM Playground is an AI tool designed for macOS users, offering a Multi-Model Time Travel Versioning Combinatorial Runs Variants Full-Text Search Model-Cost Aware API & Token Stats Custom Endpoints Local Models Tables. It provides a user-friendly interface with features like Syntax, LaTeX Notes Export, Shortcuts, Vim Mode, and Sandbox. The tool is built with Cocoa, SwiftUI, and SQLite, ensuring privacy and offering support & feedback.

OpenChat
OpenChat is a website that provides users with 10,000 ways to make money using ChatGPT and AI. The website offers a variety of resources, including personalized AI income ideas, a personal AI business coach, and standard email support. OpenChat also has a library of up to 10,000 AI income ideas that users can access. The website's slogan is "10,000 Ways to Make Money with ChatGPT and AI". Some of the features of OpenChat include the ability to save ideas for later use, access to a full library of up to 10,000 ideas, a personal AI business coach, and standard email support. Some of the advantages of using OpenChat include the ability to get personalized AI income ideas, access to a large library of AI income ideas, and the ability to get support from a personal AI business coach. Some of the disadvantages of using OpenChat include the fact that it is a paid service, and that the number of tokens that users can use each month is limited. Some of the frequently asked questions about OpenChat include how to use the website, how to get personalized AI income ideas, and how to get support from a personal AI business coach. The name of the application is OpenChat. Some of the jobs that are suitable for this tool include freelance AI business ideas, content creation AI income ideas, virtual assistance AI income ideas, mobile apps AI income ideas, web apps AI income ideas, finance AI income ideas, online survey AI income ideas, online course AI income ideas, social media AI income ideas, digital marketing AI income ideas, data entry AI income ideas, legal service AI income ideas, stock photography AI income ideas. Some of the AI keywords that are related to the application include AI business ideas, content creation, virtual assistance, mobile apps, web apps, finance, online surveys, online courses, social media, digital marketing, data entry, legal services, stock photography. Some of the tasks that users can use this tool to do include generating AI-driven content, creating AI-powered virtual assistants, developing AI-enhanced mobile apps, building AI-driven websites, offering AI-based financial advice, conducting AI-powered market research, creating AI-generated art, and providing AI-enabled customer support.

Idolly
Idolly is an AI-powered creative platform that allows users to generate high-quality custom images instantly. It offers a range of innovative features such as Face Transfer, Mood Fusion, Embrace Diversity, and Re-Create, enabling users to unleash their creativity and bring their wildest dreams to life. Users can interact with the platform through daily missions and a referral program to enhance their experience. With the power of AI magic and token technology, Idolly empowers users to explore new frontiers of creativity and express themselves in unique ways.

MusicGen AI
MusicGen AI is a free and advanced AI music generation tool developed by Meta. It utilizes a single Language Model (LM) to create high-quality music based on text descriptions, melodies, or audio prompts. MusicGen operates by encoding music into compressed tokens, which are then used to generate the music samples. It can produce music in various formats, including mono and stereo. MusicGen AI offers a range of features, including melody conditioning, text-conditional generation, audio-prompted generation, advanced model architecture, flexible generation modes, unconditional generation, extensive training dataset, and customizable generation process.

Zoo
Zoo is an open source text-to-image playground powered by Replicate Code Memories. Users can generate images by inputting text and utilizing the Replicate API token. It is a project from Replicate, allowing users to create images from text in an open-source environment.

CompliantChatGPT
CompliantChatGPT is a HIPAA-compliant platform that allows users to utilize OpenAI's GPT models for healthcare-related tasks while maintaining data privacy and security. It anonymizes protected health information (PHI) by replacing it with tokens, ensuring compliance with HIPAA regulations. The platform offers various modes tailored to specific healthcare needs, including bloodwork analysis, PHI anonymization, diagnosis assistance, and treatment planning. CompliantChatGPT streamlines healthcare tasks, enhances productivity, and provides user-friendly assistance through its intuitive interface.

BlockSurvey
BlockSurvey is a privacy-first AI-powered survey tool that empowers users to create secure and confidential surveys with end-to-end encryption. It prioritizes data ownership, AI-driven efficiency, and exceptional user experience. With features like anonymous surveys, AI survey creation and analysis, token-gated forms, and multilingual surveys, BlockSurvey ensures privacy, trust, and actionable insights. Trusted by leading brands, it offers market research solutions, compliance measures, and seamless app integration. BlockSurvey is designed for Web3 companies, activists, HR professionals, and mental health practitioners, providing a secure platform for data collection and analysis.

Giti Multilingual ChatGPT
Giti Multilingual ChatGPT is a powerful AI chat assistant application that offers multilingual support in over 130 languages. It leverages the GPT language model to generate text that mimics human writing, making it suitable for various natural language processing tasks such as text summarization, question answering, and text generation. The application stands out for its ability to understand context and provide personalized responses, catering to diverse user needs across different languages. Giti Multilingual ChatGPT offers affordable pricing plans with different token limits to suit varying user requirements, making AI-powered chat assistance accessible to a wide audience.

Gain
Gain is an AI-powered hybrid finance platform that offers transparent investment opportunities for users to earn returns on their ETH and USDC. The platform integrates DeFi protocols with algorithmic trading to generate alpha for digital-asset pools. Gain sets a new industry standard with daily third-party audits, full reserve tokens, vetted pool managers, and community alignment through GAIN token holder voting. The platform aims for attractive returns while prioritizing community engagement and transparency.

Draw Things
Draw Things is an AI-assisted image generation app that allows users to create images from their imagination in minutes. It is powered by Stable Diffusion models and runs entirely offline on the user's device, ensuring privacy. The app offers a range of features, including inpainting, outpainting, text-to-image generation, text-guided image-to-image generation, and image and prompt editing history. Users can also select images from their camera roll and utilize various Stable Diffusion features such as guidance scale, steps, strength, image sizes, negative prompts, manual seed, and prompt tokenization. Additionally, the app allows users to preview different models and styles, including Generic Stable Diffusion v1.4, Waifu Diffusion v1.3 for Anime, and Stable Diffusion v1.5 Inpainting.

Sora
Sora is an AI-powered video creation tool that allows users to create realistic and imaginative videos from text instructions. It is powered by OpenAI's Gemini 1.5 Pro, a large language model with 10 million tokens. Sora is designed to be easy to use, even for those with no video editing experience. Users simply need to enter a text prompt describing the video they want to create, and Sora will generate a video based on that prompt.

Gensbot
Gensbot is an innovative platform that empowers users to create personalized goods on demand. By leveraging advanced AI technology, Gensbot eliminates the hassle of searching, stressing, or second-guessing, offering a seamless and convenient online shopping experience. Users can simply prompt the AI with their desired product specifications, and Gensbot will generate unique designs tailored to their preferences. This user-centric approach extends to the production process, where Gensbot prioritizes local manufacturing to minimize shipping distances and carbon emissions, contributing to a greener planet. Additionally, Gensbot rewards users with tokens for every purchase, which can be redeemed for future designs or exclusive offers, fostering a sustainable and rewarding shopping experience.

TakeNote
TakeNote is a cutting-edge speech-to-text AI that transforms audio and video into documents, boosting productivity and enhancing meeting experiences. Its advanced AI models provide exceptional accuracy, approaching human-level robustness and accuracy in English speech recognition. TakeNote AI empowers teams to transcribe meetings into accurate transcripts, generate precise summaries, analyze sentiment, and identify speakers, all while ensuring high levels of security and data protection.
20 - Open Source AI Tools

LayerSkip
LayerSkip is an implementation enabling early exit inference and self-speculative decoding. It provides a code base for running models trained using the LayerSkip recipe, offering speedup through self-speculative decoding. The tool integrates with Hugging Face transformers and provides checkpoints for various LLMs. Users can generate tokens, benchmark on datasets, evaluate tasks, and sweep over hyperparameters to optimize inference speed. The tool also includes correctness verification scripts and Docker setup instructions. Additionally, other implementations like gpt-fast and Native HuggingFace are available. Training implementation is a work-in-progress, and contributions are welcome under the CC BY-NC license.

onnxruntime-genai
ONNX Runtime Generative AI is a library that provides the generative AI loop for ONNX models, including inference with ONNX Runtime, logits processing, search and sampling, and KV cache management. Users can call a high level `generate()` method, or run each iteration of the model in a loop. It supports greedy/beam search and TopP, TopK sampling to generate token sequences, has built in logits processing like repetition penalties, and allows for easy custom scoring.

xFasterTransformer
xFasterTransformer is an optimized solution for Large Language Models (LLMs) on the X86 platform, providing high performance and scalability for inference on mainstream LLM models. It offers C++ and Python APIs for easy integration, along with example codes and benchmark scripts. Users can prepare models in a different format, convert them, and use the APIs for tasks like encoding input prompts, generating token ids, and serving inference requests. The tool supports various data types and models, and can run in single or multi-rank modes using MPI. A web demo based on Gradio is available for popular LLM models like ChatGLM and Llama2. Benchmark scripts help evaluate model inference performance quickly, and MLServer enables serving with REST and gRPC interfaces.

onefilellm
OneFileLLM is a command-line tool that streamlines the creation of information-dense prompts for large language models (LLMs). It aggregates and preprocesses data from various sources, compiling them into a single text file for quick use. The tool supports automatic source type detection, handling of multiple file formats, web crawling functionality, integration with Sci-Hub for research paper downloads, text preprocessing, token count reporting, and XML encapsulation of output for improved LLM performance. Users can easily access private GitHub repositories by generating a personal access token. The tool's output is encapsulated in XML tags to enhance LLM understanding and processing.

Train-llm-from-scratch
Train-llm-from-scratch is a repository that guides users through training a Large Language Model (LLM) from scratch. The model size can be adjusted based on available computing power. The repository utilizes deepspeed for distributed training and includes detailed explanations of the code and key steps at each stage to facilitate learning. Users can train their own tokenizer or use pre-trained tokenizers like ChatGLM2-6B. The repository provides information on preparing pre-training data, processing training data, and recommended SFT data for fine-tuning. It also references other projects and books related to LLM training.

1filellm
1filellm is a command-line data aggregation tool designed for LLM ingestion. It aggregates and preprocesses data from various sources into a single text file, facilitating the creation of information-dense prompts for large language models. The tool supports automatic source type detection, handling of multiple file formats, web crawling functionality, integration with Sci-Hub for research paper downloads, text preprocessing, and token count reporting. Users can input local files, directories, GitHub repositories, pull requests, issues, ArXiv papers, YouTube transcripts, web pages, Sci-Hub papers via DOI or PMID. The tool provides uncompressed and compressed text outputs, with the uncompressed text automatically copied to the clipboard for easy pasting into LLMs.

buildware-ai
Buildware is a tool designed to help developers accelerate their code shipping process by leveraging AI technology. Users can build a code instruction system, submit an issue, and receive an AI-generated pull request. The tool is created by Mckay Wrigley and Tyler Bruno at Takeoff AI. Buildware offers a simple setup process involving cloning the repository, installing dependencies, setting up environment variables, configuring a database, and obtaining a GitHub Personal Access Token (PAT). The tool is currently being updated to include advanced features such as Linear integration, local codebase mode, and team support.

lite_llama
lite_llama is a llama model inference lite framework by triton. It offers accelerated inference for llama3, Qwen2.5, and Llava1.5 models with up to 4x speedup compared to transformers. The framework supports top-p sampling, stream output, GQA, and cuda graph optimizations. It also provides efficient dynamic management for kv cache, operator fusion, and custom operators like rmsnorm, rope, softmax, and element-wise multiplication using triton kernels.

slack-bot
The Slack Bot is a tool designed to enhance the workflow of development teams by integrating with Jenkins, GitHub, GitLab, and Jira. It allows for custom commands, macros, crons, and project-specific commands to be implemented easily. Users can interact with the bot through Slack messages, execute commands, and monitor job progress. The bot supports features like starting and monitoring Jenkins jobs, tracking pull requests, querying Jira information, creating buttons for interactions, generating images with DALL-E, playing quiz games, checking weather, defining custom commands, and more. Configuration is managed via YAML files, allowing users to set up credentials for external services, define custom commands, schedule cron jobs, and configure VCS systems like Bitbucket for automated branch lookup in Jenkins triggers.

AutoGPTQ
AutoGPTQ is an easy-to-use LLM quantization package with user-friendly APIs, based on GPTQ algorithm (weight-only quantization). It provides a simple and efficient way to quantize large language models (LLMs) to reduce their size and computational cost while maintaining their performance. AutoGPTQ supports a wide range of LLM models, including GPT-2, GPT-J, OPT, and BLOOM. It also supports various evaluation tasks, such as language modeling, sequence classification, and text summarization. With AutoGPTQ, users can easily quantize their LLM models and deploy them on resource-constrained devices, such as mobile phones and embedded systems.

InternLM
InternLM is a powerful language model series with features such as 200K context window for long-context tasks, outstanding comprehensive performance in reasoning, math, code, chat experience, instruction following, and creative writing, code interpreter & data analysis capabilities, and stronger tool utilization capabilities. It offers models in sizes of 7B and 20B, suitable for research and complex scenarios. The models are recommended for various applications and exhibit better performance than previous generations. InternLM models may match or surpass other open-source models like ChatGPT. The tool has been evaluated on various datasets and has shown superior performance in multiple tasks. It requires Python >= 3.8, PyTorch >= 1.12.0, and Transformers >= 4.34 for usage. InternLM can be used for tasks like chat, agent applications, fine-tuning, deployment, and long-context inference.

rakis
Rakis is a decentralized verifiable AI network in the browser where nodes can accept AI inference requests, run local models, verify results, and arrive at consensus without servers. It is open-source, functional, multi-model, multi-chain, and browser-first, allowing anyone to participate in the network. The project implements an embedding-based consensus mechanism for verifiable inference. Users can run their own node on rakis.ai or use the compiled version hosted on Huggingface. The project is meant for educational purposes and is a work in progress.

holmesgpt
HolmesGPT is an open-source DevOps assistant powered by OpenAI or any tool-calling LLM of your choice. It helps in troubleshooting Kubernetes, incident response, ticket management, automated investigation, and runbook automation in plain English. The tool connects to existing observability data, is compliance-friendly, provides transparent results, supports extensible data sources, runbook automation, and integrates with existing workflows. Users can install HolmesGPT using Brew, prebuilt Docker container, Python Poetry, or Docker. The tool requires an API key for functioning and supports OpenAI, Azure AI, and self-hosted LLMs.

mistral-inference
Mistral Inference repository contains minimal code to run 7B, 8x7B, and 8x22B models. It provides model download links, installation instructions, and usage guidelines for running models via CLI or Python. The repository also includes information on guardrailing, model platforms, deployment, and references. Users can interact with models through commands like mistral-demo, mistral-chat, and mistral-common. Mistral AI models support function calling and chat interactions for tasks like testing models, chatting with models, and using Codestral as a coding assistant. The repository offers detailed documentation and links to blogs for further information.

1.5-Pints
1.5-Pints is a repository that provides a recipe to pre-train models in 9 days, aiming to create AI assistants comparable to Apple OpenELM and Microsoft Phi. It includes model architecture, training scripts, and utilities for 1.5-Pints and 0.12-Pint developed by Pints.AI. The initiative encourages replication, experimentation, and open-source development of Pint by sharing the model's codebase and architecture. The repository offers installation instructions, dataset preparation scripts, model training guidelines, and tools for model evaluation and usage. Users can also find information on finetuning models, converting lit models to HuggingFace models, and running Direct Preference Optimization (DPO) post-finetuning. Additionally, the repository includes tests to ensure code modifications do not disrupt the existing functionality.

LLMUnity
LLM for Unity enables seamless integration of Large Language Models (LLMs) within the Unity engine, allowing users to create intelligent characters for immersive player interactions. The tool supports major LLM models, runs locally without internet access, offers fast inference on CPU and GPU, and is easy to set up with a single line of code. It is free for both personal and commercial use, tested on Unity 2021 LTS, 2022 LTS, and 2023. Users can build multiple AI characters efficiently, use remote servers for processing, and customize model settings for text generation.

Awesome-LLM-Quantization
Awesome-LLM-Quantization is a curated list of resources related to quantization techniques for Large Language Models (LLMs). Quantization is a crucial step in deploying LLMs on resource-constrained devices, such as mobile phones or edge devices, by reducing the model's size and computational requirements.

LLMSpeculativeSampling
This repository implements speculative sampling for large language model (LLM) decoding, utilizing two models - a target model and an approximation model. The approximation model generates token guesses, corrected by the target model, resulting in improved efficiency. It includes implementations of Google's and Deepmind's versions of speculative sampling, supporting models like llama-7B and llama-1B. The tool is designed for fast inference from transformers via speculative decoding.

chatgpt-universe
ChatGPT is a large language model that can generate human-like text, translate languages, write different kinds of creative content, and answer your questions in a conversational way. It is trained on a massive amount of text data, and it is able to understand and respond to a wide range of natural language prompts. Here are 5 jobs suitable for this tool, in lowercase letters: 1. content writer 2. chatbot assistant 3. language translator 4. creative writer 5. researcher
20 - OpenAI Gpts

TokenGPT
Guides users through creating Solana tokens from scratch with detailed explanations.

Creative Prompt Tokens Explorer
From @cure4hayley - A comprehensive exploration of words and phrases. Includes composite word fusion and emotion-focused. Can also try film, TV and book titles. Enjoy!

Dungeon Master Assistant
Enhance D&D campaigns with Roll20 setup and custom token creation.

Sugma Discrete Math Solver
Powered by GPT-4 Turbo. 128,000 Tokens. Knowledge base of Discrete Math concepts, proofs and terminology. This GPT is instructed to carefully read and understand the prompt, plan a strategy to solve the problem, and write formal mathematical proofs.

Angular Architect AI: Generate Angular Components
Generates Angular components based on requirements, with a focus on code-first responses.

🖌️ Line to Image: Generate The Evolved Prompt!
Transforms lines into detailed prompts for visual storytelling.

Generate text imperceptible to detectors.
Discover how your writing can shine with a unique and human style. This prompt guides you to create rich and varied texts, surprising with original twists and maintaining coherence and originality. Transform your writing and challenge AI detection tools!

Fantasy Banter Bot - Special Teams
I generate witty trash talk for fantasy football leagues.

Product StoryBoard Director
Helps you generate script keyframes, for better experience please visit museclip.ai

Visual Storyteller
Extract the essence of the novel story according to the quantity requirements and generate corresponding images. The images can be used directly to create novel videos.小说推文图片自动批量生成,可自动生成风格一致性图片

CodeGPT
This GPT can generate code for you. For now it creates full-stack apps using Typescript. Just describe the feature you want and you will get a link to the Github code pull request and the live app deployed.