Best AI tools for< Manage Llm Provider Keys >
20 - AI tool Sites
![LiteLLM Screenshot](/screenshots/berri.ai.jpg)
LiteLLM
LiteLLM is a platform that provides model access, logging, and usage tracking across various LLMs in the OpenAI format. It offers features such as control over model access, budget tracking, pass-through endpoints for migration, OpenAI-compatible API access, and a self-serve portal for key management. LiteLLM also offers different pricing tiers, including Open Source, Enterprise Basic, and Enterprise Premium, with various integrations and features tailored for different user needs.
![Athina AI Screenshot](/screenshots/athina.ai.jpg)
Athina AI
Athina AI is a comprehensive platform designed to monitor, debug, analyze, and improve the performance of Large Language Models (LLMs) in production environments. It provides a suite of tools and features that enable users to detect and fix hallucinations, evaluate output quality, analyze usage patterns, and optimize prompt management. Athina AI supports integration with various LLMs and offers a range of evaluation metrics, including context relevancy, harmfulness, summarization accuracy, and custom evaluations. It also provides a self-hosted solution for complete privacy and control, a GraphQL API for programmatic access to logs and evaluations, and support for multiple users and teams. Athina AI's mission is to empower organizations to harness the full potential of LLMs by ensuring their reliability, accuracy, and alignment with business objectives.
![Wordware Screenshot](/screenshots/wordware.ai.jpg)
Wordware
Wordware is an AI toolkit that empowers cross-functional teams to build reliable high-quality agents through rapid iteration. It combines the best aspects of software with the power of natural language, freeing users from traditional no-code tool constraints. With advanced technical capabilities, multiple LLM providers, one-click API deployment, and multimodal support, Wordware offers a seamless experience for AI app development and deployment.
![Pontus Screenshot](/screenshots/www.pontus.so.jpg)
Pontus
Pontus is an AI tool that enables users to build AI models with trust, manage risk, and ensure compliance effortlessly. It offers features like smart anonymization, rapid audit, and liability reduction, along with privacy-enhancing technology. Pontus allows for on-premise deployment, role-based access controls, and toxicity checking to prevent inappropriate content. The application is designed to work seamlessly with common LLM providers, making it a valuable asset for industries like healthcare, finance, and research.
![LLM Price Check Screenshot](/screenshots/llmpricecheck.com.jpg)
LLM Price Check
LLM Price Check is an AI tool designed to compare and calculate the latest prices for Large Language Models (LLM) APIs from leading providers such as OpenAI, Anthropic, Google, and more. Users can use the streamlined tool to optimize their AI budget efficiently by comparing pricing, sorting by various parameters, and searching for specific models. The tool provides a comprehensive overview of pricing information to help users make informed decisions when selecting an LLM API provider.
![Allganize Screenshot](/screenshots/allganize.ai.jpg)
Allganize
Allganize Inc. is a leading provider of enterprise AI solutions. Their platform enables businesses to build and deploy custom AI applications without the need for coding. Allganize's solutions are used by a variety of industries, including financial services, healthcare, and manufacturing.
![prompter.engineer Screenshot](/screenshots/prompter.engineer.jpg)
prompter.engineer
prompter.engineer is a domain that is currently parked for free, courtesy of GoDaddy.com. The website does not provide any specific content or services at the moment, as it is not associated with any particular company, product, or service. It primarily serves as a placeholder domain registered with GoDaddy, LLC, and does not imply any endorsement or association with third-party advertisers.
![Langtail Screenshot](/screenshots/langtail.com.jpg)
Langtail
Langtail is a platform that helps developers build, test, and deploy AI-powered applications. It provides a suite of tools to help developers debug prompts, run tests, and monitor the performance of their AI models. Langtail also offers a community forum where developers can share tips and tricks, and get help from other users.
![Weights & Biases Screenshot](/screenshots/docs.wandb.ai.jpg)
Weights & Biases
Weights & Biases is an AI tool that offers documentation, guides, tutorials, and support for using AI models in applications. The platform provides two main products: W&B Weave for integrating AI models into code and W&B Models for building custom AI models. Users can access features such as tracing, output evaluation, cost estimates, hyperparameter sweeps, model registry, and more. Weights & Biases aims to simplify the process of working with AI models and improving model reproducibility.
![Autotab Screenshot](/screenshots/autotab.com.jpg)
Autotab
Autotab is an AI-powered digital robot that can automate repetitive tasks on any website or web application. It is designed to help businesses save time and money by automating tasks such as data entry, web scraping, and social media management. Autotab is easy to use and can be set up in minutes. It is also very affordable, with plans starting at just $1 per hour.
![Datasaur Screenshot](/screenshots/datasaur.ai.jpg)
Datasaur
Datasaur is an advanced text and audio data labeling platform that offers customizable solutions for various industries such as LegalTech, Healthcare, Financial, Media, e-Commerce, and Government. It provides features like configurable annotation, quality control automation, and workforce management to enhance the efficiency of NLP and LLM projects. Datasaur prioritizes data security with military-grade practices and offers seamless integrations with AWS and other technologies. The platform aims to streamline the data labeling process, allowing engineers to focus on creating high-quality models.
![Chatty Screenshot](/screenshots/chattyui.com.jpg)
Chatty
Chatty is an AI-powered chat application that utilizes cutting-edge models to provide efficient and personalized responses to user queries. The application is designed to optimize VRAM usage by employing models with specific suffixes, resulting in reduced memory requirements. Users can expect a slight delay in the initial response due to model downloading. Chatty aims to enhance user experience through its advanced AI capabilities.
![OneDollarAI.lol Screenshot](/screenshots/onedollarai.lol.jpg)
OneDollarAI.lol
OneDollarAI.lol is an AI application that offers the best AI language model for just one dollar a month. It features LLaMa 3, which is known for being the fastest and most powerful language model. Users can enjoy unlimited usage with no limits, at an affordable price of only $1 per month. The application provides instant responses and requires no setup. It is designed to be user-friendly and accessible to all, making it a convenient tool for various language-related tasks.
![Lyzr AI Screenshot](/screenshots/lyzr.ai.jpg)
Lyzr AI
Lyzr AI is a full-stack agent framework designed to build GenAI applications faster. It offers a range of AI agents for various tasks such as chatbots, knowledge search, summarization, content generation, and data analysis. The platform provides features like memory management, human-in-loop interaction, toxicity control, reinforcement learning, and custom RAG prompts. Lyzr AI ensures data privacy by running data locally on cloud servers. Enterprises and developers can easily configure, deploy, and manage AI agents using Lyzr's platform.
![FinetuneDB Screenshot](/screenshots/finetunedb.com.jpg)
FinetuneDB
FinetuneDB is an AI fine-tuning platform that allows users to easily create and manage datasets to fine-tune LLMs, evaluate outputs, and iterate on production data. It integrates with open-source and proprietary foundation models, and provides a collaborative editor for building datasets. FinetuneDB also offers a variety of features for evaluating model performance, including human and AI feedback, automated evaluations, and model metrics tracking.
![Yellow.ai Screenshot](/screenshots/yellow.ai.jpg)
Yellow.ai
Yellow.ai is a leading provider of AI-powered customer service automation solutions. Its Dynamic Automation Platform (DAP) is built on multi-LLM architecture and continuously trains on billions of conversations for scale, speed, and accuracy. Yellow.ai's platform leverages the latest advancements in NLP and generative AI to deliver empathetic and context-aware conversations that exceed customer expectations across channels. With its enterprise-grade security, advanced analytics, and zero-setup bot deployment, Yellow.ai helps businesses transform their customer and employee experiences with AI-powered automation.
![chatQR.ai Screenshot](/screenshots/chatqr.ai.jpg)
chatQR.ai
chatQR.ai is an AI-powered ordering application that serves as a complete Point Of Sale/Kiosk replacement. It utilizes voice recognition technology combined with the latest Large Language Model (LLM) AI to create a seamless QR code ordering experience for customers. The system is designed to be AI-first, offering mature point of sale features and the ability to integrate the ChatQR Voice Assistant into existing systems. With support for multiple currencies and payment providers like Stripe and Square, chatQR.ai aims to revolutionize the way businesses manage orders and payments.
![EDOM.AI Screenshot](/screenshots/edom.ai.jpg)
EDOM.AI
EDOM.AI is the first artificial business brain that provides secret strategies used by major companies to help users create, grow, and start their businesses. It offers access to proven billionaire secrets and allows users to create ideas based on the brains of the greatest entrepreneurs. EDOM.AI is constantly evolving to offer the best LLM possible for businesses.
![Connex AI Screenshot](/screenshots/connex.ai.jpg)
Connex AI
Connex AI is an advanced AI platform offering a wide range of AI solutions for businesses across various industries. The platform provides cutting-edge features such as AI Agent, AI Guru, AI Voice, AI Analytics, Real-Time Coaching, Automated Speech Recognition, Sentiment Analysis, Keyphrase Analysis, Entity Recognition, LLM Topic-Based Modelling, SMS Live Chat, WhatsApp Voice, Email Dialler, PCI DSS, Social Media Flow, Calendar Schedular, Staff Management, Gamify Shop, PDF Builder, Pricing Matrix, Themes, Article Builder, Marketplace Integrations, and more. Connex AI aims to enhance customer engagement, workforce productivity, sales, and customer satisfaction through its innovative AI-driven solutions.
![Luminance Screenshot](/screenshots/luminance.com.jpg)
Luminance
Luminance is a legal AI co-pilot that automates the generation, negotiation, and analysis of contracts. It is built on a proprietary legal Large Language Model (LLM) and uses next-generation AI to provide legal teams with a trusted assistant. Luminance's AI-driven features include AI-Driven Negotiation, 'Legal-Grade' Chatbot, and Business-Wide Automation.
20 - Open Source AI Tools
![pyspur Screenshot](/screenshots_githubs/PySpur-Dev-pyspur.jpg)
pyspur
PySpur is a graph-based editor designed for LLM (Large Language Models) workflows. It offers modular building blocks, node-level debugging, and performance evaluation. The tool is easy to hack, supports JSON configs for workflow graphs, and is lightweight with minimal dependencies. Users can quickly set up PySpur by cloning the repository, creating a .env file, starting docker services, and accessing the portal. PySpur can also work with local models served using Ollama, with steps provided for configuration. The roadmap includes features like canvas, async/batch execution, support for Ollama, new nodes, pipeline optimization, templates, code compilation, multimodal support, and more.
![PySpur Screenshot](/screenshots_githubs/PySpur-Dev-PySpur.jpg)
PySpur
PySpur is a graph-based editor designed for LLM workflows, offering modular building blocks for easy workflow creation and debugging at node level. It allows users to evaluate final performance and promises self-improvement features in the future. PySpur is easy-to-hack, supports JSON configs for workflow graphs, and is lightweight with minimal dependencies, making it a versatile tool for workflow management in the field of AI and machine learning.
![notte Screenshot](/screenshots_githubs/nottelabs-notte.jpg)
notte
Notte is a web browser designed specifically for LLM agents, providing a language-first web navigation experience without the need for DOM/HTML parsing. It transforms websites into structured, navigable maps described in natural language, enabling users to interact with the web using natural language commands. By simplifying browser complexity, Notte allows LLM policies to focus on conversational reasoning and planning, reducing token usage, costs, and latency. The tool supports various language model providers and offers a reinforcement learning style action space and controls for full navigation control.
![WDoc Screenshot](/screenshots_githubs/thiswillbeyourgithub-WDoc.jpg)
WDoc
WDoc is a powerful Retrieval-Augmented Generation (RAG) system designed to summarize, search, and query documents across various file types. It supports querying tens of thousands of documents simultaneously, offers tailored summaries to efficiently manage large amounts of information, and includes features like supporting multiple file types, various LLMs, local and private LLMs, advanced RAG capabilities, advanced summaries, trust verification, markdown formatted answers, sophisticated embeddings, extensive documentation, scriptability, type checking, lazy imports, caching, fast processing, shell autocompletion, notification callbacks, and more. WDoc is ideal for researchers, students, and professionals dealing with extensive information sources.
![holmesgpt Screenshot](/screenshots_githubs/robusta-dev-holmesgpt.jpg)
holmesgpt
HolmesGPT is an open-source DevOps assistant powered by OpenAI or any tool-calling LLM of your choice. It helps in troubleshooting Kubernetes, incident response, ticket management, automated investigation, and runbook automation in plain English. The tool connects to existing observability data, is compliance-friendly, provides transparent results, supports extensible data sources, runbook automation, and integrates with existing workflows. Users can install HolmesGPT using Brew, prebuilt Docker container, Python Poetry, or Docker. The tool requires an API key for functioning and supports OpenAI, Azure AI, and self-hosted LLMs.
![gateway Screenshot](/screenshots_githubs/Portkey-AI-gateway.jpg)
gateway
Gateway is a tool that streamlines requests to 100+ open & closed source models with a unified API. It is production-ready with support for caching, fallbacks, retries, timeouts, load balancing, and can be edge-deployed for minimum latency. It is blazing fast with a tiny footprint, supports load balancing across multiple models, providers, and keys, ensures app resilience with fallbacks, offers automatic retries with exponential fallbacks, allows configurable request timeouts, supports multimodal routing, and can be extended with plug-in middleware. It is battle-tested over 300B tokens and enterprise-ready for enhanced security, scale, and custom deployments.
![AnkiAIUtils Screenshot](/screenshots_githubs/thiswillbeyourgithub-AnkiAIUtils.jpg)
AnkiAIUtils
Anki AI Utils is a powerful suite of AI-powered tools designed to enhance your Anki flashcard learning experience by automatically improving cards you struggle with. The tools include features such as adaptive learning, personalized memory hooks, automation readiness, universal compatibility, provider agnosticism, and infinite extensibility. The toolkit consists of tools like Illustrator for creating custom mnemonic images, Reformulator for rephrasing flashcards, Mnemonics Creator for generating memorable mnemonics, Explainer for providing detailed explanations, and Mnemonics Helper for quick mnemonic generation. The project aims to motivate others to package the tools into addons for wider accessibility.
![llm2sh Screenshot](/screenshots_githubs/randombk-llm2sh.jpg)
llm2sh
llm2sh is a command-line utility that leverages Large Language Models (LLMs) to translate plain-language requests into shell commands. It provides a convenient way to interact with your system using natural language. The tool supports multiple LLMs for command generation, offers a customizable configuration file, YOLO mode for running commands without confirmation, and is easily extensible with new LLMs and system prompts. Users can set up API keys for OpenAI, Claude, Groq, and Cerebras to use the tool effectively. llm2sh does not store user data or command history, and it does not record or send telemetry by itself, but the LLM APIs may collect and store requests and responses for their purposes.
![archgw Screenshot](/screenshots_githubs/katanemo-archgw.jpg)
archgw
Arch is an intelligent Layer 7 gateway designed to protect, observe, and personalize AI agents with APIs. It handles tasks related to prompts, including detecting jailbreak attempts, calling backend APIs, routing between LLMs, and managing observability. Built on Envoy Proxy, it offers features like function calling, prompt guardrails, traffic management, and observability. Users can build fast, observable, and personalized AI agents using Arch to improve speed, security, and personalization of GenAI apps.
![skyvern Screenshot](/screenshots_githubs/Skyvern-AI-skyvern.jpg)
skyvern
Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions. Traditional approaches to browser automations required writing custom scripts for websites, often relying on DOM parsing and XPath-based interactions which would break whenever the website layouts changed. Instead of only relying on code-defined XPath interactions, Skyvern adds computer vision and LLMs to the mix to parse items in the viewport in real-time, create a plan for interaction and interact with them. This approach gives us a few advantages: 1. Skyvern can operate on websites it’s never seen before, as it’s able to map visual elements to actions necessary to complete a workflow, without any customized code 2. Skyvern is resistant to website layout changes, as there are no pre-determined XPaths or other selectors our system is looking for while trying to navigate 3. Skyvern leverages LLMs to reason through interactions to ensure we can cover complex situations. Examples include: 1. If you wanted to get an auto insurance quote from Geico, the answer to a common question “Were you eligible to drive at 18?” could be inferred from the driver receiving their license at age 16 2. If you were doing competitor analysis, it’s understanding that an Arnold Palmer 22 oz can at 7/11 is almost definitely the same product as a 23 oz can at Gopuff (even though the sizes are slightly different, which could be a rounding error!) Want to see examples of Skyvern in action? Jump to #real-world-examples-of- skyvern
![pipecat-flows Screenshot](/screenshots_githubs/pipecat-ai-pipecat-flows.jpg)
pipecat-flows
Pipecat Flows is a framework designed for building structured conversations in AI applications. It allows users to create both predefined conversation paths and dynamically generated flows, handling state management and LLM interactions. The framework includes a Python module for building conversation flows and a visual editor for designing and exporting flow configurations. Pipecat Flows is suitable for scenarios such as customer service scripts, intake forms, personalized experiences, and complex decision trees.
![vnc-lm Screenshot](/screenshots_githubs/jake83741-vnc-lm.jpg)
vnc-lm
vnc-lm is a Discord bot designed for messaging with language models. Users can configure model parameters, branch conversations, and edit prompts to enhance responses. The bot supports various providers like OpenAI, Huggingface, and Cloudflare Workers AI. It integrates with ollama and LiteLLM, allowing users to access a wide range of language model APIs through a single interface. Users can manage models, switch between models, split long messages, and create conversation branches. LiteLLM integration enables support for OpenAI-compatible APIs and local LLM services. The bot requires Docker for installation and can be configured through environment variables. Troubleshooting tips are provided for common issues like context window problems, Discord API errors, and LiteLLM issues.
![OpenAI-sublime-text Screenshot](/screenshots_githubs/yaroslavyaroslav-OpenAI-sublime-text.jpg)
OpenAI-sublime-text
The OpenAI Completion plugin for Sublime Text provides first-class code assistant support within the editor. It utilizes LLM models to manipulate code, engage in chat mode, and perform various tasks. The plugin supports OpenAI, llama.cpp, and ollama models, allowing users to customize their AI assistant experience. It offers separated chat histories and assistant settings for different projects, enabling context-specific interactions. Additionally, the plugin supports Markdown syntax with code language syntax highlighting, server-side streaming for faster response times, and proxy support for secure connections. Users can configure the plugin's settings to set their OpenAI API key, adjust assistant modes, and manage chat history. Overall, the OpenAI Completion plugin enhances the Sublime Text editor with powerful AI capabilities, streamlining coding workflows and fostering collaboration with AI assistants.
![intellij-aicoder Screenshot](/screenshots_githubs/SimiaCryptus-intellij-aicoder.jpg)
intellij-aicoder
AI Coding Assistant is a free and open-source IntelliJ plugin that leverages cutting-edge Language Model APIs to enhance developers' coding experience. It seamlessly integrates with various leading LLM APIs, offers an intuitive toolbar UI, and allows granular control over API requests. With features like Code & Patch Chat, Planning with AI Agents, Markdown visualization, and versatile text processing capabilities, this tool aims to streamline coding workflows and boost productivity.
![agents-js Screenshot](/screenshots_githubs/livekit-agents-js.jpg)
agents-js
LiveKit Agents for Node.js is a framework designed for building realtime, programmable voice agents that can see, hear, and understand. It includes support for OpenAI Realtime API, allowing for ultra-low latency WebRTC transport between GPT-4o and users' devices. The framework provides concepts like Agents, Workers, and Plugins to create complex tasks. It offers a CLI interface for running agents and a versatile web frontend called 'playground' for building and testing agents. The framework is suitable for developers looking to create conversational voice agents with advanced capabilities.
![monacopilot Screenshot](/screenshots_githubs/arshad-yaseen-monacopilot.jpg)
monacopilot
Monacopilot is a powerful and customizable AI auto-completion plugin for the Monaco Editor. It supports multiple AI providers such as Anthropic, OpenAI, Groq, and Google, providing real-time code completions with an efficient caching system. The plugin offers context-aware suggestions, customizable completion behavior, and framework agnostic features. Users can also customize the model support and trigger completions manually. Monacopilot is designed to enhance coding productivity by providing accurate and contextually appropriate completions in daily spoken language.
![open-computer-use Screenshot](/screenshots_githubs/e2b-dev-open-computer-use.jpg)
open-computer-use
Open Computer Use is a secure cloud Linux computer powered by E2B Desktop Sandbox and controlled by open-source LLMs. It allows users to operate the computer via keyboard, mouse, and shell commands, live stream the display of the sandbox on the client computer, and pause or prompt the agent at any time. The tool is designed to work with any operating system and supports integration with various LLMs and providers following the OpenAI API specification.
![llm-client Screenshot](/screenshots_githubs/dosco-llm-client.jpg)
llm-client
LLMClient is a JavaScript/TypeScript library that simplifies working with large language models (LLMs) by providing an easy-to-use interface for building and composing efficient prompts using prompt signatures. These signatures enable the automatic generation of typed prompts, allowing developers to leverage advanced capabilities like reasoning, function calling, RAG, ReAcT, and Chain of Thought. The library supports various LLMs and vector databases, making it a versatile tool for a wide range of applications.
![model.nvim Screenshot](/screenshots_githubs/gsuuon-model.nvim.jpg)
model.nvim
model.nvim is a tool designed for Neovim users who want to utilize AI models for completions or chat within their text editor. It allows users to build prompts programmatically with Lua, customize prompts, experiment with multiple providers, and use both hosted and local models. The tool supports features like provider agnosticism, programmatic prompts in Lua, async and multistep prompts, streaming completions, and chat functionality in 'mchat' filetype buffer. Users can customize prompts, manage responses, and context, and utilize various providers like OpenAI ChatGPT, Google PaLM, llama.cpp, ollama, and more. The tool also supports treesitter highlights and folds for chat buffers.
20 - OpenAI Gpts
![CISO GPT Screenshot](/screenshots_gpts/g-SLIP9xhwo.jpg)
CISO GPT
Specialized LLM in computer security, acting as a CISO with 20 years of experience, providing precise, data-driven technical responses to enhance organizational security.
![GPT Detector Screenshot](/screenshots_gpts/g-dpepdfReQ.jpg)
GPT Detector
ChatGPT Detector quickly finds AI writing from ChatGPT, LLMs, Bard, and GPT-4. It's easy and fast to use!
![FODMAPs Dietician Screenshot](/screenshots_gpts/g-e35g3BUSy.jpg)
FODMAPs Dietician
Dietician that helps those with IBS manage their symptoms via FODMAPs. FODMAP stands for fermentable oligosaccharides, disaccharides, monosaccharides and polyols. These are the chemical names of 5 naturally occurring sugars that are not well absorbed by your small intestine.
![Cognitive Behavioral Coach Screenshot](/screenshots_gpts/g-bl5PtbMmb.jpg)
Cognitive Behavioral Coach
Provides cognitive-behavioral and emotional therapy guidance, helping users understand and manage their thoughts, behaviors, and emotions.
![1ACulma - Management Coach Screenshot](/screenshots_gpts/g-oUbz8Abiw.jpg)
1ACulma - Management Coach
Cross-cultural management. Useful for those who relocate to another country or manage cross-cultural teams.
![Finance Butler(ファイナンス・バトラー) Screenshot](/screenshots_gpts/g-qZ83DsJwt.jpg)
Finance Butler(ファイナンス・バトラー)
I manage finances securely with encryption and user authentication.
![GroceriesGPT Screenshot](/screenshots_gpts/g-FCINlsXdK.jpg)
GroceriesGPT
I manage your grocery lists to help you stay organized. *1/ Tell me what to add to a list. 2/ Ask me to add all ingredients for a receipe. 3/ Upload a receipt to remove items from your lists 4/ Add an item by simply uploading a picture. 5/ Ask me what items I would recommend you add to your lists.*
![Family Legacy Assistant Screenshot](/screenshots_gpts/g-IOkMLLwkG.jpg)
Family Legacy Assistant
Helps users manage and preserve family heirlooms with empathy and practical advice.
![AI Home Doctor (Guided Care) Screenshot](/screenshots_gpts/g-9Z2Ps2W2v.jpg)
AI Home Doctor (Guided Care)
Give me your syptoms and I will provide instructions for how to manage your illness.
![MixerBox ChatGSlide Screenshot](/screenshots_gpts/g-Zikr9Yiqi.jpg)
MixerBox ChatGSlide
Your AI Google Slides assistant! Effortlessly locate, manage, and summarize your presentations!
![Herbal Healer: The Art of Botany Screenshot](/screenshots_gpts/g-5imEPTNd4.jpg)
Herbal Healer: The Art of Botany
A simulation game where players learn grow medicinal plants, craft remedies, and manage a herbal healing garden. Another AI Tiny Game by Dave Lalande