Best AI tools for< Work With Large Language Models >

AnythingLLM is an all-in-one AI application designed for everyone. It offers a suite of tools for working with LLM (Large Language Models), documents, and agents in a fully private environment. Users can install AnythingLLM on their desktop for Windows, MacOS, and Linux, enabling flexible one-click installation and secure, fully private operation without internet connectivity. The application supports custom models, including enterprise models like GPT-4, custom fine-tuned models, and open-source models like Llama and Mistral. AnythingLLM allows users to work with various document formats, such as PDFs and word documents, providing tailored solutions with locally running defaults for privacy.

Upstage is an Artificial General Intelligence (AGI) application designed to enhance work productivity by automating simple tasks and providing decision support through generative Business Intelligence (BI) knowledge and numerical understanding. The application offers various features such as Document AI, Solar LLM, and Developers Demo Playground, enabling users to automate tasks, extract key information from documents, and create conversational agents. Upstage aims to streamline workflow automation and improve efficiency in various domains such as healthcare, finance, and law.

Playground AI is a multi-functional AI image generation tool and general purpose AI chatbot that allows you to create incredible AI art and images using Stable Diffusion and chat with different AI language models including ChatGPT, Cohere, and more. Easily create art, use one of our pre-made templates, generate custom art prompts, apply filters, change image sizes and design parameters using one of 10 AI art models based on Stable Diffusion. Chat with different AI large language models to help with getting work done, planning a trip, or having a conversation about something you want to learn more about. Playground AI makes it easy to save and access your past conversation histories or the art you created. With one click you can share online, copy and paste, and favorite conversations.

AIgentor is a free AI generator and character platform that allows users to chat with realistic AI characters from books, movies, games, or personal favorites. Users can enjoy all AI tools for free without any subscription plan, with a simple start that requires no login. The platform offers powerful integration with the latest large language models and features various AI characters like Pet Food Taster, Professional Line Sitter, Professional Mermaid Performer, Underwater Delivery, Japanese Tea Ceremony Master, Kid-Friendly Explainer, Carpenter, Drama Teacher, British Literature Teacher, and Hypnotherapist. Users can also learn how to use AI tools, gain prompt skills, and improve work efficiency.

ThirdAI is a production-ready AI platform designed for enterprise use, offering out-of-the-box solutions that work at scale and provide 10x better price performance. The platform features enterprise SSO, LLM guardrails, built-in models, a no-code interface, and implicit feedback & RLHF. It allows for turnkey deployment of complex AI ecosystems, enabling business leaders to solve critical needs quickly. With a focus on security, scalability, and performance, ThirdAI helps drive innovation and achieve business goals from day one.

Entry Point AI is a modern AI optimization platform for fine-tuning proprietary and open-source language models. It provides a user-friendly interface to manage prompts, fine-tunes, and evaluations in one place. The platform enables users to optimize models from leading providers, train across providers, work collaboratively, write templates, import/export data, share models, and avoid common pitfalls associated with fine-tuning. Entry Point AI simplifies the fine-tuning process, making it accessible to users without the need for extensive data, infrastructure, or insider knowledge.

BrainChat is an AI application that enables teams to utilize ChatGPT and other Large Language Models (LLMs) in a structured, secure, and collaborative manner for work purposes. It offers organized and collaborative chats, tailored AI assistants for various job roles, private and safe infrastructure, multiple LLM options, and cost-efficient pricing compared to ChatGPT Team. BrainChat allows users to import chats from ChatGPT, offers real-time collaboration, and ensures data security and GDPR compliance.

Odyssey is a native Mac application designed for creating remarkable art, completing tasks efficiently, and automating repetitive tasks using AI and cutting-edge machine-learning models without the need for coding. It serves as an all-purpose tool for creators, students, educators, artists, marketers, photographers, AI hobbyists, developers, interior designers, and data analysts. Odyssey offers features like image generation and processing, stable diffusion models, controlNet support, super-resolution upscaling, background removal, image transitions, large language models, math equations, automation and batch workflows, private and secure processing, custom workflows, and more. It is a versatile tool that simplifies various tasks across different fields.

Seamless is an AI Literature Review Tool for Scientific Research that enables users to draft literature reviews 100x faster by leveraging advanced AI technology. It allows researchers to find relevant papers and create a draft directly from an excerpt of their work. Seamless utilizes the Semantic Scholar database of scientific papers and large language models like GPT-4 to generate literature reviews in various fields such as engineering, computer science, chemistry, biology, law, medicine, pharma, and business. The tool is designed to streamline the process of literature review creation and enhance the efficiency of researchers and students.

Demand.io is a network of AI-driven, community-centric e-commerce applications that create social shopping experiences powered by artificial intelligence. The platform aims to help consumers shop smarter, save money, and connect with their passions by curating accurate e-commerce knowledge and delivering it through digital consumer apps and AI experiences. Demand.io leverages AI, decentralized community principles, and advanced engineering to solve complex problems and provide differentiated user value in the evolving landscape of e-commerce.

Imagen is an AI application that leverages text-to-image diffusion models to create photorealistic images based on input text. The application utilizes large transformer language models for text understanding and diffusion models for high-fidelity image generation. Imagen has achieved state-of-the-art results in terms of image fidelity and alignment with text. The application is part of Google Research's text-to-image work and focuses on encoding text for image synthesis effectively.

YesChat is an AI-driven platform that provides access to a vast array of AI technologies for various needs, including ChatGPT, GPT-4V for text generation and image understanding, Dalle3 for image creation, and Claude for document analysis. With YesChat, users can chat with their files, browse the internet, chat with images, generate images, and access nearly 200,000 GPT models for a wide variety of applications in work, study, and everyday life. YesChat offers 20 free GPT-4V uses per day, and users can subscribe for additional benefits and extended access.

MacWhisper is a native macOS application that utilizes OpenAI's Whisper technology for transcribing audio files into text. It offers a user-friendly interface for recording, transcribing, and editing audio, making it suitable for various use cases such as transcribing meetings, lectures, interviews, and podcasts. The application is designed to protect user privacy by performing all transcriptions locally on the device, ensuring that no data leaves the user's machine.

AskKarlMarx is a chatbot that allows users to ask questions to Karl Marx, the famous philosopher and economist. The chatbot is powered by ChatGPT, a large language model trained by Google. AskKarlMarx can be used to learn more about Marx's ideas, his life, and his work. It can also be used to ask questions about current events and politics from a Marxist perspective.

Code Generator for Arduino is an AI-powered tool that allows users to generate code for Arduino projects effortlessly. The website uses GPT-3.5-turbo, OpenAI's large-scale language-generation model, to create Arduino code. Users can easily create code for their Arduino devices by simply inputting their project requirements. The generated code must be reviewed before being uploaded to any hardware devices. Code Generator for Arduino is not affiliated with Arduino SA but provides a convenient solution for Arduino enthusiasts to streamline their coding process.

Notion is a connected workspace that combines wikis, docs, projects, and calendars into a single platform. It is designed to be simple and powerful, with a focus on collaboration and organization. Notion's AI assistant can help you with a variety of tasks, such as answering questions, generating text, and translating languages. With its powerful building blocks, you can customize Notion to fit your specific needs and workflows. Notion is used by millions of people around the world, from individuals and small businesses to large enterprises.

Leena AI is a Gen AI employee assistant that reduces IT, HR, Finance tickets. It guarantees a 70% self-service ratio in the contract. Leena AI centralizes knowledge that is scattered across the enterprise, making information easy to find right on chat with a simple query. The knowledge is auto-updated when changes are made, so your employees always get support that is both relevant and accurate. Leena AI integrates with all knowledge base systems within your enterprise from day one, eliminating the need for any consolidation or migration effort across the knowledge base systems. The work assistant tailors responses to employee queries based on their role, team and access level which boosts employee experience while adhering to security protocols and preventing unauthorized access to information. Leena AI analyzes historically closed tickets and learns from their resolutions to create knowledge articles that can prevent similar tickets from being raised again. Leena AI breaks down large policy documents and knowledge articles into consumable snippets so the responses are sharper and more specific to the employee’s query.

Quadratic is an infinite spreadsheet with Python, SQL, and AI. It combines the familiarity of a spreadsheet with the power of code, allowing users to analyze data, write code, and create visualizations in a single environment. With built-in Python library support, users can bring open source tools directly to their spreadsheets. Quadratic also features real-time collaboration, allowing multiple users to work on the same spreadsheet simultaneously. Additionally, Quadratic is built for speed and performance, utilizing Web Assembly and WebGL to deliver a smooth and responsive experience.

Phenaki is a model capable of generating realistic videos from a sequence of textual prompts. It is particularly challenging to generate videos from text due to the computational cost, limited quantities of high-quality text-video data, and variable length of videos. To address these issues, Phenaki introduces a new causal model for learning video representation, which compresses the video to a small representation of discrete tokens. This tokenizer uses causal attention in time, which allows it to work with variable-length videos. To generate video tokens from text, Phenaki uses a bidirectional masked transformer conditioned on pre-computed text tokens. The generated video tokens are subsequently de-tokenized to create the actual video. To address data issues, Phenaki demonstrates how joint training on a large corpus of image-text pairs as well as a smaller number of video-text examples can result in generalization beyond what is available in the video datasets. Compared to previous video generation methods, Phenaki can generate arbitrarily long videos conditioned on a sequence of prompts (i.e., time-variable text or a story) in an open domain. To the best of our knowledge, this is the first time a paper studies generating videos from time-variable prompts. In addition, the proposed video encoder-decoder outperforms all per-frame baselines currently used in the literature in terms of spatio-temporal quality and the number of tokens per video.

DeepOpinion is a Generative Automation platform designed for enterprises to automate various business processes using cutting-edge AI technology. It combines business process digitization, low/no-code development, and Generative AI to create powerful enterprise-grade automations in minutes. Trusted by enterprises large and small, DeepOpinion offers solutions for industries such as financial services, insurance, and manufacturing, with a focus on automating tasks like trade financing, consumer loan processing, and customer support. The platform also provides AI models, case studies, and testimonials to showcase its effectiveness in streamlining operations and improving efficiency.

This practical free hands-on course focuses on Large Language models and their applications, providing a hands-on experience using models from OpenAI and the Hugging Face library. The course is divided into three major sections: Techniques and Libraries, Projects, and Enterprise Solutions. It covers topics such as Chatbots, Code Generation, Vector databases, LangChain, Fine Tuning, PEFT Fine Tuning, Soft Prompt tuning, LoRA, QLoRA, Evaluate Models, Knowledge Distillation, and more. Each section contains chapters with lessons supported by notebooks and articles. The course aims to help users build projects and explore enterprise solutions using Large Language Models.

LLMFarm_core.swift is a Swift library designed to work with large language models (LLM). It enables users to load different LLMs with specific parameters. The library supports MacOS (13+) and iOS (16+), offering various inferences and sampling methods. It includes features such as Metal support (not compatible with Intel Mac), model setting templates, LoRA adapters support, and LoRA train support. The library is based on ggml and llama.cpp by Georgi Gerganov, with additional sources from rwkv.cpp by saharNooby and Mia by byroneverson.

LLMFarm is an iOS and MacOS app designed to work with large language models (LLM). It allows users to load different LLMs with specific parameters, test the performance of various LLMs on iOS and macOS, and identify the most suitable model for their projects. The tool is based on ggml and llama.cpp by Georgi Gerganov and incorporates sources from rwkv.cpp by saharNooby, Mia by byroneverson, and LlamaChat by alexrozanski. LLMFarm features support for MacOS (13+) and iOS (16+), various inferences and sampling methods, Metal compatibility (not supported on Intel Mac), model setting templates, LoRA adapters support, LoRA finetune support, LoRA export as model support, and more. It also offers a range of inferences including LLaMA, GPTNeoX, Replit, GPT2, Starcoder, RWKV, Falcon, MPT, Bloom, and others. Additionally, it supports multimodal models like LLaVA, Obsidian, and MobileVLM. Users can customize inference options through JSON files and access supported models for download.

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS. It's a lightweight abstraction layer over `llama.cpp` package, so that it stays as performant as possible while is always up to date. Theoretically, any model that works on `llama.cpp` should work with this library as well. It's only a single file library, so you can copy, study and modify the code however you want.

Podman AI Lab is an open source extension for Podman Desktop designed to work with Large Language Models (LLMs) on a local environment. It features a recipe catalog with common AI use cases, a curated set of open source models, and a playground for learning, prototyping, and experimentation. Users can quickly and easily get started bringing AI into their applications without depending on external infrastructure, ensuring data privacy and security.

An Open-Source Engineering Guide for Prompt-in-context-learning from EgoAlpha Lab. 📝 Papers | ⚡️ Playground | 🛠 Prompt Engineering | 🌍 ChatGPT Prompt | ⛳ LLMs Usage Guide > **⭐️ Shining ⭐️:** This is fresh, daily-updated resources for in-context learning and prompt engineering. As Artificial General Intelligence (AGI) is approaching, let’s take action and become a super learner so as to position ourselves at the forefront of this exciting era and strive for personal and professional greatness. The resources include: _🎉Papers🎉_: The latest papers about _In-Context Learning_ , _Prompt Engineering_ , _Agent_ , and _Foundation Models_. _🎉Playground🎉_: Large language models（LLMs）that enable prompt experimentation. _🎉Prompt Engineering🎉_: Prompt techniques for leveraging large language models. _🎉ChatGPT Prompt🎉_: Prompt examples that can be applied in our work and daily lives. _🎉LLMs Usage Guide🎉_: The method for quickly getting started with large language models by using LangChain. In the future, there will likely be two types of people on Earth (perhaps even on Mars, but that's a question for Musk): - Those who enhance their abilities through the use of AIGC; - Those whose jobs are replaced by AI automation. 💎EgoAlpha: Hello! human👤, are you ready?

gollm is a Go package designed to simplify interactions with Large Language Models (LLMs) for AI engineers and developers. It offers a unified API for multiple LLM providers, easy provider and model switching, flexible configuration options, advanced prompt engineering, prompt optimization, memory retention, structured output and validation, provider comparison tools, high-level AI functions, robust error handling and retries, and extensible architecture. The package enables users to create AI-powered golems for tasks like content creation workflows, complex reasoning tasks, structured data generation, model performance analysis, prompt optimization, and creating a mixture of agents.

This repository provides resources, demos, and recipes for working with Large Language Models (LLMs) on OpenShift using OpenShift AI or Open Data Hub. It includes instructions for deploying inference servers for LLMs, such as vLLM, Hugging Face TGI, Caikit-TGIS-Serving, and Ollama. Additionally, it offers guidance on deploying serving runtimes, such as vLLM Serving Runtime and Hugging Face Text Generation Inference, in the Single-Model Serving stack of Open Data Hub or OpenShift AI. The repository also covers vector databases that can be used as a Vector Store for Retrieval Augmented Generation (RAG) applications, including Milvus, PostgreSQL+pgvector, and Redis. Furthermore, it provides examples of inference and application usage, such as Caikit, Langchain, Langflow, and UI examples.

PyLLMCore is a light-weighted interface with Large Language Models with native support for llama.cpp, OpenAI API, and Azure deployments. It offers a Pythonic API that is simple to use, with structures provided by the standard library dataclasses module. The high-level API includes the assistants module for easy swapping between models. PyLLMCore supports various models including those compatible with llama.cpp, OpenAI, and Azure APIs. It covers use cases such as parsing, summarizing, question answering, hallucinations reduction, context size management, and tokenizing. The tool allows users to interact with language models for tasks like parsing text, summarizing content, answering questions, reducing hallucinations, managing context size, and tokenizing text.

Transformer Lab is an app that allows users to experiment with Large Language Models by providing features such as one-click download of popular models, finetuning across different hardware, RLHF and Preference Optimization, working with LLMs across different operating systems, chatting with models, using different inference engines, evaluating models, building datasets for training, calculating embeddings, providing a full REST API, running in the cloud, converting models across platforms, supporting plugins, embedded Monaco code editor, prompt editing, inference logs, all through a simple cross-platform GUI.

LLMOps Duke AIPI is a course focused on operationalizing Large Language Models, teaching methodologies for developing applications using software development best practices with large language models. The course covers various topics such as generative AI concepts, setting up development environments, interacting with large language models, using local large language models, applied solutions with LLMs, extensibility using plugins and functions, retrieval augmented generation, introduction to Python web frameworks for APIs, DevOps principles, deploying machine learning APIs, LLM platforms, and final presentations. Students will learn to build, share, and present portfolios using Github, YouTube, and Linkedin, as well as develop non-linear life-long learning skills. Prerequisites include basic Linux and programming skills, with coursework available in Python or Rust. Additional resources and references are provided for further learning and exploration.

The 'llm' package for Emacs provides an interface for interacting with Large Language Models (LLMs). It abstracts functionality to a higher level, concealing API variations and ensuring compatibility with various LLMs. Users can set up providers like OpenAI, Gemini, Vertex, Claude, Ollama, GPT4All, and a fake client for testing. The package allows for chat interactions, embeddings, token counting, and function calling. It also offers advanced prompt creation and logging capabilities. Users can handle conversations, create prompts with placeholders, and contribute by creating providers.

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output (objects). It provides a simple yet robust interface and supports llama-cpp-python and OpenAI endpoints with GBNF grammar support (like the llama-cpp-python server) and the llama.cpp backend server. It works by generating a formal GGML-BNF grammar of the user defined structures and functions, which is then used by llama.cpp to generate text valid to that grammar. In contrast to most GBNF grammar generators it also supports nested objects, dictionaries, enums and lists of them.

Aider is an AI pair programming tool that allows users to collaborate with large language models (LLMs) to edit code in their local git repository. It works best with GPT-4o & Claude 3.5 Sonnet and can connect to almost any LLM. Users can run Aider with specific files, request changes, add new features or test cases, describe bugs, refactor code, update docs, and more. Aider automatically commits changes with sensible messages, supports multiple programming languages, and can handle complex requests by editing multiple files at once. It uses a map of the entire git repo for efficient performance in larger codebases. Users can chat with Aider, add images, URLs, and even code with their voice. Aider has achieved top scores on SWE Bench, solving real GitHub issues from popular open source projects like django, scikitlearn, matplotlib, etc.

LLMClient is a JavaScript/TypeScript library that simplifies working with large language models (LLMs) by providing an easy-to-use interface for building and composing efficient prompts using prompt signatures. These signatures enable the automatic generation of typed prompts, allowing developers to leverage advanced capabilities like reasoning, function calling, RAG, ReAcT, and Chain of Thought. The library supports various LLMs and vector databases, making it a versatile tool for a wide range of applications.

Awesome-AI-Agents is a curated list of projects, frameworks, benchmarks, platforms, and related resources focused on autonomous AI agents powered by Large Language Models (LLMs). The repository showcases a wide range of applications, multi-agent task solver projects, agent society simulations, and advanced components for building and customizing AI agents. It also includes frameworks for orchestrating role-playing, evaluating LLM-as-Agent performance, and connecting LLMs with real-world applications through platforms and APIs. Additionally, the repository features surveys, paper lists, and blogs related to LLM-based autonomous agents, making it a valuable resource for researchers, developers, and enthusiasts in the field of AI.

PatchWork is an open-source framework designed for automating development tasks using large language models. It enables users to automate workflows such as PR reviews, bug fixing, security patching, and more through a self-hosted CLI agent and preferred LLMs. The framework consists of reusable atomic actions called Steps, customizable LLM prompts known as Prompt Templates, and LLM-assisted automations called Patchflows. Users can run Patchflows locally in their CLI/IDE or as part of CI/CD pipelines. PatchWork offers predefined patchflows like AutoFix, PRReview, GenerateREADME, DependencyUpgrade, and ResolveIssue, with the flexibility to create custom patchflows. Prompt templates are used to pass queries to LLMs and can be customized. Contributions to new patchflows, steps, and the core framework are encouraged, with chat assistants available to aid in the process. The roadmap includes expanding the patchflow library, introducing a debugger and validation module, supporting large-scale code embeddings, parallelization, fine-tuned models, and an open-source GUI. PatchWork is licensed under AGPL-3.0 terms, while custom patchflows and steps can be shared using the Apache-2.0 licensed patchwork template repository.

This repository contains a Rest-Backend for a Conversational Agent that allows embedding documents, semantic search, QA based on documents, and document processing with Large Language Models. It uses Aleph Alpha and OpenAI Large Language Models to generate responses to user queries, includes a vector database, and provides a REST API built with FastAPI. The project also features semantic search, secret management for API keys, installation instructions, and development guidelines for both backend and frontend components.

Txtai is an all-in-one embeddings database for semantic search, LLM orchestration, and language model workflows. It combines vector indexes, graph networks, and relational databases to enable vector search with SQL, topic modeling, retrieval augmented generation, and more. Txtai can stand alone or serve as a knowledge source for large language models (LLMs). Key features include vector search with SQL, object storage, topic modeling, graph analysis, multimodal indexing, embedding creation for various data types, pipelines powered by language models, workflows to connect pipelines, and support for Python, JavaScript, Java, Rust, and Go. Txtai is open-source under the Apache 2.0 license.

Awesome-LLM is a curated list of resources related to large language models, focusing on papers, projects, frameworks, tools, tutorials, courses, opinions, and other useful resources in the field. It covers trending LLM projects, milestone papers, other papers, open LLM projects, LLM training frameworks, LLM evaluation frameworks, tools for deploying LLM, prompting libraries & tools, tutorials, courses, books, and opinions. The repository provides a comprehensive overview of the latest advancements and resources in the field of large language models.

An AI sidekick trained on your world █▓▓▒▒░░░░░░░░░░░░░░░░░░░░░▒▒▒▒▓▓█ Personalize GPT with context about your life, work, and other unique knowledge.

Maintain the originality of your work with our Plagiarism Checker. This plagiarism checker identifies duplicate content, ensuring your work's uniqueness and integrity.

Generates believable, ethical excuses for not attending work.

To assist individuals seeking to learn about or work with Microsoft's Defender for Endpoint. I provide detailed explanations, step-by-step guides, troubleshooting advice, cybersecurity best practices, and demonstrations, all specifically tailored to Microsoft Defender for Endpoint.

A Learning Experience Designer (LXD) - in support of LXDs and those who work with them.

This FREE tool can help you choose the best gold investment companies to work with.

The union steward bro, guiding you through the intricacies of union work with the wisdom of a seasoned pro and the warmth of a trusted colleague.

This is a guide on how to do a 401k to gold IRA rollover, and select the best company to work with.

Design logos from sketches. Upload a sketch of your logo idea to Logo Creator GPT. Tell it your company name, select the style you like, choose your colors and let Logo Creator GPT do the rest. Then work with Logo Creator GPT to refine and edit it until you have the perfect brand logo.

This GPT will help any business developer write their own technical Statement of Work.

Hint-giving, single-question quiz master on Twain

In-depth tutor for complex and simple STEM queries with customizable learning paths

A safeguarding advisor for schools, aligned with 'Keeping Children Safe In Education' guidelines.

Creates measurable objectives from educational documents and suggests assessments based on those LO's. PDF's work best.

A creative aide for Theatre Directors, offering suggestions and organizational support.

Expert in comprehensive work reports with insights and clarifications, just upload your data!

Conduct various flexible analyses and inquiries based on official information about companies with work visa sponsorship qualifications.

Efficient planner for nurses with subtle priority management.

Guides in creating a Work Contribution Record Table.

Using "Crucial Conversations," I can help you handle work and home challenges with confidence and clarity.