Awesome-LLM-Resources-List

Awesome-LLM-Resources-List

A Curated Collection of LLM resources (work in progress).

Stars: 105

Visit
 screenshot

Awesome LLM Resources is a curated collection of resources for Large Language Models (LLMs) covering various aspects such as serverless hosting, accessing off-the-shelf models via API, local inference, LLM serving frameworks, open-source LLM web chat UIs, renting GPUs for fine-tuning, fine-tuning with no-code UI, fine-tuning frameworks, OS agentic/AI workflow, AI agents, co-pilots, voice API, open-source TTS models, OS RAG frameworks, research papers on chain-of-thought prompting, CoT implementations, CoT fine-tuned models & datasets, and more.

README:

🌟 Awesome LLM Resources

A Curated Collection of LLM resources. πŸ’‘βœ¨

🌐 Updated: 12th of March 2025

'Serverless' Hosting of Private/OS Models

Platform/Tool Rel. Scale Down OS πŸ”“ GH Start GPU Machine One-Click Dev Exp. Free-Tier
Beam.Cloud 2021 > 1 min GitHub Repo stars GitHub followers Helpers ❌ ❌ πŸ‘ πŸ†“ 15h
Baseten 2019 > 15 min πŸ”΄ GitHub followers Guide ❌ 🟑 πŸ‘ $30
Modal 2021 < 1 min πŸ”΄ GitHub followers Helpers ❌ ❌ πŸ‘ $30/m
HF Endpoints 2023 > 15 min πŸ”΄ GitHub followers None Needed ❌ βœ… πŸ˜“ ❌
Replicate 2019 < 1 min πŸ”΄ GitHub followers Guide βœ… 🟑 🀷 ❌
Sagemaker (Serverless) 2017 N/A πŸ”΄ GitHub followers N/A πŸ”΅ ❌ ❌ 300,000s
Lambda w/ EFS (AWS) 2014 < 1 min πŸ”΄ GitHub followers Guide 🟑 ❌ ❌ βœ…
RunPod Serverless 2022 > 30s πŸ”΄ GitHub followers N/A 🟑 ❌ 🀷 ❌
BentoML 2019 > 5 min GitHub Repo stars GitHub followers Gallery 🟑 🟑 πŸ‘ πŸ†“ $10

It goes without saying that these platforms can usually do more than LLM serving**

Access Off-the-Shelf OS Models (via API):

Platform/Tool Released GitHub
Together.ai N/A πŸ”΄
Fireworks.ai N/A GitHub followers
Replicate 2019 GitHub followers
Groq N/A GitHub followers
DeepInfra N/A GitHub followers
Bedrock N/A GitHub followers
Lepton N/A GitHub followers
Fal.ai N/A GitHub followers
VertexAI N/A GitHub followers

Local Inference

Framework Browser Chat πŸ–₯️ Organization Open Source GitHub
Llama.cpp ❌ ggerganov GitHub Repo stars GitHub followers
Ollama ❌ Ollama GitHub Repo stars GitHub followers
gpt4all βœ… Nomic.ai GitHub Repo stars GitHub followers
LMStudio βœ… LMStudio AI πŸ”΄ GitHub followers
OpenLLM βœ… BentoML GitHub Repo stars GitHub followers

LLM Serving Frameworks

Framework Open Source GitHub
vLLM GitHub Repo stars GitHub followers
OpenLLM GitHub Repo stars GitHub followers
TGI (Text Generation Inference) GitHub Repo stars GitHub followers
TensorRT LLM GitHub Repo stars GitHub followers
Ray Serve GitHub Repo stars GitHub followers
LMDeploy GitHub Repo stars GitHub followers
Ollama GitHub Repo stars GitHub followers
MLC-LLM GitHub Repo stars GitHub followers

Building Open-Source LLM Web Chat UIs

Tool Organization Description Open Source GitHub
Text Generation WebUI oobabooga A Gradio web UI for Large Language Models. GitHub Repo stars GitHub followers
Jan AI Jan HQ An open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM). GitHub Repo stars GitHub followers
AnythingLLM Mintplex Labs The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more. GitHub Repo stars GitHub followers
Superagent Superagent AI Allows developers to add powerful AI assistants to their applications using LLMs and RAG. GitHub Repo stars GitHub followers
Bionic-GPT Bionic GPT A ChatGPT replacement offering generative AI advantages while maintaining strict data confidentiality. GitHub Repo stars GitHub followers
Open WebUI Open WebUI A user-friendly web interface for interacting with Large Language Models (LLMs). GitHub Repo stars GitHub followers
Xyne xynehq A sleek, minimal web chat interface for interacting with Large Language Models. GitHub Repo stars GitHub followers
Assistant UI assistant-ui An open-source ChatGPT-like interface with a clean and responsive design. GitHub Repo stars GitHub followers
Scira zaidmukaddam An AI-powered search interface that leverages LLMs for intelligent search results. GitHub Repo stars GitHub followers
Onyx onyx-dot-app A customizable and extendable web chat UI for interacting with large language models. GitHub Repo stars GitHub followers
NextChat ChatGPTNextWeb A Next.js-based, open-source ChatGPT clone for seamless web interaction. GitHub Repo stars GitHub followers

Rent GPUs (Fine-Tuning, Deploying, Training)

Platform Templates Beginner Friendly GitHub
Brev.dev Fine-tuning ❌ GitHub followers
Modal Fine-tuning ❌ GitHub followers
Hyperbolic AI None ❌ GitHub followers
RunPod None ❌ GitHub followers
Paperspace Fine-tuning βœ… GitHub followers
Colab Small models only βœ… GitHub followers

Fine-Tuning with No-Code UI

Tool Beginner Friendly Open Source GitHub
Together.ai βœ… ❌ N/A
Hugging Face AutoTrain βœ… ❌ GitHub Repo stars
AutoML ❌ βœ… GitHub Repo stars
LLaMA-Factory ❌ βœ… GitHub Repo stars
H2O LLM Studio βœ… βœ… GitHub Repo stars

Fine-Tuning Frameworks

Framework Open Source GitHub
Axolotl GitHub Repo stars GitHub followers
Unsloth GitHub Repo stars GitHub followers

OS Agentic/AI Workflow

Framework Open Source Beginner Friendly Released GitHub
LangChain GitHub Repo stars βœ… 2022 GitHub followers
LangGraph GitHub Repo stars ❌ 2023 GitHub followers
LlamaIndex GitHub Repo stars ❌ 2023 GitHub followers
Langroid GitHub Repo stars ❌ 2023 GitHub followers
Flowise GitHub Repo stars βœ… 2023 GitHub followers
Swarms GitHub Repo stars ❌ 2023 GitHub followers
CrewAI GitHub Repo stars βœ… 2023 GitHub followers
Autogen GitHub Repo stars βœ… 2023 GitHub followers
AutoChain GitHub Repo stars ❌ 2023 GitHub followers
SuperAGI GitHub Repo stars ❌ 2023 GitHub followers
AILegion GitHub Repo stars ❌ 2023 GitHub followers
MemGPT (Letta) GitHub Repo stars ❌ 2023 GitHub followers
uAgents GitHub Repo stars ❌ 2023 GitHub followers
Phidata GitHub Repo stars ❌ 2023 GitHub followers
AGiXT GitHub Repo stars ❌ 2023 GitHub followers
Agno GitHub Repo stars ❌ 2023 GitHub followers
Dify GitHub Repo stars βœ… 2024 GitHub followers
TaskingAI GitHub Repo stars βœ… 2024 GitHub followers
Bee Agent Framework GitHub Repo stars ❌ 2024 GitHub followers
Swarms GitHub Repo stars ❌ 2024 GitHub followers
IoA GitHub Repo stars ❌ 2024 GitHub followers
Atomic Agents GitHub Repo stars ❌ 2024 GitHub followers
Upsonic GitHub Repo stars ❌ 2024 GitHub followers
Parlant GitHub Repo stars ❌ 2024 GitHub followers
Rig GitHub Repo stars ❌ 2024 GitHub followers
smolagents GitHub Repo stars βœ… 2023 GitHub followers
eliza GitHub Repo stars βœ… 2024 GitHub followers

Visual AI Agent Builders

Tool Organization Description Open Source GitHub
Rivet Ironclad A visual builder to design and deploy AI agent workflows. GitHub Repo stars GitHub followers
PySpur PySpur-Dev A tool to build and visualize AI agents seamlessly. GitHub Repo stars GitHub followers
Flowise FlowiseAI A no‑code, visual platform for designing AI agent workflows. GitHub Repo stars GitHub followers

Agentic Tools (for β€œbuilding”)

Tool Organization Description Open Source GitHub
browser-use browser-use Integrates browser functionalities into agentic workflows. GitHub Repo stars GitHub followers
code2prompt mufeedvh Converts code snippets into actionable prompts for development. GitHub Repo stars GitHub followers
note-gen codexu Automatically generates notes and documentation from your code. GitHub Repo stars GitHub followers
refly refly-ai Automates code refactoring and prompt generation tasks. GitHub Repo stars GitHub followers
potpie potpie-ai A toolkit for prototyping and building AI agent pipelines. GitHub Repo stars GitHub followers
AgentStack AgentOps-AI A comprehensive stack for constructing and deploying AI agents. GitHub Repo stars GitHub followers
browser lightpanda-io A browser‑based tool designed for integrating agentic functionalities. GitHub Repo stars GitHub followers
Memary kingjulio8238 A memory module for retaining context in agent workflows. GitHub Repo stars GitHub followers
open-canvas langchain-ai A visual interface for designing agent workflows with LangChain. GitHub Repo stars GitHub followers
agent-service-toolkit JoshuaC215 A toolkit for building and deploying agent-based services. GitHub Repo stars GitHub followers

Virtual Brains

Tool Organization Description Open Source GitHub
Leon leon-ai An open‑source personal assistant and automation platform powered by AI. GitHub Repo stars GitHub followers
Khoj khoj-ai A virtual brain for organizing and retrieving your knowledge using AI. GitHub Repo stars GitHub followers

AI Agents

Framework Organization Open Source Released GitHub
GPT Engineer GPT Engineer Org GitHub Repo stars 2023 GitHub followers
XAgent OpenBMB GitHub Repo stars 2023 GitHub followers
Bolt.new StackBlitz GitHub Repo stars 2023 GitHub followers
Goose Block GitHub Repo stars 2023 GitHub followers
Jobs Applier AI Agent feder-cr GitHub Repo stars 2023 GitHub followers
AI Hedge Fund virattt GitHub Repo stars 2023 GitHub followers
FinRobot AI4Finance Foundation GitHub Repo stars 2024 GitHub followers
STORM Stanford OVAL GitHub Repo stars 2024 GitHub followers
Multion MULTI-ON πŸ”΄ N/A GitHub followers
Minion Minion AI πŸ”΄ N/A GitHub followers

Co-Pilots

Framework Open Source GitHub
Aider GitHub Repo stars GitHub followers
Cursor GitHub Repo stars GitHub followers
Continue GitHub Repo stars GitHub followers

Voice API

Framework Open Source GitHub
VAPI.ai πŸ”΄ GitHub followers
Bland.ai πŸ”΄ N/A
CallAnnie πŸ”΄ N/A
RealtimeTTS GitHub Repo stars GitHub followers
RealtimeSTT GitHub Repo stars GitHub followers
Coqui TTS GitHub Repo stars GitHub followers

Open Source TTS Models

Model License Stars/Likes Downloads (Last Month) Repository
Kokoro-82M Apache 2.0 ⭐ 3.16k (HF) πŸ“₯ 557,392 Hugging Face
Zonos-v0.1-transformer Apache 2.0 ⭐ 249 (HF) πŸ“₯ 24,240 Hugging Face
XTTS-v2 Non-Commercial ❀️ 368 (HF) πŸ“₯ 2,545,850 Hugging Face
ChatTTS AGPL-3.0 N/A N/A GitHub
MeloTTS MIT N/A N/A GitHub

For more TTS models and rankings, check out the TTS Leaderboard.

LLM Application Frameworks

Tool Organization Description Open Source GitHub
Eino CloudWeGo A lightweight LLM application framework for scalable AI solutions. GitHub Repo stars GitHub followers
Conversation Knowledge Mining Solution Accelerator Microsoft A solution accelerator for integrating conversation intelligence and knowledge mining using LLMs. GitHub Repo stars GitHub followers
Olmocr AllenAI An OCR framework optimized for integration with language models. GitHub Repo stars GitHub followers
PDFMathTranslate Byaidu A tool for converting and translating mathematical content in PDFs using LLMs. GitHub Repo stars GitHub followers
Podcastfy souzatharsis A tool to generate podcasts from written content using LLMs. GitHub Repo stars GitHub followers
Pandas AI sinaptik-ai Brings LLM-powered analytics to pandas dataframes. GitHub Repo stars GitHub followers
Ramalama containers An LLM application framework for containerized deployment of AI solutions. GitHub Repo stars GitHub followers
Robyn facebookexperimental A scalable framework for building LLM applications from Facebook Experimental. GitHub Repo stars GitHub followers
ExtractThinker enoch3712 A tool for extracting and synthesizing insights from textual data using LLMs. GitHub Repo stars GitHub followers

OS RAG Frameworks

Framework Organization Open Source Released GitHub
Haystack deepset.ai GitHub Repo stars 2023 GitHub followers
RAGflow Infiniflow GitHub Repo stars 2024 GitHub followers
txtai Neuml GitHub Repo stars 2022 GitHub followers
LLM App Pathway GitHub Repo stars 2023 GitHub followers
Cognita Truefoundry GitHub Repo stars 2024 GitHub followers
R2R SciPhi AI GitHub Repo stars 2024 GitHub followers
Raptor Parth Sarthi GitHub Repo stars 2024 GitHub followers
LightRAG HKUDS GitHub Repo stars 2023 GitHub followers
PIKE-RAG Microsoft GitHub Repo stars 2024 GitHub followers
KAG OpenSPG GitHub Repo stars 2024 GitHub followers
MemoRAG qhjqhj00 GitHub Repo stars 2023 GitHub followers

See RAG_Techniques if you get stuck (not always needed)

AI Tools (for β€œusing”)

Tool Organization Description Open Source GitHub
magic-resume JOYCEQL An AI-powered tool for generating resumes. GitHub Repo stars GitHub followers
VideoCaptioner WEIFENG2333 An AI tool for automatically generating video captions. GitHub Repo stars GitHub followers
DeepSeekAI DeepLifeStudio Browser extension for invoking the DeepSeek AI large model. GitHub Repo stars GitHub followers
logocreator Nutlope A tool for creating logos using AI. GitHub Repo stars GitHub followers
blinkshot Nutlope An AI-powered tool for capturing and enhancing screenshots. GitHub Repo stars GitHub followers
pollinations pollinations A tool for generating creative images and artwork using AI. GitHub Repo stars GitHub followers
PromptWizard microsoft A tool to generate, manage, and optimize prompts for AI models. GitHub Repo stars GitHub followers
Open-Interface AmberSahdev Control Any Computer Using LLMs. GitHub Repo stars GitHub followers
wut shobrook LLM for the terminal GitHub Repo stars GitHub followers

Training/Optimization

Tool Organization Description Open Source GitHub
transformerlab-app transformerlab An application for training and optimizing transformer models. GitHub Repo stars GitHub followers
fluxgym cocktailpeanut A gym environment for reinforcement learning training and optimization. GitHub Repo stars GitHub followers
AutoGPTQ AutoGPTQ A tool for automating GPT quantization and optimization. GitHub Repo stars GitHub followers

AI Models

Tool Organization Description Open Source GitHub
WALDO stephansturges An AI model for visual reasoning and object detection. GitHub Repo stars GitHub followers
Janus deepseek-ai A multi-modal AI model for advanced data processing. GitHub Repo stars GitHub followers
ModernBERT AnswerDotAI A modernized version of BERT for natural language processing tasks. GitHub Repo stars GitHub followers
Magma microsoft A scalable AI model for large-scale data analysis. GitHub Repo stars GitHub followers
Cosmos-Nemotron NVlabs An AI model for advanced image and video processing. GitHub Repo stars GitHub followers
Paints-UNDO lllyasviel An interactive AI model for image generation and editing. GitHub Repo stars GitHub followers

Monitoring / Evaluation

Tool Organization Description Open Source GitHub
helicone Helicone A platform for monitoring and analyzing AI model performance. GitHub Repo stars GitHub followers
langwatch langwatch A tool for monitoring outputs and performance of language models. GitHub Repo stars GitHub followers
shortest antiwork A tool for evaluating and optimizing AI-generated content. GitHub Repo stars GitHub followers
deepeval confident-ai A framework for deep evaluation of AI models. GitHub Repo stars GitHub followers

Infrastructure

Tool Organization Description Open Source GitHub
gpustack gpustack A toolkit for managing GPU infrastructure for AI workloads. GitHub Repo stars GitHub followers
harbor av A repository for containerized AI infrastructure management. GitHub Repo stars GitHub followers

Research Papers on Chain-of-Thought Prompting

Publication Date Title πŸ”— Authors Organization Technique
January 28, 2022 Chain-of-Thought Prompting Elicits Reasoning in Large Language Models πŸ”— Jason Wei, et al. DeepMind CoT Prompting
March 21, 2022 Self-Consistency Improves Chain of Thought Reasoning in Language Models πŸ”— Xuezhi Wang et al. DeepMind CoT with Self-Consistency
May 21, 2022 Least-to-Most Prompting Enables Complex Reasoning in Large Language Models πŸ”— Denny Zhou et al. DeepMind Least-to-Most Prompting
May 21, 2022 Large Language Models are Zero-Shot Reasoners πŸ”— Takeshi Kojima, et al. DeepMind Zero-shot-CoT
October 6, 2022 ReAct: Synergizing Reasoning and Acting in Language Models πŸ”— Shunyu Yao et al. Princeton University ReAct
April 1, 2023 Teaching Large Language Models to Self-Debug πŸ”— Xiang Lisa Li, et al. DeepMind, Stanford University Self-Debugging
May 6, 2023 Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models πŸ”— Lei Wang et al. The Chinese University of Hong Kong, SenseTime Research Plan-and-Solve Prompting
May 23, 2023 Let’s Verify Step by Step πŸ”— Anya Goyal, et al. DeepMind Verification for CoT
October 3, 2023 Large Language Models Cannot Self-Correct Reasoning Yet πŸ”— Qingxiu Dong, et al. The Chinese University of Hong Kong, Huawei Noah's Ark Lab Self-Correction in LLMs
November 2023 Universal Self-Consistency for Large Language Model Generation πŸ”— Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, Denny Zhou DeepMind Universal Self-Consistency
May 17, 2023 Tree of Thoughts: Deliberate Problem Solving with Large Language Models πŸ”— Shunyu Yao, et al. Princeton University, DeepMind Tree-of-Thought
February 15, 2024 Chain-of-Thought Reasoning Without Prompting πŸ”— Xuezhi Wang, Denny Zhou DeepMind Chain-of-Thought Decoding
March 21, 2024 ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting πŸ”— Xiaoxue Cheng et al. Renmin University of China CoTGenius
June 2024 Language Agent Tree Search Unifies Reasoning, Acting, and Planning in Language Models πŸ”— Andy Zhou, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, Yu-Xiong Wang Language Agent Tree Search (LATS)
May 2024 Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning πŸ”— Yuxi Xie, et al. National University of Singapore, DeepMind MCTS
September 18, 2024 To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning πŸ”— Zayne Sprague, et al. The University of Texas at Austin, Johns Hopkins University, Princeton University Meta-analysis of CoT
September 25, 2024 Chain-of-Thoughtlessness? An Analysis of CoT in Planning πŸ”— Kaya Stechly, et al. Arizona State University Analysis of CoT in Planning
October 18, 2024 Supervised Chain of Thought πŸ”— Xiang Zhang, Dujian Ding University of British Columbia Supervised Chain of Thought
October 24, 2024 On examples: A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration πŸ”— Zhiqiang Hu, et al. Amazon, Michigan State University Theoretical Analysis of CoT

CoT Implementations

Implementation Link Author GitHub Stars GitHub Followers
CoT chain-of-thought-hub Franx Yao Stars Followers
CoT optillm Codelion Stars Followers
CoT auto-cot Amazon Science Stars Followers
CoT g1 BKlieger Groq Stars Followers
Decoding CoT optillm/cot_decoding.py Codelion Stars Followers
Tree of Thoughts tree-of-thought-llm Princeton NLP Stars Followers
Tree of Thoughts tree-of-thoughts Kye Gomez Stars Followers
Tree of Thoughts saplings Shobrook Stars Followers
MCTS optillm/mcts.py Codelion Stars Followers
Graph of Thoughts graph-of-thoughts SPCL Stars Followers
Other CPO SAIL SG Stars Followers
Other Everything-of-Thoughts-XoT Microsoft Stars Followers

CoT Fine-Tuned Models & Datasets

Models

Model Name Author Size Link
CoT-T5-3B KAIST AI 3B πŸ”—
CoT-T5-11B KAIST AI 11B πŸ”—
Llama-3.2V-11B-cot Xkev 11B πŸ”—
Llama-3.1-8B-Instruct-Reasoner-1o1_v0.3 Lyte 8B πŸ”—

Datasets

Dataset Name Author Data Size Likes Link
chain-of-thought-sharegpt Isaiah Bjork 7.14k rows 🌟 8 πŸ”—
CoT-Collection KAIST AI 1.84 million rows 🌟 122 πŸ”—
Reasoner-1o1-v0.3-HQ Lyte 370 rows 🌟 7 πŸ”—
OpenLongCoT-Pretrain qq8933 103k rows 🌟 86 πŸ”—

Learning Resources

Tool Organization Description Open Source GitHub
awesome-cursorrules PatrickJS A curated list of resources and guides on cursorrules. GitHub Repo stars GitHub followers
ai-engineering-hub patchy631 A hub of AI engineering learning resources, tutorials, and best practices. GitHub Repo stars GitHub followers
GenAI_Agents NirDiamant Resources and examples for building Generative AI Agents. GitHub Repo stars GitHub followers
learn-agentic-ai panaversity Learning materials for understanding and building agentic AI. GitHub Repo stars GitHub followers
awesome-generative-ai steven2358 A curated list of generative AI resources and projects. GitHub Repo stars GitHub followers
awesome-mcp-servers punkpeye A curated collection of awesome MCP servers resources. GitHub Repo stars GitHub followers
GenAI-Showcase mongodb-developer A showcase of innovative Generative AI projects. GitHub Repo stars GitHub followers
well-architected-iac-analyzer aws-samples A tool to analyze and ensure well-architected Infrastructure as Code practices. GitHub Repo stars GitHub followers
llama-cookbook meta-llama A collection of recipes and guides for working with LLaMA models. GitHub Repo stars GitHub followers
optillm codelion Resources for optimizing LLM usage and performance. GitHub Repo stars GitHub followers
cursor.directory pontusab A directory of tools and resources related to cursor-based workflows. GitHub Repo stars GitHub followers
GenAI_Agents NirDiamant A curated collection of generative AI agents and related tools. GitHub Repo stars GitHub followers

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for Awesome-LLM-Resources-List

Similar Open Source Tools

For similar tasks

For similar jobs