Awesome-LLM-Resources-List

Awesome-LLM-Resources-List

A Curated Collection of LLM resources (work in progress).

Stars: 95

Visit
 screenshot

Awesome LLM Resources is a curated collection of resources for Large Language Models (LLMs) covering various aspects such as serverless hosting, accessing off-the-shelf models via API, local inference, LLM serving frameworks, open-source LLM web chat UIs, renting GPUs for fine-tuning, fine-tuning with no-code UI, fine-tuning frameworks, OS agentic/AI workflow, AI agents, co-pilots, voice API, open-source TTS models, OS RAG frameworks, research papers on chain-of-thought prompting, CoT implementations, CoT fine-tuned models & datasets, and more.

README:

๐ŸŒŸ Awesome LLM Resources

A Curated Collection of LLM resources. ๐Ÿ’กโœจ

๐ŸŒ Updated: 8th November 2024

'Serverless' Hosting of Private/OS Models

Platform/Tool Rel. Scale Down OS ๐Ÿ”“ GH Start GPU Machine One-Click Dev Exp. Free-Tier
Beam.Cloud 2021 > 1 min GitHub Repo stars GitHub followers Helpers โŒ โŒ ๐Ÿ‘ ๐Ÿ†“ 15h
Baseten 2019 > 15 min ๐Ÿ”ด GitHub followers Guide โŒ ๐ŸŸก ๐Ÿ‘ $30
Modal 2021 < 1 min ๐Ÿ”ด GitHub followers Helpers โŒ โŒ ๐Ÿ‘ $30/m
HF Endpoints 2023 > 15 min ๐Ÿ”ด GitHub followers None Needed โŒ โœ… ๐Ÿ˜“ โŒ
Replicate 2019 < 1 min ๐Ÿ”ด GitHub followers Guide โœ… ๐ŸŸก ๐Ÿคท โŒ
Sagemaker (Serverless) 2017 N/A ๐Ÿ”ด GitHub followers N/A ๐Ÿ”ต โŒ โŒ 300,000s
Lambda w/ EFS (AWS) 2014 < 1 min ๐Ÿ”ด GitHub followers Guide ๐ŸŸก โŒ โŒ โœ…
RunPod Serverless 2022 > 30s ๐Ÿ”ด GitHub followers N/A ๐ŸŸก โŒ ๐Ÿคท โŒ
BentoML 2019 > 5 min GitHub Repo stars GitHub followers Gallery ๐ŸŸก ๐ŸŸก ๐Ÿ‘ ๐Ÿ†“ $10

It goes without saying that these platforms can usually do more than LLM serving**

Access Off-the-Shelf OS Models (via API):

Platform/Tool Released GitHub
Together.ai N/A ๐Ÿ”ด
Fireworks.ai N/A GitHub followers
Replicate 2019 GitHub followers
Groq N/A GitHub followers
DeepInfra N/A GitHub followers
Bedrock N/A GitHub followers
Lepton N/A GitHub followers
Fal.ai N/A GitHub followers
VertexAI N/A GitHub followers

Local Inference

Framework Browser Chat ๐Ÿ–ฅ๏ธ Organization Open Source GitHub
Llama.cpp โŒ ggerganov GitHub Repo stars GitHub followers
Ollama โŒ Ollama GitHub Repo stars GitHub followers
gpt4all โœ… Nomic.ai GitHub Repo stars GitHub followers
LMStudio โœ… LMStudio AI ๐Ÿ”ด GitHub followers
OpenLLM โœ… BentoML GitHub Repo stars GitHub followers

LLM Serving Frameworks

Framework Open Source GitHub
vLLM GitHub Repo stars GitHub followers
OpenLLM GitHub Repo stars GitHub followers
TGI (Text Generation Inference) GitHub Repo stars GitHub followers
TensorRT LLM GitHub Repo stars GitHub followers
Ray Serve GitHub Repo stars GitHub followers
LMDeploy GitHub Repo stars GitHub followers
Ollama GitHub Repo stars GitHub followers
MLC-LLM GitHub Repo stars GitHub followers

Open-Source LLM Web Chat UIs

Tool Organization Description Open Source GitHub
Text Generation WebUI oobabooga A Gradio web UI for Large Language Models. GitHub Repo stars GitHub followers
Jan AI Jan HQ Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) GitHub Repo stars GitHub followers
AnythingLLM Mintplex Labs The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more. GitHub Repo stars GitHub followers
Superagent Superagent AI Superagent allows any developer to add powerful AI assistants to their applications. These assistants use large language models (LLM), retrieval augmented generation (RAG), and generative AI to help users. GitHub Repo stars GitHub followers
Bionic-GPT Bionic GPT Replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality. GitHub Repo stars GitHub followers
Open WebUI Open WebUI A user-friendly web interface for interacting with Large Language Models (LLMs). GitHub Repo stars GitHub followers

Rent GPUs (Fine-Tuning, Deploying, Training)

Platform Templates Beginner Friendly GitHub
Brev.dev Fine-tuning โŒ GitHub followers
Modal Fine-tuning โŒ GitHub followers
Hyperbolic AI None โŒ GitHub followers
RunPod None โŒ GitHub followers
Paperspace Fine-tuning โœ… GitHub followers
Colab Small models only โœ… GitHub followers

Fine-Tuning with No-Code UI

Tool Beginner Friendly Open Source GitHub
Together.ai โœ… โŒ N/A
Hugging Face AutoTrain โœ… โŒ GitHub Repo stars
AutoML โŒ โœ… GitHub Repo stars
LLaMA-Factory โŒ โœ… GitHub Repo stars
H2O LLM Studio โœ… โœ… GitHub Repo stars

Fine-Tuning Frameworks

Framework Open Source GitHub
Axolotl GitHub Repo stars GitHub followers
Unsloth GitHub Repo stars GitHub followers

OS Agentic/AI Workflow

Framework Open Source Beginner Friendly Released GitHub
LangChain GitHub Repo stars โœ… 2022 GitHub followers
LangGraph GitHub Repo stars โŒ 2023 GitHub followers
LlamaIndex GitHub Repo stars โŒ 2023 GitHub followers
Langroid GitHub Repo stars โŒ 2023 GitHub followers
Flowise GitHub Repo stars โœ… 2023 GitHub followers
Swarms GitHub Repo stars โŒ 2023 GitHub followers
CrewAI GitHub Repo stars โœ… 2023 GitHub followers
Autogen GitHub Repo stars โœ… 2023 GitHub followers
AutoChain GitHub Repo stars โŒ 2023 GitHub followers
SuperAGI GitHub Repo stars โŒ 2023 GitHub followers
AILegion GitHub Repo stars โŒ 2023 GitHub followers
MemGPT (Letta) GitHub Repo stars โŒ 2023 GitHub followers
uAgents GitHub Repo stars โŒ 2023 GitHub followers
Phidata GitHub Repo stars โŒ 2023 GitHub followers
Dify GitHub Repo stars โœ… 2024 GitHub followers
TaskingAI GitHub Repo stars โœ… 2024 GitHub followers
Bee Agent Framework GitHub Repo stars โŒ 2024 GitHub followers
Swarms GitHub Repo stars โŒ 2024 GitHub followers
IoA GitHub Repo stars โŒ 2024 GitHub followers
Atomic Agents GitHub Repo stars โŒ 2024 GitHub followers

AI Agents

Framework Organization Open Source Released GitHub
GPT Engineer GPT Engineer Org GitHub Repo stars 2023 GitHub followers
XAgent OpenBMB GitHub Repo stars 2023 GitHub followers
FinRobot AI4Finance Foundation GitHub Repo stars 2024 GitHub followers
STORM Stanford OVAL GitHub Repo stars 2024 GitHub followers
Multion MULTI-ON ๐Ÿ”ด N/A GitHub followers
Minion Minion AI ๐Ÿ”ด N/A GitHub followers

Co-Pilots

Framework Open Source GitHub
Aider GitHub Repo stars GitHub followers
Cursor GitHub Repo stars GitHub followers
Continue GitHub Repo stars GitHub followers

Voice API

Framework Open Source GitHub
VAPI.ai ๐Ÿ”ด GitHub followers
Bland.ai ๐Ÿ”ด N/A
CallAnnie ๐Ÿ”ด N/A
RealtimeTTS GitHub Repo stars GitHub followers
RealtimeSTT GitHub Repo stars GitHub followers
Coqui TTS GitHub Repo stars GitHub followers

Open Source TTS Models

Model License Stars/Likes Downloads (Last Month) Repository
Kokoro-82M Apache 2.0 โญ 3.16k (HF) ๐Ÿ“ฅ 557,392 Hugging Face
Zonos-v0.1-transformer Apache 2.0 โญ 249 (HF) ๐Ÿ“ฅ 24,240 Hugging Face
XTTS-v2 Non-Commercial โค๏ธ 368 (HF) ๐Ÿ“ฅ 2,545,850 Hugging Face
ChatTTS AGPL-3.0 N/A N/A GitHub
MeloTTS MIT N/A N/A GitHub

For more TTS models and rankings, check out the TTS Leaderboard.

OS RAG Frameworks

Framework Organization Open Source Released GitHub
Haystack deepset.ai GitHub Repo stars 2023 GitHub followers
RAGflow Infiniflow GitHub Repo stars 2024 GitHub followers
txtai Neuml GitHub Repo stars 2022 GitHub followers
LLM App Pathway GitHub Repo stars 2023 GitHub followers
Cognita Truefoundry GitHub Repo stars 2024 GitHub followers
R2R SciPhi AI GitHub Repo stars 2024 GitHub followers
Raptor Parth Sarthi GitHub Repo stars 2024 GitHub followers

See RAG_Techniques if you get stuck (not always needed)

Research Papers on Chain-of-Thought Prompting

Publication Date Title ๐Ÿ”— Authors Organization Technique
January 28, 2022 Chain-of-Thought Prompting Elicits Reasoning in Large Language Models ๐Ÿ”— Jason Wei, et al. DeepMind CoT Prompting
March 21, 2022 Self-Consistency Improves Chain of Thought Reasoning in Language Models ๐Ÿ”— Xuezhi Wang et al. DeepMind CoT with Self-Consistency
May 21, 2022 Least-to-Most Prompting Enables Complex Reasoning in Large Language Models ๐Ÿ”— Denny Zhou et al. DeepMind Least-to-Most Prompting
May 21, 2022 Large Language Models are Zero-Shot Reasoners ๐Ÿ”— Takeshi Kojima, et al. DeepMind Zero-shot-CoT
October 6, 2022 ReAct: Synergizing Reasoning and Acting in Language Models ๐Ÿ”— Shunyu Yao et al. Princeton University ReAct
April 1, 2023 Teaching Large Language Models to Self-Debug ๐Ÿ”— Xiang Lisa Li, et al. DeepMind, Stanford University Self-Debugging
May 6, 2023 Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models ๐Ÿ”— Lei Wang et al. The Chinese University of Hong Kong, SenseTime Research Plan-and-Solve Prompting
May 23, 2023 Letโ€™s Verify Step by Step ๐Ÿ”— Anya Goyal, et al. DeepMind Verification for CoT
October 3, 2023 Large Language Models Cannot Self-Correct Reasoning Yet ๐Ÿ”— Qingxiu Dong, et al. The Chinese University of Hong Kong, Huawei Noah's Ark Lab Self-Correction in LLMs
November 2023 Universal Self-Consistency for Large Language Model Generation ๐Ÿ”— Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, Denny Zhou DeepMind Universal Self-Consistency
May 17, 2023 Tree of Thoughts: Deliberate Problem Solving with Large Language Models ๐Ÿ”— Shunyu Yao, et al. Princeton University, DeepMind Tree-of-Thought
February 15, 2024 Chain-of-Thought Reasoning Without Prompting ๐Ÿ”— Xuezhi Wang, Denny Zhou DeepMind Chain-of-Thought Decoding
March 21, 2024 ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting ๐Ÿ”— Xiaoxue Cheng et al. Renmin University of China CoTGenius
June 2024 Language Agent Tree Search Unifies Reasoning, Acting, and Planning in Language Models ๐Ÿ”— Andy Zhou, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, Yu-Xiong Wang Language Agent Tree Search (LATS)
May 2024 Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning ๐Ÿ”— Yuxi Xie, et al. National University of Singapore, DeepMind MCTS
September 18, 2024 To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning ๐Ÿ”— Zayne Sprague, et al. The University of Texas at Austin, Johns Hopkins University, Princeton University Meta-analysis of CoT
September 25, 2024 Chain-of-Thoughtlessness? An Analysis of CoT in Planning ๐Ÿ”— Kaya Stechly, et al. Arizona State University Analysis of CoT in Planning
October 18, 2024 Supervised Chain of Thought ๐Ÿ”— Xiang Zhang, Dujian Ding University of British Columbia Supervised Chain of Thought
October 24, 2024 On examples: A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration ๐Ÿ”— Zhiqiang Hu, et al. Amazon, Michigan State University Theoretical Analysis of CoT

CoT Implementations

Implementation Link Author GitHub Stars GitHub Followers
CoT chain-of-thought-hub Franx Yao Stars Followers
CoT optillm Codelion Stars Followers
CoT auto-cot Amazon Science Stars Followers
CoT g1 BKlieger Groq Stars Followers
Decoding CoT optillm/cot_decoding.py Codelion Stars Followers
Tree of Thoughts tree-of-thought-llm Princeton NLP Stars Followers
Tree of Thoughts tree-of-thoughts Kye Gomez Stars Followers
Tree of Thoughts saplings Shobrook Stars Followers
MCTS optillm/mcts.py Codelion Stars Followers
Graph of Thoughts graph-of-thoughts SPCL Stars Followers
Other CPO SAIL SG Stars Followers
Other Everything-of-Thoughts-XoT Microsoft Stars Followers

CoT Fine-Tuned Models & Datasets

Models

Model Name Author Size Link
CoT-T5-3B KAIST AI 3B ๐Ÿ”—
CoT-T5-11B KAIST AI 11B ๐Ÿ”—
Llama-3.2V-11B-cot Xkev 11B ๐Ÿ”—
Llama-3.1-8B-Instruct-Reasoner-1o1_v0.3 Lyte 8B ๐Ÿ”—

Datasets

Dataset Name Author Data Size Likes Link
chain-of-thought-sharegpt Isaiah Bjork 7.14k rows ๐ŸŒŸ 8 ๐Ÿ”—
CoT-Collection KAIST AI 1.84 million rows ๐ŸŒŸ 122 ๐Ÿ”—
Reasoner-1o1-v0.3-HQ Lyte 370 rows ๐ŸŒŸ 7 ๐Ÿ”—
OpenLongCoT-Pretrain qq8933 103k rows ๐ŸŒŸ 86 ๐Ÿ”—

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for Awesome-LLM-Resources-List

Similar Open Source Tools

For similar tasks

For similar jobs