llm-zoomcamp

llm-zoomcamp

LLM Zoomcamp - a free online course about building a Q&A system

Stars: 2755

Visit
 screenshot

LLM Zoomcamp is a free online course focusing on real-life applications of Large Language Models (LLMs). Over 10 weeks, participants will learn to build an AI bot capable of answering questions based on a knowledge base. The course covers topics such as LLMs, RAG, open-source LLMs, vector databases, orchestration, monitoring, and advanced RAG systems. Pre-requisites include comfort with programming, Python, and the command line, with no prior exposure to AI or ML required. The course features a pre-course workshop and is led by instructors Alexey Grigorev and Magdalena Kuhn, with support from sponsors and partners.

README:

LLM Zoomcamp

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base.

2024 cohort

Pre-requisites

  • Comfortable with programming and Python
  • Comfortable with command line
  • Docker
  • No previous exposure to AI or ML is required

Syllabus

We encourage Learning in Public

Pre-course workshops

Implement a search engine: Video, code

  • LLMs and RAG
  • Preparing the environment
  • Retrieval and the basics of search
  • OpenAI API
  • Simple RAG with Open AI
  • Text search with Elasticsearch
  • Getting an environment with a GPU
  • Open-source models from HuggingFace Hub
  • Running LLMs on a CPU with Ollama
  • Creating a simple UI with Streamlit
  • Vector search
  • Creating and indexing embeddings
  • Vector search with Elasticsearch
  • Offline evaluation of retrieval
  • Offline evaluation of RAG
  • Cosine and LLM-as-a-Judge metrics
  • Tracking chat history and user feedback
  • Creating dashboards with Grafana for visualization
  • Ingesting data with Mage
  • Techniques to improve RAG pipeline
  • Hybrid search
  • Document reranking
  • Hybrid search with LangChain
  • Building an end-to-end fitness assistant project
  • Examples of pre-processing text datasets

LLM Zoomcamp 2024 Competition

More details

Instructors

Asking questions

The best way to get support is to use DataTalks.Club's Slack. Join the #course-llm-zoomcamp.

To make discussions in Slack more organized:

Supporters and partners

Thanks to the course sponsors for making it possible to run this course

Do you want to support our course and our community? Please reach out to [email protected]

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for llm-zoomcamp

Similar Open Source Tools

For similar tasks

For similar jobs