Weights & Biases: Building LLM powered apps
This is a course by Weights & Biases that explains the basics of tokenization and how to build apps using LLM APIs: https://www.wandb.courses/courses/building-llm-powered-apps
Useful notebooks: https://github.com/wandb/edu/tree/971ef92ee35ecaaf6b5a4902d11804540af60879/llm-apps-course/notebooks
Example chatbot implementation that can answer questions about documentation in form of Markdown files: https://github.com/wandb/edu/tree/971ef92ee35ecaaf6b5a4902d11804540af60879/llm-apps-course/src
Coursera / deeplearning.ai – Generative AI with Large Language Models
This course costs 39 pounds but is worth the price. It covers many topics of the LLM lifecycle in three weeks of videos, labs and quizzes. Lots of papers and articles for deeper knowledge are also provided!
Topics that are covered are:
- Transformer architectures (encoder-decoder, encoder only, decoder only) and their use cases
- Pre-training for the different transformer variants
- Fine-tuning (Parameter-efficient fine-tuning (PEFT), Low rank adaptation (LoRA), prompt tuning)
- Distributed training
- Quantization
- Model evaluation
- Reinforcement learning from human feedback (RLHF)
- Program-aided language models (PAL)
- and others
You can enroll here: https://www.coursera.org/learn/generative-ai-with-llms/