AI systems 0/10

Lesson 9 of 10

Fine-tuning versus prompting

Decide between prompting, RAG and fine-tuning, and know what LoRA changes.

1,491 words · 7 min read Ultra Premium Useful background: How an LLM call works, Evals

In this lesson

  1. What training changes
  2. Loss and generalization
  3. Choose the mechanism
  4. LoRA adapters
  5. Fit and contaminate
  6. Implement the experiment
  7. What stays true
  8. Cost and tradeoffs
  9. Common mistakes
  10. Related topics and practice

Ultra Premium

Unlock this lesson

Ultra Premium opens the 10 premium lessons in AI systems, along with the rest of WhiteBox's premium lessons and problems.

Not ready yet? Read the free lesson: Backpressure