Instruction Tuning

Summary

Fine-tuning a pretrained model on (instruction, response) pairs so it learns to follow directions rather than just complete text — the step that turns a base model into an assistant.

• 1Study the format of an instruction-tuning dataset (e.g. Alpaca-style).
• 2Fine-tune a small model on an instruction dataset and compare its behavior before/after.
• 3Learn how instruction tuning differs from RLHF as a later alignment step.