Teaching Habits Without Forgetting

A lesson in the free Generative AI course on LogicWiz, in the module Teaching FinAssistant the House Style: Fine-Tuning & Domain Adaptation. The course is free with no card. The later chapters need a free account to open the full lesson and run its lab.

What you'll learn

• The Fear of Forgetting
• Freeze Most, Train a Little
• The Detour Road: LoRA
• Two Knobs: Rank and Alpha
• Shrink the Base: QLoRA
• The PEFT Family

Create a free account to read this lesson or see the whole course.