6.7.4
Beta 0.1: Standard Starting Point
Understand why beta 0.1 is the default starting point for balancing model quality and training stability.
What is it?
The source identifies β = 0.1 as the standard default starting point. It offers a balance between response quality improvement and training stability.
Key points
1. β = 0.1.
2. Regime: Standard.
3. Default starting point in the source.
4. Balances quality and stability.
5. Provides a practical baseline for further tuning.
Beta 0.1 – Standard Starting Point
Scenario: You are beginning DPO training and do not yet have evidence that an aggressive or highly conservative setting is necessary.
Start with β = 0.1, then evaluate quality and stability.
Real-world application
Use β = 0.1 as the initial experiment setting and compare alternatives using validation preference data.
Key takeaway
β = 0.1 is the source-recommended default starting point.