Skip to main content

​
Fine-tuning and RL

As we’ve mentioned above, and will mention elsewhere: don’t reach for this first most analytical AI use-cases. For one thing it’s typically not necessary and a waste of time/money to gather the data that’s needed - and for another it locks model behavior into weights which can make further adaptation more difficult. Push automated prompt optimization as far as possible before deciding a task needs fine-tuning.