Tech
Don't Fine-Tune. Unless You Can Answer These Three Questions.
Twice now I have gone looking for a retrain and found the problem somewhere else.
The first time, a third of my output had collapsed into one template. Before spending anything I counted the pattern in my training data. 5 occurrences in 1,610 examples. Then I counted it in the output. 36%. The cause was a single example I had hardcoded into my own prompt months earlier, and the model was copying it.
The second time, quality had gone flat across the board. The system prompt had grown to 224...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to