Tech
Building a Fine-Tuning Dataset From Production Logs
Production logs are the best training data you will ever have and the most dangerous. They are real inputs in the real distribution — and they are full of your current model’s outputs, which is exactly what you must not train on.
Selection is the entire job
A log dump is not a dataset. Ninety percent of production traffic is the model already doing the right thing, and training on it teaches nothing you do not already have. The examples worth including are the ones carrying infor...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to