A single headline metric is an average, and averages are very good at hiding the people your model fails. Here is a reproducible example, the code to catch it,