A support agent answers refund questions. You rewrite its instructions to be clearer, try the new version on three examples you picked, and all three come out right. The old version got two of those three right, so the change looks like a win.
That feeling is how many agent changes ship. Nothing here is a measurement yet: three hand-picked examples are a sample too small to separate improvement from luck.
💡Good to know
An eval is an experiment: same tasks, same scoring, two versions to compare.