Professional Documents
Culture Documents
Flamingo
Flamingo
One response has accuracy issues and the other does not
One response has major grammatical errors and the other does not
One response completely responds to the prompt and the other does not
One response has minor errors that the other does not, in any dimension
When the errors in one response, when compared to errors in the other response, produce a
significantly different user experience
For example, a user prompt asking about the inspirations of Monet’s paintings:
One response may give the correct inspiration but misidentify where Monet lived
The other may respond with incorrect inspiration but correctly identify where Monet lived
When the difference between the two responses comes down to preference and is subjective
If the only difference between A and B is based on personal opinion, rather than an objective
metric, choose one of the two neutral ratings.
1. Always refer to Response A or Response B directly, never as "the selected response" or "the
first/second response" or "the other response".
2. Always be VERY specific. If you choose A over B because B has grammatical errors, point out
where those errors are.
3. Ensure the grammar and reasoning in your justification is logical and clear, and mention as many
details as possible.