Scorecard Prompt Comment
Human reviewer should be able to edit AI's comments, most especially when manually changing the rating. While there is a field for general feedback, a prompt/parameter-specific comment is necessary to direct the agent to the exact interaction timestamps where failure or misbehavior happened, which AI may have missed to review.
Current state: AI's comment vanishes, if there is one, when the rating is manually edited.
Ideal state: Human reviewer should be able to input a comment when for that specific prompt when the rating is manually edited.
8
votes