Skip to main content

Edit Calibration Evaluator Feedback Phrases

Written by Alex Richards

How do I edit the phrases used to encourage evaluator-feedback as part of a calibration session?

Required Feature Flags

The following feature flags and permissions are required to use this feature:

Feature Flag

Technical Name

Description

Calibration

feature_calibration

Enables calibration sessions and the Calibration Feedback tab

Feedback

feature_feedback

Enables the wider feedback functionality

Required Permissions:

  • Configure feedback settings (feedback.settings.configure) β€” to edit calibration feedback titles, prompts, and active statuses

Overview

When running calibration sessions, you can prompt participants to provide feedback. This page explains how to configure the phrases and settings used for calibration feedback prompts.

Getting There

Go to Settings > Feedback Settings > click the Calibration Feedback tab.

Configurable settings

You can configure four parameters for calibration participant feedback:

Part 1: Feedback titles

The three default feedback tab titles are Positive, Negative, and Neutral, with associated colours (Green, Red, Amber). You can edit both the titles and colours.

Part 2: Prompts

The phrases used to prompt feedback from calibration participants can be edited and saved.

Part 3: Time to acknowledge

Set the time period before the associated notification turns red.

Part 4: Active status

The system supports up to three different types of feedback for calibration participant feedback. If you only want one or two types, untick the relevant Active status. Feedback options that are unticked will not be presented to facilitators.

What facilitators see

If all three feedback types remain active (and the default options have not been changed), the feedback pop-up (accessed by clicking the pencil icon next to a participant) looks like this:

Best practices

  • Be consistent -- Use similar feedback titles across quality and calibration feedback for familiarity

  • Focus on development -- Calibration feedback should encourage discussion, not just scoring

  • Keep prompts actionable -- Guide facilitators to provide feedback that supports evaluator growth

Did this answer your question?