How to use the Evaluator Performance report

Navigation prompt

Go to REPORTING > click Evaluator performance

The Evaluator Performance report gives you insights into evaluator productivity, scoring patterns, query outcomes, review results, and feedback activities. Use it to monitor and improve the performance of your quality assurance team.

Required permissions

Feature flag	Technical name	Description
KPI Reports	`feature_kpi_reports`	Enables KPI reporting (included by default)

Required permissions:

View Evaluator Performance Reports (Full View) — to view all evaluator data
View Evaluator Performance Reports (Scoped View) — to view only your own data

Note: Contact your evaluagent administrator if you don't have access to these features.

Access requirements

To access Evaluator Performance Reports, you need:

An active reporting contract
Either Full View or Scoped View permissions:
- Full View: Access data for all evaluators
- Scoped View: Access only your own performance data

Report tabs

1. Productivity tab

Monitor team output and productivity based on evaluations published or sent for review.

Metrics displayed:

Evaluator name and status
Evaluations completed (published)
Evaluations pending (awaiting review)
Total evaluations
Average evaluation quality score
Average time per evaluation

Features:

Download CSV export
Show/hide empty rows
View individual evaluator trends
View time breakdown analysis

2. Scoring tab

Analyse scoring patterns and potential bias across the team based on published evaluations.

Metrics displayed:

Evaluator performance metrics
Quality scores
Scoring distribution
Badge awards (if enabled)
Comparative analysis

Features:

Column customisation
CSV export
Show/hide empty rows
View evaluator scoring heatmap

3. Queries tab

Understand the outcome of queries raised during evaluations (requires query permissions).

Report views:

Evaluator report: Queries raised by evaluators
Reviewer report: Queries handled by reviewers
Querier report: Performance of query raisers

Metrics displayed:

Query volumes
Resolution rates
Response times
Outcome analysis

4. Reviews tab

Track the outcome of evaluations sent for review prior to publication (if reviews are enabled).

Metrics displayed:

Review volumes
Approval/rejection rates
Review turnaround times
Reviewer performance

5. Feedback and 1-to-1s tab

Monitor feedback and coaching sessions published during the period (requires feedback feature).

Metrics displayed:

Feedback sessions delivered
Coaching interventions
Improvement tracking
Team member engagement

Features:

CSV export
Show/hide empty rows

Filtering options

Date range (required): Select the reporting period
Scorecards: Filter by specific evaluation forms (supports multiple selections)

Interactive features

Productivity tab actions

View evaluations button: Navigate to the evaluations list filtered for that specific evaluator
Trend chart icon (bar chart icon): Opens a modal showing a bar chart of evaluations completed over time
Average time link: Click on the average time value to see individual evaluation completion times with direct links to each evaluation

Scoring tab actions

Actions column (magnifying glass icon): Navigate to a detailed individual performance page showing:
- Summary scoring metrics for the evaluator
- Evaluation heatmap displaying scoring patterns across different criteria
- Detailed breakdown of all evaluations

Data export

CSV download: Available on Productivity, Scoring, and Feedback and 1-to-1s tabs via the cloud download icon
Downloads filtered data based on current report parameters
Exports all visible columns and metrics