Skip to main content

How Do I Set Evaluation Quotas

Written by Alex Richards

How do I set evaluation quotas?

Required Feature Flags

The following feature flags and permissions are required to use this feature:

Feature Flag

Description

Auto Work Queues

Enables automated work queues, which is where evaluation quotas are configured

Required Permissions:

  • Manage Auto Work Queues (admin.assignmentbuilders.configure) — to create and edit work queue templates and quotas

Evaluation quotas set how many evaluations each agent should receive in a given period and how that work is split among your evaluators. Set them once and evaluagent does the heavy lifting — pulling contacts into queues and distributing them according to your rules.

Step 1: Open auto work-queues

Go to Evaluate > click Auto work-queues.

You'll see your existing work queue templates. Quotas are configured per template, so either open an existing template or create a new one.

Step 2: Set the replenishment cycle

The replenishment cycle decides how often quotas reset. Edit the template's General settings and choose one of:

Cycle

Best for

Daily (every X days)

High-volume operations needing frequent refresh

Weekly (every X weeks)

Most teams. Balances workload with reporting cadence

Monthly (on day X)

Teams aligned to monthly reporting cycles

Pick the cycle that matches how your team plans QA work, not how often agents are scored.

Step 3: Open the contact type

Go to the Contact Types tab on the template and select (or create) the contact type you want to set a quota on.

A contact type defines which conversations land in the queue — for example, "voice calls from the sales team" or "support emails over 5 minutes long".

Step 4: Set the target per agent

Find the Set your target number of evaluations per agent field and enter how many evaluations each agent should receive each cycle.

evaluagent calculates the total evaluations automatically:

Total evaluations = number of agents × evaluations per agent

For example, 10 agents at 5 evaluations per agent gives 50 evaluations per cycle.

If you're using an automated scorecard and don't want a fixed quota, you can choose I want to evaluate all contacts that match this filter instead. evaluagent will show you the number of contacts available in the last 7 days so you can sanity-check the volume.

Step 5: Add evaluators and set their share

Scroll to Add your evaluators and add the people who'll work the queue. For each evaluator, set their share of the total evaluations as a percentage.

Rules to know:

  • All shares must total exactly 100%

  • Every evaluator needs a share greater than 0%

  • You can't have more evaluators than there are evaluations in the queue

evaluagent works out each evaluator's quota for you:

Evaluator quota = total evaluations × (share ÷ 100)

So in a queue of 50 evaluations:

  • Evaluator A on 40% gets 20 evaluations

  • Evaluator B on 35% gets around 17

  • Evaluator C on 25% gets around 13

Step 6: Set the human evaluation percentage (automated scorecards only)

If you're using an automated scorecard with human oversight, use the slider to set what percentage of AI-scored evaluations need a human to review them. Anything from 0% to 100%.

If you want every AI evaluation reviewed, set it to 100%. If you trust the AI on most contacts and just want spot-checks, set it lower.

Step 7: Save the template

Click Save to apply the quota.

The next replenishment cycle will populate the queue based on your settings.

How quota progress shows up

Once the queue is live, you can track how the team's doing.

Progress report

Go to Evaluate > Auto work-queues and click the Progress button. The progress view breaks down completion rates by:

  • Template

  • Agent (so you can see who's been evaluated and who hasn't)

  • Evaluator (so you can see which evaluators are on track)

  • Time period

Coverage alerts

The work queue list page shows an alert if any active agents aren't covered by an active work queue. That's your prompt to extend a template or create a new one — agents not in any queue won't get evaluated.

Common errors and how to fix them

Error

What to do

"Please assign some evaluators"

Add at least one evaluator to the contact type

"More evaluators than evaluations"

Reduce the number of evaluators or raise the per-agent target

"Queue shares don't total 100%"

Adjust the share percentages so they add up to exactly 100%

"Evaluator has 0% share"

Give every evaluator a share above 0%, or remove them from the queue

Tips for setting realistic quotas

  • Start conservative. It's easier to raise a quota than to apologise for missing it. Begin lower and adjust based on what your team actually delivers

  • Match quotas to volume. Setting a quota of 20 a week when only 50 contacts come through is asking for unfilled queues. Check your contact volume before setting the target

  • Account for complexity. Long calls or detailed scorecards take longer to score. Don't set the same quota for a 2-minute chat scorecard and a 30-minute calibration-grade voice scorecard

  • Review monthly. Completion rates tell you whether the quota is right. Consistently low rates mean the quota is too high, the volume is too low, or both

  • Distribute by capacity, not seniority. Newer evaluators may need lower shares while they ramp up

Did this answer your question?