How do I set evaluation quotas?
Required Feature Flags
The following feature flags and permissions are required to use this feature:
Feature Flag | Description |
Auto Work Queues | Enables automated work queues, which is where evaluation quotas are configured |
Required Permissions:
Manage Auto Work Queues (
admin.assignmentbuilders.configure) — to create and edit work queue templates and quotas
Evaluation quotas set how many evaluations each agent should receive in a given period and how that work is split among your evaluators. Set them once and evaluagent does the heavy lifting — pulling contacts into queues and distributing them according to your rules.
Step 1: Open auto work-queues
Go to Evaluate > click Auto work-queues.
You'll see your existing work queue templates. Quotas are configured per template, so either open an existing template or create a new one.
Step 2: Set the replenishment cycle
The replenishment cycle decides how often quotas reset. Edit the template's General settings and choose one of:
Cycle | Best for |
Daily (every X days) | High-volume operations needing frequent refresh |
Weekly (every X weeks) | Most teams. Balances workload with reporting cadence |
Monthly (on day X) | Teams aligned to monthly reporting cycles |
Pick the cycle that matches how your team plans QA work, not how often agents are scored.
Step 3: Open the contact type
Go to the Contact Types tab on the template and select (or create) the contact type you want to set a quota on.
A contact type defines which conversations land in the queue — for example, "voice calls from the sales team" or "support emails over 5 minutes long".
Step 4: Set the target per agent
Find the Set your target number of evaluations per agent field and enter how many evaluations each agent should receive each cycle.
evaluagent calculates the total evaluations automatically:
Total evaluations = number of agents × evaluations per agent
For example, 10 agents at 5 evaluations per agent gives 50 evaluations per cycle.
If you're using an automated scorecard and don't want a fixed quota, you can choose I want to evaluate all contacts that match this filter instead. evaluagent will show you the number of contacts available in the last 7 days so you can sanity-check the volume.
Step 5: Add evaluators and set their share
Scroll to Add your evaluators and add the people who'll work the queue. For each evaluator, set their share of the total evaluations as a percentage.
Rules to know:
All shares must total exactly 100%
Every evaluator needs a share greater than 0%
You can't have more evaluators than there are evaluations in the queue
evaluagent works out each evaluator's quota for you:
Evaluator quota = total evaluations × (share ÷ 100)
So in a queue of 50 evaluations:
Evaluator A on 40% gets 20 evaluations
Evaluator B on 35% gets around 17
Evaluator C on 25% gets around 13
Step 6: Set the human evaluation percentage (automated scorecards only)
If you're using an automated scorecard with human oversight, use the slider to set what percentage of AI-scored evaluations need a human to review them. Anything from 0% to 100%.
If you want every AI evaluation reviewed, set it to 100%. If you trust the AI on most contacts and just want spot-checks, set it lower.
Step 7: Save the template
Click Save to apply the quota.
The next replenishment cycle will populate the queue based on your settings.
How quota progress shows up
Once the queue is live, you can track how the team's doing.
Progress report
Go to Evaluate > Auto work-queues and click the Progress button. The progress view breaks down completion rates by:
Template
Agent (so you can see who's been evaluated and who hasn't)
Evaluator (so you can see which evaluators are on track)
Time period
Coverage alerts
The work queue list page shows an alert if any active agents aren't covered by an active work queue. That's your prompt to extend a template or create a new one — agents not in any queue won't get evaluated.
Common errors and how to fix them
Error | What to do |
"Please assign some evaluators" | Add at least one evaluator to the contact type |
"More evaluators than evaluations" | Reduce the number of evaluators or raise the per-agent target |
"Queue shares don't total 100%" | Adjust the share percentages so they add up to exactly 100% |
"Evaluator has 0% share" | Give every evaluator a share above 0%, or remove them from the queue |
Tips for setting realistic quotas
Start conservative. It's easier to raise a quota than to apologise for missing it. Begin lower and adjust based on what your team actually delivers
Match quotas to volume. Setting a quota of 20 a week when only 50 contacts come through is asking for unfilled queues. Check your contact volume before setting the target
Account for complexity. Long calls or detailed scorecards take longer to score. Don't set the same quota for a 2-minute chat scorecard and a 30-minute calibration-grade voice scorecard
Review monthly. Completion rates tell you whether the quota is right. Consistently low rates mean the quota is too high, the volume is too low, or both
Distribute by capacity, not seniority. Newer evaluators may need lower shares while they ramp up
