Configure the template
By following the navigation prompt, you'll be directed to the following screen, where you'll be prompted to enter some basic information about the template.
- Template name: Add a unique name for this template. Please note that, to avoid confusion, names must be unique and cannot be the same as any previously created templates (including deleted templates).
- First publication: It's not necessary at this point, but once you’ve configured all of the template details, at the end of the process, you’ll be asked to set the date and time that the template will be used to publish the very first set of work-queues.
- Replenishment cycle: After that very first publication, an active template can be configured to replenish work-queues on a daily (to run every n days), or weekly-cycle (from once a week, up to once every 52 weeks), or on a specific day (1st to the 28th) of each month.
This replenishment cycle obviously influences how you set quotas for the template, so this is why you need to decide on the cycle here at the start of the process. Returning to the example above, if you want the template to generate 4 evaluations per agent per week, and you want work-queues to be replenished once a week, then (as part of a latter step) the quota you assign to each agent would be 4. Alternatively, if you wanted to replenish work-queues on the 1st day of every month, then the quota you assign to each agent would be closer to 16 (4 per week x 4 weeks in a month).
Once you've named the template, assigned a replenishment cycle, and clicked Create template, you'll be directed to the first of 3 steps required to assign quotas to the template
Step 1: Assign Agents
You first land on the Assign agents tab where all active agents will be listed. You simply select the agents you wish to be covered by this template by ticking the relevant names. You can tick individuals or any level of your organisational structure to auto-select all groups / teams / agents underneath.
There are a few points to reference here; (1) Only active agents are visible; (2) As soon as any previously selected (ticked) agent is made inactive via User Admin, they are removed from the template automatically so that future work queues generated by the template will not include evaluations for agents who have left the business and, (3) Active agents can be added to more than one template.
Once you've ticked the agents you wish to be covered by the template, press Save and move onto the next step, by clicking the second tab...
Step 2: Add contact types & assign evaluators
Click the + New contact type button to add the types of contact you wish to evaluate. You have 2 contact types to choose from...
Option 1: Imported contacts
First of all, it's worth mentioning that this option is only available if you've set up an integration and you have configured at least one active filter.
The filter is created within the Imported contacts & filters screen.
If you have not created at least one active filter then the following screen will be presented.
If an active filter has been created then a list of the active filters is presented and you'll be prompted to choose one.
Once you've selected the filter that will be used to populate the work queue, you'll be prompted to select how you will allocate tickets that contain multiple responses.
Next, you select a date range or look-back period to sample. For example, if you select the last 24 hours, only tickets from the last 24 hours will be randomly sampled for this work-queue.
When an auto work queue is initially published it will start to fetch contacts based on the selected date range specified in the 'Sample contacts from' field. If for example this was set to 'Last 7 days', when the queue is published it will look back for contacts from the previous 7 days. If the number of contacts to fill the agents quota's are not achieved after the publication of the auto work queue, then on the following day the system will look again at the 'Last 7 days' from the current date and not the date that the auto work queue was published. This effectively means that the 'Sample contacts from' setting is a rolling period from the current date.
Next, you set an evaluation quota for each agent. For example, if you configured work queues to be replenished every 1 week and you set a quota of 4 here, then each agent in your work queue will be evaluated 4 times every 1 weeks for this work type.
Based on the example we've used so far to illustrate the process - we assigned 7 agents in Step 1 and based on the parameters selected above, this work type is to be evaluated 4 times per agent.
As a result, there are currently 28 contacts to be evaluated. So, lastly, you now need to assign evaluators to this work-type. You do this by selecting evaluators are assigning a % share to each user.
Attaching a scorecard to an AutoWorkQueue
If you wish, you can now attach a scorecard to your AutoWorkQueue. This means the evaluation mode and scorecard are pre-selected for the evaluator when they open the evaluation saving them time.
Additionally, if your scorecard contains automated line items as a customer of EvaluAgent CX, any automated line items will be pre-scored for the evaluator so they no longer have to press the SmartScore button.
To take advantage of this optional feature:
1. Select an evaluation mode
2. Choose from any active scorecard.
Once all parameters have been set, the contact-type is saved and it appears in the table as shown below.
Option 2: Prompted contacts
If you don't have any integrations set up, you could add prompted contacts.
For prompted contacts, the process is almost identical to that described above. However, instead of selecting an integration, you'll be asked to add a channel and a prompt that effectively instructs the evaluator on the type of contact to evaluate.
Prompts for each channel can be configured in quality settings. See the guide.
You can repeat the process of adding work-types to a template as many times as you wish, building up the work queue and its quotas based on a range of different contact types.
Step 3: Review and publish the resulting work queues
Once you've added all of the contact-types and agent quotas for this template and you've allocated the resulting workload amongst your team of evaluators, the template is ready to be used to generate a work queue for each of those assigned evaluators.
Before publishing, the system summarises the template on the third tab...
When you're ready, click the Publish button and you'll be prompted to choose the date and time that the template will be used to publish the very first set of work-queues. You'll also be prompted to re-confirm how often work-queues will be replenished.
Success!
Once published, the work queue template will automatically (and randomly) assign specific contact-types to specific agents and specific evaluators at specific times!
In the example we've used here to describe the process, the two evaluators assigned (Matt and William) will each have 14 evaluations allocated to them. The contacts to evaluate will be randomly selected from contacts imported via the "Zendesk: All tickets " connector.
The resulting 28 contacts will cover the 8 assigned agents. Finally, unless edited or deleted beforehand, the template will automatically run again in 1 weeks time to replenish Matt's and Williams's work queues with another batch of 14 evaluations each, thus ensuring that the assigned agents continue to receive a regular quota of evaluations.
To ensure a fair and balanced workload distribution, in the event that a work-queue needs to manage the allocation of an odd number of contacts, the system has been designed to prevent any one evaluator being consistently assigned a disproportionate share of contacts through the month or year.
For example:
In week 1 there are 99 contacts to evaluate: Evaluator 1 receives 50% of the contacts, totalling 50 contacts to evaluate. Evaluator 2 then receives the remaining 50%, totalling 49 contacts to evaluate.
In week 2 there are a further 99 contacts to evaluate: Evaluator 1 again receives 50% of the contacts to evaluate, which now totals 49 evaluations. Evaluator 2 continues to receive the other 50% of contacts to evaluate, which now totals 50 evaluations.
This alternating pattern ensures that over time the assignment of evaluations is more equal across all evaluators when dealing with odd numbers of evaluations.
The resulting work queues
Those 14 evaluations are now available for Matt, and when he accesses the Evaluate tab, he'll be presented with his work-queue of randomly selected contacts to evaluate.
In the event that there aren't enough imported contacts available to fill an evaluator's work-queue when the queue is first published, then messaging at the top of the table (See below) informs the evaluator as to the status of their work-queue.
Contacts are imported on a regular basis and, when any import job next runs, the resulting batch of newly imported contacts will be sampled in order to fill any gaps in the evaluator's work queue.
This process will continue until one of the following events occurs; (1) the work-queue is filled; (2) the template runs again and the work-queue is replenished (See below); or, (3) the work-queue template is deleted (See below).
Replenishing work queues
After a template publishes its very first set of work queues, it will repeat the process at regular intervals (whilst it remains active) based on its assigned replenishment cycle. (E.g. once a month, once every 13 weeks, on the 1st of every month, every 3 days).
Whenever a template replenishes a work-queue, any incomplete evaluations remaining in the work-queue from a previous run are dealt with as follows:
- Any incomplete evaluations that have been assigned an actual imported contact remain in the work-queue.
- Any incomplete evaluations not yet assigned an imported contact (unfilled quota) are removed from the work queue.
- All incomplete evaluations assigned to a manual prompt remain in the work-queue.
If you do wish to delete or re-assign any or all incomplete evaluations from a previous or current run, it's a very straightforward process...
Deleting / re-assigning work queues
Users assigned the permission to Delete & re-assign contacts can do this one by one (or in bulk). Firstly, tick the box(es) adjacent to the relevant incomplete evaluations and secondly, press the button that matches the outcome you wish to achieve.
Deleting work-queue templates
Templates can be deleted at any time by clicking Delete on the row of the template you wish to delete.
When a template is deleted, the scheduled next run is cancelled and it will never again be used to generate work queues.
If a template has been used to generate work queues, as well as deleting the template, you'll be asked if you wish to remove any incomplete evaluations remaining in the work-queues generated by this template.
If you choose Yes, then any incomplete evaluations remaining in the work-queue from this template's last run are dealt with as follows:
- Any incomplete evaluations that have been assigned an actual imported contact are removed from the work queue and the contacts are returned to the imported contacts table.
- Any incomplete evaluations not yet assigned an imported contact (unfilled quota) are removed from the work queue.
- All incomplete evaluations assigned to a manual prompt are removed from the work queue.
If you choose No, then any incomplete evaluations remaining in the work-queue from this template's last run are dealt with as follows:
- Any incomplete evaluations that have been assigned an actual imported contact remain in the work queue.
- Any incomplete evaluations not yet assigned an imported contact (unfilled quota) are removed from the work queue.
- All incomplete evaluations assigned to a manual prompt remain in the work-queue.
Understanding how templates and evaluators are performing
It's possible to track the progress of a specific instance of a published work queue template by viewing the Progress report.
Clicking the Progress button reveals the following report where you can search for a specific work-queue template to understand how it is being processed...
Clicking View, reveals how each of the assigned evaluators is processing their assigned work queue...
While viewing the progress page, you also have the option to reduce the number of contacts awaiting an imported contact. By selecting the 'edit' option on the page, and reducing the number for each evaluator:
You can also pause a Work Queue Template to stop it from running again in the future. On the Work Queue Templates table, one of the options is "Pause"
A paused work queue will stop the work queue from being published at it's next scheduled publication date. To resume it, just click on the resume button:
Comments
0 comments
Please sign in to leave a comment.