evaluagent CX: Adding Automated Line Items to a Scorecard / Building a blended scorecard
Prerequisites
To complete this help guide, you must have the following:
evaluagent CX enabled on your account
Permission to Manage Scorecards
At least one "Active" Automated Line Item within the Topic Manager
Step 1: Read before continuing
Before reading this guide, it is worth familiarising yourself with the following user guides that cover:
Adding an Automated Line Item to your scorecard is very similar to adding a manual line item, as described in Step 3 of the above guide and you may be able to proceed by yourself without reading the rest of this user guide.
How to add an automated line item to a scorecard
From within your Draft Scorecard, click the Add Line Item option to reveal the Add Line Item Popup
From the popup modal, select the "Automated" tab
Complete the remainder of the form:
Title = This is unique to the Line Item on your Scorecard and can be changed if you wish.
Allow Line item Feedback = Decide if the evaluator can add Feedback to this specific line item.
Categories = Assign any categories to the line item. Categories can be used to filter reports and identify the performance of line items that have been categorised under a specific heading. For example, you may wish to understand the performance of all line items categorised as Risk. Line item categories can be configured in Quality Settings.
Set line item as an Auto-fail = Decide whether or not the line item is an auto-fail line item whereby the evaluation FAILS if this line item is marked as a "fail" during evaluation.
Weighting: If this is a weighted scorecard, then you will need to add a weighting for the line item. Don't worry about making the weighting of all line items add up to 100% at this point. When you save the scorecard, the system will sum the weightings for all line items and then divide each individual line item weighting by this sum to derive a percentage weight for each line item. In this way, the sum of the system-derived percentages will always add up to 100%. Of course, if your scorecard has percentages already assigned and you're comfortable that they all add up to 100%, just add each line-item percentage as an integer into the field.
Once you're happy with your selections, click Add line item and you'll be taken back to the scorecard screen where you can continue adding line items.
N/A configuration for automated line items
N/A (Not Applicable) configuration differs depending on the type of automated line item:
AI line items: N/A is inherited from the linked topic. The N/A field is visible on the line item but is read-only. To modify N/A behaviour, you must edit the topic in Analytics > Manage Topics.
Text analytics line items: N/A is not available. Text analytics uses binary pass/fail scoring only.
AutoPublish and blended scorecards
If your scorecard contains both manual and automated line items (a "blended" scorecard), all manual line items must be completed before the evaluation can be published. The AutoPublish feature does not work with blended scorecards.
If you need evaluations to run completely automatically without any manual input, create a scorecard where all line items are linked to Line Item Topics, then enable AutoPublish.
Editing/Deleting Automated Line Items from Scorecards
Editing an Automated Line Item takes place in two places within the evaluagent App.
I want to edit an Automated Line Item I've just added to my Scorecard (e.g., Weightings/Categories etc.)
Once a scorecard is published and becomes active, to ensure reporting integrity, it is not possible to edit most parts of the scorecard. By the same token, inactive scorecards that have evaluations saved against them cannot be edited.
This remains true for Automated Line Items, however, when the Scorecard is in "Draft" mode, you can edit the following from within the Scorecard Builder by clicking the EDIT button next to a line item. This opens a modal where you can edit:
Title
Allow Line item Feedback
Categories
Set line item as an Auto-fail
Weighting
If you wish to delete an automated line item from your scorecard, press the "Delete" button instead.
I want to edit the underlying logic of an Automated Line Item
If you wish to edit the underlying logic or guidelines of a Topic, this is done from within the Topic Manager. A user guide for creating and managing Automated Line Items can be found here. If an Automated Line Item is updated within the Topic Manager, these changes are automatically applied to your existing Line Items as Scorecards will always use the latest Active version when deciding on the outcome.
To edit the underlying logic/guidelines/prompt, you must have the SmartScore AddOn and access to Topic Manager.
We therefore recommend if you are materially changing the guidelines, you create a new line item and scorecard.