How do I create my own customised scoring templates for line items / questions?
Overview
Scoring templates define the possible score values and their associated outcomes for scorecard line items. They determine the scale evaluators use when scoring (for example, Pass/Fail, 3-point scale, 5-point scale) and how each score maps to a pass or fail outcome.
Getting there
Go to Settings > Quality Settings > click the Line Item Scoring tab
evaluagent offers several default templates that you can edit before use. If they do not suit your needs, you can create your own fully customised templates.
Creating a scoring template
Click + New scoring template to open the modal.
Configure the following:
Name: Give the template a descriptive name (3-30 characters)
Number of outcomes: Choose from 2 to 11 possible outcomes
Outcome title: Assign a label to each outcome (1-30 characters, must be unique within the template)
Score: Assign a score to each outcome. The top score must always be "1" and the bottom score "0". Any score between 0 and 1 can be assigned to other outcomes, as long as they are ordered in descending value.
Treat as: Decide how the system will treat each outcome -- either as a system "Pass" or a system "Fail". This allows line items with different scoring templates to be grouped together in the Category Performance report. You cannot have a Fail with a higher score than a Pass.
Colour: Click the colour box to select from a palette of colours. Each colour must be unique within the template.
Common template types
Two-Point (Pass/Fail)
Score | Title | Treat As |
1 | Pass | Pass |
0 | Fail | Fail |
Three-Point Scale
Score | Title | Treat As |
1 | Excellent | Pass |
0.5 | Acceptable | Pass |
0 | Unacceptable | Fail |
Four-Point Scale
Score | Title | Treat As |
1 | Exceeds | Pass |
0.75 | Meets | Pass |
0.25 | Partially Meets | Fail |
0 | Does Not Meet | Fail |
Locked templates
Once a scoring template is active (assigned to an active scorecard) or has been used on an evaluation, it becomes partially locked to preserve reporting integrity:
You can edit: Name, outcome titles, and colours
You cannot edit: Number of outcomes, scores, and pass/fail mappings
Important notes
The top outcome (score 1) is always treated as Pass
The bottom outcome (score 0) is always treated as Fail
Scores must be in descending order from top to bottom
Default templates included with your account have the number of outcomes locked
When using a two-point (Pass/Fail) template, the outcome titles are also used for stepped-scoring templates