Default scoring templates for marking line items / questions

Getting started

EvaluAgent offers four default scoring templates to help get you started. However, if they don't suit your needs, you can create your own unique / fully customised templates

Here are the four default templates....

OPTION 1: The 2-point scoring template

The 2-point (binary) scoring template is typically used to evaluate process adherence/risk line items (questions) and, as the name suggests, this template offers two outcomes. 

  • Before use, you can edit the Name of the template.
  • You can also edit the default Outcome titles from "Pass" and "Fail" to words / phrases of your choice.
  • You can even change the Colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from

PLEASE NOTE

  • The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail". 
  • Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". Obviously with only two outcomes available on this template, you don't have the option to edit the two scores.
  • To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 2-point scoring template and you then marked all line items as a "Pass", the Quality Score would be 100%. Conversely, if you marked all line items as a "Fail", the Quality Score would be 0%.
  • Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.

OPTION 2: The Steps scoring template

The Step scoring template is typically used to evaluate more complex process adherence/risk questions and line items and allows you to evaluate and ultimately report the performance of the detailed steps which make up the line item.

15.png

  • Add as many steps as you need by clicking Add step
  • You will have already decided on whether the line item overall can be marked as Not applicable. However, as you add each step, you will need to decide whether or not the step can be marked as not applicable.
  • If all steps can be marked as Not applicable, then the line item always defaults to allow Not applicable as an option.

During an evaluation, the score outcome for a step is either "Pass" or "Fail". 

How the system determines a score for a line item that contains steps

The following logic is hard-coded into the system:

  • If all steps are marked as Not applicable, then the line item is determined to be Not applicable.
  • If some steps are marked as "Pass" and some are marked as Not applicable, then the line item is determined to be a "Pass".
  • As soon as just one step is marked as "Fail", then the line item is determined to be a "Fail".

OPTION 3: The 3-point scoring template

The 3-point scoring template includes three outcomes 

  • Before use, you can edit the Name of the template.
  • You can change the default Outcome titles from "Complete", "Partially complete" and "Incomplete" to words or phrases of your choice.
  • You can edit the Score of the middle outcome and decide whether the system will Treat as "Pass" or a "Fail"
  • You can even change the colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from.

PLEASE NOTE

  • The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail". 
  • Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". Obviously with only three outcomes available on this template, you don't have the option to edit the top and bottom scores but you can edit the middle score.
  • To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 3-point scoring template as configured in the diagram above and you then marked all line items as "Complete", the Quality Score would be 100%. Conversely, if you marked all line items as "Incomplete", the Quality Score would be 0%. However, with a score of 0.5 assigned to the "Partially complete" outcome, if you marked all line items as "Partially complete", the Quality Score would be 50%.
  • Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.

OPTION 4: The 4-point scoring template

The 4-point scoring template includes four outcomes

  • Before use, you can edit the Name of the template.
  • You can change the default Outcome titles from "Exceeds", "Meets", "Coach" and "Underperform" to words and phrases of your choice.
  • You can edit the Score of the two middle outcomes and decide whether the system will treat each one as a "Pass" or a "Fail".
  • You can even change the colour assigned to each outcome by clicking the colour box to reveal a palette of colours to choose from.

PLEASE NOTE

  • The Line Item Performance Report presents the performance breakdown of all the possible outcomes available on each line item. However, to enable line items with different scoring templates to be grouped together in the Category Performance Report, all outcomes also need to be classified (treated) as either a system "Pass" or a system "Fail". 
  • Outcome Score: Each outcome can be assigned a score. The top score for a template must always be "1", and the bottom score "0". With four outcomes available on this template, you don't have the option to edit the top and bottom scores but you can edit the two middle scores.
  • To help explain Scores in this context - If you created a scorecard that only contained line items that could be marked using the 4-point scoring template as configured in the diagram above and you then marked all line items as "Exceeds", the Quality Score would be 100%. Conversely, if you marked all line items as "Underperform", the Quality Score would be 0%. However, with a score of 1 also assigned to the "Meets" outcome, if you marked all line items as "Meets", the Quality Score would also be 100%. In the same way, with a score of 0 also assigned to the "Coach" outcome, if you marked all line items as "Coach", the Quality Score would be 0%. If you wanted to different performance, you could assign a score of 0.75 to Meets and a score of 0.5 to Coach for example.
  • Once a scoring template is Active (i.e it is assigned to an Active scorecard) and/or is used as part of an evaluation, it becomes locked and can no longer be edited.
Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.