Skip to main content

How do I evauate using my own knowledge base for context?

Written by Alex Richards
Updated yesterday

Introduction

The Knowledge Vault is a central repository that enables you to upload, manage, and attach internal knowledge materials (policies, guides, compliance documents) to Evaluagent. This documentation can then be appended to your automated line items to ensure automated evaluations are informed by your organisation's own standards and documentation, improving accuracy and alignment with internal processes.

In this article we’ll cover

  1. Adding and managing documents to your knowledge vault

  2. Creating and managing document tags

  3. Attaching documentation to line item topics

  4. Creating scorecards with knowledge documents

Getting Started

Navigation Prompt

You can access the Knowledge Vault from Analytics → Context Engine → Knowledge Vault tab

Adding documents to your knowledge vault

To add your first knowledge base documents click the + Add document button. A modal will open where you can

  • Upload the appropriate documents
    Supported formats: PDF, DOC, DOCX, TXT, CSV.

  • Name your documents

  • Add a description (optional)

  • Tag your documents (you can add more than one tag if relevant)
    Note this will allow for document grouping and bulk actions

Click upload to upload your document to the knowledge vault. You can upload multiple documents, upto 50 documents at a time.

Uploaded documents will be displayed in a table, this includes

Column header

Description

Title

Friendly name assigned to the document when uploaded

Description

Description entered when uploaded. This is an optional field, if no description was entered this column will be blank

Tags

Tags associated with the document. There can be no tags or multiple tags against a document

Last Updated Date

Date the document was last modified (uploaded, edited)

Line Items

Line items the document has been attached against

Actions Menu

• Edit
• Delete

Managing your documents

Editing Documents

Using the actions menu you can edit your document. A modal will open where you can

  • Upload a new file - such as an updated version of the documentation
    This will replace the existing file

  • Update document title

  • Update the document description

  • Add or remove tags

Click save to apply your latest changes.

Deleting Documents

From the actions menu you can also delete documents. You’ll be present with an ‘are you sure?' modal as this will permanently delete your document. Click delete to confirm the action and permanently remove this document.

Tagging

Tagging documents allows you to organise your documentation and carry out certain actions in bulk.

Create a tag

To create a new tag

  1. Update the page view to view by ‘tags’ > Click + Add Tag

  2. Upload document > Tag > + Add Tag

Add the tag name and click create

Viewing and managing tags

Select the tag view to see the tags that have created. These will be displayed in a table format

Column header

Description

Tag Name

Tag name set when created

Documents

Number of documents the tag is associated with

Line Items

Line items the tag has been attached against

Created date

Date the tag was created

Actions Menu

• Edit
• Delete

Editing tags

Using the actions menu you can edit tags. A modal will open where you can edit the name of the tag.

Click save to save your changes or cancel to close the modal and cancel the action.

Deleting tags

From the actions menu you also have the option to delete a tag. A confirmation modal will appear, where you can confirm to permanently delete the tag.

Adding documents to line items

Gen AI Line item topics

You can attach the relevant documents to line items by creating a GenAI line item topic.

Navigation Prompt

Analytics > Manage Topics > GenAI, Line Item > Attach knowledge documents

Using the attach knowledge documents dropdown you can select individual documents or bulk add documents based on tag. Documents with no tags will be categorised as ‘untagged’

  • Select the tag name to select all documents associated with the tag

  • Select the individual document name to select that doc

To review the documents selected

  • You can open the documents dropdown, all selected socuments will have a blue tick next to them or

  • Click on ‘Show selected documents’ - a modal will open listing all the documents

Using knowledge base documents in Scorecards

In line with existing behaviour, once your GenAI line item topic is active this can be utlised in the automated line item section of a scorecard.

Where documents have been attached to the line item topic this will be displayed in the line item overview. Click show selected documents to review a summary of the attachments.

Note: You cannot edit the atatched documents from this modal, this can be amended by editing the topic

Did this answer your question?