How Can We Help?

How to Create Human & AI Friendly Scorecards

Create scorecards for Voxjar's AI evaluator exactly as you would for your QA team. No keyword searches, complex queries, or data science team needed.

Every scorecard made in Voxjar is automatically compatible with our AI evaluator for automated quality assurance.

To create a new scorecard, go to the Scorecards page (

Once there, you can create a new scorecard in three ways.

  1. Start with a template
  2. Duplicate an existing scorecard
  3. Start from scratch

Once a scorecard is created you can assign them to evaluators in your Queues or when you generate a one-off AI evaluation.

list of quality assurance scorecards

Start with a Template

Voxjar has several scorecard templates built in to help you get started as quickly as possible.

Once you select a template, you can edit it and preview it before saving the scorecard to your account.

Click through the templates list, preview the templates and click the "Start with this template" button when you're made your selection.

how to create a call quality assurance scorecard from a template

Duplicate a Scorecard

duplicate a call monitoring scorecard

If you have an existing scorecard, you can duplicate it to create a new version.

This is usually preferred over deleting or adding questions to your existing scorecard to keep historical scores aligned with the scorecard's current state.

It is also a big time saver when launching similar scorecards.

Click on your existing scorecard in the scorecards list, click the edit button on the preview window, then select "Duplicate" from the drop down menu.

Test a Scorecard With Voxjar's AI Evaluator

Auto QA scorecard testing

As you're building your scorecard you can test it with Voxjar's AI evaluator.

From the scorecard options menu, click the "AI Test" button.

Voxjar's built in test loop shows you what the AI's responses will look like before launching your Auto QA program.

Check out our guide on how to test your scorecard with the AI evaluator.

Create a Scorecard from Scratch

build a call monitoring form from scratch

And of course, you can build a new scorecard from scratch.

This is usually the path taken when you have an existing scorecard and want to migrate it into Voxjar.

From the scorecards list click "Start from Scratch" and you're off to the races.

Scorecard Details

The scorecard editor will initially load with the scorecard details panel open.

This lets you name your scorecard, set a description, and define a passing score.

To navigate back to this panel, click on the scorecard header that shows the title and description.

qa scorecard details

Scorecard Sections

Scorecard sections are used to group your questions so it's easier to navigate your form.

You can label your sections, add a description, and drag them to rearrange their order.

Clicking on a section will open the section editor panel on the right side of your screen.

shows how to access and rearrange scorecard sections in voxjar's qa scorecard editor

Scorecard Questions

The questions you create on your call monitoring forms are the questions that will be shown to your QA team or the AI evaluator for review.

Questions are grouped in Sections. They can be dragged and dropped into new orders and into different Sections.

The question editor panel on the right side of your screen lets you define the question in detail and control the possible answers.

Questions can be answered with multiple choice, single selection, or sliding scale responses that you define. Single selection is the most common response type followed by sliding scale.

All of the options you select for each question are combined as prompts for the Ai evaluator. Giving you the ability to tweak and tune for the best AI responses

voxjar scorecard quesitons for ai and human call evaluations


The question is what your human call evaluators or Voxjar's AI evaluator will attempt to answer based on a provided call recording.

It's usually best to ask detailed questions instead of relying on industry specific knowledge or jargon.


qa scorecard question builder


You can provide general examples of what you would expect to hear on a phone call.

These will be displayed on the scorecard for human evaluators and are also provided to the AI evaluator to better clarify what you want.

give an example for a scorecard question

Single Selection Answers

Single selection answers limit the response to one answer.

By default we label the placeholders "yes" and "no" but you can replace them with anything that makes sense.

Each answer can be assigned different point values and be marked as an autofail.

single selection answer options for call monitoring form builder

Sliding Scale Answers

A sliding scale lets the evaluator answer a question with any number between the min and max.

This is especially useful for subjective questions like "How polite was the agent?" etc.

Each number on the scale will be counted as a point on the scorecard.

You can set a threshold for autofails.

sliding scale answer options for call monitoring form builder

Multiple Choice Answers

Multiple choice answers allow the selection of multiple answers.

The points of each selected answered will be added to the overall score of your scorecard.

multiple choice answer options for call monitoring form builder

N/A Answers

Every question on your scorecard has an N/A option.

If you want a question to default to N/A you can select that above your answer options.

When a question is marked as N/A it is excluded from the score calculation of that scorecard.

A scorecard response with a question marked as N/A can still receive a 100% score.

default a call monitoring form answer to n/a

AutoFail Answers

An answer marked as auto-fail will mark the entire scorecard as a fail.

make an answer autofail

Follow Up Questions

Follow up questions follow the same rules as normal questions with the exception that follow up questions are conditional.

They will only appear if the parent question is answered according to your rules.

create a follow up question on your call monitoring scorecard

When to show follow up questions

When you add a follow up question a condition box shows at the top of the question editor.

It shows the parent question's possible answers so you can choose when the follow up shows on your scorecard.

You can test the conditions by going to the thee dot menu at the top of the scorecard view and clicking "Preview".

follow up question conditions