1. Help Center
  2. Tutorials
  3. Office Sandbox Authoring Tutorials

Office Tutorial 15 - Adding an Assessment

Create some in-headset feedback for your user.

In-headset assessments are based on four different assessment items: Pass or Fail, Completion, Raw Score or Scaled Score. These are explained in-depth in this article.

You can use these four different measures to produce user reports for feedback when the scenario is complete.

Quick Links

Step 1: Create an Assessment Script

Step 2: Create a set of "Results" Frames

Step 3: Determine overall Scenario Success

Step 4: Determine Success on Specific Performance Indicators

Step 5: Create User Reports for In-Headset Feedback

Step 6: Add your Assessment script to your Director script

Step 1: Create an Assessment Script

Step 2: Create a set of "Results" Frames

Name the first frame "Results" and add a subframe to it called "Overall Scenario Success":

Step 3: Determine overall Scenario Success

Add a "Pass or Fail" resource to the "Overall Scenario Success Frame:

The overall success of the scenario, in this case, is based on whether or not the trainee resolved the situation and offered a helpful solution to the employee's issue or not. They have "passed" if they reached the "Scenario Complete - Success" event and they have "failed" if the "Scenario Complete - Failed" event is fired. This resource needs to use dynamic variables in order to determine "pass/fail" each time:

In order to set the values of these variables, we will use the dynamic content editor. Toggle the editor view by clicking on the atom icon in the top right corner of the screen:

If the event "Scenario Complete: Success" was fired, the trainee has passed. Watch this quick video on setting the values based on the completion events fired in the scenario:

set dynamic pass or fail

Step 4: Determine Success on Specific Performance Indicators

The trainee may want more information about where they could improve. In this scenario, the trainee needed to greet the employee, give meaningful feedback, and suggest a helpful solution. Create a new frame called "Performance Indicators" and drag in three more "Pass or Fail" resources. Create new variables for feedback (if you want to give varied feedback) and for the P/F result for each:

create performance indicators variables

In order to set pass/fail for each of these, we could use the dynamic editor OR we can make these variables global and set them in different scripts. Here is a video showing setting them in the dynamic editor:

set p f for kpis

Step 5: Create User Reports for In-Headset Feedback

With our assessment values determined, we can now create reports that the user can see after they have completed the scenario.

First create a new top-level frame called "Reports". We don't want this frame to open until the character has finished delivering their last line.  We will create an event called "Start Report" and have the report frame wait for that event before it opens:

create and open report frame

In this new "Reports" frame, add a screen message:

When the user closes this screen message, the reports should appear. Create a new frame that will open on close of this resource.

Add a "User Report" resource to this frame. Watch this quick video on creating the report:

Sequence 01

Step 6: Add your Assessment script to your Director script

Go back to the Director script, add a new frame and launch this assessment script. We don't want the assessment script to launch until the scenario is complete (so that the assessment items are evaluated properly). We will create a compound condition so that the script will only launch if "Scenario Complete - Failure" or "Scenario Complete - Success" are fired:

Save and test. Now you should see a report at the end of your scenario.