Simulations

Simulations run scripted conversations against your agent and check whether the agent behaves as expected. Use them to catch problems before visitors encounter them. Open the Testing tab in the Navattic Agent editor to access your simulation suite.

​

Creating a simulation

Click Add simulation to create a new simulation. Each simulation defines:

• Persona: The visitor the simulation plays. Give the persona a name, role, and behavior style (for example, Cautious, Eager, or Skeptical).
• Expected outcome: The conversation outcome the agent should reach by the end of the session.
• Max turns: The number of conversation exchanges before the simulation ends.
• Questions the buyer asks: Specific questions the persona asks during the session.
• What the buyer does: Instructions for how the persona engages (for example, objections they raise or flows they request).
• Criteria: Specific behaviors or phrases you want to verify. The simulation checks each criterion when grading the run.

Navattic can also generate a starter suite for your agent. Click Generate to create a set of simulations based on your agent’s stages and outcomes.

​

Running simulations

Click Run all to start the suite. Navattic runs every simulation in sequence and grades each one against the expected outcome and criteria. A pass rate bar at the top of the sidebar updates as runs complete. Simulations that you edited since the last run are marked Queued. Re-run the suite after editing your agent to get an updated health score.

​

Reading results

After a run, each simulation shows one of the following statuses:

• Passing: The agent reached the expected outcome and met the criteria.
• Failing: The agent did not reach the expected outcome or missed one or more criteria.
• Needs attention: The run completed but returned inconsistent results. Review the findings to decide whether the agent or the simulation criteria needs updating.
• Queued: The simulation has not run yet, or was edited since the last run.

Click any simulation to open its detail view. For failed simulations, a Findings list shows what went wrong and, where possible, proposes a specific change you can apply directly from the card.

​

Applying a finding

When a simulation fails, each finding may include a proposed fix: a concrete text change to a stage goal, topic message, outcome condition, outcome final message, or brain entry. To apply a fix:

1. Review the proposed change shown on the finding card. The card displays the current live text so you can compare it with the suggestion.
2. Click Apply to patch your agent with the proposed change. Navattic checks that the text has not changed since the suggestion was generated. If it has, the apply is refused and you can review the current version first.
3. After applying, the simulation is marked Queued. The pass rate does not change until you re-run the suite.

To reverse an applied fix, click Undo on the same finding card. Navattic restores the exact text that was in place before you applied the change.

​

Health score

The pass rate bar shows what percentage of your simulations passed in the most recent run. Applying a finding does not update the score. Re-run the suite after making changes to earn credit for each fix.