Build a test set
For a fictional order-management agent, a useful first set might be:
Use examples from your own product and approved test data. For each case, define what a good result contains and what would make it misleading. Avoid requiring one exact sentence when several accurate answers would help the visitor.
Save a repeatable case
On the agent’s Tests page, select Add test → Create new test. Choose a test type that matches what you want to check:- Single answer test checks a response against your description of a good answer. You can add good and bad examples to clarify the distinction.
- Full conversation test uses a simulated visitor and success criteria to exercise a longer exchange.
- Action test checks behavior involving an action.