Suites
What it is
Suites group related tests together for organized execution. A suite contains tests, personas, and configuration settings that define how tests should run against your AI assistants.
How to use
- Navigate to Testing → Suites in the sidebar
- Click New Suite to create a suite
- Configure the suite with an assistant, personas, and settings
- Add tests to the suite
- Click Run Now to execute all tests
Suite Configuration
- Name: A descriptive name for the suite
- Assistant: The AI assistant to test
- Personas: User profiles that will interact with the assistant
- Setup: Optional pre-run configuration (see Setups)
- Schedule: Optionally run on a recurring schedule
Key Features
- Test builder: Create and edit tests directly within the suite
- Run history: View past run results and trends
- Live runs: Watch tests execute in real-time
- Scheduling: Automate regular test runs
- Export reports: Generate compliance reports from run results
Running Tests
- Open a suite and click Run Now
- Select environment and options
- Monitor progress on the live run page
- View results when complete
Tips
- Group tests by feature area or user journey
- Use meaningful suite names (e.g., “Onboarding Flow”, “Support Queries”)
- Configure schedules for continuous monitoring
- Review run history to identify trends and regressions
Last updated on