Getting Started

This guide takes you from a blank org to running your first AI assistant test.

Prerequisites

• Lamdis account  & org
• An AI assistant to test (chatbot, copilot, or agent)
• The assistant’s endpoint URL or API credentials

Step 1: Set Up Credentials

Store your secrets securely in Lamdis.

1. Go to Integrations → Variables 
2. Add any API keys your assistant requires (e.g., MY_ASSISTANT_API_KEY)
3. Variables are encrypted at rest and referenced in connections

Step 2: Create a Connection

Connect to your assistant’s endpoint.

1. Go to Integrations → Connections 
2. Click New Connection
3. Configure:
   • Label: A friendly name (e.g., “My Chatbot - Production”)
   • Auth Type: API Key or OAuth2
   • Credentials: Reference your variable (e.g., {{variables.MY_ASSISTANT_API_KEY}})
4. Save the connection

Step 3: Create an Environment

Environments hold configuration for different deployment stages.

1. Go to Integrations → Environments 
2. Click New Environment
3. Name it (e.g., “Production” or “Staging”)
4. Add any environment-specific variable overrides

Step 4: Create a Setup

Setups link environments and connections for test execution.

1. Go to Testing → Setups 
2. Click New Setup
3. Select your environment and connection
4. Save the setup

Step 5: Create a Persona

Personas define simulated user behavior.

1. Go to Testing → Personas 
2. Click New Persona
3. Define:
   • Name: e.g., “Confused Customer”
   • Description: Background and behavior traits
4. Save the persona

Step 6: Create a Test

Tests define conversation flows and evaluation criteria.

1. Go to Testing → Tests 
2. Click New Test
3. Add steps:
   • User message: What the simulated user says
   • Assistant check: Rubric for evaluating the response
4. Save the test

Example Test Steps

- type: user
  message: "I need help with my account"
 
- type: assistant_check
  rubric: "Assistant should acknowledge the request and ask clarifying questions"
  threshold: 0.75

Step 7: Create a Suite and Run

Suites group tests for execution.

1. Go to Testing → Suites 
2. Click New Suite
3. Add your test to the suite
4. Select your setup and persona
5. Click Run Now

Step 8: View Results

1. Go to Testing → Results 
2. Click on your run to see:
   • Pass/fail status for each test
   • Conversation transcripts
   • Judge scores and reasoning

Next Steps

• Add more tests  — Cover more scenarios
• Set up CI/CD — Automate test runs
• Explore Assurance  — Compliance and evidence collection
• Use the AI Assistant  — Get help configuring tests

Need Help?

• Check the Troubleshooting guide
• Review the FAQ
• Email support@lamdis.ai