Operio Doc
Test Runs

Running Tests

Start a test run from a suite or a single test case

Launch a test run to execute one or more published test cases against a target environment. Runs start from Tests — there is no separate New Run page.

Running a suite

  1. Open Tests in the sidebar.
  2. Select a suite in the left rail.
  3. Click Run Suite.
  4. Choose the target environment and start the run.

Operio applies the suite's execution-order config and runs all published test cases in the suite. The run is named after the suite.

Running a single test case

  1. Open Tests and find the published test case (under All tests, a suite, or Ungrouped).
  2. Open the test case, or use its row actions, and choose Run.
  3. Pick the target environment and start the run.

Only published test cases can run. Publish any drafts from Tests first.

Choosing an environment

Every run asks for a target environment. Everything environment-specific resolves from it at run time:

  • The agent starts from the environment's base URL.
  • @credential mentions and Login steps use the project's credentials.
  • @asset mentions use project assets.

Starting a run consumes credits from your plan. If your balance is too low, Operio prompts you to top up before the run starts.

Monitoring progress

Active runs appear under Live Runs on the Runs page with a live status:

  • Pending / Queued means the run is waiting to start.
  • Running means test cases are executing.

Open the run to follow along in real time. Each test case shows its current status, and opening a case gives you the agent's live browser preview, activity feed, and logs as it works.

Need to stop early? Open the run and click Stop. Remaining test cases are canceled, and whatever results were captured so far are kept.

After the run

  • Review outcomes, logs, screenshots, and recordings in Viewing Results.
  • Rerun a run from its detail page. You can pick a different environment for the rerun.
  • Failures trigger Slack notifications when configured.

On this page