Test creation best practices
How to nail creating new tests for your project
Tl;dr:
- start with auto-generation
- have AI agent generate more test cases
- create test cases with a prompt
- use
dependencies
- help the AI agent where it went wrong
- use
run locally
andPlaywright Codegen
- work on multiple test cases in parallel
Start with the AI auto-generation
Our AI auto-generation gives you a head start with up to 3 AI auto-generated tests.
You can have the AI agent generate more test cases. Go into the test case and hover over the generate more
icon - a button will appear. Click on it. Find more on how generate more
works here.
The AI agent will auto-generate up to 3 new tests based on the one you started it from. The original test will be added as dependency. We will auto-generate steps for every found test case and validate them.
Have the AI agent generate more test cases, 10/2024
At sign-up, we automatically auto-generate close cookie banner and “required” login test cases. These are often the necessary prerequisites for all other tests. Learn more.
Create more tests with a prompt
This comes in handy when you want a specific test the AI agent didn’t find during auto-generation. There are multiple ways to start with a prompt.
Use the generate test case
button on the overview page or on the test cases page.
Create new test case from the overview page, 07/2024
Why should you start with AI? All these techniques will give you a couple of test cases to get started with almost no effort.
Use dependencies
Best practice is to keep the test cases short and to the point. Ideally, each test case represents a small task you want to achieve.
What if you want to test if a full user flow is working? A good method for this is test chaining - the use of dependencies.
Take accept all cookies, login and open profile page. Every test case runs in isolation and therefore needs to include the full flow. Open profile page would have to include steps for closing cookie banner and logging in.
Unless you chain the tests together - make accept all cookies a dependency of login and make login a dependency of open profile page.
This way the test runner as well as the AI Agent are using pre-play to execute dependencies before starting their actual work.
'accept cookies' test is first in the chain - it does not have a dependency, 08/2024
'login' test depends on 'accept cookies', 08/2024
'navigate to returns' test depends on 'login' test, 08/2024
Advantages of using dependencies
- code is reused and only maintained in one place
- much shorter test cases are easier to understand and debug
- better chance of the AI agent being successful when generating test steps, it can focus on the main task
Help the AI agent when it went wrong
We are constantly improving the AI agent but it still might make mistakes. Help it find its way. Use the steps
tab to edit and fine tune your test.
You can add missing steps by clicking the + add step
button and choosing the desired interaction or assertion. Use the virtual locator picker to select the right locator
in the snapshot on the right. Drag and drop the step where needed.
More details can be found in the editing test cases section.
add missing steps, 08/2024
Advantages of manual editing
- Modifying steps much faster than changing the prompts and having the step AI auto-generated
- Our virtual locator picker, copy paste and drag & drop functionalities make it a smooth experience
- You have much more control over the outcome
Run Octomind tests locally
Run locally
is most helpful for step by step adjustments since it is giving you the current state of a page. It will noticeably speed up your test creation efforts.
You can find the run locally
button in the debug
tab of your test case. Find out how to run Octomind tests locally.
'run locally' in test detail view, 08/2024
You can use the locator tool to easily receive locators. Activate it and click on the desired element. Then you can copy the locator.
Playwright locator tool when running locally, 02/2024