Maintain Your Tests
AI auto-fix (beta)
How to have the AI agent fix your broken tests automatically
Test maintenance is time consuming
End-to-end tests break often. Maintenance of a test suite can be more time consuming than the set-up and scripting combined. It is one of the reasons we started Octomind.
We gave our users access to the first version (beta) of our AI auto-fix feature.
This feature is in beta mode. We want you to use it and give us feedback on anything you liked or missed, let us know how successful you were.
This is how to proceed when you diagnosed a broken test.
- Go to
test report
, intotest result
detail and click on theauto-fix
tab. - Have the Agent attempt the auto-fix by clicking on the
attempt auto-fix
button.
Agent auto-fix in beta version, 12/2024
- Agent will take some time to explore the fix. You will see its progress in the AI Agent status bar.
AI auto-fix in process, 12/2024
- Click on
see proposed solution
button.
Review proposed solution for the test auto-fix, 12/2024
- Review proposed fix step by step (red steps are original - broken steps, green are new - proposed fixes). Approve or decline the auto-fix suggestion.
Review proposed test steps and approve the auto-fix, 12/2024
- When you approved the fix, the new steps of the test case will be saved. If you didn’t like the suggestions, you can:
- have the Agent
retry the auto-fix
- decline the auto-fix and edit the test case manually
- try editing the prompt
Retry auto-fix button, 12/2024