Quickstart Azure DevOps

​

CI/CD pipeline integration

​

1. Create an API key

The option to create your API key can be found within the settings menu.

Click on Create an API key.

You then will be navigated to our auth provider where you can create a new org-level API key.

Add the API key to your CI provider as a secret to run test reports from the CI.

​

2. Copy your test target ID

The option to copy your test target ID can be found within the settings menu.

Click on the copy test target id.

​

3. Install Azure DevOps pipeline extension

Install our Azure DevOps pipeline extension from the Marketplace.

​

4. Include the Azure DevOps Task

Include the following Azure DevOps Task into your CI/CD build pipeline on pull request. We assume you are running branch deployments so that every change can be tested in isolation. You will have to inject the publicly accessible URL of your branch deployment and the API key via the azure task.

- task: automagicallyexecute@2
  inputs:
    url: <publicly accessible url to your deployment>
    token: ${{ secrets.AUTOMAGICALLY_TOKEN }}
    testTargetId: <your testTargetId that you also get from us>
    blocking: <if you want your pipeline to wait for all tests to pass>
    environmentName: <if you want to run tests on an environment other than default>

​

5. Set user permissions

Make sure that your build service user also has permissions to comment to pull requests. To do so, navigate to the Project Settings > Repos > Repositories > Security tab and allow the ‘contribute to pull request’ flag.

​

6. Allow comments

During installation, we’ll ask you to grant access to your repository with write access to pull request threads, so we are allowed to comment back into the pipeline. It will list the test results with additional links to more details, looking like this ↓