TestOps logo
Try TestOps

Integration with GitLab

This page describes how to set up both Allure TestOps and GitLab in a project that uses GitLab to run tests.

Like all other CI integrations for Allure TestOps, this involves communication in two directions.

  • A job in a GitLab pipeline will use allurectl to send its status and test results to Allure TestOps.
  • Allure TestOps will use GitLab API to trigger new pipelines, optionally passing a test plan.

Once a pipeline run stops, the corresponding launch in Allure TestOps may be closed either manually or automatically, according to the Auto close policy.

To enable Allure TestOps support in your GitLab project:

  1. enable sending data from GitLab,
  2. enable triggering GitLab pipelines,
  3. parametrize jobs (if necessary).

1. Enable sending data from GitLab

For GitLab to send pipeline statuses and test results to Allure TestOps, you need to generate an authentication token in Allure TestOps, add the token to GitLab, and modify the pipeline itself.

Then, run and check the pipeline to make sure that everything works so far.

1.1. Create a token in Allure TestOps

  1. In Allure TestOps, click on your avatar and go to Your profile.

  2. Under the API tokens section, click Create.

  3. Enter a Token name (e.g., “Token for GitLab”), then click Submit.

  4. In the dialog that appears, click the Copy icon to copy the token into clipboard.

    You will need this token on the next step.

1.2. Specify the token in GitLab

  1. In GitLab, open the project and go to Settings → CI/CD.

  2. Under the Variables section, click Add variable.

  3. In the dialog that appears, fill in the fields:

    • Type — Variable.
    • Visibility — Masked.
    • Key — “ALLURE_TOKEN”.
    • Value — the API token that you got on step 1.1.

  4. Click Add variable to close the dialog and save the settings.

1.3. Modify the pipeline

To make changes to the pipeline, edit the .gitlab-ci.yml in your GitLab repository. You can do it either in a local directory or in the GitLab's web-based text editor (CI/CD → Editor in the old navigation, Build → Pipeline editor in the new navigation).

For each CI job that runs tests, do the following:

  1. Add a before_script command that downloads the allurectl tool and makes it executable.

    In the example below, we use curl for downloading the file. If curl is not included in the Docker image that you use for the job, use wget or a similar tool.

    Alternatively, consider building and using your own Docker image with allurectl included in it.

  2. Add or extend the job's variables block. It must include the following variables:

    • ALLURE_ENDPOINT — the URL of the Allure TestOps server.
    • ALLURE_PROJECT_ID — the ID of the Allure TestOps project.
    • ALLURE_RESULTS — the path to the test results directory, e.g., “build/allure-results”. If there are multiple test result directories in your project, you can separate them with commas or use a wildcard pattern, e.g., “modules/*/build/allure-results”.

  3. Wrap the command that runs the tests into the ./allurectl watch command.

Example

Assume we have a Java project with a .gitlab-ci.yml file like this:

test:
  stage: test
  image: gradle
  script:
    - gradle clean test

With Allure TestOps integration, the file will look something like this:

test:
  stage: test
  image: gradle
  variables:
    ALLURE_ENDPOINT: https://demo.testops.cloud
    ALLURE_PROJECT_ID: 1
    ALLURE_RESULTS: build/allure-results
  before_script:
    - curl -fsSL https://github.com/allure-framework/allurectl/releases/latest/download/allurectl_linux_amd64 -o allurectl
    - chmod +x allurectl
  script:
    - ./allurectl watch -- gradle clean test

1.4. Run and check the pipeline

  1. In GitLab, open the project and go to the pipeline run triggered by the latest commit.

  2. If the pipeline run is not yet finished, wait until it finishes.

  3. In the pipeline run details, click on the job that runs tests.

    Close to the end of its log, there should be a link to the test report at Allure TestOps. Make sure that it is present and works.

    The link to the launch is in the pipeline run log.

  4. In the test report at Allure TestOps, open a single test's results.

    At the bottom of the page, there should be a link back to the GitLab pipeline. Make sure that it is present and works.

    The link to the GitLab pipeline is at the bottom of the test result.

2. Enable triggering GitLab pipelines

On the Allure TestOps side, the integration with GitLab needs to be configured on two levels.

First, the administrator enables integration with a GitLab server by providing the server's URL.

Then project's owner adds the enabled integration to their project as follows.

A project's owner creates an authentication token in GitLab, adds it to Allure TestOps, and configures the job in Allure TestOps.

2.1. Enable integration with a GitLab server in Allure TestOps

  1. Log into Allure TestOps using an administrator account.

  2. Click on your avatar and go to Administration → Integrations.

  3. Click Add integration in the top right corner of the page.

  4. In the dialog that appears, select GitLab.

  5. Fill in the fields:

    • Name — a name to help you recognize the GitLab server, e.g., “GitLab production”.
    • Endpoint — the URL of the GitLab server, e.g., “https://gitlab.example.com/”.

  6. If your GitLab server uses a self-signed SSL certificate, check the Disable certificate validation checkbox.

  7. Click Add integration.

2.2. Create a token in GitLab

  1. In GitLab, click on your avatar and go to Preferences.

  2. In the menu on the left, click Access Tokens.

  3. If the token creation form has not appeared, click Add new token above the tokens list.

  4. Fill in the fields:

    • Token name — a name to help you recognize the token, e.g., “Token for Allure TestOps”.
    • Expiration date — any date within a year from the current date. After this date, the integration will stop working, and you will need to create a new token to continue using the integration.
    • Select scopes — “api” and “read_api”.

  5. Click Create personal access token.

    The page will reload, and the Your new personal access token field will appear on the top. Click the Copy icon next to it.

    You will need this token on the next step.

The same way, you can use a project access token, but keep in mind, project access token allows you working with a single project.

2.3. Add the token to an Allure TestOps project

  1. In Allure TestOps, go to the project page.

  2. In the menu on the left, click Settings → Integrations.

  3. Under the Available integrations, find the GitLab integration and click Add integration next to it.

  4. In the dialog that appears, specify the Token that you got on step 2.2.

    Check that the credentials are correct

    Click Test connection. After a few moments, a message should appear saying “Connection established”.

  5. Click Add integration to close the dialog and save the settings.

2.4. Configure the job in Allure TestOps

  1. In Allure TestOps, go to the project page.

  2. In the menu on the left, click Jobs.

    The page should contain a new job automatically added and configured during the launch on step 1.4.

  3. Click the job's three dots menu, then select Configure.

  4. In the dialog that appears, edit the fields:

    • Name — a name to help you recognize the job.
    • Build server — the name of the integration that you added on step 2.1.
    • Job can be used to run tests — if checked, users will be able to trigger this job from Allure TestOps.
    • Parameters — parameters that should be passed to GitLab via environment variables, see Environment.

    The dialog allows to set job settings.

  5. Click Submit.

3. Parametrize jobs

GitLab uses environment variables for passing parameters to pipelines. Allure TestOps integrates this feature with its own Environment concept, which lets you both set parameters for new jobs and see parameters set for jobs that were started outside Allure TestOps.

In GitLab, the project's owner adds variables and their default values.

In Allure TestOps, the administrator declares the required display names for parameters globally, then the project's owner configures the parameters mapping both in the project's settings and in the job's settings.

If your project's repository has multiple branches, make sure to create a “Branch” environment variable in Allure TestOps and pass it to your job. This special name will instruct GitLab which of the branches it should use.

3.1. Set the default values in GitLab

To make changes to the pipeline, edit the .gitlab-ci.yml in your GitLab repository. You can do it either in a local directory or in the GitLab's web-based text editor (CI/CD → Editor in the old navigation, Build → Pipeline editor in the new navigation).

Add variables and their default values into the pipeline's or the job's variables block. For example:

test:
  stage: test
  image: gradle
  variables:
    ALLURE_ENDPOINT: https://demo.testops.cloud
    ALLURE_PROJECT_ID: 1
    ALLURE_RESULTS: build/allure-results
    PRODUCT_VERSION: '1.23'
    TESTS_BROWSER: chrome
  before_script:
    - curl -fsSL https://github.com/allure-framework/allurectl/releases/latest/download/allurectl_linux_amd64 -o allurectl
    - chmod +x allurectl
  script:
    - ./allurectl watch -- gradle clean test

3.2. Add global parameter names in Allure TestOps

  1. Log into Allure TestOps using an administrator account.

  2. Click on your avatar and go to Administration → Environment.

  3. For each parameter name that you want to add, click Create, enter the name of the new parameter and click Submit.

    Note that this name can be a human-readable label and does not have to be equal to the name from step 3.1.

    Environment variable names are added in the Administration settings.

3.3. Map parameters to environment variables in Allure TestOps

  1. In Allure TestOps, go to the project page.

  2. In the menu on the left, click Settings → Environment.

  3. For each parameter name that you want to use:

    1. Click Create if the parameter is not in the list. Otherwise, click the Edit icon next to its name.

    2. In the Mapping key field, specify the name of the environment variable name from step 3.1.

    3. In the Environment variable field, select the global parameter name from step 3.2.

    4. Click Submit.

    Mapping environment variables is configured in the project settings.

3.4. Add the parameters into the Allure TestOps job

  1. In Allure TestOps, go to the project page.

  2. In the menu on the left, click Jobs.

  3. Find the job which you want to parametrize. In the job's three dots menu, click Configure.

    The job settings dialog will appear, containing the Parameters section.

  4. For each parameter that you want to use, click Add and fill in the fields:

    • Name — the name of the environment variable name from step 3.1.
    • Value — the default value, same as the value from step 3.1.
    • Environment Variable — the global parameter name from step 3.2.

    Multiple environment variables can be specified in the dialog.

  5. Click Submit.

© Qameta Software Inc. All rights reserved.