Run Tests Step Settings
This topic provides settings and permissions for the Harness CI Run Tests step, which executes one or more tests on a container image.
Name
The unique name for this step.
ID
See Entity Identifier Reference.
Description
Text string.
Container Registry
The Harness Connector for a container registry. This is the container registry for the image Harness will use run build commands on, such as DockerHub.
Image
The name of the Docker image to use when running commands. For example: maven:3.6.3-jdk-8.
The image name should include the tag and will default to the latest tag if unspecified. You can use any docker image from any docker registry, including docker images from private registries.
Different container registries require different name formats:
- Docker Registry: enter the name of the artifact you want to deploy, such as library/tomcat. Wildcards are not supported.
- GCR: enter the name of the artifact you want to deploy. Images in repos need to reference a path starting with the project ID that the artifact is in, for example:
us.gcr.io/playground-243019/quickstart-image:latest. - ECR: enter the name of the artifact you want to deploy. Images in repos need to reference a path, for example:
40000005317.dkr.ecr.us-east-1.amazonaws.com/todolist:0.2.
Arguments
Enter the arguments for the build tool. These are used as input for the build tool choice. Thus for Maven, you can provide Dargs to configure timezone, max memory, etc.
Build Tool
Enter the build automation tool. Currently Harness only supports Maven.
Language
Enter the programming language of the source code to build. For example: Java.
Packages
List of source code package prefixes separated by a comma. For example: com.company., io.company.migrations.
Run Only Selected Tests
If this option is unchecked, Test Intelligence is disabled and all tests will run.
Test Annotations
Enter the list of test annotations used in unit testing, separated by commas. Any method annotated with this will be treated as a test method. The defaults are: org.junit.Test, org.junit.jupiter.api.Test, org.testng.annotations.Test
Pre-Command
Enter the commands for setting up the environment before running the tests. For example,printenv prints all or part of the environment.
Post-Command
Enter the commands used for cleaning up the environment after running the tests. For example, sleep 600 suspends the process for 600 seconds.
Report Paths
The path to the file(s) that store results in the JUnit XML format. You can enter multiple paths. Regex is supported.
Environment Variables
Variables passed to the container as environment variables and used in the Commands.
Output Variables
Output variables expose Environment Variables for use by other steps/stages of the Pipeline. You reference the output variable of a step using the step ID and the name of the variable in Output Variables.
Let's look at a simple example.
In a step with the ID S1, in Command, export a new variable:
export myVar=varValue
In Output Variables, list the exported variable name:
In a later Run step, in Command, reference the output variable:
echo <+S1.output.outputVariables.myVar>
Here's how the S1 step's output variable is referenced:
Syntax for referencing output variables between steps in the same stage:
<+[stepID].output.outputVariables.[varName]>
Syntax for referencing output variables between steps in different stages:
<+stages.[stageID].execution.steps.[stepID].output.outputVariables.[varName]>
Image Pull Policy
Select an option to set the pull policy for the image.
- Always: The kubelet queries the container image registry to resolve the name to an image digest every time the kubelet launches a container. If the kubelet encounters an exact digest cached locally, it uses its cached image; otherwise, the kubelet downloads (pulls) the image with the resolved digest, and uses that image to launch the container.
- If Not Present: The image is pulled only if it isn't already present locally.
- Never: The kubelet assumes that the image exists locally and doesn't try to pull the image.
Run as User
Set the value to specify the user id for all processes in the pod, running in containers. See Set the security context for a pod.
Set container resources
These settings specify the maximum resources used by the container at runtime.
Limit Memory
Maximum memory that the container can use. You can express memory as a plain integer or as a fixed-point number using the suffixes G or M. You can also use the power-of-two equivalents Gi and Mi.
Limit CPU
The maximum number of cores that the container can use. CPU limits are measured in cpu units. Fractional requests are allowed: you can specify one hundred millicpu as 0.1 or 100m. See Resource units in Kubernetes.
Timeout
Timeout for the step. Once the timeout is reached, the step fails and the Pipeline execution continues.