CI/CD on Logan's Nest

Capture bash command error in file

Wed, 12 Oct 2022 00:00:00 +0000

Neat trick to capture STDERR into a text file for the next command but also exit with the preserved exit code after then.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12


gradle \
 build \
 2> >(tee error.log >&2)

EXIT_CODE=${PIPESTATUS[0]}

if [[ -s "error.log" ]] && [[ ${EXIT_CODE} -ne 0 ]]
then
 cat error.log | buildkite-agent annotate --style "error"
fi

exit $EXIT_CODE

[BASH] Repeat Build Step

Mon, 22 Jun 2020 00:00:00 +0000

When you need to print out YAML build step for multiple environments.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21


DEPLOY_ENVS=(staging:account1 staging2:account2)

build_pipeline_step() {
 yaml_orig=$1
 for DEPLOY_ENV in "${DEPLOY_ENVS[@]}"
 do
 IFS=':' read -r -a DEPLOY_ENV_ARRAY <<< "$DEPLOY\_ENV"
 DEPLOY_ENV=${DEPLOY_ENV_ARRAY[0]}
 DEPLOY_ACCOUNT=${DEPLOY_ENV_ARRAY[1]}
 yaml="$(sed "s/DEPLOY_ENV/${DEPLOY_ENV}/g" <<< "$yaml_orig")"
 yaml="$(sed "s/DEPLOY_ACCOUNT/${DEPLOY_ACCOUNT}/g" <<< "$yaml")"
 echo "$yaml"
 done
 echo " - wait"
}

build_pipeline_step "$(cat <<EOF
 - label: 'DEPLOY_ENV - DEPLOY_ACCOUNT'
 commands: "echo hello DEPLOY_ENV"
EOF
)"

Selenoid Parallel CI testing

Tue, 12 May 2020 00:00:00 +0000

Selenoid is handy tool to manage test runner with minimum efforts.
As it uses own dependent containers by itself, need to maintain single Selenoid run per build agent.

docker-compose.yml

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37


services: 
 e2e-test-runner:
 networks:
 selenoid: null
 depends_on:
 - selenoid
 build:
 context: .
 dockerfile: end-to-end/Dockerfile
 environment:
 - BUILDKITE
 - NEXUS_USERNAME
 - NEXUS_PASSWORD
 - PAYLATER_VERSION
 - CHROME_PROFILE_DIR=/tmp/chrome_profile
 - SEL_JUP_SELENIUM_SERVER_URL=http://selenoid:4444/wd/hub/
 - GRADLE_USER_HOME=/app/.gradle
 volumes:
 - $PWD/end-to-end/build/reports:/app/end-to-end/build/reports
 - $PWD/build/reports:/app/build/reports
 - /var/run/docker.sock:/var/run/docker.sock


 selenoid:
 image: aerokube/selenoid:latest-release
 networks:
 selenoid: null
 volumes:
 - "/tmp/selenoid/video:/opt/selenoid/video:delegated"
 - "/tmp/selenoid/logs:/opt/selenoid/logs:delegated"
 - "$PWD/end-to-end/selenoid:/etc/selenoid:delegated"
 - "/var/run/docker.sock:/var/run/docker.sock"
 expose:
 - "4444"
 environment:
 - OVERRIDE_VIDEO_OUTPUT_DIR=/tmp/selenoid/video
 command: ["-conf", "/etc/selenoid/browsers.json", "-video-output-dir", "/opt/selenoid/video", "-log-output-dir", "/opt/selenoid/logs","-save-all-logs","-disable-privileged", "-container-network", "selenoid"]

CI Pipeline (BK)