diff options
author | Ævar Arnfjörð Bjarmason <avarab@gmail.com> | 2021-01-26 16:57:34 +0300 |
---|---|---|
committer | Ævar Arnfjörð Bjarmason <avarab@gmail.com> | 2021-01-26 17:53:27 +0300 |
commit | 4ef9efa722632797fc58aa3376d6bce96e1942c6 (patch) | |
tree | 96a4f5eb322b015f3d228243e420ed72772505b7 | |
parent | 627c53e3e51f73c3d19df2b49b956c02ba200e78 (diff) |
CI: retry to work around flaky testsavar/retry-ci-on-failure
We have flaky tests[1] that keep causing false alarms in the CI, so
people have to waste time looking at the same issue and click "retry"
manually.
Let's do that retry automatically. We'll waste less time just having
it retry so you'll potentially wait a bit more for a real failure,
v.s. the false alarms.
This is an interim solution for[1]. We should also fix those tests, a
smarter way to do this would be to quickly annotate known failed
tests, or to have "make test" et al smartly retry just the failing
tests, but just doing this is simpler and better than the status quo.
1. https://gitlab.com/gitlab-org/gitaly/-/issues?label_name[]=failure%3A%3Aflaky-test
-rw-r--r-- | .gitlab-ci.yml | 8 |
1 files changed, 6 insertions, 2 deletions
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 1640488fa..b5b7c2691 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -51,8 +51,12 @@ danger-review: - _build/Makefile.sha256 - ruby/vendor/bundle +.test_template: &retry_definition + retry: 2 + .test_template: &test_definition <<: *cache_definition + <<: *retry_definition stage: test # Override the cache definition for pull cache: @@ -257,16 +261,16 @@ praefect_sql_test: - make test-postgres lint: + <<: *retry_definition stage: test - retry: 2 script: - go version - make lint lint-strict: + <<: *retry_definition allow_failure: true stage: test - retry: 2 script: - go version - make lint-strict |