diff options
| author | Patrick Steinhardt <psteinhardt@gitlab.com> | 2022-07-20 08:39:09 +0300 |
|---|---|---|
| committer | Patrick Steinhardt <psteinhardt@gitlab.com> | 2022-07-20 08:57:27 +0300 |
| commit | eb8326d7e73e3b9f5eaefb237f12b86f6cad91ad (patch) | |
| tree | 8ef6f9baeab158b437f7bc7523bd0c0016c58d34 | |
| parent | 3fc66dc23581de48bdbbf1b5a5d5ca9faf5f925b (diff) | |
ci: Enable use of fastzip to speed up cache handling
Creating and extracting caches takes up a significant amount of time in
our CI pipelines: extracting the cache takes almost 2 minutes, while
creating the cache takes roundabout 4:30min. This is quite excessive and
diminishes the returns we get from the cache.
Luckily, CI folks have realized that the current caching mechanism is
not ideal and have implemented a "fastzip" strategy [1] that can be
optionally enabled by setting the `FF_USE_FASTZIP` feature flag. This
results in a significant speedup: extracting the cache only takes about
40 seconds compared to 2 minutes, and saving the cache is sped up from
4:30min to about 50 seconds.
Let's enable the fastzip feature for Gitaly to speed up our pipelines.
[1]: https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26490
| -rw-r--r-- | .gitlab-ci.yml | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index d48ff0a7a..fd28fb2a0 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -9,6 +9,8 @@ default: - gitlab-org variables: + FF_USE_FASTZIP: "true" + FF_NETWORK_PER_BUILD: "true" SAST_DISABLE_DIND: "true" SAST_DEFAULT_ANALYZERS: "gosec" DEBIAN_VERSION: "bullseye" @@ -234,7 +236,6 @@ test:pgbouncer: PGPORT_PGBOUNCER: 6432 # We need to enable per-build networking such that the PgBouncer service # can reach Postgres. - FF_NETWORK_PER_BUILD: "true" TEST_TARGET: "test-with-praefect" test:nightly: |