[libcxx-commits] [libcxx] f271df0 - [clang][ci] Improves buildkite artifacts.

[Mark de Wever via libcxx-commits]

Author: Mark de Wever
Date: 2023-05-12T17:44:26+02:00
New Revision: f271df0e790302023c3602a4e8638e5a20ea8513

URL: https://github.com/llvm/llvm-project/commit/f271df0e790302023c3602a4e8638e5a20ea8513
DIFF: https://github.com/llvm/llvm-project/commit/f271df0e790302023c3602a4e8638e5a20ea8513.diff

LOG: [clang][ci] Improves buildkite artifacts.

The financial cost of the network I/O for the Clang install artifacts is
quite significant. afd3478f37c8 improved this by creating tarballs. This
commit improves the tarball by using xz compression instead of gzip. This
option is the slowest, but gives the smallest size.

      size  time           time
            (compression)  (decompression)
gzip  51 M  7  s           1.2 s
bz2   44 M  17 s           5.8 s
xz    33 M  76 s           3.1 s

Reviewed By: ldionne, #libc

Differential Revision: https://reviews.llvm.org/D150062

Added: 
    

Modified: 
    libcxx/utils/ci/buildkite-pipeline-clang.yml

Removed: 
    


################################################################################
diff  --git a/libcxx/utils/ci/buildkite-pipeline-clang.yml b/libcxx/utils/ci/buildkite-pipeline-clang.yml
index c030257fe82b6..e0522e491cfe9 100644
--- a/libcxx/utils/ci/buildkite-pipeline-clang.yml
+++ b/libcxx/utils/ci/buildkite-pipeline-clang.yml
@@ -24,8 +24,8 @@ steps:
       # but with the number of jobs we run daily, this can result in thousands of GB of network I/O.
       - "cmake -S llvm -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=install -DLLVM_ENABLE_PROJECTS=\"clang;compiler-rt\""
       - "ninja -C build install-clang install-clang-resource-headers"
-      - "tar -czvf install.tar.gz install/"
-      - "buildkite-agent artifact upload --debug install.tar.gz"
+      - "tar -cJvf install.tar.xz install/"
+      - "buildkite-agent artifact upload --debug install.tar.xz"
     env:
         CC: "clang-${LLVM_HEAD_VERSION}"
         CXX: "clang++-${LLVM_HEAD_VERSION}"
@@ -42,8 +42,8 @@ steps:
 
   - label: "C++03"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.xz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"
@@ -65,8 +65,8 @@ steps:
 
   - label: "C++2b"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.xz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"
@@ -88,8 +88,8 @@ steps:
 
   - label: "Modules"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.xz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"