[libcxx-commits] [PATCH] D150062: [clang][ci] Improves buildkite artifacts.

[Mark de Wever via Phabricator via libcxx-commits]

Mordante created this revision.
Mordante added reviewers: EricWF, ldionne.
Herald added a subscriber: arichardson.
Herald added a project: All.
Mordante requested review of this revision.
Herald added a project: libc++.
Herald added a subscriber: libcxx-commits.
Herald added a reviewer: libc++.

The financial cost of the network I/O for the Clang install artifacts is
quite significant. afd3478f37c8 <https://reviews.llvm.org/rGafd3478f37c8734ec6a0f028f772645a108d14b2> improved this by creating tarballs. This
commit improves the tarball by using xz compression instead of gzip. This
option is the slowest, but gives the smallest size.

  size  time           time
        (compression)  (decompression)

gzip  51 M  7  s           1.2 s
bz2   44 M  17 s           5.8 s
xz    33 M  76 s           3.1 s


Repository:
  rG LLVM Github Monorepo

https://reviews.llvm.org/D150062

Files:
  libcxx/utils/ci/buildkite-pipeline-clang.yml


Index: libcxx/utils/ci/buildkite-pipeline-clang.yml
===================================================================
--- libcxx/utils/ci/buildkite-pipeline-clang.yml
+++ libcxx/utils/ci/buildkite-pipeline-clang.yml
@@ -24,8 +24,8 @@
       # but with the number of jobs we run daily, this can result in thousands of GB of network I/O.
       - "cmake -S llvm -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=install -DLLVM_ENABLE_PROJECTS=\"clang;compiler-rt\""
       - "ninja -C build install-clang install-clang-resource-headers"
-      - "tar -czvf install.tar.gz install/"
-      - "buildkite-agent artifact upload --debug install.tar.gz"
+      - "tar -cJvf install.tar.xz install/"
+      - "buildkite-agent artifact upload --debug install.tar.xz"
     env:
         CC: "clang-${LLVM_HEAD_VERSION}"
         CXX: "clang++-${LLVM_HEAD_VERSION}"
@@ -42,8 +42,8 @@
 
   - label: "C++03"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.gz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"
@@ -65,8 +65,8 @@
 
   - label: "C++2b"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.xz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"
@@ -88,8 +88,8 @@
 
   - label: "Modules"
     commands:
-      - "buildkite-agent artifact download install.tar.gz ."
-      - "tar -xzvf install.tar.gz"
+      - "buildkite-agent artifact download install.tar.xz ."
+      - "tar -xvf install.tar.xz"
       - "export CC=$(pwd)/install/bin/clang"
       - "export CXX=$(pwd)/install/bin/clang++"
       - "chmod +x install/bin/clang install/bin/clang++"


-------------- next part --------------
A non-text attachment was scrubbed...
Name: D150062.520171.patch
Type: text/x-patch
Size: 2085 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/libcxx-commits/attachments/20230507/db84ec18/attachment.bin>