[clang] [OffloadBundler] Compress bundles over 4GB (PR #122307)

[LLVM Continuous Integration via cfe-commits]

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `clang-armv8-quick` running on `linaro-clang-armv8-quick` while building `clang` at step 5 "ninja check 1".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/154/builds/10570

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 5 (ninja check 1) failure: stage 1 checked (failure)
******************** TEST 'Clang :: Driver/clang-offload-bundler-zlib.c' FAILED ********************
Exit Code: 1

Command Output (stderr):
--
RUN: at line 7: /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/bin/clang -O0 -target armv8l-unknown-linux-gnueabihf /home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c -c -emit-llvm -o /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.bc
+ /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/bin/clang -O0 -target armv8l-unknown-linux-gnueabihf /home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c -c -emit-llvm -o /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.bc
RUN: at line 12: touch /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.empty
+ touch /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.empty
RUN: at line 17: echo 'Content of device file 1' > /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1
+ echo 'Content of device file 1'
RUN: at line 18: echo 'Content of device file 2' > /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2
+ echo 'Content of device file 2'
RUN: at line 23: env OFFLOAD_BUNDLER_COMPRESS=1 OFFLOAD_BUNDLER_VERBOSE=1    clang-offload-bundler -type=bc -targets=hip-amdgcn-amd-amdhsa--gfx900,hip-amdgcn-amd-amdhsa--gfx906    -input=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1 -input=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2 -output=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.hip.bundle.bc 2>&1 |    /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/bin/FileCheck -check-prefix=COMPRESS /home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c
+ env OFFLOAD_BUNDLER_COMPRESS=1 OFFLOAD_BUNDLER_VERBOSE=1 clang-offload-bundler -type=bc -targets=hip-amdgcn-amd-amdhsa--gfx900,hip-amdgcn-amd-amdhsa--gfx906 -input=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1 -input=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2 -output=/home/tcwg-buildbot/worker/clang-armv8-quick/stage1/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.hip.bundle.bc
+ /home/tcwg-buildbot/worker/clang-armv8-quick/stage1/bin/FileCheck -check-prefix=COMPRESS /home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c
/home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c:59:14: error: COMPRESS: expected string not found in input
// COMPRESS: Compressed bundle format version: 3
             ^
<stdin>:4:21: note: scanning from here
Compression level: 6
                    ^
<stdin>:7:1: note: possible intended match here
Compression rate: 1.86
^

Input file: <stdin>
Check file: /home/tcwg-buildbot/worker/clang-armv8-quick/llvm/clang/test/Driver/clang-offload-bundler-zlib.c

-dump-input=help explains the following input dump.

Input was:
<<<<<<
            1: Compressed bundle format version: 2 
            2: Total file size (including headers): 125 bytes 
            3: Compression method used: zlib 
            4: Compression level: 6 
check:59'0                         X error: no match found
            5: Binary size before compression: 188 bytes 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
            6: Binary size after compression: 101 bytes 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
            7: Compression rate: 1.86 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~
check:59'1     ?                       possible intended match
            8: Compression ratio: 53.72% 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~
            9: Compression speed: 0.02 MB/s 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           10: Truncated MD5 hash: 0x2bcafb899a29dc94 
...

```

</details>

https://github.com/llvm/llvm-project/pull/122307