[clang] [OffloadBundler] Compress bundles over 4GB (PR #122307)

[LLVM Continuous Integration via cfe-commits]

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `clang-debian-cpp20` running on `clang-debian-cpp20` while building `clang` at step 6 "test-build-unified-tree-check-all".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/108/builds/8358

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 6 (test-build-unified-tree-check-all) failure: test (failure)
******************** TEST 'Clang :: Driver/clang-offload-bundler-zlib.c' FAILED ********************
Exit Code: 1

Command Output (stderr):
--
RUN: at line 7: /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/bin/clang -O0 -target x86_64-unknown-linux-gnu /vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c -c -emit-llvm -o /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.bc
+ /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/bin/clang -O0 -target x86_64-unknown-linux-gnu /vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c -c -emit-llvm -o /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.bc
RUN: at line 12: touch /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.empty
+ touch /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.empty
RUN: at line 17: echo 'Content of device file 1' > /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1
+ echo 'Content of device file 1'
RUN: at line 18: echo 'Content of device file 2' > /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2
+ echo 'Content of device file 2'
RUN: at line 23: env OFFLOAD_BUNDLER_COMPRESS=1 OFFLOAD_BUNDLER_VERBOSE=1    clang-offload-bundler -type=bc -targets=hip-amdgcn-amd-amdhsa--gfx900,hip-amdgcn-amd-amdhsa--gfx906    -input=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1 -input=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2 -output=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.hip.bundle.bc 2>&1 |    /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/bin/FileCheck -check-prefix=COMPRESS /vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c
+ /vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/bin/FileCheck -check-prefix=COMPRESS /vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c
+ env OFFLOAD_BUNDLER_COMPRESS=1 OFFLOAD_BUNDLER_VERBOSE=1 clang-offload-bundler -type=bc -targets=hip-amdgcn-amd-amdhsa--gfx900,hip-amdgcn-amd-amdhsa--gfx906 -input=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt1 -input=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.tgt2 -output=/vol/worker/clang-debian-cpp20/clang-debian-cpp20/build/tools/clang/test/Driver/Output/clang-offload-bundler-zlib.c.tmp.hip.bundle.bc
/vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c:59:14: error: COMPRESS: expected string not found in input
// COMPRESS: Compressed bundle format version: 3
             ^
<stdin>:4:21: note: scanning from here
Compression level: 6
                    ^
<stdin>:7:1: note: possible intended match here
Compression rate: 1.86
^

Input file: <stdin>
Check file: /vol/worker/clang-debian-cpp20/clang-debian-cpp20/llvm-project/clang/test/Driver/clang-offload-bundler-zlib.c

-dump-input=help explains the following input dump.

Input was:
<<<<<<
            1: Compressed bundle format version: 2 
            2: Total file size (including headers): 125 bytes 
            3: Compression method used: zlib 
            4: Compression level: 6 
check:59'0                         X error: no match found
            5: Binary size before compression: 188 bytes 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
            6: Binary size after compression: 101 bytes 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
            7: Compression rate: 1.86 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~
check:59'1     ?                       possible intended match
            8: Compression ratio: 53.72% 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~
            9: Compression speed: 1.14 MB/s 
check:59'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
           10: Truncated MD5 hash: 0x2bcafb899a29dc94 
...

```

</details>

https://github.com/llvm/llvm-project/pull/122307