[llvm] [LLVM] add LZMA for compression/decompression (PR #83297)

Artem Belevich via llvm-commits llvm-commits at lists.llvm.org
Wed Feb 28 10:41:07 PST 2024


Artem-B wrote:

> LZMA (Lempel-Ziv/Markov-chain Algorithm) provides better comparession rate than zstd and zlib for clang-offload-bundler bundles which often contains large number of similar entries.

Do you have any benchmarks to support this assertion? 

For huge binaries, decompression speed may be more important than compression ratio. E.g. it's not unusual to have large ML apps carrying O(gigabyte) of GPU code blobs. 

lzma's somewhat better compression ratio (vs zstd) comes at a price of a relatively slow decompression speed. zstd gives comparable compression ratio at much higher decompression speed:
https://morotti.github.io/lzbench-web/?dataset=silesia/mozilla&machine=desktop#results
![image](https://github.com/llvm/llvm-project/assets/526795/d0d2ac0b-168e-4004-b0ab-15d2376037fa)



https://github.com/llvm/llvm-project/pull/83297


More information about the llvm-commits mailing list