[llvm] [WIP][ADT] Avoid slow size queries on append (PR #136365)

[Jakub Kuderski via llvm-commits]

kuhar wrote:

@nikic Would you be able to see if this helps with compile times?

https://github.com/llvm/llvm-project/pull/136365