[llvm] [HWASan] optimize AttrInfer fix for selective HWASan (PR #108111)

[Vitaly Buka via llvm-commits]

vitalybuka wrote:

Can we put real part of the patch on hold to the moment when we get back to actively working on SelHWASAN?
It would be nice to see a difference.

https://github.com/llvm/llvm-project/pull/108111