[llvm] [SROA]: Only defer trying partial sized ptr or ptr vector types (PR #82279)

[Jeffrey Byrnes via llvm-commits]

jrbyrnes wrote:

@topperc This is what I was referring to 

https://github.com/llvm/llvm-project/pull/82279