[llvm] [AMDGPU][Attributor] Don't run `AAAddressSpace` for graphics functions (PR #108560)

[Shilei Tian via llvm-commits]

shiltian wrote:

> I wouldn't bother skipping it

If we don't want to bother skipping it, do we want to do the same thing for `InferAddressSpacePass`? This can allow the TTI version of `getFlatAddressSpace` to go.

https://github.com/llvm/llvm-project/pull/108560