[llvm] [Attributor] Fix an issue that an access is skipped by mistake (PR #101862)

[Johannes Doerfert via llvm-commits]

jdoerfert wrote:

> Hmm, I can't reproduce this issue on gfx1030 as well as gfx90a.

Was a fluke: https://lab.llvm.org/buildbot/#/builders/73/builds/3244


https://github.com/llvm/llvm-project/pull/101862