[clang] [Frontend] Avoid repeated hash lookups (NFC) (PR #107728)

[Nikita Popov via cfe-commits]

https://github.com/nikic approved this pull request.

LGTM with the note that converting these to SmallSetVector would probably be more elegant...

https://github.com/llvm/llvm-project/pull/107728