[clang] [clang] Avoid invalidating specialization lookup (PR #196533)

[via cfe-commits]

mzukovec wrote:

@ChuanqiXu9 would you be able to check this out since you were part of the https://github.com/llvm/llvm-project/pull/172658?

https://github.com/llvm/llvm-project/pull/196533