https://github.com/tkarna approved this pull request. Looks good to me. As I understand an immediate use case for this is to gather sharded computation results on rank 0 for verification purposes. https://github.com/llvm/llvm-project/pull/180754