Support Complex Data Type in all_reduce and broadcast for Gloo Backend #156632
Description
🚀 The feature, motivation and pitch
Currently PyTorch only supports Complex data type for nccl but not for gloo. To solve a similar problem mentioned in this PR when training model using gloo backend, it's required to add this feature in gloo.
Alternatives
No response
Additional context
No response
cc @H-Huang @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k