Distributed package doesn't have NCCL built in

[Bigfield77]

Hello,

On windows, I have to change line 88 of demo.py to use "gloo" instead of NCCL

I guess this only impacts training?

sincerely

[PommesPeter]

Hi, @Bigfield77

We currently support inference on Linux, and we are not fully testing the functionality on Windows. We will initially process the group with NCCL both training and inference. Please stay tuned.

[Bigfield77]

thanks for the answer!