Replies: 1 comment
-
|
I don't think there is a runtime toggle to disable NCCL in Horovod. Would it help in your case to place certain communication ops onto CPU? In that case those wouldn't use NCCL. Of course, I'd imagine that this would also preclude MPI-aware GPU in case that's a concern to you. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I searched horovod with NCCL, and most materials are about install horovod with NCCL.
after we installed horovod with NCCL, is there any setting for us to choose whether to use NCCL? if we don't want to use NCCL in some case, we must install another horovod without NCCL?
Beta Was this translation helpful? Give feedback.
All reactions