Replies: 1 comment 2 replies
-
|
As an example, what library have you thought of? IMO it is extremely unlikely that this would be possible without any code changes in Horovod. |
Beta Was this translation helpful? Give feedback.
-
|
Something like HCCL (Huawei Collective Communication Library) |
Beta Was this translation helpful? Give feedback.
-
|
I only briefly looked at some documentation for HCCL, but there's a good chance that it would be relatively straightforward to add backend implemantations to Horovod that use that library. We currently have those for MPI, NCCL, Gloo, oneCCL, DDL. The code is separated out pretty well and compiled only conditionally (lots of #if directives). See horovod/horovod/common/operations.cc Line 144 in 8d34c85 |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Is your feature request related to a problem? Please describe.
No.
Describe the solution you'd like
Adding new Collective Communication Library without changing HVD's code.
Describe alternatives you've considered
HVD involve a plugin frameword for CCL extention.
Additional context
NA.
Beta Was this translation helpful? Give feedback.
All reactions