#2240: Add `Rabenseifner` and `Recursive doubling` allreduce algorithms for `ObjGroup`#2272

Closed

JacobDomagala wants to merge 29 commits intodevelopfrom 2240-use-a-proper-all-reduce-algorithm-for-proxyallreduce

+2,785-29

Commits on Jul 18, 2024

#2240 : Initial work for new allreduce
JacobDomagala
committed
#2240 : Semi working Rabenseifner
JacobDomagala
committed
#2240 : Working Rabenseifner (non-commutative ops)
JacobDomagala
committed
#2240 : Fix non power of 2 for new allreduce
JacobDomagala
committed
#2240 : Initial work for adding recursive doubling allreduce algorithm
JacobDomagala
committed
#2240 : Make sure the order of reduce operations is correct
JacobDomagala
committed
#2240 : Working Recursive doubling
JacobDomagala
committed
#2240 : Code cleanup and make Rabenseifner work with any Op type
JacobDomagala
committed
#2240 : Improve accuracy of timing allreduce algorithms in allreduce.cc
JacobDomagala
committed
#2240 : Add unit tests for new allreduce and cleanup code
JacobDomagala
committed
#2240 : DataHandler for Rabenseifner allreduce that provides common API for various data types
JacobDomagala
committed
#2240 : Fix warnings
JacobDomagala
committed
#2240 : Update ObjGroup test to use custom DataHandler for Rabenseifner allreduce test
JacobDomagala
committed
#2240 : Add unit test for Rabenseifner with Kokkos::View as DataType and fix compile issues realted to using Kokkos::View for allreduce
JacobDomagala
committed
#2240 : Move function definitions to impl.h file for Rabenseifner
JacobDomagala
committed
#2240 : Add allreduce print category and use it in rabenseifner instead of fmt::print
JacobDomagala
committed
#2240 : Provide documentation for RecursiveDoubling algorithm
JacobDomagala
committed
#2240 : Use vt_debug_print for RecursiveDoubling allreduce
JacobDomagala
committed
#2240 : Update allreduce perf tests to use array of payload sizes
JacobDomagala
committed
#2240 : Fix runtime failure in allreduce perf test
JacobDomagala
committed
#2240 : Working allreduce perf test with Kokkos
JacobDomagala
committed
#2240 : Working RecursiveDoubling with multiple allreduce in flight
JacobDomagala
committed
#2240 : Update Rabenseifner to use ID for each allreduce and update tests
JacobDomagala
committed
#2240 : Fix failing unit and performance tests for multiple allreduce in flight
JacobDomagala
committed
#2240 : Fix compile issues on some compilers and runtime issue with passing proxy by reference
JacobDomagala
committed
#2240 : Update logs
JacobDomagala
committed
#2240 : Fix issues with handlers being executed and payload not being initialized
JacobDomagala
committed
#2240 : Add helpers and use Kokkos::View for internals of Rabenseifner when user's payload is View
JacobDomagala
committed
#2240 : Store Reducers by tuple(ProxyType, DataType, OperandType)
JacobDomagala
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

#2240: Add `Rabenseifner` and `Recursive doubling` allreduce algorithms for `ObjGroup`#2272

Commits on Jul 18, 2024

#2240 : Initial work for new allreduce

#2240 : Semi working Rabenseifner

#2240 : Working Rabenseifner (non-commutative ops)

#2240 : Fix non power of 2 for new allreduce

#2240 : Initial work for adding recursive doubling allreduce algorithm

#2240 : Make sure the order of reduce operations is correct

#2240 : Working Recursive doubling

#2240 : Code cleanup and make Rabenseifner work with any Op type

#2240 : Improve accuracy of timing allreduce algorithms in allreduce.cc

#2240 : Add unit tests for new allreduce and cleanup code

#2240 : DataHandler for Rabenseifner allreduce that provides common API for various data types

#2240 : Fix warnings

#2240 : Update ObjGroup test to use custom DataHandler for Rabenseifner allreduce test

#2240 : Add unit test for Rabenseifner with Kokkos::View as DataType and fix compile issues realted to using Kokkos::View for allreduce

#2240 : Move function definitions to impl.h file for Rabenseifner

#2240 : Add allreduce print category and use it in rabenseifner instead of fmt::print

#2240 : Provide documentation for RecursiveDoubling algorithm

#2240 : Use vt_debug_print for RecursiveDoubling allreduce

#2240 : Update allreduce perf tests to use array of payload sizes

#2240 : Fix runtime failure in allreduce perf test

#2240 : Working allreduce perf test with Kokkos

#2240 : Working RecursiveDoubling with multiple allreduce in flight

#2240 : Update Rabenseifner to use ID for each allreduce and update tests

#2240 : Fix failing unit and performance tests for multiple allreduce in flight

#2240 : Fix compile issues on some compilers and runtime issue with passing proxy by reference

#2240 : Update logs

#2240 : Fix issues with handlers being executed and payload not being initialized

#2240 : Add helpers and use Kokkos::View for internals of Rabenseifner when user's payload is View

#2240 : Store Reducers by tuple(ProxyType, DataType, OperandType)