src.core.parameter_server_dasgd module

class src.core.parameter_server_dasgd.ParameterServerDASGD(model: Module, param: ConfigParameters)[source]

Bases: ParameterServer

“Asynchronous SGD with stale gradient dynamic adjustment for deep learning training” (https://www.sciencedirect.com/science/article/pii/S0020025524011344?via%3Dihub)

push(wid, w_version: int, grads: list[Tensor]) → ParameterServerStatus[source]