src.core.parameter_server_saasgd module

class src.core.parameter_server_saasgd.ParameterServerSAASGD(model: Module, param: ConfigParameters)

Bases: ParameterServer

Staleness-aware Async-SGD Implementation from the paper: “Staleness-aware Asynchronous SGD for Distributed Deep Learning” (https://arxiv.org/pdf/1511.05950).

push(wid, w_version: int, grads: list[Tensor]) → ParameterServerStatus