src.core.parameter_server_asap module

class src.core.parameter_server_asap.ParameterServerASAP_SGD(model: Module, param: ConfigParameters)

Bases: ParameterServer

“Instance-based Adaptiveness to Staleness in Asynchronous SGD” (https://proceedings.mlr.press/v162/backstrom22a/backstrom22a.pdf).

push(wid, w_version: int, grads: list[Tensor]) → ParameterServerStatus