sketchgraphs_models.nn.distributed

Utility modules for distributed and parallel training.

Classes

SingleDeviceDistributedParallel(module, …)

This module implements a module similar to DistributedDataParallel, but it accepts inputs of any shape, and only supports a single device per instance.