Sketched Linear Layers

Sketched Linear Layers#

Backward time for linear on NVIDIA T4 with Tensor Core implementation

Backward pass time (ms) for SKLinear vs nn.Linear on NVIDIA T4 (Tensor Cores), varying layer width

Backward time for linear on NVIDIA P100 without Tensor Cores

Backward pass time (ms) for SKLinear vs nn.Linear on NVIDIA P100 (no Tensor Cores), varying layer width

Forward time for linear on NVIDIA T4 with Tensor Core implementation

Forward pass time (ms) for SKLinear vs nn.Linear on NVIDIA T4 (Tensor Cores), varying layer width

Forward time for linear on NVIDIA P100 without Tensor Cores

Forward pass time (ms) for SKLinear vs nn.Linear on NVIDIA P100 (no Tensor Cores), varying layer width