From 869f4bf63886739b1fc2ed6f133410c0c2fb34cf Mon Sep 17 00:00:00 2001 From: Prashanth <30420973+PrashanthCorp@users.noreply.github.com> Date: Tue, 1 Apr 2025 15:16:35 -0700 Subject: [PATCH] Update comment in VectorCrossNet in crossnet.py to correctly reflect the code and spec in DCN V1 paper The original comment mentioned the bias was scaled by x_0. The paper mentions the bias is a separate term in the update --- torchrec/modules/crossnet.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/torchrec/modules/crossnet.py b/torchrec/modules/crossnet.py index 43771be5d..5188455d1 100644 --- a/torchrec/modules/crossnet.py +++ b/torchrec/modules/crossnet.py @@ -196,7 +196,7 @@ class VectorCrossNet(torch.nn.Module): On each layer l, the tensor is transformed into - .. math:: x_{l+1} = x_0 * (W_l . x_l + b_l) + x_l + .. math:: x_{l+1} = x_0 * (W_l . x_l) + b_l + x_l where :math:`W_l` is either a vector, :math:`*` means element-wise multiplication; :math:`.` means dot operations.