Code

layernorm_decay_fix#35927

Code

Merged

SunMarc merged 9 commits intohuggingface:mainhuggingface/transformers:mainfrom Ryoo72:fix-rmsnorm-weight-decayRyoo72/transformers:fix-rmsnorm-weight-decayCopy head branch name to clipboardFeb 4, 2025

+45-15

Commits

Commits on Jan 28, 2025

• layernorm_decay_fix

  Ryoo72

  committed
  e38dab5

  Copy full SHA for e38dab5

• W293 fix

  Ryoo72

  committed
  9c45f24

  Copy full SHA for 9c45f24

• ruff format fix

  Ryoo72

  committed
  7c9c0b8

  Copy full SHA for 7c9c0b8

Commits on Jan 30, 2025

• black format

  Ryoo72

  committed
  de0cfde

  Copy full SHA for de0cfde

• ruff format

  Ryoo72

  committed
  dfe3965

  Copy full SHA for dfe3965

• erase last layer

  Ryoo72

  committed
  9601fb8

  Copy full SHA for 9601fb8

• upstream update

  Ryoo72

  committed
  e81da08

  Copy full SHA for e81da08

• add test_get_parameter_names_rmsnorm

  Ryoo72

  committed
  bca024b

  Copy full SHA for bca024b

• rmsnorm fix

  Ryoo72

  committed
  5e5f9c0

  Copy full SHA for 5e5f9c0