Skip to content

Fix key and value heads patching for models with different n_heads from n_key_value_heads#981

Open
nikolaystanishev wants to merge 2 commits intoTransformerLensOrg:mainfrom
nikolaystanishev:patching_key_value_heads_bug
Open

Fix key and value heads patching for models with different n_heads from n_key_value_heads#981
nikolaystanishev wants to merge 2 commits intoTransformerLensOrg:mainfrom
nikolaystanishev:patching_key_value_heads_bug

Commits

Commits on Jul 25, 2025