https://github.com/stanford-cs336/spring2025-lectures/blob/main/nonexecutable/2025%20Lecture%204%20-%20MoEs.pdf <img width="1864" height="1120" alt="Image" src="https://github.com/user-attachments/assets/56f5bc36-a366-4fcb-828b-b7b259a9b74f" /> It should be V3 (671B -37 active) instead of V2(671B -37 active)
https://github.com/stanford-cs336/spring2025-lectures/blob/main/nonexecutable/2025%20Lecture%204%20-%20MoEs.pdf
It should be V3 (671B -37 active) instead of V2(671B -37 active)