karpathy autoresearch Ideas Discussions
Pinned Discussions
Ideas Discussions
Share ideas for new features
-
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote Session report: 0.9979 → 0.9697 in 126 experiments — weight decay on everything + init scaling
reportSession report, tracking past experiments -
You must be logged in to vote -
You must be logged in to vote Session report: 0.9979 → 0.9773 in 89 experiments (H100, batch halving + depth + window tuning)
reportSession report, tracking past experiments -
You must be logged in to vote
