Code

Humanity's last exam#520

Code

Merged

NathanHB merged 13 commits intomainhuggingface/lighteval:mainfrom clem_last_examhuggingface/lighteval:clem_last_examCopy head branch name to clipboardFeb 18, 2025

+297-15

Commits

Commits on Jan 27, 2025

• added HLE init + option to pass format to open ai models

  clefourrier

  committed
  b7e2e80

  Copy full SHA for b7e2e80

Commits on Jan 28, 2025

• wip

  clefourrier

  committed
  f9bb2a1

  Copy full SHA for f9bb2a1

• added option for inference endpoints in openai

  clefourrier

  committed
  db4c4e8

  Copy full SHA for db4c4e8

Commits on Jan 29, 2025

• metrics working

  clefourrier

  committed
  59ce9e1

  Copy full SHA for 59ce9e1

• attempt at async code

  clefourrier

  committed
  23ad476

  Copy full SHA for 23ad476

• revert harcoding

  clefourrier

  committed
  c3e02ea

  Copy full SHA for c3e02ea

Commits on Jan 30, 2025

• revert async

  clefourrier

  committed
  a58e6d6

  Copy full SHA for a58e6d6

• fix review

  clefourrier

  committed
  1dd74f0

  Copy full SHA for 1dd74f0

Commits on Feb 13, 2025

• Merge branch 'main' into clem_last_exam

  NathanHB

  authored
  ab9a6d8

  Copy full SHA for ab9a6d8

Commits on Feb 18, 2025

• Merge branch 'main' into clem_last_exam

  NathanHB

  authored
  8acb461

  Copy full SHA for 8acb461

• commit

  NathanHB

  committed
  6b3976a

  Copy full SHA for 6b3976a

• commit

  NathanHB

  committed
  9054c99

  Copy full SHA for 9054c99

• commit

  NathanHB

  committed
  ebd1a99

  Copy full SHA for ebd1a99