Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Add ifeval_pt to harness Tasks Modified #6654: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
Add ifeval_pt to harness Unit Tests #6627: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
fix(afrixnli): use Jinja braces in prompt_1 doc_to_text (#3944) Tasks Modified #6653: Commit ad3ee81 pushed by baberabb
1m 10s main
main
1m 10s
fix(afrixnli): use Jinja braces in prompt_1 doc_to_text (#3944) Unit Tests #6626: Commit ad3ee81 pushed by baberabb
5m 19s main
main
5m 19s
fix(longbench): skip blank leading line in code_sim_score extraction … Unit Tests #6625: Commit a97cfc2 pushed by baberabb
5m 4s main
main
5m 4s
fix(longbench): skip blank leading line in code_sim_score extraction … Tasks Modified #6652: Commit a97cfc2 pushed by baberabb
1m 3s main
main
1m 3s
fix(longbench): skip blank leading line in code_sim_score extraction Tasks Modified #6651: Pull request #3921 synchronize by baberabb
1m 0s cameronshinn:fix/longbench-code-sim-score-leading-whitespace
cameronshinn:fix/longbench-code-sim-score-leading-whitespace
1m 0s
fix(longbench): skip blank leading line in code_sim_score extraction Unit Tests #6624: Pull request #3921 synchronize by baberabb
4m 57s cameronshinn:fix/longbench-code-sim-score-leading-whitespace
cameronshinn:fix/longbench-code-sim-score-leading-whitespace
4m 57s
Fix broken afrobench group task references (afrisenti/mafand prompt_2… Unit Tests #6623: Commit 877a609 pushed by baberabb
5m 21s main
main
5m 21s
Fix broken afrobench group task references (afrisenti/mafand prompt_2… Tasks Modified #6650: Commit 877a609 pushed by baberabb
39s main
main
39s
fix(tmmluplus): load from ikala/tmmluplus so the task works on datase… Tasks Modified #6649: Commit fe9a1c7 pushed by baberabb
45s main
main
45s
fix(tmmluplus): load from ikala/tmmluplus so the task works on datase… Unit Tests #6622: Commit fe9a1c7 pushed by baberabb
5m 24s main
main
5m 24s
fix(tasks): use script-less parquet mirrors for mathqa, siqa, and mor… Unit Tests #6621: Commit 7575f6e pushed by baberabb
4m 47s main
main
4m 47s
fix(tasks): use script-less parquet mirrors for mathqa, siqa, and mor… Tasks Modified #6648: Commit 7575f6e pushed by baberabb
58s main
main
58s
replace sqlitedict cache with stdlib sqlite3 + JSON Tasks Modified #6647: Pull request #3988 opened by Mute-404
Action required Mute-404:fix-cache-pickle-deserialization
Mute-404:fix-cache-pickle-deserialization
Action required
replace sqlitedict cache with stdlib sqlite3 + JSON Unit Tests #6620: Pull request #3988 opened by Mute-404
Action required Mute-404:fix-cache-pickle-deserialization
Mute-404:fix-cache-pickle-deserialization
Action required
Add ifeval_pt to harness Tasks Modified #6646: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
Add ifeval_pt to harness Unit Tests #6619: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
fix(scrolls): load SCROLLS without the removed dataset script (#3975) Tasks Modified #6645: Commit 671b155 pushed by baberabb
53s main
main
53s
fix(scrolls): load SCROLLS without the removed dataset script (#3975) Unit Tests #6618: Commit 671b155 pushed by baberabb
5m 15s main
main
5m 15s
fix(mmlusr): restore dataset loading for all 171 MMLU-SR tasks (#3972) Tasks Modified #6644: Commit d245db2 pushed by baberabb
6m 29s main
main
6m 29s
fix(mmlusr): restore dataset loading for all 171 MMLU-SR tasks (#3972) Unit Tests #6617: Commit d245db2 pushed by baberabb
5m 2s main
main
5m 2s
fix(arithmetic): load arithmetic tasks without the removed dataset sc… Unit Tests #6616: Commit a5cdfdd pushed by baberabb
5m 17s main
main
5m 17s
fix(arithmetic): load arithmetic tasks without the removed dataset sc… Tasks Modified #6643: Commit a5cdfdd pushed by baberabb
52s main
main
52s
fix(tasks): use namespaced dataset paths for webqs, medmcqa, and wmt1… Unit Tests #6615: Commit 434d473 pushed by baberabb
5m 23s main
main
5m 23s