Skip to content

Commit d48a2ba

Browse files
authored
Create SciAssess_vote.md
This PR is a vote for a new project "SciAssess" in AI for literature analysis area.
1 parent 5ba8807 commit d48a2ba

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

votes/SciAssess_vote.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
2+
# A Vote for New Projects: SciAssess
3+
4+
## Proposal
5+
6+
**SciAssess**, a benchmark specifically designed for the comprehensive evaluation of LLMs in scientific literature analysis. It aims to thoroughly assess the efficacy of LLMs by evaluating their capabilities in Memorization (L1), Comprehension (L2), and Analysis & Reasoning (L3). It encompasses a variety of tasks drawn from diverse scientific fields, including biology, chemistry, material, and medicine.
7+
8+
SciAssess inclusion in the DeepModeling community aligns with the community's short-term plan of expanding exploration into “AI for literature analysis” area.
9+
10+
For more information, see the [original repository](https://github.com/sci-assess/SciAssess)
11+
12+
## Deadline
13+
14+
The vote will be open for at least 6 days unless there is an objection.
15+
16+
## Scope
17+
18+
TOC MEMBERS.

0 commit comments

Comments
 (0)