Skip to content

Commit 575be4d

Browse files
authored
Update index.md
1 parent 52cdfa1 commit 575be4d

File tree

1 file changed

+8
-6
lines changed

1 file changed

+8
-6
lines changed

docs/index.md

+8-6
Original file line numberDiff line numberDiff line change
@@ -20,10 +20,14 @@
2020

2121
<p align="center">
2222
* Equal contribution lead authors. † Data curation, alphabetical order.
23-
24-
‡ Corresponding to: {mtian8,haopeng}@illinois.edu, [email protected]
23+
‡ Corresponding to: {mtian8, haopeng}@illinois.edu, [email protected]
2524
</p>
2625

26+
## Introduction
27+
SciCode is a newly developed benchmark designed to evaluate the capabilities of language models (LMs) in generating code for solving realistic scientific research problems. It has a diverse coverage of **6** domains: Physics, Math, Material Science, Biology, and Chemistry. They span 16 diverse natural science sub-fields. Unlike previous benchmarks that consist of question-answer pairs, SciCode problems naturally factorize into multiple subproblems, each involving knowledge recall, reasoning, and code synthesis. In total, SciCode contains **338** subproblems decomposed from **80** challenging main problems, and it offers optional descriptions specifying useful scientific background information and scientist-annotated gold-standard solutions and test cases for evaluation.
28+
29+
30+
## Overview
2731

2832

2933

@@ -37,18 +41,16 @@
3741

3842
[:octicons-arrow-right-24: Browse the results](leaderboard.md)
3943

40-
- :material-book:{ .lg .middle } __Preprint__
44+
- :material-book:{ .lg .middle } __Paper__
4145

4246
---
4347

4448
Learn all the details
4549

46-
[:octicons-arrow-right-24: Read the preprint](https://arxiv.com)
50+
[:octicons-arrow-right-24: Read the paper](https://arxiv.com)
4751
</div>
4852

49-
commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus. Donec quam felis, ultricies nec, pellentesque eu, pretium quis, sem. Nulla consequat massa quis enim. Donec pede justo, fringilla vel, aliquet nec, vulputate eget, arcu. In enim justo, rhoncus ut, imperdiet a, venenatis vitae, justo. Nullam dictum felis eu pede mollis pretium. Integer tincidunt. Cras dapibus. Vivamus elementum semper nisi. Aenean vulputate eleifend tellus.
5053

51-
Aenean leo ligula, porttitor eu, consequat vitae, eleifend ac, enim. Aliquam lorem ante, dapibus in, viverra quis, feugiat a, tellus. Phasellus viverra nulla ut metus varius laoreet. Quisque rutrum. Aenean imperdiet. Etiam ultricies nisi vel augue. Curabitur ullamcorper ultricies nisi. Nam eget dui. Etiam rhoncus. Maecenas tempus, tellus eget condimentum rhoncus, sem quam semper libero, sit amet adipiscing sem neque sed ipsum. Nam quam nunc, blandit vel, luctus pulvinar, hendrerit id, lorem. Maecenas nec odio et ante tincidunt tempus. Donec vitae sapien ut libero venenatis faucibus. Nullam quis ante. Etiam sit amet orci eget eros faucibus tincidunt. Duis leo. Sed fringilla mauris sit amet nibh. Donec sodales sagittis magna. Sed consequat, leo eget bibendum sodales, augue velit cursus nunc.
5254

5355
<div class="grid cards" markdown>
5456

0 commit comments

Comments
 (0)