Skip to content

Commit 50d3671

Browse files
authored
Update index.md
1 parent 49e63f1 commit 50d3671

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/index.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ In designing test cases for evaluation, we incorporate domain-specific test case
8181
| **Material Science** | [Semiconductor Materials](#semiconductor-materials) (7), [Molecular Modeling](#molecular-modeling) (6) |
8282

8383
![Image Title](figures/SciCode_chart.png)
84-
<p style="text-align: center;">** Distribution of Main Problems **Right:** Distribution of Subproblems</p>**Left:
84+
<p style="text-align: center;">**Left:** Distribution of Main Problems **Right:** Distribution of Subproblems</p>
8585

8686
## Experiment Results
8787
We evaluate our model using zero-shot prompts. We keep the prompts general and design different ones for different evaluation setups only to inform the model about the tasks. We keep prompts the same across models and fields, and they contain the model’s main and sub-problem instructions and code for previous subproblems. The standard setup means the model is tested without background knowledge and carrying over generated solutions to previous subproblems. The scientists' annotated background provides the necessary knowledge and reasoning steps to solve the problems, shifting the evaluation’s focus more towards the models’ coding and instruction-following capabilities.

0 commit comments

Comments
 (0)