Search results

The tests always fail

Status: Open.

#44 In scicode-bench/SciCode;

· WeiyuCheng opened on May 22, 2025

Some example's <code>ground_truth_code</code> do not pass the tests in dev set

Status: Open.

#43 In scicode-bench/SciCode;

· John-Boccio opened on May 2, 2025

Add o3 and o4 mini to the leaderboard

Status: Open.

#42 In scicode-bench/SciCode;

· GypsyDignity opened on Apr 22, 2025

error

Status: Open.

#40 In scicode-bench/SciCode;

· haizeiwanglf opened on Apr 8, 2025

Add gpt-4.5 to the leaderboard

Status: Open.

#37 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 9, 2025

Benchmark Claude Sonnet 3.7

Status: Open.

#36 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 6, 2025

Benchmark o1

Status: Open.

#35 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 6, 2025

Dependency versions for evaluation

Status: Open.

#2 In scicode-bench/SciCode;

· zrait opened on Jul 21, 2024