Skip to content

Commit 0c3fd11

Browse files
github-actions[bot]github-actions[bot]
committed
Deployed b377e77 with MkDocs version: 1.6.1
1 parent db1901c commit 0c3fd11

20 files changed

+57
-47
lines changed

‎404.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="/assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="/assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="/assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="/assets/stylesheets/palette.06af60db.min.css">
@@ -554,7 +554,7 @@ <h1>404 - Not found</h1>
554554
<script id="__config" type="application/json">{"base": "/", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "/assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
555555

556556

557-
<script src="/assets/javascripts/bundle.5090c770.min.js"></script>
557+
<script src="/assets/javascripts/bundle.f13b1293.min.js"></script>
558558

559559
<script src="/javascripts/mathjax.js"></script>
560560

‎_footer/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>footer - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -595,7 +595,7 @@ <h1> footer</h1>
595595
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
596596

597597

598-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
598+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
599599

600600
<script src="../javascripts/mathjax.js"></script>
601601

‎assets/javascripts/bundle.5090c770.min.js renamed to ‎assets/javascripts/bundle.f13b1293.min.js

+2-2
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎assets/javascripts/bundle.5090c770.min.js.map renamed to ‎assets/javascripts/bundle.f13b1293.min.js.map

+3-3
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎assets/stylesheets/main.a40c8224.min.css

-1
This file was deleted.

‎assets/stylesheets/main.a40c8224.min.css.map

-1
This file was deleted.

‎assets/stylesheets/main.d7758b05.min.css

+1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎assets/stylesheets/main.d7758b05.min.css.map

+1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/faq/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>Faq - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../../assets/stylesheets/palette.06af60db.min.css">
@@ -584,7 +584,7 @@ <h1>Faq</h1>
584584
<script id="__config" type="application/json">{"base": "../..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
585585

586586

587-
<script src="../../assets/javascripts/bundle.5090c770.min.js"></script>
587+
<script src="../../assets/javascripts/bundle.f13b1293.min.js"></script>
588588

589589
<script src="../../javascripts/mathjax.js"></script>
590590

‎docs/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>Index - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -584,7 +584,7 @@ <h1>Index</h1>
584584
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
585585

586586

587-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
587+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
588588

589589
<script src="../javascripts/mathjax.js"></script>
590590

‎docs/quickstart/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>Quickstart - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../../assets/stylesheets/palette.06af60db.min.css">
@@ -584,7 +584,7 @@ <h1>Quickstart</h1>
584584
<script id="__config" type="application/json">{"base": "../..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
585585

586586

587-
<script src="../../assets/javascripts/bundle.5090c770.min.js"></script>
587+
<script src="../../assets/javascripts/bundle.f13b1293.min.js"></script>
588588

589589
<script src="../../javascripts/mathjax.js"></script>
590590

‎docs/usage/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>Usage - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../../assets/stylesheets/palette.06af60db.min.css">
@@ -584,7 +584,7 @@ <h1>Usage</h1>
584584
<script id="__config" type="application/json">{"base": "../..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
585585

586586

587-
<script src="../../assets/javascripts/bundle.5090c770.min.js"></script>
587+
<script src="../../assets/javascripts/bundle.f13b1293.min.js"></script>
588588

589589
<script src="../../javascripts/mathjax.js"></script>
590590

‎example_problem/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -16,15 +16,15 @@
1616

1717

1818
<link rel="icon" href="../assets/images/favicon.png">
19-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
19+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
2020

2121

2222

2323
<title>Example problem - SciCode Benchmark</title>
2424

2525

2626

27-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
27+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2828

2929

3030
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -981,7 +981,7 @@ <h2 id="domain-specific-test-cases">Domain Specific Test Cases</h2>
981981
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
982982

983983

984-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
984+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
985985

986986
<script src="../javascripts/mathjax.js"></script>
987987

‎faq/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -16,15 +16,15 @@
1616

1717

1818
<link rel="icon" href="../assets/images/favicon.png">
19-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
19+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
2020

2121

2222

2323
<title>FAQ - SciCode Benchmark</title>
2424

2525

2626

27-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
27+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2828

2929

3030
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -705,7 +705,7 @@ <h1 id="faq">FAQ</h1>
705705
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
706706

707707

708-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
708+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
709709

710710
<script src="../javascripts/mathjax.js"></script>
711711

‎index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -14,15 +14,15 @@
1414

1515

1616
<link rel="icon" href="assets/images/favicon.png">
17-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
17+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1818

1919

2020

2121
<title>SciCode - SciCode Benchmark</title>
2222

2323

2424

25-
<link rel="stylesheet" href="assets/stylesheets/main.a40c8224.min.css">
25+
<link rel="stylesheet" href="assets/stylesheets/main.d7758b05.min.css">
2626

2727

2828
<link rel="stylesheet" href="assets/stylesheets/palette.06af60db.min.css">
@@ -798,7 +798,7 @@ <h2 id="citation">Citation</h2>
798798
<script id="__config" type="application/json">{"base": ".", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
799799

800800

801-
<script src="assets/javascripts/bundle.5090c770.min.js"></script>
801+
<script src="assets/javascripts/bundle.f13b1293.min.js"></script>
802802

803803
<script src="javascripts/mathjax.js"></script>
804804

‎leaderboard/index.html

+16-6
Original file line numberDiff line numberDiff line change
@@ -14,15 +14,15 @@
1414

1515

1616
<link rel="icon" href="../assets/images/favicon.png">
17-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
17+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1818

1919

2020

2121
<title>Leaderboard - SciCode Benchmark</title>
2222

2323

2424

25-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
25+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2626

2727

2828
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -564,17 +564,27 @@ <h1 id="scicode-leaderboard">SciCode Leaderboard</h1>
564564
</thead>
565565
<tbody>
566566
<tr>
567-
<td>🥇 OpenAI o3-mini</td>
567+
<td>🥇 OpenAI o3-mini-low</td>
568+
<td><div align="center"><strong>10.8</strong></div></td>
569+
<td><div align="center" style="color:grey">33.3</div></td>
570+
</tr>
571+
<tr>
572+
<td>🥈 OpenAI o3-mini-high</td>
573+
<td><div align="center"><strong>9.2</strong></div></td>
574+
<td><div align="center" style="color:grey">34.4</div></td>
575+
</tr>
576+
<tr>
577+
<td>🥉 OpenAI o3-mini-medium</td>
568578
<td><div align="center"><strong>9.2</strong></div></td>
569579
<td><div align="center" style="color:grey">33.0</div></td>
570580
</tr>
571581
<tr>
572-
<td>🥈 OpenAI o1-preview</td>
582+
<td>OpenAI o1-preview</td>
573583
<td><div align="center"><strong>7.7</strong></div></td>
574584
<td><div align="center" style="color:grey">28.5</div></td>
575585
</tr>
576586
<tr>
577-
<td>🥉 Deepseek-R1</td>
587+
<td>Deepseek-R1</td>
578588
<td><div align="center"><strong>4.6</strong></div></td>
579589
<td><div align="center" style="color:grey">28.5</div></td>
580590
</tr>
@@ -738,7 +748,7 @@ <h1 id="scicode-leaderboard">SciCode Leaderboard</h1>
738748
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
739749

740750

741-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
751+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
742752

743753
<script src="../javascripts/mathjax.js"></script>
744754

‎leaderboard_table/index.html

+3-3
Original file line numberDiff line numberDiff line change
@@ -12,15 +12,15 @@
1212

1313

1414
<link rel="icon" href="../assets/images/favicon.png">
15-
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.1">
15+
<meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.6.2">
1616

1717

1818

1919
<title>Leaderboard table - SciCode Benchmark</title>
2020

2121

2222

23-
<link rel="stylesheet" href="../assets/stylesheets/main.a40c8224.min.css">
23+
<link rel="stylesheet" href="../assets/stylesheets/main.d7758b05.min.css">
2424

2525

2626
<link rel="stylesheet" href="../assets/stylesheets/palette.06af60db.min.css">
@@ -607,7 +607,7 @@ <h1>Leaderboard table</h1>
607607
<script id="__config" type="application/json">{"base": "..", "features": ["navigation.tabs", "navigation.tabs.sticky", "navigation.indexes", "navigation.footer", "content.code.copy", "content.footnote.tooltips", "header.autohide", "announce.dismiss"], "search": "../assets/javascripts/workers/search.f8cc74c7.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
608608

609609

610-
<script src="../assets/javascripts/bundle.5090c770.min.js"></script>
610+
<script src="../assets/javascripts/bundle.f13b1293.min.js"></script>
611611

612612
<script src="../javascripts/mathjax.js"></script>
613613

0 commit comments

Comments
 (0)