Added the README documentation for the new DRC14 benchmark and CI

[AnasSarkiz]

No description provided.

[AnasSarkiz]

/benchmark

[tscircuitbot]

Benchmark This PR

Run benchmarks by commenting on this PR:

/benchmark [benchmark.sh args...]
/benchmark [scenario-limit|all] --concurrency <n> --effort <n> --max-iterations <n>

Everything after /benchmark is forwarded directly to ./benchmark.sh.

Examples:

• /benchmark -> run default DRC14 benchmark settings
• /benchmark 10 -> run first 10 DRC14 samples
• /benchmark all --concurrency 4 -> run all DRC14 samples with 4 workers
• /benchmark --scenario-limit all --effort 2 -> run all samples with effort 2
• /benchmark --scenario-limit 20 --max-iterations 100 -> run 20 samples with a max iteration override

Any PR whose title contains [BENCHMARK TEST] will automatically run the benchmark workflow on PR updates.

[tscircuitbot]

Benchmark Results

Main Branch Results

Concurrency: 4
Effort: 1
Scenario limit used: 44

Metric	Value
Samples	44
Succeeded	44
Failed	0
Improved	40
Clean	37
Initial DRC	76
Final DRC	8
DRC improvement	68
Total solve time	28.29s
Average solve time	643ms

Raw output

Running benchmark command: ./benchmark.sh
Starting DRC14 benchmark: samples=44 workers=4 effort=1
[sample] 1/44 circuit002 traces=43 drc=1->0 iterations=1 time=314.46ms
[sample] 4/44 circuit120 traces=70 drc=1->0 iterations=1 time=421.40ms
[sample] 2/44 circuit109 traces=63 drc=1->0 iterations=2 time=590.08ms
[sample] 3/44 circuit114 traces=65 drc=2->0 iterations=2 time=997.96ms
[sample] 5/44 circuit123 traces=39 drc=1->0 iterations=2 time=472.18ms
[sample] 6/44 circuit125 traces=37 drc=2->0 iterations=1 time=525.91ms
[sample] 7/44 circuit143 traces=58 drc=1->0 iterations=1 time=947.70ms
[sample] 9/44 circuit158 traces=39 drc=1->0 iterations=2 time=457.40ms
[sample] 8/44 circuit151 traces=70 drc=3->0 iterations=1 time=997.19ms
[sample] 11/44 circuit184 traces=58 drc=1->0 iterations=2 time=569.93ms
[sample] 13/44 circuit187 traces=7 drc=1->0 iterations=1 time=35.96ms
[sample] 10/44 circuit178 traces=55 drc=1->1 iterations=2 time=1061.57ms
[sample] 15/44 circuit197 traces=21 drc=0->0 iterations=1 time=63.80ms
[sample] 12/44 circuit185 traces=49 drc=1->0 iterations=1 time=954.82ms
[sample] 16/44 circuit205 traces=43 drc=1->0 iterations=1 time=232.45ms
[sample] 17/44 circuit206 traces=36 drc=1->0 iterations=1 time=205.52ms
[sample] 14/44 circuit188 traces=51 drc=2->1 iterations=4 time=1224.13ms
[sample] 18/44 circuit212 traces=50 drc=1->0 iterations=1 time=703.94ms
[sample] 19/44 circuit216 traces=46 drc=2->0 iterations=3 time=693.05ms
[sample] 21/44 circuit222 traces=30 drc=1->1 iterations=2 time=485.64ms
[sample] 20/44 circuit219 traces=60 drc=2->0 iterations=1 time=776.33ms
[sample] 24/44 circuit230 traces=25 drc=1->0 iterations=1 time=85.80ms
[sample] 25/44 circuit231 traces=71 drc=3->0 iterations=1 time=1129.99ms
[sample] 26/44 circuit232 traces=53 drc=2->0 iterations=1 time=602.75ms
[sample] 22/44 circuit224 traces=67 drc=7->1 iterations=6 time=2509.85ms
[sample] 28/44 circuit238 traces=62 drc=5->0 iterations=3 time=738.76ms
[sample] 23/44 circuit225 traces=64 drc=3->2 iterations=8 time=3007.21ms
[sample] 29/44 circuit239 traces=43 drc=1->0 iterations=1 time=478.00ms
[sample] 27/44 circuit237 traces=86 drc=3->0 iterations=1 time=977.64ms
[sample] 31/44 circuit243 traces=56 drc=2->1 iterations=3 time=376.41ms
[sample] 30/44 circuit241 traces=47 drc=1->1 iterations=2 time=604.53ms
[sample] 32/44 circuit249 traces=28 drc=1->0 iterations=1 time=271.84ms
[sample] 33/44 circuit250 traces=63 drc=1->0 iterations=2 time=418.77ms
[sample] 37/44 circuit268 traces=37 drc=2->0 iterations=1 time=141.97ms
[sample] 36/44 circuit261 traces=38 drc=1->0 iterations=1 time=208.00ms
[sample] 34/44 circuit253 traces=38 drc=1->0 iterations=1 time=233.52ms
[sample] 35/44 circuit255 traces=35 drc=1->0 iterations=1 time=394.23ms
[sample] 39/44 circuit276 traces=29 drc=1->0 iterations=1 time=129.50ms
[sample] 40/44 circuit285 traces=77 drc=1->0 iterations=2 time=430.48ms
[sample] 41/44 circuit288 traces=55 drc=4->0 iterations=1 time=496.30ms
[sample] 42/44 circuit292 traces=77 drc=1->0 iterations=1 time=472.94ms
[sample] 38/44 circuit270 traces=77 drc=3->0 iterations=4 time=1169.71ms
[sample] 43/44 circuit293 traces=68 drc=1->0 iterations=1 time=362.66ms
[sample] 44/44 circuit294 traces=41 drc=3->0 iterations=1 time=320.11ms

Dataset DRC14 benchmark summary
+--------------------+------------+
| Metric             |      Value |
+--------------------+------------+
| Samples            |         44 |
| Succeeded          |         44 |
| Failed             |          0 |
| Improved           |         40 |
| Clean              |         37 |
| Initial DRC        |         76 |
| Final DRC          |          8 |
| DRC improvement    |         68 |
| Total solve time   | 28292.40ms |
| Average solve time |   643.01ms |
+--------------------+------------+
Wrote benchmark report to benchmark-result.json

PR Results

Concurrency: 4
Effort: 1
Scenario limit used: 44

Metric	PR Value	Delta vs Main
Samples	44	0
Succeeded	44	0
Failed	0	0
Improved	40	0
Clean	37	0
Initial DRC	76	0
Final DRC	8	0
DRC improvement	68	0
Total solve time	28.32s	+32ms
Average solve time	644ms	+1ms

Raw output

Running benchmark command: ./benchmark.sh
Starting DRC14 benchmark: samples=44 workers=4 effort=1
[sample] 1/44 circuit002 traces=43 drc=1->0 iterations=1 time=353.12ms
[sample] 4/44 circuit120 traces=70 drc=1->0 iterations=1 time=398.76ms
[sample] 2/44 circuit109 traces=63 drc=1->0 iterations=2 time=563.37ms
[sample] 3/44 circuit114 traces=65 drc=2->0 iterations=2 time=944.42ms
[sample] 6/44 circuit125 traces=37 drc=2->0 iterations=1 time=369.28ms
[sample] 5/44 circuit123 traces=39 drc=1->0 iterations=2 time=464.91ms
[sample] 7/44 circuit143 traces=58 drc=1->0 iterations=1 time=739.49ms
[sample] 9/44 circuit158 traces=39 drc=1->0 iterations=2 time=405.79ms
[sample] 8/44 circuit151 traces=70 drc=3->0 iterations=1 time=958.02ms
[sample] 10/44 circuit178 traces=55 drc=1->1 iterations=2 time=788.87ms
[sample] 11/44 circuit184 traces=58 drc=1->0 iterations=2 time=333.59ms
[sample] 13/44 circuit187 traces=7 drc=1->0 iterations=1 time=46.61ms
[sample] 15/44 circuit197 traces=21 drc=0->0 iterations=1 time=99.94ms
[sample] 12/44 circuit185 traces=49 drc=1->0 iterations=1 time=912.34ms
[sample] 16/44 circuit205 traces=43 drc=1->0 iterations=1 time=349.21ms
[sample] 17/44 circuit206 traces=36 drc=1->0 iterations=1 time=243.14ms
[sample] 14/44 circuit188 traces=51 drc=2->1 iterations=4 time=1321.47ms
[sample] 18/44 circuit212 traces=50 drc=1->0 iterations=1 time=713.15ms
[sample] 19/44 circuit216 traces=46 drc=2->0 iterations=3 time=707.51ms
[sample] 21/44 circuit222 traces=30 drc=1->1 iterations=2 time=392.68ms
[sample] 20/44 circuit219 traces=60 drc=2->0 iterations=1 time=951.49ms
[sample] 24/44 circuit230 traces=25 drc=1->0 iterations=1 time=155.81ms
[sample] 25/44 circuit231 traces=71 drc=3->0 iterations=1 time=1053.50ms
[sample] 26/44 circuit232 traces=53 drc=2->0 iterations=1 time=704.18ms
[sample] 22/44 circuit224 traces=67 drc=7->1 iterations=6 time=2649.35ms
[sample] 28/44 circuit238 traces=62 drc=5->0 iterations=3 time=844.60ms
[sample] 27/44 circuit237 traces=86 drc=3->0 iterations=1 time=1084.15ms
[sample] 29/44 circuit239 traces=43 drc=1->0 iterations=1 time=410.17ms
[sample] 23/44 circuit225 traces=64 drc=3->2 iterations=8 time=3502.16ms
[sample] 31/44 circuit243 traces=56 drc=2->1 iterations=3 time=406.07ms
[sample] 30/44 circuit241 traces=47 drc=1->1 iterations=2 time=679.81ms
[sample] 32/44 circuit249 traces=28 drc=1->0 iterations=1 time=250.16ms
[sample] 34/44 circuit253 traces=38 drc=1->0 iterations=1 time=252.36ms
[sample] 33/44 circuit250 traces=63 drc=1->0 iterations=2 time=337.09ms
[sample] 35/44 circuit255 traces=35 drc=1->0 iterations=1 time=340.50ms
[sample] 36/44 circuit261 traces=38 drc=1->0 iterations=1 time=170.47ms
[sample] 37/44 circuit268 traces=37 drc=2->0 iterations=1 time=160.76ms
[sample] 39/44 circuit276 traces=29 drc=1->0 iterations=1 time=147.95ms
[sample] 40/44 circuit285 traces=77 drc=1->0 iterations=2 time=574.84ms
[sample] 38/44 circuit270 traces=77 drc=3->0 iterations=4 time=1087.34ms
[sample] 41/44 circuit288 traces=55 drc=4->0 iterations=1 time=620.63ms
[sample] 42/44 circuit292 traces=77 drc=1->0 iterations=1 time=423.48ms
[sample] 43/44 circuit293 traces=68 drc=1->0 iterations=1 time=180.63ms
[sample] 44/44 circuit294 traces=41 drc=3->0 iterations=1 time=231.30ms

Dataset DRC14 benchmark summary
+--------------------+------------+
| Metric             |      Value |
+--------------------+------------+
| Samples            |         44 |
| Succeeded          |         44 |
| Failed             |          0 |
| Improved           |         40 |
| Clean              |         37 |
| Initial DRC        |         76 |
| Final DRC          |          8 |
| DRC improvement    |         68 |
| Total solve time   | 28324.44ms |
| Average solve time |   643.74ms |
+--------------------+------------+
Wrote benchmark report to benchmark-result.json

Workflow: View run
Artifact: https://github.com/tscircuit/high-density-repair03/actions/runs/25488077751

[tscircuitbot]

---

Thank you for your contribution! 🎉

PR Rating: ⭐
Impact: Tiny

Track your contributions and see the leaderboard at: tscircuit Contribution Tracker

---