Skip to content

update metrics for dpl enhance initial snap - #4467

Open
gudeh wants to merge 11 commits into
The-OpenROAD-Project:masterfrom
The-OpenROAD-Project-staging:secure-dpl-enhance-initial-snap
Open

update metrics for dpl enhance initial snap#4467
gudeh wants to merge 11 commits into
The-OpenROAD-Project:masterfrom
The-OpenROAD-Project-staging:secure-dpl-enhance-initial-snap

Conversation

@gudeh

@gudeh gudeh commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Update metrics for OR PR The-OpenROAD-Project/OpenROAD#11121

CI Could not Update Rules

[ERROR] asap7/tinyRocket skipped. File 'rules-base.json' not found. Please create the file with 'make update_rules'.

Messages from CI

[INFO] asap7/minimal not included in CI.
[INFO] gf12 not included in the update.
[INFO] gf55 not included in the update.
[INFO] nangate45/bp_quad not included in CI.

CI Could not Update Rules

[ERROR] asap7/tinyRocket skipped. File 'rules-base.json' not found. Please create the file with 'make update_rules'.

Messages from CI

[INFO] asap7/minimal not included in CI.
[INFO] gf12 not included in the update.
[INFO] gf55 not included in the update.
[INFO] nangate45/bp_quad not included in CI.

gudeh added 10 commits August 3, 2026 14:24
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
@gudeh gudeh self-assigned this Aug 24, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the tools/OpenROAD subproject commit to a newer version. There are no review comments, and I have no feedback to provide.

@gudeh gudeh added the UpdateRules Starts GHA to update rules label Aug 24, 2026
@openroad-ci

openroad-ci commented Aug 24, 2026

Copy link
Copy Markdown
Member

🔍 QoR check

Metrics reflect the PR merge build — i.e. what will land on the target branch. Advisory — results are log-only and do not affect build status. The authoritative QoR gate remains the local rules-file check.

Commit c60e5a6 · Jenkins build #3 · Baseline: build

62 design(s) checked — 19 with regression(s), 0 without a comparable baseline.
Design Variant Verdict local vs inline passed / failed / missing
asap7/aes base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/aes-block base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/aes-mbff base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/aes_lvt base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/cva6 base ✅ pass ✅ MATCH 12 / 0 / 0
asap7/ethmac base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/ethmac_lvt base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/gcd-ccs base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/jpeg_lvt base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/mock-alu base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/mock-cpu base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/riscv32i base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
asap7/riscv32i-mock-sram base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/swerv_wrapper base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/uart base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/aes base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/aes-hybrid base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/riscv32i base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
gf180/uart-blocks base ✅ pass ✅ MATCH 25 / 0 / 0
gt2n/aes base ✅ pass ✅ MATCH 25 / 0 / 0
gt2n/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
gt2n/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/aes base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/i2c-gpio-expander base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/jpeg base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
ihp-sg13g2/riscv32i base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/spi base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/aes base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/ariane133 base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
nangate45/ariane136 base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/black_parrot base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/bp_be_top base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/bp_fe_top base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
nangate45/bp_multi_top base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/cva6 base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/dynamic_node base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
nangate45/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/ibex base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
nangate45/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/mempool_group base ✅ pass ✅ MATCH 12 / 0 / 0
nangate45/swerv base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
nangate45/swerv_wrapper base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
nangate45/tinyRocket base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
sky130hd/aes base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/chameleon base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
sky130hd/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/jpeg base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
sky130hd/microwatt base ❌ fail ⚠️ MISMATCH 20 / 5 / 0
sky130hd/riscv32i base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/aes base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/riscv32i base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
❌ asap7/aes-block base — 1 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -1441.21 -1269.75 13.503445560149636% -1359.75 PeriodPadding 20%
❌ asap7/aes-mbff base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -244.224 -121.825 100.47116765852658% -197.825 PeriodPadding 20%
❌ asap7/ethmac_lvt base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -361.893 -231.644 56.2280913816028% -291.644 PeriodPadding 20%
❌ asap7/jpeg_lvt base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -141.55 -3.38568 4080.8440254247303% -123.38568 PeriodPadding 20%
❌ asap7/riscv32i base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -14348.6 -8314.3 72.57736670555549% -8504.3 PeriodPadding 20%
globalroute__timing__setup__tns -3608.3 -1179.01 206.04490207886278% -1369.01 PeriodPadding 20%
❌ asap7/riscv32i-mock-sram base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -7918.65 -3522.14 124.82496436825339% -3712.14 PeriodPadding 20%
❌ gf180/riscv32i base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -8.15413 -3.69767 120.52076037071994% -5.49767 PeriodPadding 20%
globalroute__timing__setup__tns -8.31723 -3.70141 124.70436941597931% -5.50141 PeriodPadding 20%
❌ ihp-sg13g2/jpeg base — 1 failing metric(s)
Metric target base delta limit band
detailedroute__antenna_diodes_count 156 135 15.555555555555555% 135.135 Metric 0.1%
❌ nangate45/ariane133 base — 1 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -465.789 -449.345 3.6595488989529206% -449.945 PeriodPadding 20%
❌ nangate45/bp_fe_top base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -2.54458 -1.86745 36.25960534418592% -2.22745 PeriodPadding 20%
❌ nangate45/dynamic_node base — 2 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -794.456 -793.073 0.17438495573547455% -793.473 PeriodPadding 20%
finish__timing__setup__tns -823.113 -820.522 0.315774592271749% -820.922 PeriodPadding 20%
❌ nangate45/ibex base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -0.639933 -0.0996192 542.3791799171244% -0.5396192 PeriodPadding 20%
❌ nangate45/swerv base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -521.731 -489.865 6.505057515846203% -490.215 PeriodPadding 20%
globalroute__timing__setup__tns -518.681 -477.642 8.591999866008432% -477.992 PeriodPadding 20%
❌ nangate45/swerv_wrapper base — 1 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -418.569 -399.02 4.899253170267155% -399.42 PeriodPadding 20%
❌ nangate45/tinyRocket base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -35.7614 -31.1553 14.784322410633182% -31.3953 PeriodPadding 20%
finish__timing__setup__tns -47.7559 -47.4505 0.6436180862161621% -47.6905 PeriodPadding 20%
globalroute__timing__setup__tns -53.4296 -49.4402 8.069142115120894% -49.6802 PeriodPadding 20%
❌ sky130hd/chameleon base — 3 failing metric(s)
Metric target base delta limit band
detailedroute__antenna_diodes_count 119 106 12.264150943396226% 106.106 Metric 0.1%
finish__timing__setup__tns -84.9843 -46.7781 81.67539938560994% -47.3781 PeriodPadding 20%
globalroute__timing__setup__tns -91.9306 -48.1714 90.84062327439104% -48.7714 PeriodPadding 20%
❌ sky130hd/jpeg base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -111.478 -101.92 9.377943485086343% -102.92 PeriodPadding 20%
finish__timing__setup__tns -91.8651 -88.2502 4.096194682844912% -89.2502 PeriodPadding 20%
globalroute__timing__setup__tns -168 -163.108 2.9992397675160016% -164.108 PeriodPadding 20%
❌ sky130hd/microwatt base — 5 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -240.291 -227.393 5.672118314987708% -230.393 PeriodPadding 20%
detailedroute__antenna_diodes_count 1424 1392 2.2988505747126435% 1393.392 Metric 0.1%
finish__timing__setup__tns -199.866 -177.785 12.420057935146385% -180.785 PeriodPadding 20%
globalroute__antenna_diodes_count 3428 3424 0.11682242990654206% 3427.424 Metric 0.1%
globalroute__timing__setup__tns -258.601 -221.868 16.55624064759226% -224.868 PeriodPadding 20%
❌ sky130hs/riscv32i base — 1 failing metric(s)
Metric target base delta limit band
globalroute__timing__setup__tns -354.108 -350.006 1.1719799089158471% -350.806 PeriodPadding 20%

@openroad-ci openroad-ci removed the UpdateRules Starts GHA to update rules label Aug 24, 2026
@gudeh gudeh added the UpdateRules Starts GHA to update rules label Aug 24, 2026
@openroad-ci openroad-ci removed the UpdateRules Starts GHA to update rules label Aug 24, 2026
designs/gf180/riscv32i/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__timing__setup__tns                       |      -4.98 |      -3.85 | Tighten  |
| globalroute__timing__setup__tns               |       -5.5 |      -10.1 | Failing  |
| finish__timing__setup__tns                    |       -5.5 |      -9.95 | Failing  |

designs/asap7/ethmac_lvt/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| placeopt__design__instance__area              |       8324 |       8308 | Tighten  |
| cts__timing__setup__ws                        |      -35.2 |      -35.0 | Tighten  |
| globalroute__timing__setup__ws                |      -45.6 |      -45.5 | Tighten  |
| globalroute__timing__setup__tns               |     -537.0 |     -531.0 | Tighten  |
| finish__timing__setup__tns                    |     -268.0 |     -422.0 | Failing  |

designs/asap7/riscv32i/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__timing__setup__tns                       |     -384.0 |     -234.0 | Tighten  |
| globalroute__timing__setup__tns               |    -1890.0 |    -3800.0 | Failing  |
| finish__timing__setup__ws                     |      -80.6 |      -79.5 | Tighten  |
| finish__timing__setup__tns                    |   -12100.0 |   -14500.0 | Failing  |

designs/sky130hd/chameleon/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| synth__canonical_netlist__hash                | a00ab29ad0ffbaeefa32f9095dc0ba456716fff7 | 95da73a25e9cd04ecac4d295fdb60c2fee120741 | Failing  |
| synth__netlist__hash                          | 2336e903becb507610dd910ba765f7fc269d1f95 | 20346e2bb71b3bceb5ddfd86c17ebd78f52a7810 | Failing  |
| cts__timing__setup__ws                        |      -3.25 |      -3.21 | Tighten  |
| cts__timing__setup__tns                       |     -136.0 |     -134.0 | Tighten  |
| globalroute__antenna_diodes_count             |        179 |        138 | Tighten  |
| globalroute__timing__setup__tns               |      -48.8 |      -92.5 | Failing  |
| detailedroute__route__wirelength              |     853725 |     851647 | Tighten  |
| detailedroute__antenna_diodes_count           |        106 |        119 | Failing  |
| finish__timing__setup__ws                     |      -2.66 |      -2.52 | Tighten  |
| finish__timing__setup__tns                    |      -47.4 |      -85.6 | Failing  |

designs/sky130hd/gcd/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__design__instance__count__setup_buffer    |         48 |         54 | Failing  |
| cts__timing__setup__ws                        |      -1.57 |      -1.49 | Tighten  |
| cts__timing__setup__tns                       |      -68.5 |      -63.9 | Tighten  |
| globalroute__timing__setup__ws                |      -1.75 |      -1.61 | Tighten  |
| globalroute__timing__setup__tns               |      -75.0 |      -69.7 | Tighten  |
| detailedroute__route__wirelength              |      14559 |      13554 | Tighten  |
| finish__timing__setup__ws                     |      -1.68 |      -1.52 | Tighten  |
| finish__timing__setup__tns                    |      -71.2 |      -65.3 | Tighten  |

designs/sky130hd/microwatt/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__timing__setup__tns                       |     -230.0 |     -243.0 | Failing  |
| globalroute__antenna_diodes_count             |       3427 |       3431 | Failing  |
| globalroute__timing__setup__tns               |     -225.0 |     -262.0 | Failing  |
| detailedroute__route__wirelength              |    7780575 |    7753254 | Tighten  |
| detailedroute__antenna__violating__nets       |         72 |         69 | Tighten  |
| detailedroute__antenna_diodes_count           |       1393 |       1425 | Failing  |
| finish__timing__setup__tns                    |     -181.0 |     -203.0 | Failing  |

designs/nangate45/tinyRocket/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__timing__setup__ws                        |     -0.201 |     -0.195 | Tighten  |
| cts__timing__setup__tns                       |      -31.4 |      -36.0 | Failing  |
| globalroute__timing__setup__tns               |      -49.7 |      -53.7 | Failing  |
| finish__timing__setup__tns                    |      -47.7 |      -48.0 | Failing  |

designs/nangate45/dynamic_node/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| cts__timing__setup__ws                        |      -1.13 |      -1.11 | Tighten  |
| cts__timing__setup__tns                       |     -952.0 |     -795.0 | Tighten  |
| globalroute__timing__setup__ws                |      -1.14 |      -1.13 | Tighten  |
| globalroute__timing__setup__tns               |     -800.0 |     -797.0 | Tighten  |
| detailedroute__route__wirelength              |     256231 |     246867 | Tighten  |
| finish__timing__setup__ws                     |      -1.11 |       -1.1 | Tighten  |
| finish__timing__setup__tns                    |     -821.0 |     -824.0 | Failing  |
| finish__design__instance__area                |      30878 |      30558 | Tighten  |

designs/nangate45/ibex/rules-base.json updates:
| Metric                                        | Old        | New        | Type     |
| ------                                        | ---        | ---        | ----     |
| synth__design__instance__area__stdcell        |    32800.0 |    32400.0 | Tighten  |
| placeopt__design__instance__count__stdcell    |      17244 |      16921 | Tighten  |
| cts__design__instance__count__setup_buffer    |       1500 |       1471 | Tighten  |
| cts__design__instance__count__hold_buffer     |       1500 |       1471 | Tighten  |
| globalroute__timing__setup__ws                |     -0.127 |     -0.111 | Tighten  |
| globalroute__timing__setup__tns               |      -1.27 |     -0.441 | Tighten  |
| finish__timing__setup__tns                    |      -0.44 |      -1.08 | Failing  |

Large percentage changes in failing metrics (>50%):
 - ibex (nangate45)      finish__timing__setup__tns       145.45%  (-0.44 → -1.08)
 - riscv32i (asap7)      globalroute__timing__setup__tns  101.06%  (-1890.0 → -3800.0)
 - chameleon (sky130hd)  globalroute__timing__setup__tns   89.55%  (-48.8 → -92.5)
 - riscv32i (gf180)      globalroute__timing__setup__tns   83.64%  (-5.5 → -10.1)
 - riscv32i (gf180)      finish__timing__setup__tns        80.91%  (-5.5 → -9.95)
 - chameleon (sky130hd)  finish__timing__setup__tns        80.59%  (-47.4 → -85.6)
 - ethmac_lvt (asap7)    finish__timing__setup__tns        57.46%  (-268.0 → -422.0)

Large percentage improvements in tighten metrics (>50%):
 - ibex (nangate45)  globalroute__timing__setup__tns  -65.28%  (-1.27 → -0.441)

Signed-off-by: Augusto Berndt <augusto.berndt@precisioninno.com>
@gudeh
gudeh requested a review from eder-matheus August 25, 2026 13:50

@eder-matheus eder-matheus left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have some large timing degradations, especially on asap7/ethmac_lvt and sky130hd/chameleon. They're not a blocker, but it would be good to understand what caused the degradation.

@gudeh

gudeh commented Aug 25, 2026

Copy link
Copy Markdown
Contributor Author

Here is sky130hd/chameleon worst path at nightly:
image

And here is the worst path on this branch:
image

On this branch we start with a higher amount of violations. I will have a look on debug mode to understand.
image

I also noticed a relatively high amount of GPL iterations at chameleon (both nightly and branch obviously).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants