Conversation
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This draft introduces an explicit PowerElectronics v1 path without changing the published v0 dataset or the package-level v0 default.
The intended v1 benchmark:
abs(dc_gain - 0.25)andVpp / abs(mean_voltage);The generator pins
IDEALLab/power_electronics_v0at revision5c4adb2ec5cfc71794988b1297a7ff8ffe59daa5, refuses dirty code, uncontainerized execution, noncanonical backend fingerprints, and existing output files by default, and writes each shard plus its manifest atomically. It contains no upload or overwrite path.The exact original v0 runtime remains unknown. The archived notebook is evidence for Windows/x86_64 and ngspice 36, while a small ngspice 44.2 reproduction on an ARM64 Mac is much closer to the published labels than the matching Linux x86_64 reproduction. Because the operating system, ngspice version, compiler, and build also differ, that comparison is evidence consistent with ARM but not proof of the original architecture. The documentation retains both facts rather than asserting either architecture as certain.
Frozen backend
40816f203b7e1c68ae37f4d9353bd302486d77988b98733c021f1ff71f48ae0211a4334ee90509f5edfdceef541711a34a1943d26a14cf0928ac8d5947b723745c4adb2ec5cfc71794988b1297a7ff8ffe59daa564e6107d44349e67e031cad36633c1af26817784The SIF, its dependency freeze, source bundle, pilot outputs, manifests, scripts, and logs are preserved on backed-up Euler group work storage rather than purgeable scratch.
Euler pilot results
The final pilot selected 100 evenly spaced source indices from each split and was run twice from isolated directories:
ok24e4eed443da4234bb576a722baa70ddd33acd339790f664926a2b9a16820909ok, 1invalid_measurements(source_index=223)bb677633e4548a1e9ea655f1b6b646ad14225603b79f19933149293af62239abok679c43afbf033a77add527613c6981ba57cc37a69c1642fb1d5b7fcc1a546482Both runs produced byte-identical JSONL hashes for all three splits. The same validation row was invalid in both runs, so the non-finite simulator measurement is preserved deterministically rather than dropped or replaced. A strict audit verified all selected indices, row counts, formulas, checksums, source revision, clean code commit, canonical image/binary fingerprints, statuses, and JSON finiteness.
Full Euler generation
After the repeatable pilot, the same frozen commit and image generated eight deterministic shards per split in Euler array job
14690255. All 24 tasks completed with exit code0:0. Each task used an isolated work/runtime directory and an offline copy of the pinned v0 cache; no Hugging Face token or upload path was present.The independent full-run audit passed with all 13,824 source indices present exactly once and all formulas, manifests, output hashes, source revisions, code commit, and backend fingerprints verified:
ok; 2invalid_measurements(indices 4,309 and 5,960)ok; 1invalid_measurements(index 223)okThe SHA-256 of the audit report is
6a489f82b2a99cadf0c1d3e4e8b53202bc2528ff2ac22a8653d06a24e153bf46. The full shards, manifests, audit report, Slurm/audit scripts, and logs are preserved with the SIF on backed-up Euler group work storage.Published dataset
The audited dataset is published at
IDEALLab/power_electronics_v1:v1.0.0eefad7d727ea1e5bef5e1b7088dea20a9b0cd67f68f3c8f9afa380490692f1a4417cb0773b6f0b1aed313ab138cc429b750291cfv1.0.0both reproduced the exact split counts, row order, statuses, invalid indices, and per-split semantic hashesThe three invalid simulator measurements remain as rows with status/validity fields and null raw/objective values. Consumers should retain those rows and mask their objective loss. The original
IDEALLab/power_electronics_v0repository and labels were not modified.Related to #271 and #276. This draft intentionally does not close either issue automatically; checkpoint/leaderboard integration remains out of scope.
Type of change
Checklist
pre-commitchecks withpre-commit run --all-filesruff check .andruff format --check .mypy engibenchReviewer Checklist