Skip to content

Enhance, stabilize and optimize dI/dV test suite - #87

Merged
GianmarcoMidena merged 4 commits into
masterfrom
enhance-tests
Sep 2, 2026
Merged

Enhance, stabilize and optimize dI/dV test suite#87
GianmarcoMidena merged 4 commits into
masterfrom
enhance-tests

Conversation

@GianmarcoMidena

Copy link
Copy Markdown
Contributor

Improves the stability, reliability, and execution speed of the dI/dV (differential conductance) test suite. It introduces backend configurations, addresses numerical precision issues, works around OpenCL driver poisoning, and categorizes slow tests to allow for faster development feedback loops.

Key Changes

  • Configure Backends for Core Tests: Set up proper dI/dV backend configurations for core property tests to ensure consistent testing environments.
  • Introduce Numerical Tolerances: Added an absolute tolerance (atol) to backend consistency checks. This prevents false test failures caused by minor floating-point precision differences near zero.
  • Skip Flaky Sequential PyOpenCL Tests on Si 7x7: Temporarily bypassed sequential PyOpenCL dI/dV tests for the Si 7x7 system, as they trigger an OpenCL driver error that poisons the session and causes subsequent parallel tests to fail.
  • Mark Slow Tests: Tagged/marked particularly slow dI/dV tests. This allows developers to easily skip time-consuming tests during quick local test runs, speeding up the development cycle.

Related Issues

Introduce a small absolute tolerance (atol) to treat near-zero
values as zero. This prevents false failures caused by precision
issues when assessing dI/dV backend consistency.
Temporarily bypass sequential PyOpenCL dI/dV tests on Si 7x7 because they trigger an error that poisons the OpenCL driver state for the remainder of the session, causing subsequent parallel PyOpenCL tests to fail as well.

Relates to #75, #77
Comment thread tests/didv/_test_didv_backend_consistency.py
Comment thread tests/didv/test_didv_backend_consistency_with_real_tip_positions.py
Comment thread tests/didv/test_didv_core.py
Comment thread tests/didv/test_didv_core.py
Comment thread README.md

@ondrejkrejci ondrejkrejci left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few questions, but I did not find any problem with anything.

@ondrejkrejci

Copy link
Copy Markdown
Contributor

Good to go.

@GianmarcoMidena
GianmarcoMidena merged commit ceceeaf into master Sep 2, 2026
@GianmarcoMidena
GianmarcoMidena deleted the enhance-tests branch September 2, 2026 11:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Skip failing sequential PyOpenCL tests to prevent test-suite state poisoning

2 participants