Internal Error Occurs and Test Fails in DEVICE-3-1-14-v21.06 START SYSTEM RESTORE on ONVIF Device Test Tool v25.06

[ShinjiroTakami]

When executing DEVICE-3-1-14-v21.06 START SYSTEM RESTORE using ONVIF Device Test Tool v25.06,
an Internal Error occurs after STEP 7 passes, and the test fails.

This test passes in DTT v24.12. Also, we have confirmed via packet capture that the camera correctly returns HTTP 200 OK in response to the HTTP POST request in STEP 7.

Could you please investigate the cause of the Internal Error in DTT and provide a fix?

• Situation
  Changing Time Between Request to 300000ms still results in the same error.
  When this Internal Error occurs, DTT starts the next test without waiting for the camera to finish rebooting,
  causing many subsequent tests to fail.

• Test Environment
  PC: Intel(R) Core(TM) i7-14700 2.10 GHz / 64bit
  OS: Windows 11 Enterprise 23H2
  DTT: v25.06 (.NET 8.0 Desktop Runtime / ASP.NET Core 8.0 Runtime – latest versions installed)

[madhurao68]

Hello
We will be issuing an erratum to cover this issue in v25.06. Thanks for your patience.

[ShinjiroTakami]

@madhurao68
Thank you for an answer.

When the Internal Error occurs during the DEVICE-3-1-14-v21.06 START SYSTEM RESTORE test,
DTT proceeds to the next test without waiting for the camera to finish rebooting.
As a result, many of the subsequent tests fail.

DEVICE-3-1-15-v21.06 START SYSTEM RESTORE – INVALID BACKUP FILE
DEVICE-4-1-1-v20.12 SECURITY COMMAND GETUSERS
DEVICE-4-1-3-v20.12 SECURITY COMMAND CREATEUSERS ERROR CASE
DEVICE-4-1-4-v20.12 SECURITY COMMAND DELETEUSERS
DEVICE-4-1-5-v20.12 SECURITY COMMAND DELETEUSERS ERROR CASE
DEVICE-4-1-7-v20.12 SECURITY COMMAND SETUSER
DEVICE-4-1-8-v20.12 SECURITY COMMAND USER MANAGEMENT ERROR CASE
DEVICE-4-1-9-v20.12 SECURITY COMMAND CREATEUSERS
DEVICE-6-1-1-v21.06 DEVICE MANAGEMENT - NAMESPACES (DEFAULT NAMESPACES FOREACH TAG)
DEVICE-6-1-2-v21.06 DEVICE MANAGEMENT - NAMESPACES (DEFAULT NAMESPACES FORPARENT TAG)
DEVICE-6-1-3-v21.06 DEVICE MANAGEMENT - NAMESPACES (NOT STANDARD PREFIXES)
DEVICE-6-1-4-v21.06 DEVICE MANAGEMENT - NAMESPACES (DIFFERENT PREFIXES FOR THE SAME NAMESPACE)
DEVICE-6-1-5-v21.06 DEVICE MANAGEMENT - NAMESPACES (THE SAME PREFIX FOR DIFFERENT NAMESPACES)
DEVICE-7-1-1-v20.12 GET IP ADDRESS FILTER
DEVICE-7-1-2-v20.12 SET IP ADDRESS FILTER - IPv4
DEVICE-7-1-3-v20.12 ADD IP ADDRESS FILTER - IPv4
DEVICE-7-1-4-v20.12 REMOVE IP ADDRESS FILTER - IPv4
DEVICE-8-1-1-v25.06 AUXILIARY COMMANDS
DEVICE-9-1-1-v15.06 Processor Usage event
DEVICE-9-1-2-v15.06 Last Reset event
DEVICE-9-1-3-v15.06 Last Reboot event
DEVICE-9-1-4-v21.06 Last Reboot event (Status Change)
DEVICE-9-1-5-v15.06 Last Clock Synchronization event
DEVICE-9-1-6-v17.06 Last Clock Synchronization change event (SetSystemDateAndTime)
DEVICE-9-1-7-v16.01 Last Clock Synchronization change event (NTP message)

Additionally, the number of failed tests varies depending on the reboot duration.
In this case, would it be possible to issue an Errata?

[madhurao68]

Our vendor is on a break so expect a delay in the response, but we will revert back for sure. Thanks for your patience and understanding!

[madhurao68]

An erratum #71 has been issued for this issue and covers the list of tests mentioned, so you can claim conformance with errata for v25.06. We will fix this issue in v25.12 for sure.

[ShinjiroTakami]

Thank you for issuing the errta.
Please let me know so I can check if the intermediate version of v25.12 passes the tests.

[madhurao68]

Hello,
You could test with the latest intermediate release (link below) and provide your feedback. Thanks.
https://github.com/onvif/dtt/releases/tag/DTT25.11

[ShinjiroTakami]

@madhurao68
We have confirmed that the test passes with DTTv25.11. Thank you for the correction!