View Categories

Testing – Quality of Virtual Tests

There is still a lot of scepticism with respect to results derived by virtual testing method. To address this scepticism it is crucial that the quality of the output of the virtual testing tools is proven. Depending on the scope of the assessment different steps are required: the quality of the test tool, applied models shall be checked, in case of FuSa analysis the tool needs to be qualified, the input data should be checked. A comprehensive approach is the credibility assessment as described for instance by the EU commission (2022). Additional input for this question is discussion on test tools the UN ECE level (UNECE -NATM ,2021).

Main Question

Are processes in place to ensure the quality of the virtual testing? (tool qualification, validation and verification of tools)

Sub-Questions

  1. Is a process available and applied that checks the quality of the applied virtual testing tool? (validation and verification)
  2. Is a process available and applied that checks the quality of the applied models in the virtual testing tool? (validation and verification)
  3. In the case of functional safety analysis, is the tool qualified according to ISO 26262-1-12 (2018)?
  4. Is the plausibility of input data checked?
  5. Is a credibility assessment performed?
  6. Is the reliability of the virtual assessment checked?

References

  • EU Commission (2022)  Laying down rules for the application of Regulation (EU) 2019/2144 of the European Parliament and of the Council as regards uniform procedures and technical specifications for the type-approval of the automated driving system (ADS) of fully automated vehicles, Available at: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32022R1426 (Accessed: 27 October 2023).
  • UNECE -NATM (2023) or (UNECE -NATM, 2023)
  • ISO (2018) 26262-1-12: Road vehicles — Functional safety part 1-12, Part 1 availabe at: https://www.iso.org/standard/68383.html (Accessed: 18 October 2023)