Today different test tools exist – physical and virtual ones. Each test tool has strengths and weaknesses, which can differ per implementation of the test tool. Before a test is carried out, it needs to be checked whether the test tool is appropriate / the most appropriate available test tool (fit for purpose check). In particular for virtual testing it should be avoided that models in the virtual testing are applied outside their defined range.

To decide which simulation tool and models should be applied first an overview of the available tools / models is required. In the second step the operation conditions as well as the strength and weaknesses of the available tools / models should be checked to decide which tool / model fits the assessment purpose best. The use of common interfaces for different tools or standarlized data formats of inputs (e.g., ASAM OpenDrive 1.7.0, 2021, ASAM OpenScenario 1.2.0, 2021 or ASAM XIL, 2021) will forster the interoperability between tools and models .
Additional information are povided for example by Wood, M., et al (2019) and the German founded research project SET LEVEL (TÜV Rheinland, 2019).
Main Question
Are the applied tools and models checked for their applicability (fit for purpose)?
Sub-Questions
- Are different virtual testing tools available?
- Have the strength and weakness of virtual testing tools been analysed?
- Can different models be used in the different virtual testing tools used?
- Is a fit for purpose analysis of the tool conducted?
- Are the system under test’s requirements for the testing identified (e.g. is V2X interaction required)?
References
- Wood, M., Knobel, C., Garbacik, N., et al. (2019). “Safety first for automated driving”,Safety First Automated Driving. Available at: https://www.connectedautomateddriving.eu/wp-content/uploads/2019/09/Safety_First_for_Automated_Driving.pdf (Accessed: 31 October 2023).
- ASAM (2021) OpenDrive 1.7.0. Available at: https://www.asam.net/standards/detail/opendrive/ (Accessed: 18 October 2023)
- ASAM (2022) OpenScenario 1.2.0. Available at: https://www.asam.net/standards/detail/openscenario/ (Accessed: 18 October 2023)
- TÜV Rheinland (2019) SET Level 4 to 5 – Simulation-based development and testing of Level 4 and 5 systems. Available at: http://www.tuvpt.de/index.php?id=setlevel4to5 (Accessed: 31 October 2023).
- ASAM (2020) XIL. Available at: https://www.asam.net/standards/detail/xil (27 October 2023)