Following the definition of the test concept, the execution of the test starts. In terms of test specification, this question covers the more practical planning of the test that are to be carried out. This includes aspect such data recording and storages as well as defining require safety measures.
For this purpose, the specification shall include information about the following items:
- Guidelines on the test execution shall be defined in order to minimise the risk of false test execution, which typically leads to unuseable data.
- It shall be defined, which data and information of the test must be documented and how the data are stored.
- If reference data are required or measured in the test, these reference data shall be clearly defined. This includes information, which data should be used as a reference and how they are collected respectively by which tool they are measured.
- It shall be checked for the different tests, whether privacy aspects are relevant and how these can be ensured during testing.
- In case certain interactions (e.g. interaction with other users, V2X interactions) are simulated in test, since the test environment does not provide the real interaction, the modelled interactions shall be described (What is used? Is the required model available? etc.).
- Develop training protocols that are used for the training of safety drivers. With no standardised industry requirements, automated driving companies have taken a variety of approaches to train safety drivers. Robust procedures to ensure the competency of safety drivers and operators must be developed.
Main Question
Is each single test of the (test) concept specified properly? (Test execution)
Sub-Questions
- Is it defined which information from the tests needs to be documented?
- Is it defined, how the information from the tests should be stored?
- Is the reference data (ground truth data) for the test defined?
- Are data privacy aspects considered (e.g. in case of tests on public roads data privacy of surrounding traffic participants)?
- Are safety measures for the participants considered?
- Is the approach for the training of safety drivers or remote operators been defined / implemented?