Testing
The development process consists of different stages. One core phase of these processes is the testing of developed product. Testing can be conducted for different purposes. Tests can be carried out during the development to measure the current performance. Tests can be performed to check whether the internal requirements are fulfilled (verification). Test can be performed to check whether the developed system or component fulfils its purpose (validation). Next to the purpose, testing can focus on different system level – ranging from component level to the complete system. This chapter focuses rather on the testing of an entire ADF instead of the testing of single components used for its implementation. Nevertheless, many principles apply also for the component testing. Over the years, various testing tools have been developed, including open road tests, test track tests, and simulations. Each tool has its advantages and limitations. The tools can be categorized into physical tests (using real objects) and virtual tests (using models).
The testing topic covers three sub-topics: the test concept, physical testing, and virtual testing.
The test concept defines the scope and methods based on internal (e.g., checking compliance with internal development requirements) and external (e.g., homologation test) requirements, ensuring safe and appropriate test execution. Documentation of test results, especially deviations from the plan, is crucial in this context.
Physical testing involves real objects. The tests are typically carried on test tracks or even public road tests. Therefore, they require careful planning due to physical limitations and safety risks. Important references include ISO standards and national testing regulations.
Virtual testing is set up analogous to the physical testing. However, it relies on virtual testing tools, such as MIL, SIL, HIL approaches. The main challenge is ensuring the virtual model accurately represents the real world. However, virtual testing offers advantages like easier scaling and reduced risk of harm. Relevant references include ISO standards and UNECE guidelines.
- Testing – Definition Safety Validation
- Testing – Test Concept Planning
- Testing – Test Concept Execution
- Testing – Concept Safety Validation
- Testing – Test Concept Specification Planning
- Testing – Test Concept Specification Execution
- Testing – Testing ODD
- Testing – Correct Execution of Tests
- Testing – Feasibility of Tests
- Testing – Safety of Tests
- Testing – National Regulations
- Testing – Consideration of Virtual Testing
- Testing – Applicability of Virtual Test Tools
- Testing – Quality of Virtual Tests
- Testing – Development of Virtual Test Tools
- Testing – Traceability
- Requirement – Performance in Mixed Traffic
- Requirement – Verification of Operational Design Domain
- Requirement – Implementation of Minimal Risk Manoeuvre
- Requirement – Documentation
- Ethics – Compliance with Laws and Traffic Rules
- Ethics – Adherence to Ethical Standards
- HVI – Controllability of Vehicle from User’s Perspective
- HVI – Assessment of Controllability for ADF Concept
- HVI – Post-production Evaluation of ADF
- HVI – Long-term Effects of ADF (on Users’ Behaviour)
- HVI – Guidelines for the Design of HVI (in ADF)
- SOTIF – SOTIF Release
- SOTIF – Verification and Validation Strategy
- Cyber Security – Validation Concept and Process
- Functional Safety – Minimal Risk Manoeuvre
- Functional Safety – Derivation of Test Cases
- Functional Safety – Validation of the Safety Concept
- Functional Safety – Identification of Hazards
- — Cross-References after this —
- Ethics – Manufacturer Documentation and Responsibility
- Ethics – Risk Assessment Compared to Human Driving
- Ethics – Driver Information and Education Materials
- Ethics – Consistent Consideration of ADF Benefits
- Ethics – Addressing Dilemma Scenarios in ADF Development
- SDB – Coverage of ODD in Scenario Database
- SDB – Identification of Necessary Scenarios for ODD
- SDB – Availability of Data for Scenario Creation
- SDB – Availability of Tool Chain for Scenario Application
- SDB – Sufficiency of Scenario Data Quality
- Simulation – Research on state-of-the-art Simulation Technology
- Simulation – Use of Simulations for ADF Evolution Evaluation
- Simulation – Validation and Verification Strategy for Simulation
- Simulation – Simulator Compatibility with Relevant Standards
- AI – Maintenance and Update of the Dataset
- AI – Generation of Specific Scenarios of Interest
- AI – XAI Understandability of Explaination
- AI – Uncertainty Estimation (for DNN)
- System – Evaluation of Architecture Interaction within ODD
- System – Verification of Architecture Response within ODD Limits
- System – Defined OTA and Software Update Strategy
- System – Consideration of Safety Criticality for Updates