Artificial Intelligence (AI) and Machine Learning (ML) models are increasingly used in an ADF development context. This brings benefits, but also challenges. For safety critical systems, these challenges are predominantly around the explainability and reliability of decision making of the function to guarantee performance and compatibility with functional safety requirements. This is explored in more detail within the Artificial Intelligence section.
ISO/IEC TR 5469 (2024) and, more specifically to road vehicles, ISO/PAS 8800:2024, have been developed to support safety critical systems developers in applying AI technologies appropriately for safety related function. The document focuses on awareness of AI technology in a safety critical context (including potential constraints), functional safety risk factors and potential functional safety methods.
Main Question
Has sufficient consideration been given to the suitability of the chosen AI/ML models and data inputs, in terms of their ability to fulfil the safety requirements of the ADF?
References
- ISO/IEC (2024) TR 5469:2024 Artificial intelligence – Functional safety and AI systems. Availabe at: https://www.iso.org/standard/81283.html (Accessed: 25 March 2024)