Demet Demir, Enhancing DNN Test Data Selection Through Uncertainty-Based and Data Distribution-Aware Approaches
This study introduces a testing framework for Deep Neural Network (DNN) models to identify fault-revealing data and understand the causes of failures. We prioritized test inputs based on model uncertainty, and with the proposed meta-model-based approach, we enhanced the effectiveness of test data prioritization. Moreover, distribution-aware test datasets are generated by initially focusing on in-distribution data and subsequently including out-of-distribution data. Finally, we employed post-hoc explainability methods to pinpoint the causes of incorrect predictions after test executions. Evaluations in the image classification domain show that uncertainty-based test selection significantly improves the detection rate of DNN model failures.
Date: 10.07.2024 / 15:30 Place: A-212