An Active Learning and Deep Attention Framework for Robust Driver Emotion Recognition
An Active Learning and Deep Attention Framework for Robust Driver Emotion Recognition
B. S. Al-dabbagh,Agapito Ledezma,A. Sanchis
TLDR
AlDAM introduces three key innovations: an active learning cycle that reduces labeling effort by ~40%; a weighted-cluster loss that mitigates class imbalance; and a deep attention mechanism that strengthens feature selection under occlusion, pose variation, and illumination changes.
Abstract
Driver emotion recognition is vital for intelligent driver assistance systems, where the accurate detection of emotional states enhances both safety and user experience. Current approaches, however, require extensive labeled datasets, perform poorly under real-world conditions, and degrade with class imbalance. To overcome these challenges, we propose the Active Learning and Deep Attention Mechanism (ALDAM) framework. ALDAM introduces three key innovations: (1) an active learning cycle that reduces labeling effort by ~40%; (2) a weighted-cluster loss that mitigates class imbalance; and (3) a deep attention mechanism that strengthens feature selection under occlusion, pose variation, and illumination changes. Evaluated on four benchmark datasets (FER-2013, AffectNet, CK+, and EMOTIC), ALDAM achieves an average accuracy of 97.58%, F1-score of 98.64%, and AUC of 98.76% surpassing CNN-based models and advanced baselines such as SE-ResNet-50. These results establish ALDAM as a robust and efficient solution for real-time driver emotion recognition.
