UPDF AI

Infrared and visible image object detection based on dual-attention multiscale fusion network

Wenhao Wang,Xiaozhi Mu,Linhong Dai,Ashim Khadka

2026 · DOI: 10.1117/12.3094780
0 Citations

TLDR

DAMFNet is proposed, a dual-attention multi-scale fusion network integrated with YOLOv8 for robust infrared-visible object detection under complex environments and significantly improves cross-modal detection accuracy in diverse scenarios.

Abstract

This paper proposes DAMFNet, a dual-attention multi-scale fusion network integrated with YOLOv8 for robust infrared-visible object detection under complex environments. The framework addresses three key challenges through: (1) a cross-modal feature alignment module (CFAM) with deformable convolutions and spatial transformers for pixel-semantic alignment; (2) a dual-attention multi-scale fusion module (DAFM) combining frequency-domain enhancement with channel-spatial attention to suppress redundancy; and (3) a contrastive guidance loss (LCGL) synergizing detection and alignment losses for discriminative feature learning. The design significantly improves cross-modal detection accuracy in diverse scenarios.