What’s Behind the Graphic? The Impact of Pictogram-Semantic Mapping Structure on Icon Understanding

Abstract Icons map computational concepts through pictorial representations, assisting users in learning and using interfaces. However, constructing effective mapping structures and graphically expressing icon semantics remain challenges. This study explores how pictogram-semantic mapping structures impact icon understanding, employing a 3 (Pictogram-semantic mapping structure: Direct mapping, Metaphorical mapping, Metonymical mapping) × 2 (Semantic congruity: Semantic congruence, Semantic incongruence) within-subject design with behavioral experiments and Event-Related Potential (ERP) measurements. Results reveal that mapping structure significantly influences understanding: direct mapping enhances understanding efficiency, enabling quick and accurate interpretation; metaphorical mapping improves semantic processing fluency and emotional arousal, enriching the emotional experience; while metonymical mapping reduces efficiency without notable benefits in semantic coherence or emotional engagement. These findings offer practical insights for designing understandable icons and a theoretical foundation for strategically improving user experience through icon design.