UPDF AI

Exploring Machine Learning and Language Models for Multimodal Depression Detection

Javier Si Zhao Hong,Timothy Zoe Delaya,2 Authors,Xiaoxiao Miao

2025 · DOI: 10.1109/APSIPAASC65261.2025.11249212
Asia-Pacific Signal and Information Processing Association Annual Summit and Conference · 2 Citations

TLDR

The approach to the first Multimodal Personality-Aware Depression Detection Challenge is presented, focusing on multimodal depression detection using machine learning and deep learning models, and the strengths and limitations of each type of model are highlighted.

Abstract

This paper presents our approach to the first Multimodal Personality-Aware Depression Detection Challenge, focusing on multimodal depression detection using machine learning and deep learning models. We explore and compare the performance of XGBoost, transformer-based architectures, and large language models (LLMs) on audio, video, and text features. Our results highlight the strengths and limitations of each type of model in capturing depression-related signals across modalities, offering insights into effective multimodal representation strategies for mental health prediction.