Systematic Literature Review of Transformer Model Implementations in Detecting Depression

This systematic literature review explores the application of transformer models in early detection of human depression, encompassing text, audio, and video data modalities. Transformer architectures, notably BERT for text, have proven adept at capturing crucial contextual and linguistic patterns associated with depression. For audio and video data, hybrid approaches that combine transformer models with other architectures are prevalent. Key features considered include eye gaze, head pose, facial muscle movements, and audio characteristics such as MFCC and Log-mel Spectrogram, along with text embeddings. Performance comparisons underscore the superiority of text-based data in consistently delivering the most promising results, followed by audio and video modalities when utilizing transformer models. The fusion of multiple modalities emerges as an effective strategy for enhancing predictive accuracy, with the amalgamation of audio, video, and text data yielding the most precise outcomes. However, it is noteworthy that unimodal approaches also exhibit potential, with text data exhibiting superior performance over audio and video data. Nevertheless, several challenges persist in this research domain, including imbalanced datasets, the limited availability of comprehensive and diverse samples, and the inherent complexities in interpreting visual cues. Addressing these challenges remains imperative for the continued advancement of depression detection using transformer-based models across various modalities.