UPDF AI

The impact of BERT-infused deep learning models on sentiment analysis accuracy in financial news

Oussama Ndama,I. Bensassi,El Mokhtar En-Naimi

2025 · DOI: 10.11591/eei.v14i2.8469
Bulletin of Electrical Engineering and Informatics · 6 Citations

TLDR

The findings reveal significant improvements in model accuracy, precision, recall, and F1 scores when BERT is integrated, surpassing both traditional sentiment analysis models and contemporary natural language processing (NLP) transformers.

Abstract

This study delves into the enhancement of sentiment analysis accuracy within the financial news domain through the integration of bidirectional encoder representations from transformers (BERT) with traditional deep learning models, including artificial neural networks (ANN), long short-term memory (LSTM) networks, gated recurrent units (GRU), and convolutional neural networks (CNN). By employing a comprehensive method encompassing data preprocessing, polarity analysis, and the application of advanced neural network architectures, we investigate the impact of incorporating BERT’s contextual embeddings on the models’ sentiment classification performance. The findings reveal significant improvements in model accuracy, precision, recall, and F1 scores when BERT is integrated, surpassing both traditional sentiment analysis models and contemporary natural language processing (NLP) transformers. This research contributes to the body of knowledge in financial sentiment analysis by demonstrating the potential of combining deep learning and NLP technologies to achieve a more nuanced understanding of financial news sentiment. The study’s insights advocate for a shift towards sophisticated, context-aware models, highlighting the pivotal role of transformer-based techniques in advancing the field.