Hybrid IndoBERT–BiLSTM with Attention Mechanism for Sentiment Analysis in Imbalanced Digital Society Data

Main Article Content

👤 Aris Budiasono
🏢 Master of Computer Science, Amikom Purwokerto University, Indonesia
👤 Muhamad Khafid
🏢 Master of Computer Science, Amikom Purwokerto University, Indonesia

Sentiment analysis plays an important role in understanding public opinion within digital society, particularly from social media data that is often noisy and imbalanced. This study proposes a hybrid deep learning model that integrates IndoBERT, Bidirectional Long Short-Term Memory (BiLSTM), and an attention mechanism to improve sentiment classification performance. IndoBERT is utilized to capture contextual semantic representations, while BiLSTM models sequential dependencies in text data. The attention mechanism further enhances the model by focusing on important features within sequences. To address class imbalance, a weighted cross-entropy loss is applied during training. The model is evaluated using accuracy, precision, recall, and F1-score, along with confusion matrix and visualization analysis. Experimental results show that the proposed model achieves high overall performance, with an accuracy of 91.16% and a weighted F1-score of 0.9005. However, class-wise evaluation reveals limitations in handling minority classes, particularly the negative class, due to severe data imbalance. These findings highlight that while hybrid architectures can significantly improve performance, additional strategies are required to ensure balanced classification. This study contributes to the development of robust sentiment analysis models for digital society applications.

Budiasono, A., & Khafid, M. (2026). Hybrid IndoBERT–BiLSTM with Attention Mechanism for Sentiment Analysis in Imbalanced Digital Society Data. Journal of Digital Society, 2(4), 271–282. https://doi.org/10.63913/jds.v2i4.45

Article Details

Section
Articles

Similar Articles

<< < 1 2 3 4 > >> 

You may also start an advanced similarity search for this article.