Enhancing Deep Learning-Based Sentiment Analysis Using Static and Contextual Language Models
Abstract
Abstract
Sentiment Analysis (SA) is an essential task of Natural Language Processing and is
used in various fields such as marketing, brand reputation control, and social media
monitoring. The various scores generated by users in product reviews are essential
feedback sources for businesses to discover their products' positive or negative
aspects. However, it takes work for businesses facing a large user population to
accurately assess the consistency of the scores. Recently, automated methodologies
based on Deep Learning (DL), which utilize static and especially pre-trained
contextual language models, have shown successful performances in SA tasks. To
address the issues mentioned above, this paper proposes Multi-layer Convolutional
Neural Network-based SA approaches using Static Language Models (SLMs) such
as Word2Vec and GloVe and Contextual Language Models (CLMs) such as ELMo
and BERT that can evaluate product reviews with ratings. Focusing on improving
model inputs by using sentence representations that can store richer features, this
study applied SLMs and CLMs to the inputs of DL models and evaluated their impact
on SA performance. To test the performance of the proposed approaches,
experimental studies were conducted on the Amazon dataset, which is publicly
available and considered a benchmark dataset by most researchers. According to the
results of the experimental studies, the highest classification performance was
obtained by applying the BERT CLM with 82% test and 84% training accuracy
scores. The proposed approaches can be applied to various domains' SA tasks and
provide insightful decision-making information.
Collections

DSpace@BEU by Bitlis Eren University Institutional Repository is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 Unported License..