Document Type
Article
Publication Date
2024
DOI
10.1109/ACCESS.2024.3516946
Publication Title
IEEE Access
Volume
12
Pages
190240-190254
Abstract
The exponential growth of scientific literature in digital repositories poses challenges in interpreting complex attitudes within academic texts. Traditional sentiment analysis methods often struggle with nuanced word meanings due to contextual variations. To address this, we propose the Electra-MPNet-based BiGRU attention classifier that extracts the high-level semantic features from citation sentences using the combined strength of Electra and MPNet encoder layers. These features are then combined to extract long-range dependencies through a stacked BiGRU layer. A linear attention mechanism is imposed to estimate the attention weights and context vector which enables the model to selectively focus on relevant information. The proposed model overcomes inherent constraints and adeptly manages contextual information, enhancing the model’s understanding of sequential data and improving predictive accuracy. We evaluate the proposed model on a dataset of 8736 citation sentences extracted from scientific articles spanning multiple domains. Our model outperforms state-of-the-art models like LSTM-GRU, Bert-BiLSTM, Bert-LSTM-CNN and MPNet, Electra, BiGRU, and machine learning models in terms of accuracy, precision, recall, F1 and kappa measure which further solidifies its superiority in scientific text sentiment analysis tasks.
Rights
© 2024 The Authors.
This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.
Data Availability
Article states: "The data set used in this study can be accessed at https://awaisathar.com/citation-sentiment-corpus/ https://github.com/allenai/scicite https://github.com/UFOdestiny/DictSentiBERT/blob/main."
Original Publication Citation
Haq, M. I. U., Mahmood, K., Li, Q., Das, A. K., Shetty, S., & Hussain, M. (2024). Efficiently learning an encoder that classifies token replacements and masked permuted network-based BiGRU attention classifier for enhancing sentiment classification of scientific text. IEEE Access, 12, 190240 - 190254. https://doi.org/10.1109/ACCESS.2024.3516946
ORCID
0000-0002-8789-0610 (Shetty)
Repository Citation
Ul Haq, Muhammad Inaam; Mahmood, Khalid; Li, Qianmu; Das, Ashok Kumar; Shetty, Sachin; and Hussain, Majid, "Efficiently Learning an Encoder That Classifies Token Replacements And Masked Permuted Network-Based BiGRU Attention Classifier for Enhancing Sentiment Classification of Scientific Text" (2024). VMASC Publications. 135.
https://digitalcommons.odu.edu/vmasc_pubs/135
Included in
Artificial Intelligence and Robotics Commons, Data Science Commons, Scholarly Communication Commons