Document Type

Article

Publication Date

2024

DOI

10.1109/ACCESS.2024.3516946

Publication Title

IEEE Access

Volume

12

Pages

190240-190254

Abstract

The exponential growth of scientific literature in digital repositories poses challenges in interpreting complex attitudes within academic texts. Traditional sentiment analysis methods often struggle with nuanced word meanings due to contextual variations. To address this, we propose the Electra-MPNet-based BiGRU attention classifier that extracts the high-level semantic features from citation sentences using the combined strength of Electra and MPNet encoder layers. These features are then combined to extract long-range dependencies through a stacked BiGRU layer. A linear attention mechanism is imposed to estimate the attention weights and context vector which enables the model to selectively focus on relevant information. The proposed model overcomes inherent constraints and adeptly manages contextual information, enhancing the model’s understanding of sequential data and improving predictive accuracy. We evaluate the proposed model on a dataset of 8736 citation sentences extracted from scientific articles spanning multiple domains. Our model outperforms state-of-the-art models like LSTM-GRU, Bert-BiLSTM, Bert-LSTM-CNN and MPNet, Electra, BiGRU, and machine learning models in terms of accuracy, precision, recall, F1 and kappa measure which further solidifies its superiority in scientific text sentiment analysis tasks.

Rights

© 2024 The Authors.

This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.

Data Availability

Article states: "The data set used in this study can be accessed at https://awaisathar.com/citation-sentiment-corpus/ https://github.com/allenai/scicite https://github.com/UFOdestiny/DictSentiBERT/blob/main."

Original Publication Citation

Haq, M. I. U., Mahmood, K., Li, Q., Das, A. K., Shetty, S., & Hussain, M. (2024). Efficiently learning an encoder that classifies token replacements and masked permuted network-based BiGRU attention classifier for enhancing sentiment classification of scientific text. IEEE Access, 12, 190240 - 190254. https://doi.org/10.1109/ACCESS.2024.3516946

ORCID

0000-0002-8789-0610 (Shetty)

Share

COinS