Document Type

Article

Publication Date

2024

DOI

10.1016/j.asoc.2023.111067

Publication Title

Applied Soft Computing

Volume

150

Pages

111067 (1-30)

Abstract

The construction of knowledge graph is beneficial for grid production, electrical safety protection, fault diagnosis and traceability in an observable and controllable way. Highly-precision text classification algorithm is crucial to build a professional knowledge graph in power system. Unfortunately, there are a large number of poorly described and specialized texts in the power business system, and the amount of data containing valid labels in these texts is low. This will bring great challenges to improve the precision of text classification models. To offset the gap, we propose a classification algorithm for Chinese text in the power system based on deep active learning (CCTP-DAL). Our core idea is to apply a hierarchical confidence strategy to a deep active learning model, to balance the trade-offs between the amount of training data and the accuracy of text classification. Our CCTP-DAL (1) trains the Bert model using a small amount of labeled data to calculate the confidence level of each short text, (2) selects high-confidence text data with optimal model generalization capability based on the hierarchical confidence level, and (3) fuses deep learning models and active learning strategies to ensure high text classification accuracy with less labeled training data. We benchmark our model on a real crawler data on the web with extensive experiments. The experimental results demonstrate that our proposed model can achieve higher text classification accuracy with less labeled training data compared with other deep learning models.

Rights

© 2024 Elsevier B.V. All rights reserved. This preprint version is made available under the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International (CC-BY-NC-ND 4.0) license.

This is a preprint edition of the article, and is not a substitute for the final version of the article, which is available online at: https://doi.org/10.1016/j.asoc.2023.111067.

Included in accordance with publisher policy.

Original Publication Citation

Deng, S., Li, Q., Dai, R., Wei, S., Wu, D., He, Y., & Wu, X. (2024). A Chinese power text classification algorithm based on deep active learning. Applied Soft Computing, 150, 1-30, Article 111067. https://doi.org/10.1016/j.asoc.2023.111067

ORCID

0000-0002-5357-6623 (He)

Download

Share

COinS