Document Type

Article

Publication Date

2024

DOI

10.1007/s00799-024-00395-4

Publication Title

International Journal on Digital Libraries

Volume

25

Issue

2

Pages

175-196

Abstract

Despite the millions of electronic theses and dissertations (ETDs) publicly available online, digital library services for ETDs have not evolved past simple search and browse at the metadata level. We need better digital library services that allow users to discover and explore the content buried in these long documents. Recent advances in machine learning have shown promising results for decomposing documents into their constituent parts, but these models and techniques require data for training and evaluation. In this article, we present high-quality datasets to train, evaluate, and compare machine learning methods in tasks that are specifically suited to identify and extract key elements of ETD documents. We explain how we construct the datasets by manual labeling the data or by deriving labeled data through synthetic processes. We demonstrate how our datasets can be used to develop downstream applications and to evaluate, retrain, or fine-tune pre-trained machine learning models. We describe our ongoing work to compile benchmark datasets and exploit machine learning techniques to build intelligent digital libraries for ETDs.

Rights

© 2024 The Authors.

This article is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original authors and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Original Publication Citation

Ingram, W. A., Wu, J., Kahu, S. Y., Manzoor, J. A., Banerjee, B., Ahuja, A., Choudhury, M. H., Salsabil, L., Shields, W., & Fox, E. A. (2024). Building datasets to support information extraction and structure parsing from electronic theses and dissertations. International Journal on Digital Libraries. 25(2),175-196. https://doi.org/10.1007/s00799-024-00395-4

ORCID

0000-0003-0173-4463 (Wu), 0000-0002-9318-8844 (Choudhury), 0000-0002-6162-2896 (Salsabil)

Download

Share

COinS