Document Type
Article
Publication Date
2025
DOI
10.1109/ACCESS.2025.3609200
Publication Title
IEEE Access
Volume
13
Pages
163982 - 163998
Abstract
Recent advances in the integration of high-speed mobile networks and real-time IoT devices have facilitated in building of smart warehouses, where a set of beacons and Internet of Things (IoT) devices (or source nodes) can monitor the status of various physical processes in a time-critical way. In real-time status monitoring systems, like smart warehouses, quantifying the freshness of the Internet of Things (IoT) data based on the age of information (AoI) metrics becomes quite crucial. As source nodes are battery-constrained, a balanced trade-off between AoI minimization and preservation of source node battery energy is essential. In this paper, in a smart warehouse scenario, we address the problem of minimization of the average weighted sum of AoI subject to the available energy constraint of each source node. We focus on joint optimization of packet transmission and energy may not be suitable for finding a solution in a reasonable time. To address the issue, we develop a deep Q-network (DQN) algorithm that enables us to a simultaneous reduction of the state-space dimension with learning of the age-optimal policy in unknown environmental dynamics. Taking account into the limited energy constraints of the user nodes, the proposed DQN algorithm aims to minimize the long-term average weighted sum-AoI of the user-transmitted data. Finally, we produce multifaceted simulation results in terms of convergence, learning process, and change of average sum-AoI under different energy constraints that shows the effectiveness of the proposed DQN algorithm.
Rights
© 2025 The Authors.
This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.
Original Publication Citation
Roy, S., Bisht, A., Das, A. K., & Shetty, S. (2025). Age of information-based optimal scheduling with energy cost trade-off for smart warehouse: A deep reinforcement learning based approach. IEEE Access, 13, 163982-163998. https://doi.org/10.1109/ACCESS.2025.3609200
ORCID
0000-0002-8789-0610 (Shetty)
Repository Citation
Roy, Sandip; Bisht, Abhishek; Das, Ashok Kumar; and Shetty, Sachin, "Age of Information-Based Optimal Scheduling With Energy Cost Trade-Off for Smart Warehouse: A Deep Reinforcement Learning-Based Approach" (2025). VMASC Publications. 147.
https://digitalcommons.odu.edu/vmasc_pubs/147
Included in
Operations Research, Systems Engineering and Industrial Engineering Commons, OS and Networks Commons, Power and Energy Commons, Theory and Algorithms Commons