Document Type

Conference Paper

Publication Date




Publication Title

Pattern Recognition and Tracking XXXIV, Proceedings of SPIE 12527




125270J (1-9)

Conference Name

SPIE Defense + Commercial Sensing, April 30- May 5, 2023, Orlando, Florida


Analysis of human gait using 3-dimensional co-occurrence skeleton joints extracted from Lidar sensor data has been shown a viable method for predicting person identity. The co-occurrence based networks rely on the spatial changes between frames of each joint in the skeleton data sequence. Normally, this data is obtained using a Lidar skeleton extraction method to estimate these co-occurrence features from raw Lidar frames, which can be prone to incorrect joint estimations when part of the body is occluded. These datasets can also be time consuming and expensive to collect and typically offer a small number of samples for training and testing network models. The small number of samples and occlusion can cause challenges when training deep neural networks to perform real time tracking of the person in the scene. We propose preliminary results with a deep reinforcement learning actor critic network for person tracking of 3D skeleton data using a small dataset. The proposed approach can achieve an average tracking rate of 68.92±15.90% given limited examples to train the network.


Copyright 2023 Society of Photo‑Optical Instrumentation Engineers (SPIE).

One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this publication for a fee or for commercial purposes, and modification of the contents of the publication are prohibited.

Original Publication Citation

Zalameda, J. G., Glandon, A., & Iftekharuddin, K. M. (2023). Adaptive critic network for person tracking using 3D skeleton data. In M. S. Alam & V. K. Asari (Eds.), Pattern Recognition and Tracking XXXIV, Proceedings of SPIE 12527 (125270J). SPIE.


0000-0001-8316-4163 (Iftekharuddin)