Hierarchical Particle Filtering for 3D Hand Tracking

Brief description

We present a fast and accurate 3D hand tracking method which relies on RGB-D data. The method follows a model based approach using a hierarchical particle filter variant to track the model’s state. The filter estimates the probability density function of the state’s posterior. As such, it has increased robustness to observation noise and compares favourably to existing methods that can be trapped in local minima resulting in track loses. The data likelihood term is calculated by measuring the discrepancy between the rendered 3D model and the observations. Extensive experiments with real and simulated data show that hand tracking is achieved at a frame rate of 90fps with less that 10mm average error using a GPU implementation, thus comparing favourably to the state of the art in terms of both speed and tracking accuracy.

Sample results

Video with experimental results


Relevant publications

  • A. Makris, N. Kyriazis, A.A. Argyros, “Hierarchical Particle Filtering for 3D Hand Tracking”, IEEE Workshop on “Observing and Understanding Hands in Action” (HANDS 2015), in conjunction with CVPR 2015, Boston, USA, June 12, 2015.

The electronic versions of the above publications can be downloaded from my publications page.