Human detection and tracking supporting interaction with large-scale displays

Brief description

We present a computer vision system that supports non-instrumented, location-based interaction of multiple users with digital representations of large-scale artifacts. The proposed system is based on a camera network that observes multiple humans in front of a very large display. The acquired views are used to volumetrically reconstruct and track the humans robustly and in real time, even in crowded scenes and challenging human configurations. Given an accurate monitoring of humans in space and time, a dynamic and personalized textual/graphical annotation of the display can be achieved based on the location and the walk-through trajectory of each visitor. The proposed system has been successfully deployed in an archaeological museum, offering its visitors the capability to interact with and explore a digital representation of an ancient wall painting. This installation permits an extensive evaluation of the proposed system in terms of tracking robustness, computational performance and usability. Furthermore, it proves that computer vision technology can be effectively used to support non-instrumented interaction of humans with their environments in realistic settings.

Sample results

Interactive exhibition: "Macedonia: from fragments to pixels": Visit the web site of the exhibition Macedonia: from fragments to pixels featuring several interactive exhibits (including Macrographia, an interactive exhibit developed based on this work) developed in the context of the Ambient Intelligence Programme of FORTH-ICS.


Relevant publications

The electronic versions of the above publications can be downloaded from my publications page.