Brief description
We have proposed a new approach for the detection of events in image sequences. Our method relies on a number of logical sensors that can be defined over specific regions of interest in the viewed scene. These sensors measure time varying image properties that can be attributed to primitive events of interest. Thus, the logical sensors can be viewed as a means to transform image data to a set of symbols that can assist event detection and activities interpretation. On top of these elementary sensors, temporal and logical a ggregation mechanisms are used to define hierarchies of progressively more complex sensors, able to detect events having more complex semantics. Finally, scenario verification mechanisms are employed to achieve process monitoring, by checking whether events occur according to a predetermined order.
The framework proposed in this paper is particularly suited to the application area of monitoring of automated processes. In most such processes, things occur in a strict, predetermined way. For example, in an assembly automation process, mechanical parts move on a conveyor belt and are being manipulated by actuators in a process that, typically, presents no considerable deviations. The fact that these processes have considerable structure, permit us to turn difficult detection problems into much simpler verification problems. More precisely, instead of trying to detect what is going on in the viewed scene, the VBLS approach can be used to verify that things proceed as expected. This results in several advantages:
- Computational efficiency: The VBLS approach requires simple, low level, computationally cheap, data parallel image processing operations to be applied on (typically) small image regions.
- Extendibility: LSs and CLSs can be dynamically tailored and expanded based on the needs of different application domains.
- Flexibility and adaptability: Most complex vision algorithms either fail in specific settings or require elaborate, non-intuitive parameter tuning. With the VBLS approach the process of finding an arrangement of LSs/CLSs that succeeds in detecting interesting events, is facilitated.
The proposed framework has been tested and validated in an application involving monitoring of automated processes. The obtained results demonstrate that the proposed approach, despite its simplicity, provides a promising framework for vision based event detection in the context of such applications.
Sample results
The prototype software developed for testing the VBLS approach, while in operation.
Contributors
Thomas Sarmis, Antonis Argyros
Relevant publications
- A.A. Argyros, G. Bártfai, C. Eitzinger, Z. Kemény, B.C. Csáji, L. Kék, M.I.A. Lourakis, W. Reisner, W. Sandrisser, T. Sarmis and others, "Smart sensor based vision system for automated processes", Emerging Technologies, Robotics and Control Systems, International Society for Advanced Research, ISBN: 978-88-901928-9-5, 2007.
- A.A. Argyros, G. Bártfai, C. Eitzinger, Z. Kemény, B.C. Csáji, L. Kék, M.I.A. Lourakis, W. Reisner, W. Sandrisser, T. Sarmis and others, "Smart sensor based vision system for automated processes", International Journal of Factory Automation, Robotics and Soft Computing, Thomson Scientific Journal, vol. 3, pp. 118-123, 2007.
- T. Sarmis, A.A. Argyros, M.I.A. Lourakis and K. Hatzopoulos, "Robust and efficient event detection for the monitoring of automated processes", In International conference on visual information engineering (VIE 2006), pp. 454-459, Bangalore, India, September 2006.
The electronic versions of the above publications can be downloaded from my publications page.