Real-Time Fusion of Multimodal Tracking Data and Generalization of Motion Patterns for Trajectory Prediction

Author(s): M. Weser, D. Westhoff, M. Hüser, and J. Zhang

in: Proc. of the 2006 IEEE Int. Conference on Information Aquisition (ICIA 2006), August 2006

Abstract

A sensor-based model of a service robot's environment is a prerequisite for interaction. Such a model should contain the positions of the robot's interaction partners. Many reasonable applications require this knowledge in realtime. It could for example be used to realize efficient path planning for delivery tasks. Additionally to the actual positions of the partners it is important for the service robot to predict their possible future positions. In this paper we propose an extensible framework that combines different sensor modalities in a general real-time tracking system. Exemplarily, a tracking system is implemented that fuses tracking algorithms in laser range scans as well as in camera images by a particle filter. Furthermore, human trajectories are predicted by deducing them from learned motion patterns. The observed trajectories are generalized to trajectory patterns by a novel method which uses Self Organizing Maps. Those patterns are used to predict trajectories of the currently observed persons. Practical experiments show that multimodality increases the system's robustness to incorrect measurements of single sensors. It is also demonstrated that a Self Organizing Map is suitable for learning and generalizing trajectories. Convenient predictions of future trajectories are presented which are deduced from these generalizations.

BibTeX


@INPROCEEDINGS{Weser2006a,
  author = {Martin Weser AND Daniel Westhoff AND Markus H"user AND Jianwei Zhang},
  title = {Real-Time Fusion of Multimodal Tracking Data and Generalization of
	   Motion Patterns for Trajectory Prediction},
  booktitle = {Proceedings of the 2006 IEEE International Conference on Information
               Aquisition (ICIA 2006)},
  year = {2006},
  address = {Weihai, China},
  month = {August},
  keywords = {Multi-modal Tracking, Motion Patterns, People Tracking, Sensor Fusion},
  url = {http://tams-www.informatik.uni-hamburg.de/people/westhoff/publications/index.php?content=icia06b}
}