Monocular Model-Based 3D Tracking of Rigid Objects: A Survey

Моноскопическое модельно-ориентированное 3D-отслеживание жёстких объектов: обзор
Pascal Fua, Vincent Lepetit
2005-01-01

camera representationmodel-based trackingmonocular 3D trackingrigid object trackingrobust estimation
Many applications require tracking complex 3D objects. These include visual serving of robotic arms on specific target objects, Augmented Reality systems that require real time registration of the object to be augmented, and head tracking systems that sophisticated interfaces can use. Computer Vision offers solutions that are cheap, practical and non-invasive. Monocular Model-Based 3D Tracking of Rigid Objects reviews the different techniques and approaches that have been developed by industry and research. First, important mathematical tools are introduced: Camera representation, robust estimation and uncertainty estimation. Then a comprehensive study of the numerous approaches developed by the Augmented Reality and Robotics communities is given. The authors begin with those that are based on 1D or planar fiducial marks and move on to those that avoid the need to engineer the environment by relying on natural features such as edges, texture or interest points are detailed. Extensions to more specific applications that require the use of a motion model or multiple objects tracking are also discussed. The survey concludes with the different possible choices that should be made when implementing a 3D tracking system and a discussion of the future of vision-based 3D tracking. Because it encompasses many computer vision techniques from low-level vision to 3D geometry and includes a comprehensive study of the massive literature on the subject, Monocular Model-Based 3D Tracking of Rigid Objects is an invaluable reference for the student and researcher.
1
Comprehensive review of approaches: from point/planar fiducial mark methods to natural-feature methods using edges, texture, or interest points.
2
Positions the survey as a comprehensive reference covering low-level vision to 3D geometry and extensive literature for students, researchers, and engineers.
3
Presents recent advances that remove the need for manual initialization and reduce failures due to fast motion.
4
Provides implementation guidance by enumerating design choices for building vision-based 3D tracking systems.
5
Survey introduces essential mathematical tools for monocular model-based 3D tracking, including camera representation, robust estimation, and uncertainty estimation.

Monocular model-based 3D tracking of rigid objects

Techniques, approaches and performance aspects for tracking rigid 3D objects from a single camera, including camera representation, robust estimation, uncertainty estimation, feature types (fiducial, edges, texture, interest points), initialization, and handling fast motion and failure modes

Publication Details
Publication Date
2005-01-01
Journal
Publisher
ISSN
Cited by
540
Access Type
Author Information
Authors
Pascal Fua
Vincent Lepetit
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%