Abstract
The problem of tracking curves in dense visual clutter is a challenging one. Trackers based on Kalman filters are of limited use; because they are based on Gaussian densities which are unimodal, they cannot represent simultaneous alternative hypotheses. Extensions to the Kalman filter to handle multiple data associations work satisfactorily in the simple case of point targets, but do not extend naturally to continuous curves. A new, stochastic algorithm is proposed here, the Condensation algorithm — Conditional Density Propagation over time. It uses ‘factored sampling’, a method previously applied to interpretation of static images, in which the distribution of possible interpretations is represented by a randomly generated set of representatives. The Condensation algorithm combines factored sampling with learned dynamical models to propagate an entire probability distribution for object position and shape, over time. The result is highly robust tracking of agile motion in clutter, markedly superior to what has previously been attainable from Kalman filtering. Notwithstanding the use of stochastic methods, the algorithm runs in near real-time.
The authors would like to acknowledge the support of the EPSRC. They are also grateful for discussions with Roger Brockett, Brian Ripley, David Reynard, Simon Rowe and Andrew Wildenberg, and for experimental assistance from Sarah Blake.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
K. J. Astrom. Introduction to stochastic control theory. Academic Press, 1970.
Y. Bar-Shalom and T.E. Fortmann. Tracking and Data Association. Academic Press, 1988.
R.H. Bartels, J.C. Beatty, and B.A. Barsky. An Introduction to Splines for use in Computer Graphics and Geometric Modeling. Morgan Kaufmann, 1987.
A. Baumberg and D. Hogg. Generating spatiotemporal models from examples. In Proc. BMVC, 413–422, 1995.
A. Blake, R. Curwen, and A. Zisserman. A framework for spatio-temporal control in the tracking of visual contours. Int. Journal of Computer Vision, 11(2):127–145, 1993.
A. Blake and M.A. Isard. 3D position, attitude and shape input using video tracking of hands and lips. In Proc. Siggraph, 185–192. ACM, 1994.
A. Blake, M.A. Isard, and D. Reynard. Learning to track the visual motion of contours. Artificial Intelligence, 78:101–134, 1995.
R. Cipolla and A. Blake. The dynamic analysis of apparent contours. In Proc. 3rd Int. Conf. on Computer Vision, 616–625, 1990.
T.F. Cootes, C.J. Taylor, A. Lanitis, D.H. Cooper, and J. Graham. Building and using flexible models incorporating grey-level information. In Proc. 4th Int. Conf. on Computer Vision, 242–246, 1993.
M.A. Fischler and R.C. Bolles. Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach., 24:381–95, 1981.
Stuart Geman and Donald Geman. Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images. IEEE Trans. Pattern Analysis and Machine Intelligence, 6(6):721–741, 1984.
D.B. Gennery. Visual tracking of known three-dimensional objects. Int. Journal of Computer Vision, 7:3:243–270, 1992.
C.G. Goodwin and K.S. Sin. Adaptive filtering prediction and control. Prentice-Hall, 1984.
U. Grenander, Y. Chow, and D. M. Keenan. HANDS. A Pattern Theoretical Study of Biological Shapes. Springer-Verlag. New York, 1991.
U. Grenander and M.I. Miller. Representations of knowledge in complex systems (with discussion). J. Roy. Stat. Soc. B., 56:549–603, 1993.
C. Harris. Tracking with rigid models. In A. Blake and A. Yuille, editors, Active Vision, 59–74. MIT, 1992.
D. Hogg. Model-based vision: a program to see a walking person. Image and Vision Computing, 1(1):5–20, 1983.
D.P. Huttenlocher, J.J. Noh, and W.J. Rucklidge. Tracking non-rigid objects in complex scenes. In Proc. 4th Int. Conf. on Computer Vision, 93–101, 1993.
M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. In Proc. 1st Int. Conf. on Computer Vision, 259–268, 1987.
D.G. Lowe. Robust model-based motion tracking through the integration of search and estimation. Int. Journal of Computer Vision, 8(2):113–122, 1992.
W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery. Numerical Recipes in C. Cambridge University Press, 1988.
B. Rao. Data association methods for tracking systems. In A. Blake and A. Yuille, editors, Active Vision, 91–105. MIT, 1992.
J.M. Rehg and T. Kanade. Visual tracking of high dof articulated structures: an application to human hand tracking. In J-O. Eklundh, editor, Proc. 3rd European Conference on Computer Vision, 35–46. Springer-Verlag, 1994.
B.D. Ripley and A.L. Sutherland. Finding spiral structures in images of galaxies. Phil. Trans. R. Soc. Lond. A., 332(1627):477–485, 1990.
G. Storvik. A Bayesian approach to dynamic contours through stochastic sampling and simulated annealing. IEEE Trans. Pattern Analysis and Machine Intelligence, 16(10):976–986, 1994.
G.D. Sullivan. Visual interpretation of known objects in constrained scenes. Phil. Trans. R. Soc. Lond. B., 337:361–370, 1992.
D. Terzopoulos and D. Metaxas. Dynamic 3D models with local and global deformations: deformable superquadrics. IEEE Trans. Pattern Analysis and Machine Intelligence, 13(7), 1991.
S. Ullman and R. Basri. Recognition by linear combinations of models. IEEE Trans. Pattern Analysis and Machine Intelligence, 13(10):992–1006, 1991.
A. Yuille and P. Hallinan. Deformable templates. In A. Blake and A. Yuille, editors, Active Vision, 20–38. MIT, 1992.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Isard, M., Blake, A. (1996). Contour tracking by stochastic propagation of conditional density. In: Buxton, B., Cipolla, R. (eds) Computer Vision — ECCV '96. ECCV 1996. Lecture Notes in Computer Science, vol 1064. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0015549
Download citation
DOI: https://doi.org/10.1007/BFb0015549
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61122-6
Online ISBN: 978-3-540-49949-7
eBook Packages: Springer Book Archive