Abstract
We deal with the problem of tracking freely flying insects that have been filmed under natural conditions. Although this appears to be an easy task for human observers it proves to be quite difficult to implement in computer vision systems. The main goal of our project was to automatize the reconstruction of animal flightpaths in a single-frame video film analysis. In addition to standard image-processing tools we employed a number of physical constraints as well as general knowledge to produce a system with acceptable performance. In this article we describe basic algorithms and techniques that provide a pragmatic solution in a specific case but that could in principle be applied to a large class of related problems. Our system copes with up to 5 degrees of freedom and a number of other variables such as brightness, illumination, object shape, occlusion and light reflection. We discuss the performance of a first implementation as well as remaining problems.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bakchine-Huber E, Marion-Poll F, Pham-Delegue H, Masson C, Soussaline F (1992) Real-time detection and analysis of the exploratory behaviour of small animals. Naturwissenschaften 79:39–42
Dahmen HJ, Zeil J (1984) Recording and reconstructing three-dimensional trajectories: a versatile method for the field biologist. Proc R Soc Lond, Ser B 222:107–113
Gonzalez RC, Wintz P (1987) Digital image processing, 2nd edn. Addison-Wesley, Reading, Mass
Häder DP, Vogel K (1991) Simultaneous tracking of flagellates in real time by image analysis. J Math Biol 30:63–72
Karmann KP, Brandt A von (1987) Moving object recognition using an adaptive background memory. Siemens AG, Corporate Research and Development, Image Processing, Munich, pp 1–8
Koller D, Daniilidis K, Nagel HH (1993) Model-based object tracking in monocular image sequences of road traffic scenes. Int J Comput Vis 10:257–281
Korn A (1988) Toward a symbolic representation of intensity changes in images. IEEE Trans Pat Anal Mach Intell 10:610–625
Li Y (1992) Reforming the theory of invariant moments for pattern recognition. Pattern Recognition 25:723–735
Marr D (1982) Vision. Freeman, New York
Sandini G, Tistarelli M (1990) Active tracking strategy for monocular depth inference over multiple frames. IEEE Trans Pat Anal Mach Intell 12:13–27
Sullivan GD (1992) Visual interpretation of known objects in constrained scenes. Philos Trans R Soc Lond, Ser B 337:361–370
Voss R, Zeil J (1993) Reconstructing the parallax field in flying insects. In Elsner N, Heisenberg M (eds) Gen-Gehirn-Verhalten. Thieme, Stuttgart, p 378
Wagner H (1986) Flight performance and visual control of flight of the free-flying housefly (Musca domestica L.). Phil Trans R Soc Lond, Ser B 312:527–595
Wehrhahn C, Poggio T, Bülthoff H (1982) Tracking and chasing in houseflies (Musca). Biol Cybern 45:123–130
Zeil J (1986) The territorial flight of male houseflies (Fannia canicularis.). Behav Ecol Sociobiol 19:213–219
Zeil J (1993a) Orientation flights of solitary wasps. I. Description of flight. J Comp Physiol 173A: 189–205
Zeil J (1993b) Orientation flights of solitary wasps. II. Similarities between orientation and return flights and the use of motion parallax. J Comp Physiol 173A:207–222
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Voss, R., Zeil, J. Automatic tracking of complex objects under natural conditions. Biol. Cybern. 73, 415–423 (1995). https://doi.org/10.1007/BF00201476
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00201476