Title

Trajectory Association Across Multiple Airborne Cameras

Keywords

Applications; Motion; Registration; Scene Analysis; Sensor fusion

Abstract

A camera mounted on an aerial vehicle provides an excellent means for monitoring large areas of a scene. Utilizing several such cameras on different aerial vehicles allows further flexibility, in terms of increased visual scope and in the pursuit of multiple targets. In this paper, we address the problem of associating objects across multiple airborne cameras. Since the cameras are moving and often widely separated, direct appearance-based or proximity-based constraints cannot be used. Instead, we exploit geometric constraints on the relationship between the motion of each object across cameras, to test multiple association hypotheses, without assuming any prior calibration information. Given our scene model, we propose a likelihood function for evaluating a hypothesized association between observations in multiple cameras that is geometrically motivated. Since multiple cameras exist, ensuring coherency in association is an essential requirement, e.g. that transitive closure is maintained between more than two cameras. To ensure such coherency we pose the problem of maximizing the likelihood function as a k-dimensional matching and use an approximation to find the optimal assignment of association. Using the proposed error function, canonical trajectories of each object and optimal estimates of inter-camera transformations (in a maximum likelihood sense) are computed. Finally, we show that as a result of associating objects across the cameras, a concurrent visualization of multiple aerial video streams is possible and that, under special conditions, trajectories interrupted due to occlusion or missing detections can be repaired. Results are shown on a number of real and controlled scenarios with multiple objects observed by multiple cameras, validating our qualitative models, and through simulation quantitative performance is also reported. © 2008 IEEE.

Publication Date

2-1-2008

Publication Title

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volume

30

Issue

2

Number of Pages

361-367

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/TPAMI.2007.70750

Socpus ID

37549044735 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/37549044735

This document is currently not available here.

Share

COinS