Title

Tri-view morphing

Authors

Authors

J. J. Xiao;M. Shah

Comments

Authors: contact us about adding a copy of your work at STARS@ucf.edu

Abbreviated Journal Title

Comput. Vis. Image Underst.

Keywords

multi-image processing; image-based rendering; trifocal geometry; trinocular-stereo; augmented reality; 4D video; dynamic view morphing; multiple view morphing; STEREO; Computer Science, Artificial Intelligence; Engineering, Electrical &; Electronic

Abstract

This paper presents an efficient image-based approach to navigate a scene based on only three wide-baseline uncalibrated images without the explicit use of a 3D model. After automatically recovering corresponding points between each pair of images, an accurate trifocal plane is extracted from the trifocal tensor of these three images. Next, based on a small number of feature marks using a friendly GUI, the correct dense disparity maps are obtained by using our trinocular-stereo algorithm. Employing the barycentric warping scheme with the computed disparity, we can generate an arbitrary novel view within a triangle spanned by three camera centers. Furthermore, after self-calibration of the cameras, 3D objects can be correctly augmented into the virtual environment synthesized by the tri-view morphing algorithm. Three applications of the tri-view morphing algorithm are demonstrated. The first one is 4D video synthesis, which can be used to fill in the gap between a few sparsely located video cameras to synthetically generate a video from a virtual moving camera. This synthetic camera can be used to view the dynamic scene from a novel view instead of the original static camera views. The second application is multiple view morphing, where we can seamlessly fly through the scene over a 2D space constructed by more than three cameras. The last one is dynamic scene synthesis using three still images, where several rigid objects may move in any orientation or direction. After segmenting three reference frames into several layers, the novel views in the dynamic scene can be generated by applying our algorithm. Finally, the experiments are presented to illustrate that a series of photo-realistic virtual views can be generated to fly through a virtual environment covered by several static cameras. (C) 2004 Elsevier Inc. All rights reserved.

Journal Title

Computer Vision and Image Understanding

Volume

96

Issue/Number

3

Publication Date

1-1-2004

Document Type

Article; Proceedings Paper

Language

English

First Page

345

Last Page

366

WOS Identifier

WOS:000224974900005

ISSN

1077-3142

Share

COinS