Geometry of 2, 3, or 4 Cameras

Tim Duff
-
PDL C-38

Reconstructing a 3D scene from multiple images is an intrinsically geometric problem with multiple applications. I will introduce a line of work that aims to characterize the set of all valid algebraic constraints that relate any number of perspective cameras, 3D points, and their 2D projections. More formally, this framework involves the study of certain multigraded vanishing ideals. This leads to several new results, as well as new proofs of old results about the well-studied multiview ideal. For example, we give some perspective about a "folklore theorem" from geometric computer vision which roughly states: "all algebraic constraints on the 2D projections of 3D points can be obtained from those involving 2, 3, or 4 cameras." I will also discuss a complementary line of work focused on practical estimation methods. Incremental 3D reconstruction systems usually focus on estimating the relative orientation of two cameras. This in turn requires solving systems of algebraic equations with (very) special structure. I will describe recent progress extending the domain of such solvers to problems involving three or four cameras, including non-perspective cameras with lens distortion. The key players are numerical homotopy continuation methods, and the Galois/monodromy groups that capture their inherent complexity.

Event Type
Event Subcalendar