Lecture 3 Camera Models 2 & Camera Calibration. Professor Silvio Savarese Computational Vision and Geometry Lab

Similar documents
Lecture 8: Camera Calibration

Lecture 3. Camera Models 2 & Camera Calibration. Professor Silvio Savarese Computational Vision and Geometry Lab. 13- Jan- 15.

Lecture 8: Camera Calibra0on

Multiple view geometry

Geometric Camera Calibration

Lecture 3 Camera Models 2 & Camera Calibration. Lecture 3 Camera Models 2 & Camera Calibration. Projective camera

Announcements. Image Formation: Outline. The course. Image Formation and Cameras (cont.)

Chapter Newton-Raphson Method of Solving a Nonlinear Equation

Chapter Newton-Raphson Method of Solving a Nonlinear Equation

Definition of Tracking

Geometric Correction or Georeferencing

Least squares. Václav Hlaváč. Czech Technical University in Prague

4. Eccentric axial loading, cross-section core

Model Fitting and Robust Regression Methods

Principle Component Analysis

Basic projective geometry

Review of linear algebra. Nuno Vasconcelos UCSD

Machine Learning. Support Vector Machines. Le Song. CSE6740/CS7641/ISYE6740, Fall Lecture 8, Sept. 13, 2012 Based on slides from Eric Xing, CMU

CS4495/6495 Introduction to Computer Vision. 3C-L3 Calibrating cameras

Jens Siebel (University of Applied Sciences Kaiserslautern) An Interactive Introduction to Complex Numbers

Fitting a Polynomial to Heat Capacity as a Function of Temperature for Ag. Mathematical Background Document

Math 497C Sep 17, Curves and Surfaces Fall 2004, PSU

An Ising model on 2-D image

Torsion, Thermal Effects and Indeterminacy

CISE 301: Numerical Methods Lecture 5, Topic 4 Least Squares, Curve Fitting

? plate in A G in

6 Roots of Equations: Open Methods

Physics 3A: Linear Momentum. Physics 3A: Linear Momentum. Physics 3A: Linear Momentum. Physics 3A: Linear Momentum

DCDM BUSINESS SCHOOL NUMERICAL METHODS (COS 233-8) Solutions to Assignment 3. x f(x)

PHYS 601 HW3 Solution

UNIVERSITY OF IOANNINA DEPARTMENT OF ECONOMICS. M.Sc. in Economics MICROECONOMIC THEORY I. Problem Set II

Numbers Related to Bernoulli-Goss Numbers

AUTO-CALIBRATION. FACTORIZATION. STRUCTURE FROM MOTION.

7.2 Volume. A cross section is the shape we get when cutting straight through an object.

EFFECTIVE BUCKLING LENGTH OF COLUMNS IN SWAY FRAMEWORKS: COMPARISONS

[ ] T Journal of Software. Vol.13, No /2002/13(05)

8. Computing Eigenvalues in Parallel

v v at 1 2 d vit at v v 2a d

The Atwood Machine OBJECTIVE INTRODUCTION APPARATUS THEORY

LECTURE :FACTOR ANALYSIS

Haddow s Experiment:

OXFORD H i g h e r E d u c a t i o n Oxford University Press, All rights reserved.

STATISTICAL MECHANICS OF THE INVERSE ISING MODEL

Variable time amplitude amplification and quantum algorithms for linear algebra. Andris Ambainis University of Latvia

Lecture 4: Piecewise Cubic Interpolation

Analysis of Geometric, Zernike and United Moment Invariants Techniques Based on Intra-class Evaluation

Construction of Gauss Quadrature Rules

Course Review Introduction to Computer Methods

Partially Observable Systems. 1 Partially Observable Markov Decision Process (POMDP) Formalism

1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a non-constant can be solved with the same idea as above.

Demand. Demand and Comparative Statics. Graphically. Marshallian Demand. ECON 370: Microeconomic Theory Summer 2004 Rice University Stanley Gilbert

NUMERICAL MODELLING OF A CILIUM USING AN INTEGRAL EQUATION

Introduction to Numerical Integration Part II

8 Transportation Problem Alpha-Beta

( ) ( )()4 x 10-6 C) ( ) = 3.6 N ( ) = "0.9 N. ( )ˆ i ' ( ) 2 ( ) 2. q 1 = 4 µc q 2 = -4 µc q 3 = 4 µc. q 1 q 2 q 3

PART - III : MATHEMATICS

SUMMER KNOWHOW STUDY AND LEARNING CENTRE

Solubilities and Thermodynamic Properties of SO 2 in Ionic

Chapter 2 Introduction to Algebra. Dr. Chih-Peng Li ( 李 )

FUNDAMENTALS ON ALGEBRA MATRICES AND DETERMINANTS

F O R SOCI AL WORK RESE ARCH

Rank One Update And the Google Matrix by Al Bernstein Signal Science, LLC

Bridging the gap: GCSE AS Level

Uniform Circular Motion

INTRODUCTION TO COMPLEX NUMBERS

Improved Frame Synchronization and Frequency Offset Estimation in OFDM System and its Application to WMAN. and

INTRODUCTION TO LINEAR ALGEBRA

Computations in Quantum Tensor Networks

Linear and Nonlinear Optimization

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

MA 131 Lecture Notes Calculus Sections 1.5 and 1.6 (and other material)

Least Squares Fitting of Data

The Schur-Cohn Algorithm

COS 511: Theoretical Machine Learning

CHAPTER 5 Newton s Laws of Motion

fractions Let s Learn to

Structure from Motion. Forsyth&Ponce: Chap. 12 and 13 Szeliski: Chap. 7

Exponents and Powers

Many-Body Calculations of the Isotope Shift

Proof that if Voting is Perfect in One Dimension, then the First. Eigenvector Extracted from the Double-Centered Transformed

For all questions, answer choice E) NOTA" means none of the above answers is correct.

Effects of polarization on the reflected wave

Review: Transformations. Transformations - Viewing. Transformations - Modeling. world CAMERA OBJECT WORLD CSE 681 CSE 681 CSE 681 CSE 681

PART 1 MULTIPLE CHOICE Circle the appropriate response to each of the questions below. Each question has a value of 1 point.

Applied Mathematics Letters

Before we can begin Ch. 3 on Radicals, we need to be familiar with perfect squares, cubes, etc. Try and do as many as you can without a calculator!!!

Math 10 C. Measurement Test ID: A. Multiple Choice Identify the choice that best completes the statement or answers the question.

Vectors and Tensors. R. Shankar Subramanian. R. Aris, Vectors, Tensors, and the Equations of Fluid Mechanics, Prentice Hall (1962).

Lecture 8. Newton s Laws. Applications of the Newton s Laws Problem-Solving Tactics. Physics 105; Fall Inertial Frames: T = mg

Contact Analysis on Large Negative Clearance Four-point Contact Ball Bearing

Dennis Bricker, 2001 Dept of Industrial Engineering The University of Iowa. MDP: Taxi page 1

Physics Dynamics: Atwood Machine

Second degree generalized gauss-seidel iteration method for solving linear system of equations. ABSTRACT

Online Appendix to. Mandating Behavioral Conformity in Social Groups with Conformist Members

Discussion Introduction P212, Week 1 The Scientist s Sixth Sense. Knowing what the answer will look like before you start.

CS:4330 Theory of Computation Spring Regular Languages. Equivalences between Finite automata and REs. Haniel Barbosa

The Spring. Consider a spring, which we apply a force F A to either stretch it or compress it

Review of Linear Algebra

Excess Error, Approximation Error, and Estimation Error

We partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b.

Transcription:

Lecture Cer Models Cer Clbrton rofessor Slvo Svrese Coputtonl Vson nd Geoetry Lb Slvo Svrese Lecture - Jn 7 th, 8

Lecture Cer Models Cer Clbrton Recp of cer odels Cer clbrton proble Cer clbrton wth rdl dstorton Exple Redng: [F] Chpter Geoetrc Cer Clbrton [HZ] Chpter 7 Coputton of Cer Mtrx Soe sldes n ths lecture re courtesy to rofs. J. once, F-F L Slvo Svrese Lecture - Jn 7 th, 8

rojectve cer j w R, f O w k w ' M w K " R! " $! W % " W W W $ % $ % 4 w4 M E ' E ( w, w ) w w

Exercse! f R, j w k w O w w à M K! " R $ ( w, w ) w w Suppose we hve no rotton or trnslton Zero skew, squre pxels, no dstorton, no off-set ' E w! " x w y w z w $ %

Exercse! R, j w f k w O w w à M K! " R ' E $ ( w w, w w ) K! " I $! " ( f x w z w, f y w z w ) f f $ %! w " x w y w z w $ %

Cnoncl rojectve rnsforton ' x y z! " $ %! " $ % x y z! " $ % x z y z! " $ % ' ' M M H 4 Â Â

rojectve cer p q r f O Q R

Wek perspectve projecton When the reltve scene depth s sll copred to ts dstnce fro the cer f p R R_ q r Q Q_ O zo _ π

Wek perspectve projecton f zo p R_ q r Q Q_ O R! " $ x' f ' z x y' f ' z y! " $ x' f ' z x y' f ' z y _ π Mgnfcton

Wek perspectve projecton f zo p R_ q r Q Q_ O π R _ rojectve (perspectve) Wek perspectve M K [ R ] A v b à M A b

! " $ % W ), ( w w E M w b A M gnfcton M w v b A M W W W W ), ( w w w w E erspectve Wek perspectve W W! " $ %

Orthogrphc (ffne) projecton Dstnce fro center of projecton to ge plne s nfnte! " $ x' f ' z x y' f ' z y! " $ x' x y' y

ros nd Cons of hese Models Wek perspectve results n uch spler th. Accurte when object s sll nd dstnt. Most useful for recognton. nhole perspectve s uch ore ccurte for odelng the D-to-D ppng. Used n structure fro oton or SLAM.

One-pont perspectve Mscco, rnty, Snt Mr Novell, Florence, 45-8 Credt slde S. Lzebnk

Wek perspectve projecton he Kngx Eperor's Southern Inspecton our (69-698)By Wng Hu

Wek perspectve projecton he Kngx Eperor's Southern Inspecton our (69-698)By Wng Hu

Lecture Cer Clbrton Recp of cer odels Cer clbrton proble Cer clbrton wth rdl dstorton Exple Redng: [F] Chpter Geoetrc Cer Clbrton [HZ] Chpter 7 Coputton of Cer Mtrx Soe sldes n ths lecture re courtesy to rofs. J. once, F-F L Slvo Svrese Lecture - 8-Jn-8

Why s ths portnt? Estte cer preters such pose or focl length fro ges!?

rojectve cer - v u cot K o o sn q b q R r r r z y x t t t 4 M w [ ] w K R Internl preters Externl preters

Gol of clbrton K[ R ] w M w Internl preters Externl preters Estte ntrnsc nd extrnsc preters fro or ultple ges Chnge notton: w p

Clbrton roble Clbrton rg j C n wth known postons n [O w, w,j w,k w ]

Clbrton roble Clbrton rg ge p j C n wth known postons n [O w, w,j w,k w ] p, p n known postons n the ge Gol: copute ntrnsc nd extrnsc preters

Clbrton roble Clbrton rg ge p j C p j C How ny correspondences do we need? M hs unknowns We need equtons 6 correspondences would do t

Clbrton roble Clbrton rg ge p j C p j C In prctce, usng ore thn 6 correspondences enbles ore robust results

Clbrton roble j C Clbrton rg p j C p p ge M p u v! " $ % n pxels [Eq. ] M

Clbrton roble u ) ( v ) ( u v v u ) ( v - u ( ) [Eq. ] [Eqs. ]

Clbrton roble u ( ) - v ( ) - u v ( ) - ( ) - [Eqs. ] u v n n ( n ) - n ( n ) - n

Block Mtrx Multplcton B B B B B A A A A A Wht s AB? + + + + B A B A B A B A B A B A B A B A AB

- u ( ) + - v ( ) + - un( n ) + n Clbrton roble - vn ( n ) + n known unknown [Eq. 4] Hoogenous lner syste def " $ $ $ $ $ $ $! n n u v u n n v n n x4 % ' ' ' ' ' ' ' n x def æ ç ç ç è 4x ö ø x

Hoogeneous M x N Lner Systes Mnuber of equtons n Nnuber of unknown M N Rectngulr syste (M>N) s lwys soluton o fnd non-zero soluton Mnze under the constrnt

Clbrton roble How do we solve ths hoogenous lner syste? V SVD decoposton!

Clbrton roble SVD decoposton of U D V n Lst colun of V gves Why? See pg 59 of HZ def æ ç ç ç è ö ø M

Extrctng cer preters M ρ

Extrctng cer preters A A [ ] K R ± r b b b b Estted vlues ( ) r u o ) ( v o r ( ) ( ) cos q Intrnsc b - v u cot K o o sn q b q r M Box See [F], Sec...

Extrctng cer preters A [ ] K R b b b b Estted vlues Intrnsc q r sn q r b sn A b r M - v u cot K o o sn q b q Box See [F], Sec...

heore (Fugers, 99)

Extrctng cer preters A [ ] K R b b b b Estted vlues A b r M - v u cot K o o sn q b q Box See [F], Sec... Extrnsc ( ) r r ± r r r b K - r

Degenerte cses s cnnot le on the se plne! onts cnnot le on the ntersecton curve of two qudrc surfces [F] secton.

Lecture Cer Clbrton Recp of projectve cers Cer clbrton proble Cer clbrton wth rdl dstorton Exple Redng: [F] Chpter Geoetrc Cer Clbrton [HZ] Chpter 7 Coputton of Cer Mtrx Soe sldes n ths lecture re courtesy to rofs. J. once, F-F L Slvo Svrese Lecture - 8-Jn-8

Rdl Dstorton Ige gnfcton (n)decreses wth dstnce fro the optcl xs Cused by perfect lenses Devtons re ost notceble for rys tht pss through the edge of the lens No dstorton n cushon Brrel

Rdl Dstorton p v u M l l d v v c u b v u d + + u o odel rdl behvor ± å p p κ p d λ olynol functon Dstorton coeffcent [Eq. 5] [Eq. 6] S λ Ige gnfcton decreses wth dstnce fro the optcl center How do we odel tht?

v u p Q q q q q q q q p v u M l l Q u q q v q q! " $ Is ths lner syste of equtons? Rdl Dstorton No! why? [Eqs.7]

Generl Clbrton roble u v q q q q n X f (Q) [Eq.8] preters esureents f( ) s the nonlner ppng -Newton Method -Levenberg-Mrqurdt Algorth Itertve, strts fro ntl soluton My be slow f ntl soluton fr fro rel soluton Estted soluton y be functon of the ntl soluton (becuse of locl n) Newton requres the coputton of J, H Levenberg-Mrqurdt doesn t requre the coputton of H

Generl Clbrton roble u v q q q q n X f (Q) [Eq.8] preters esureents f( ) s the nonlner ppng A possble lgorth. Solve lner prt of the syste to fnd pproxted soluton. Use ths soluton s ntl condton for the full syste. Solve full syste usng Newton or L.M.

ypcl ssuptons: - zero-skew, squre pxel - u o, v o known center of the ge Generl Clbrton roble esureents preters f( ) s the nonlner ppng q q q q v u X f (Q) [Eq.8] n

Cn we estte nd nd gnore the rdl dstorton? Rdl Dstorton v u p l d v u Hnt: slope v u q q q q

Esttng nd Rdl Dstorton v u p l ) ( ) ( - u v ) ( ) ( - u v ) ( ) ( - n n n n u v L n n! " $ % s [87] v u ) ( ) ( ) ( ) ( Get nd by SVD [Eq.9] [Eq.] [Eq.] L def v u v u!! v n n u n n " $ $ $ $ $ % ' ' ' ' '

Once tht nd re estted Rdl Dstorton v u p l s non lner functon of l here re soe degenerte confgurtons for whch nd cnnot be coputed,,

Lecture Cer Clbrton Recp of projectve cers Cer clbrton proble Cer clbrton wth rdl dstorton Exple Redng: [F] Chpter Geoetrc Cer Clbrton [HZ] Chpter 7 Coputton of Cer Mtrx Soe sldes n ths lecture re courtesy to rofs. J. once, F-F L Slvo Svrese Lecture - 8-Jn-8

Clbrton rocedure Cer Clbrton oolbox for Mtlb J. Bouguet [998-] http://www.vson.cltech.edu/bouguetj/clb_doc/ndex.htlexples

Clbrton rocedure

Clbrton rocedure

Clbrton rocedure

Clbrton rocedure

Clbrton rocedure

Clbrton rocedure

Clbrton rocedure

Next lecture Sngle vew reconstructon

Egenvlues nd Egenvectors Egendecoposton A - l l SL S S S. l N - Egenvectors of A re coluns of S [ ] S v v N

Sngulr Vlue decoposton A U S V - S U, V orthogonl trx s s. s N s l s sngulr vlue l egenvlue of A t A