1 / 36

Single View Metrology Class 3

Single View Metrology Class 3. 3D photography course schedule (tentative). Single View Metrology. Measuring in a plane. Need to compute H as well as uncertainty. Direct Linear Transformation (DLT). Direct Linear Transformation (DLT). Equations are linear in h.

erling
Download Presentation

Single View Metrology Class 3

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Single View MetrologyClass 3

  2. 3D photography course schedule(tentative)

  3. Single View Metrology

  4. Measuring in a plane Need to compute H as well as uncertainty

  5. Direct Linear Transformation(DLT)

  6. Direct Linear Transformation(DLT) • Equations are linear in h • Only 2 out of 3 are linearly independent (indeed, 2 eq/pt) (only drop third row if wi’≠0) • Holds for any homogeneous representation, e.g. (xi’,yi’,1)

  7. Direct Linear Transformation(DLT) • Solving for H size A is 8x9 or 12x9, but rank 8 Trivial solution is h=09T is not interesting 1-D null-space yields solution of interest pick for example the one with

  8. Direct Linear Transformation(DLT) • Over-determined solution No exact solution because of inexact measurement i.e. “noise” • Find approximate solution • Additional constraint needed to avoid 0, e.g. • not possible, so minimize

  9. DLT algorithm • Objective • Given n≥4 2D to 2D point correspondences {xi↔xi’}, determine the 2D homography matrix H such that xi’=Hxi • Algorithm • For each correspondence xi ↔xi’ compute Ai. Usually only two first rows needed. • Assemble n 2x9 matrices Ai into a single 2nx9 matrix A • Obtain SVD of A. Solution for h is last column of V • Determine H from h

  10. Importance of normalization 1 ~104 ~102 ~102 ~102 ~102 ~102 1 ~104 orders of magnitude difference! Monte Carlo simulation for identity computation based on 5 points (not normalized ↔ normalized)

  11. Normalized DLT algorithm • Objective • Given n≥4 2D to 2D point correspondences {xi↔xi’}, determine the 2D homography matrix H such that xi’=Hxi • Algorithm • Normalize points • Apply DLT algorithm to • Denormalize solution

  12. measured coordinates estimated coordinates true coordinates Error in one image Symmetric transfer error Reprojection error Geometric distance d(.,.) Euclidean distance (in image) e.g. calibration pattern

  13. Reprojection error

  14. Maximum Likelihood Estimate Statistical cost function and Maximum Likelihood Estimation • Optimal cost function related to noise model • Assume zero-mean isotropic Gaussian noise (assume outliers removed) Error in one image

  15. Maximum Likelihood Estimate Statistical cost function and Maximum Likelihood Estimation • Optimal cost function related to noise model • Assume zero-mean isotropic Gaussian noise (assume outliers removed) Error in both images

  16. Gold Standard algorithm • Objective • Given n≥4 2D to 2D point correspondences {xi↔xi’}, determine the Maximum Likelyhood Estimation of H • (this also implies computing optimal xi’=Hxi) • Algorithm • Initialization: compute an initial estimate using normalized DLT or RANSAC • Geometric minimization of reprojection error: • ● Minimize using Levenberg-Marquardt over 9 entries of h • or Gold Standard error: • ● compute initial estimate for optimal {xi} • ● minimize cost over {H,x1,x2,…,xn} • ● if many points, use sparse method

  17. Uncertainty: error in one image • Estimate the transformation from the data • Compute Jacobian , evaluated at • The covariance matrix of the estimated is given by

  18. Uncertainty: error in both images separate in homography and point parameters

  19. Error in two images (if h and x independent, i.e. new points) Using covariance matrix in point transfer Error in one image

  20. Example: s=1 pixel S=0.5cm (Criminisi’97)

  21. Example: s=1 pixel S=0.5cm (Criminisi’97)

  22. Example: (Criminisi’97)

  23. Monte Carlo estimation of covariance • To be used when previous assumptions do not hold (e.g. non-flat within variance) or to complicate to compute. • Simple and general, but expensive • Generate samples according to assumed noise distribution, carry out computations, observe distribution of result

  24. Single view measurements:3D scene

  25. Background: Projective geometry of 1D 3DOF (2x2-1) The cross ratio Invariant under projective transformations

  26. Vanishing points • Under perspective projection points at infinity can have a finite image • The projection of 3D parallel lines intersect at vanishing points in the image

  27. Basic geometry

  28. Basic geometry • Allows to relate height of point to height of camera

  29. Homology mapping between parallel planes • Allows to transfer point from one plane to another

  30. Single view measurements

  31. Single view measurements

  32. Forensic applications 190.6±2.9 cm 190.6±4.1 cm A. Criminisi, I. Reid, and A. Zisserman. Computing 3D euclidean distance from a single view. Technical Report OUEL 2158/98, Dept. Eng. Science, University of Oxford, 1998.

  33. Example courtesy of Antonio Criminisi

  34. La Flagellazione di Cristo (1460) Galleria Nazionale delle Marche by Piero della Francesca (1416-1492) http://www.robots.ox.ac.uk/~vgg/projects/SingleView/

  35. More interesting stuff • Criminisi demo http://www.robots.ox.ac.uk/~vgg/presentations/spie98/criminis/index.html • work by Derek Hoiem on learning single view 3D structure and apps http://www.cs.cmu.edu/~dhoiem/ • similar work by Ashutosh Saxena on learning single view depth http://ai.stanford.edu/~asaxena/learningdepth/

  36. Next class • Feature tracking and matching

More Related