際際滷

際際滷Share a Scribd company logo
Estimation
               Direct Linear Transformations



                                                ???




Mixed Reality Laboratory | Hanyang University         http://mr.hanyang.ac.kr
Direct Linear Transformation




Mixed Reality Laboratory | Hanyang University            http://mr.hanyang.ac.kr
Our Goal?
       ¢    ??? ???? H :

       ¢    ????
             C    ??? : Scale Factor!


       ¢    ????



Mixed Reality Laboratory | Hanyang University               http://mr.hanyang.ac.kr
Then How?
       ¢    ?? :
             C    (Why? Wikipedia Link)


       ¢    ????


                                                       {                 }



Mixed Reality Laboratory | Hanyang University              http://mr.hanyang.ac.kr
Reorganize
       ¢    ??                                  =

       ¢                                  ?? ???? ?? Linear

       ¢       ? 3? ?? 2?? Dependent
            (? ?? ???? ?? X)



Mixed Reality Laboratory | Hanyang University             http://mr.hanyang.ac.kr
What is a Solution?
       ¢    ??? ? :                             =0
             C    Not Interested!
       ¢    ? ?? ???
             C    A is 12 x 9 (8 x 9) Matrix[Rank : 8, Null-
                  Space : 1] ★ Has a Solution
       ¢       ? ? Scale? ??? ????
             || ||=1? ??? ???.


Mixed Reality Laboratory | Hanyang University            http://mr.hanyang.ac.kr
What is the Problem?
       ¢    4? ??? ???? ???? ??
            Rank ?? ??? ????? h? ??
            Exact Solution? ??
             C    ??? ?? ? 4?? ???? Error? ????
                  ???? ? Exact Solution? ??? ???
                  Solution? ?? ???.
                  (Overdetermined)




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Constraints
       ¢    What to minimize?
       ¢    Avoid =0
       ¢    || ||=1
       ¢    If No Solution? Minimize ||                  ||

       ¢    3??, 4??? ???? : ||                          ||/|| ||
       ¢    ?? ??? ??? Basic DLT Algorithm.

Mixed Reality Laboratory | Hanyang University                       http://mr.hanyang.ac.kr
Basic DLT Algorithm




Mixed Reality Laboratory | Hanyang University    http://mr.hanyang.ac.kr
Cost Function




Mixed Reality Laboratory | Hanyang University         http://mr.hanyang.ac.kr
Algebraic Distance
       ¢    ????, ??? ?? X
       ¢    Normalize? ??? ?? ??? ?
       ¢    Linear(Unique Solution)
       ¢    ??? ??
       ¢




Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
Geometric Distance
       ¢    Error in one Image
             C    H? ?? Transfer? ??, ??? ???
                  Euclidean Distance ??? ??


       ¢    Error in two Images (Symmetric Transfer
            Error)
             C    ? ??? ??? Error? ??? ???? ★
                  Forward? Backward? ?? ??


Mixed Reality Laboratory | Hanyang University    http://mr.hanyang.ac.kr
Algebraic vs. Geometric
       ¢    Algebraic :
       ¢    Geometric :

       ¢    Geometric Distance? Algebraic Distance
            ? ???? ?? (?? :              )
             C    Affine Transformation




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Reprojection Error
       ¢    True Point? Measured Point ??? ??
            (Correction)
             C    ??? True Point? ??? Estimate ???
       ¢    Transfer?? ?? True Point? Measured
            Point ??? ??(Correction)
       ¢    Measured Point? Transfer? Perfect?




Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
Reprojection vs. Symmetric




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Geometric Interpretation
                   of Reprojection Error
       ¢   2?? ??? ?? Homography? 4?? ???
           ?? ???? Fitting?? ???? ??? ? ?
           ?.
       ¢   ??? ?? 4?? ???? ??? ?? ???
           ?? ???. (Perfect Fit)
       ¢   ??? ?? ??? ? ??? Geometric
           Distance? ???

             C   ?? Reprojection Error? ??

Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Reprojection vs. Symmetric




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Geometric Error Problem
       ¢    ?? H? ?????.

       ¢    ??? H? Fitting?? Point
            ?????

       ?    ?? ???, Non-Linear, But ??


Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Sampson Error
       ¢          ? First-order Approximation? ??
             C    ??? ?? ??


       ¢                                               (                 )

       ¢                                  ? ??? ?? ?



Mixed Reality Laboratory | Hanyang University              http://mr.hanyang.ac.kr
Sampson Error
       ¢    ??? ???? ??(? ??)
             C   Error :


       ¢                   ? ??                 ? Dependent?
             C   ??? ??? ?? ?? ??? ? ??


       ¢     ? ??? ?? Hyperplane?? Fitting?
            ?? ??? ??

Mixed Reality Laboratory | Hanyang University                  http://mr.hanyang.ac.kr
Statistical Cost Function
       ¢    ??? ??? Error? ?? ??? ??? ?
            ? ??




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Error in one Image
       ¢    Exact Value? ??

       ¢    Log-likelihood? ??

       ¢    Maximum Likelihood Estimate? Log-
            likelihood? Maximize = Minimize



Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
Error in both Images
       ¢    Exact Value? ??



       ¢    ????? Log-likelihood? Maximize
            = Minimize




Mixed Reality Laboratory | Hanyang University    http://mr.hanyang.ac.kr
Mahalanobis Distance
       ¢    One Image? ??, Log-likelihood?
            Maximize = Mahalanobis Distance?
            Minimize
       ¢    Both Images? ??, ? ???? ????
            ????
       ¢    ? Point?? ?? ????? ??




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Transformation Invariance & Normalization




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Invariance to Image Coordinate
              Transformations
       1.? ???? ?? T? ??? ??
       2.?? ? ???? T¨? ???
       3.?? ??? H? ?? ? ??

       ¢    ??, ????? ?? ??? ??? ???
            ??



Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Non-invariance
       ¢    ??? ??? ??, H? H¨? ?? ?? ??
            ???
       ¢    H? H¨? 1:1 ??? ?? ? ??

       ¢    Transform? ?? ??? ?? H? ???
            ?? ? ??



Mixed Reality Laboratory | Hanyang University        http://mr.hanyang.ac.kr
Invariance of Geometric Error
       ¢    Euclidean Transformation T, T¨? ??? ?
            ?

       ¢    Euclidean Distance? Euclidean
            Transformation? ??? ?? ???? ?
            ?
       ¢    H? ?? Geometric Error? ???? ??
            ??? Invarient

Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Normalizing Transformations
       ¢   DLT Algorithm? ???? ?? ??
       ¢   SVD ??? ? ? ????? ?? ???
           Round-Off Error? ?? ? ??
       ¢   Point Near Infinity? ?? ??


       1.Centroid? ??? ??? Translate
       2.?????? ?? ???                          ? ??? Scale
       3.? ???? ?? ??

Mixed Reality Laboratory | Hanyang University          http://mr.hanyang.ac.kr
Normalized DLT for 2D
                        Homographies




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Iterative Minimization Methods




Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
Iterative Minimization Method
       ¢    Minimize Cost Function? ??? ??
       ¢    Cons : ??, Initial Estimate ??, Local
            Minimum ??, Stop ?? ??

       ¢    Iterative?? Implement? ??? ?? ?
            ???



Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Technique of Iterative
                           Minimization
       ¢   Cost Function
            C   Minimization? ?? ??
       ¢   Parametrization
            C   Finite # of Parameters
       ¢   Function Specification
            C   Parameters? ?? Function ??
       ¢   Initialization
            C   ??? ?? (?? Linear Algorithm ??)
       ¢   Iteration
                 ¢   Cost Function? ?? ?? ??????


Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
Initialization
       ¢   Normalized DLT Algorithm?? ?? ???
             C   Outlier? ?? ??

       ¢   Robust Estimation?? ???

       ¢   Dense Sampling of Parameter Space

       ¢   Fixed Point in Parameter Space

Mixed Reality Laboratory | Hanyang University              http://mr.hanyang.ac.kr
Golden Standard Algorithm +
               Sampson Error




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
Robust Estimation




Mixed Reality Laboratory | Hanyang University              http://mr.hanyang.ac.kr
Robust Estimation
       ¢    ??? ??? ???? ??, ??? ??
            Mismatch? ???? ?? (Outlier ???)

       ¢    ?? : Inlier? ???? ??? ??(??)?
            ?




Mixed Reality Laboratory | Hanyang University      http://mr.hanyang.ac.kr
RANSAC
       ¢    ?? : ?? Outlier? ??? ??? ???
            ?
       1.? 2?? ???? ?? (Line? ????)
       2.?? Distance ?? ?? Point? ?? ??
       3.? ??? ??? ?, ?? ?? Point? ??
         ?? ?? ?? Robust Fit?? ?? & ??
         ? Point?? Inlier


Mixed Reality Laboratory | Hanyang University            http://mr.hanyang.ac.kr
RANSAC Robust Algorithm




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr
RANSAC Problems
       ¢    ?? Distance? ?? ??
             C    Error Probability Distribution (DOF, Variance)
       ¢    Sample ??
             C    ???? ??(                                   )
       ¢    Acceptable Consensus Set?
             C




Mixed Reality Laboratory | Hanyang University           http://mr.hanyang.ac.kr
Robust Maximum
                         Likelihood Estimation
       ¢    RANSAC?? ??? Inlier?? ???? re-
            estimate? ??.
             C    Inlier? ??? Optimal? ?? ???
             C    ML Cost Function? Minimize
       ¢    Robust Cost Function
             C    ?? Data? ?? ??? Cost Function




Mixed Reality Laboratory | Hanyang University    http://mr.hanyang.ac.kr
Automatic Computation of
                   a Homography




Mixed Reality Laboratory | Hanyang University   http://mr.hanyang.ac.kr

More Related Content

Multiple View Geometry - Estimation (Direct Linear Transformation)

  • 1. Estimation Direct Linear Transformations ??? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 2. Direct Linear Transformation Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 3. Our Goal? ¢ ??? ???? H : ¢ ???? C ??? : Scale Factor! ¢ ???? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 4. Then How? ¢ ?? : C (Why? Wikipedia Link) ¢ ???? { } Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 5. Reorganize ¢ ?? = ¢ ?? ???? ?? Linear ¢ ? 3? ?? 2?? Dependent (? ?? ???? ?? X) Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 6. What is a Solution? ¢ ??? ? : =0 C Not Interested! ¢ ? ?? ??? C A is 12 x 9 (8 x 9) Matrix[Rank : 8, Null- Space : 1] ★ Has a Solution ¢ ? ? Scale? ??? ???? || ||=1? ??? ???. Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 7. What is the Problem? ¢ 4? ??? ???? ???? ?? Rank ?? ??? ????? h? ?? Exact Solution? ?? C ??? ?? ? 4?? ???? Error? ???? ???? ? Exact Solution? ??? ??? Solution? ?? ???. (Overdetermined) Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 8. Constraints ¢ What to minimize? ¢ Avoid =0 ¢ || ||=1 ¢ If No Solution? Minimize || || ¢ 3??, 4??? ???? : || ||/|| || ¢ ?? ??? ??? Basic DLT Algorithm. Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 9. Basic DLT Algorithm Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 10. Cost Function Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 11. Algebraic Distance ¢ ????, ??? ?? X ¢ Normalize? ??? ?? ??? ? ¢ Linear(Unique Solution) ¢ ??? ?? ¢ Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 12. Geometric Distance ¢ Error in one Image C H? ?? Transfer? ??, ??? ??? Euclidean Distance ??? ?? ¢ Error in two Images (Symmetric Transfer Error) C ? ??? ??? Error? ??? ???? ★ Forward? Backward? ?? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 13. Algebraic vs. Geometric ¢ Algebraic : ¢ Geometric : ¢ Geometric Distance? Algebraic Distance ? ???? ?? (?? : ) C Affine Transformation Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 14. Reprojection Error ¢ True Point? Measured Point ??? ?? (Correction) C ??? True Point? ??? Estimate ??? ¢ Transfer?? ?? True Point? Measured Point ??? ??(Correction) ¢ Measured Point? Transfer? Perfect? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 15. Reprojection vs. Symmetric Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 16. Geometric Interpretation of Reprojection Error ¢ 2?? ??? ?? Homography? 4?? ??? ?? ???? Fitting?? ???? ??? ? ? ?. ¢ ??? ?? 4?? ???? ??? ?? ??? ?? ???. (Perfect Fit) ¢ ??? ?? ??? ? ??? Geometric Distance? ??? C ?? Reprojection Error? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 17. Reprojection vs. Symmetric Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 18. Geometric Error Problem ¢ ?? H? ?????. ¢ ??? H? Fitting?? Point ????? ? ?? ???, Non-Linear, But ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 19. Sampson Error ¢ ? First-order Approximation? ?? C ??? ?? ?? ¢ ( ) ¢ ? ??? ?? ? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 20. Sampson Error ¢ ??? ???? ??(? ??) C Error : ¢ ? ?? ? Dependent? C ??? ??? ?? ?? ??? ? ?? ¢ ? ??? ?? Hyperplane?? Fitting? ?? ??? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 21. Statistical Cost Function ¢ ??? ??? Error? ?? ??? ??? ? ? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 22. Error in one Image ¢ Exact Value? ?? ¢ Log-likelihood? ?? ¢ Maximum Likelihood Estimate? Log- likelihood? Maximize = Minimize Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 23. Error in both Images ¢ Exact Value? ?? ¢ ????? Log-likelihood? Maximize = Minimize Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 24. Mahalanobis Distance ¢ One Image? ??, Log-likelihood? Maximize = Mahalanobis Distance? Minimize ¢ Both Images? ??, ? ???? ???? ???? ¢ ? Point?? ?? ????? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 25. Transformation Invariance & Normalization Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 26. Invariance to Image Coordinate Transformations 1.? ???? ?? T? ??? ?? 2.?? ? ???? T¨? ??? 3.?? ??? H? ?? ? ?? ¢ ??, ????? ?? ??? ??? ??? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 27. Non-invariance ¢ ??? ??? ??, H? H¨? ?? ?? ?? ??? ¢ H? H¨? 1:1 ??? ?? ? ?? ¢ Transform? ?? ??? ?? H? ??? ?? ? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 28. Invariance of Geometric Error ¢ Euclidean Transformation T, T¨? ??? ? ? ¢ Euclidean Distance? Euclidean Transformation? ??? ?? ???? ? ? ¢ H? ?? Geometric Error? ???? ?? ??? Invarient Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 29. Normalizing Transformations ¢ DLT Algorithm? ???? ?? ?? ¢ SVD ??? ? ? ????? ?? ??? Round-Off Error? ?? ? ?? ¢ Point Near Infinity? ?? ?? 1.Centroid? ??? ??? Translate 2.?????? ?? ??? ? ??? Scale 3.? ???? ?? ?? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 30. Normalized DLT for 2D Homographies Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 31. Iterative Minimization Methods Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 32. Iterative Minimization Method ¢ Minimize Cost Function? ??? ?? ¢ Cons : ??, Initial Estimate ??, Local Minimum ??, Stop ?? ?? ¢ Iterative?? Implement? ??? ?? ? ??? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 33. Technique of Iterative Minimization ¢ Cost Function C Minimization? ?? ?? ¢ Parametrization C Finite # of Parameters ¢ Function Specification C Parameters? ?? Function ?? ¢ Initialization C ??? ?? (?? Linear Algorithm ??) ¢ Iteration ¢ Cost Function? ?? ?? ?????? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 34. Initialization ¢ Normalized DLT Algorithm?? ?? ??? C Outlier? ?? ?? ¢ Robust Estimation?? ??? ¢ Dense Sampling of Parameter Space ¢ Fixed Point in Parameter Space Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 35. Golden Standard Algorithm + Sampson Error Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 36. Robust Estimation Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 37. Robust Estimation ¢ ??? ??? ???? ??, ??? ?? Mismatch? ???? ?? (Outlier ???) ¢ ?? : Inlier? ???? ??? ??(??)? ? Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 38. RANSAC ¢ ?? : ?? Outlier? ??? ??? ??? ? 1.? 2?? ???? ?? (Line? ????) 2.?? Distance ?? ?? Point? ?? ?? 3.? ??? ??? ?, ?? ?? Point? ?? ?? ?? ?? Robust Fit?? ?? & ?? ? Point?? Inlier Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 39. RANSAC Robust Algorithm Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 40. RANSAC Problems ¢ ?? Distance? ?? ?? C Error Probability Distribution (DOF, Variance) ¢ Sample ?? C ???? ??( ) ¢ Acceptable Consensus Set? C Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 41. Robust Maximum Likelihood Estimation ¢ RANSAC?? ??? Inlier?? ???? re- estimate? ??. C Inlier? ??? Optimal? ?? ??? C ML Cost Function? Minimize ¢ Robust Cost Function C ?? Data? ?? ??? Cost Function Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr
  • 42. Automatic Computation of a Homography Mixed Reality Laboratory | Hanyang University http://mr.hanyang.ac.kr