DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
UNIVERSITY OF CALIFORNIA, SAN DIEGO
CSE 252B: Computer Vision II
Spring 2005
Instructor: Serge Belongie , Assistant Professor, AP&M room
4832. Office Hours: Tue. & Wed. 3-4pm (starting April 5).
Note: when emailing the instructor with questions about the class, please put "cse252b" in the subject line or use the following address:
sjb+cse252b
cs.ucsd.edu
Class section id for CSE252B: #527965.
Lecture: TuTh 5:00-6:20pm, Center Hall 205.
Class mailing list: http://graphics.ucsd.edu/mailman/listinfo/cse252b .
Topics to be Covered:
Geometric models of image formation. Projective Geometry. Interest point detection. Robust feature matching across wide baselines. Calibrated and uncalibrated reconstruction of 3D models of objects from 2D images. Construction of photo-mosaics. Camera calibration. Optimal camera pose and structure estimation.
Prerequisites: linear algebra, calculus, probability and statistics.
This course makes extensive use of Matlab. Click here for
information on Matlab.
Here are the Grading and Course Policies .
Handouts/Readings:
Introducing Matlab [html ]
MaSKS Ch. 1-3
HZ Sec. 2.0-2.4 [pdf ]
Assignment #1 [pdf ]
MaSKS Sec. 5.1, 5.2.1-5.2.2, 5.3
A computer algorithm for reconstructing a scene from two projections (Longuet-Higgins ) [pdf ]
In Defense of the Eight Point Algorithm (Hartley ) [pdf ]
Perspective Transform Estimation (Wren ) [html ]
A Plane Measuring Device (Criminisi, Reid and Zisserman ) [html ] [ps.zip ]
Algorithms for Plane-Based Pose Estimation (Sturm ) [pdf ]
Assignment #2 [pdf ] [files ]
Metric Rectification for Perspective Images of Planes (Liebowitz and Zisserman ) [pdf ]
Autocalibration from Planar Scenes (Triggs ) [pdf ]
MaSKS Ch. 6 and Appendix 6.A
HZ Sec. 2.7, 3.2.1, 3.2.3, 3.5-3.7, 8.5 [pdf ]
Motion and structure from point correspondences with error estimation: planar surfaces (Weng, Ahuja and Huang ) [pdf ]
Assignment #3 [pdf ] [files ]
Self Calibration from Multiple Views with a Rotating Camera (Hartley ) [pdf ]
Self-calibration of rotating and zooming cameras (de Agapito, Hayman and Reid ) [pdf ]
MaSKS Sec. 5.2.3
MaSKS Ch. 4
A Fast Operator for Detection and Precise Location of Distinct Points, Corners and Centres of Circular Features (Förstner and Gülch ) [pdf ]
Junction detection with automatic selection of detection scales and localization scales (Lindeberg ) [ps.Z ]
Feature Based Methods for Structure and Motion Estimation (Torr and Zisserman ) [pdf ]
The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix (Torr and Murray ) [pdf ]
Assignment #4 [pdf ] [files ] [bonus photos ]
An iterative image registration technique with an application to stereo vision (Lucas and Kanade ) [pdf ]
Good Features to Track (Shi and Tomasi ) [ps ] [pdf ] Tech Report [ps ]
Making Good Features to Track Better (Tommasini et al. ) [pdf ]
Shape and Motion from Image Streams: A Factorization Method (Tomasi and Kanade ) [pdf ]
Affine Structure from Motion (Koenderink and van Doorn ) [pdf ]
Final Exam [pdf ]
Lecture Topics:
Lecture 1 (Mar. 29): Geometry of Image Formation, Homogeneous Coordinates
Lecture 2 (Mar. 31): Homogeneous Linear Least Squares Problems, Two View Geometry
Lecture 3 (Apr. 5): Epipolar Geometry, Calibrated Reconstruction
Lecture 4 (Apr. 7): Planar Scenes and Homography
Lecture 5 (Apr. 12): Relationships between the Homography and the Essential Matrix
Lecture 6 (Apr. 14): Stratification in 2D: from Projective to Affine to Euclidean
Lecture 7 (Apr. 19): Uncalibrated Epipolar Geometry
Lecture 8 (Apr. 21): Projective Reconstruction
Lecture 9 (Apr. 26): Affine and Euclidean Reconstruction
Lecture 10 (Apr. 28): Camera Calibration
Lecture 11 (May 3): Optimal Pose and Structure
Lecture 12 (May 5): Review Q&A Session
Lecture 13 (May 10): Interest Point Detection
Lecture 14 (May 12): Robust Feature Matching
no class May 17 & 19 due to NSF IGERT PI meeting
Lecture 15 (May 24): Feature Tracking and Optical Flow
Lecture 16 (May 26): Orthographic Structure from Motion using Tracked Points
Lecture 17 (May 31): Review for Final Exam
no class June 2 due to Calit2 site visit
Links:
Required textbook:
Relevant non-required textbooks:
Multiple View Geometry in Computer Vision, 2nd edition by Hartley & Zisserman
Computer Vision -- A Modern Approach by Forsyth and Ponce
Introductory Techniques for 3-D Computer Vision by Trucco & Verri
The Geometry of Multiple Images by Faugeras, Luong, and Papadopoulo
Vision Science: Photons to Phenomenology by Stephen E. Palmer
Handy Math reference:
MathWorld
Most recently updated on Mar. 5, 2005 by Serge Belongie.