Lecture 05 Point Feature Detection and Matching
|
|
- Alisha Newton
- 5 years ago
- Views:
Transcription
1 nstitute of nformatics nstitute of Neuroinformatics Lecture 05 Point Feature Detection and Matching Davide Scaramuzza 1
2 Lab Eercise 3 - Toda afternoon Room ETH HG E 1.1 from 13:15 to 15:00 Wor description: implement the Harris corner detector and tracer
3 Outline Filters for Feature detection Point-feature etraction: toda and net lecture 3
4 Filters for Feature Detection n the last lecture we used filters to reduce noise or enhance contours However filters can also be used to detect features Goal: reduce amount of data to process in later stages discard redundanc to preserve onl what is useful leads to lower bandwidth and memor storage Edge detection we have seen this alread; edges can enable line or shape detection Template matching Kepoint detection 4
5 Filters for Template Matching Find locations in an image that are similar to a template f we loo at filters as templates we can use correlation lie convolution but without flipping the filter to detect these locations Template 5
6 Filters for Template Matching Find locations in an image that are similar to a template f we loo at filters as templates we can use correlation lie convolution but without flipping the filter to detect these locations Detected template Correlation map 6
7 Where s Waldo? Template Scene 7
8 Where s Waldo? Template Scene 8
9 Where s Waldo? Template Scene 9
10 Summar of filters Smoothing filter: has positive values sums to 1 preserve brightness of constant regions removes high-frequenc components: low-pass filter Derivative filter: has opposite signs used to get high response in regions of high contrast sums to 0 no response in constant regions highlights high-frequenc components: high-pass filter Filters as templates Highest response for regions that loo similar to the filter 10
11 Template Matching What if the template is not identical to the object we want to detect? Template Matching will onl wor if scale orientation illumination and in general the appearance of the template and the object to detect are ver similar. What about the piels in template bacground object-bacground problem? Scene Template Scene Template 11
12 Correlation as Scalar Product Consider images H and F as vectors their correlation is: H F H F cos H F n Normalized Cross Correlation NCC we consider the unit vectors of H and F hence we measure their similarit based on the angle. f H and F are identical then NCC 1. cos H H F F u v u v H u v H u v F u v u v F u v 1
13 Other Similarit measures Sum of Absolute Differences SAD used in optical mice Sum of Squared Differences SSD Normalized Cross Correlation NCC: taes values between -1 and identical u v u v u v v u F v u H v u F v u H NCC u v v u F v u H SSD u v v u F v u H SAD 13
14 Zero-mean SAD SSD NCC To account for the difference in mean of the two images tpicall caused b illumination changes we subtract the mean value of each image: Zero-mean Sum of Absolute Differences ZSAD used in optical mice Zero-mean Sum of Squared Differences ZSSD Zero-mean Normalized Cross Correlation ZNCC u v F u v H u v F H v u F v u H v u F v u H ZNCC u v F H v u F v u H ZSAD u v F H v u F v u H ZSSD N v u F N v u H u v F u v H 14 ZNCC is invariant to affine intensit changes: α + β Are these invariant to affine illumination changes?
15 Census Transform Maps an image patch to a bit string: if a piel is greater than the center piel its corresponding bit is set to 1 else to 0 For a w w window the string will be w 1 bits long The two bit strings are compared using the Hamming distance which is the number of bits that are different. This can be computed b counting the number of 1s in the Eclusive-OR XOR of the two bit strings Advantages More robust to object-bacground problem No square roots or divisions are required thus ver efficient to implement especiall on FPGA ntensities are considered relative to the center piel of the patch maing it invariant to monotonic intensit changes 15
16 Outline Filters for feature etraction Point-feature or epoint etraction: toda and net lecture 16
17 Point-feature etraction and matching - Eample Video from Forster Pizzoli Scaramuzza SVO: Semi-Direct Visual Odometr CRA 14 17
18 What do we need point features for? Recall the Visual-Odometr flow chart: mage sequence Feature detection Feature matching tracing Motion estimation D-D 3D-3D 3D-D Eample of feature tracs Local optimization 18
19 What do we need point features for? Kepoint etraction is the e ingredient of motion estimation! mage sequence T 1? Feature detection Feature matching tracing u i u i Motion estimation D-D 3D-3D 3D-D p i Local optimization 19
20 Point Features are also used for: Panorama stitching Object recognition 3D reconstruction Place recognition ndeing and database retrieval e.g. Google mages or 0
21 mage matching: wh is it challenging? 1
22 mage matching: wh is it challenging? NASA Mars Rover images
23 mage matching: wh is it challenging? Answer below NASA Mars Rover images with SFT feature matches 3
24 Eample: panorama stitching This panorama was generated using AUTOSTTCH: 4
25 Local features and alignment We need to align images How would ou do it? 5
26 Local features and alignment Detect point features in both images 6
27 Local features and alignment Detect point features in both images Find corresponding pairs 7
28 Local features and alignment Detect point features in both images Find corresponding pairs Use these pairs to align the images 8
29 Matching with Features Problem 1: Detect the same points independentl in both images no chance to match! We need a repeatable feature detector 9
30 Matching with Features Problem : For each point identif its correct correspondence in the other images? We need a reliable and distinctive feature descriptor that is robust to geometric and illumination changes 30
31 Geometric changes Rotation Scale i.e. zoom View point i.e perspective changes 31
32 llumination changes Tpicall small illumination changes are modelled with an affine transformation so called affine illumination changes: α + β 3
33 nvariant local features Subset of local feature tpes designed to be invariant to common geometric and photometric transformations. Basic steps: 1 Detect distinctive interest points Etract invariant descriptors 33
34 Main questions What points are distinctive i.e. features epoints salient points such that the are repeatable? i.e. can be re-detected from other views How to describe a local region? How to establish correspondences i.e. compute matches? 34
35 What is a distinctive feature? Consider the image pair below with etracted patches Notice how some patches can be localized or matched with higher accurac than others mage 1 mage 35
36 A corner is defined as the intersection of one or more edges A corner has high localization accurac Corner detectors are good for VO t s less distinctive than a blob E.g. Harris Shi-Tomasi SUSAN FAST A blob is an other image pattern which is not a corner that differs significantl from its neighbors in intensit and teture e.g. a connected region of piels with similar color a circle etc. Has less localization accurac than a corner Blob detectors are better for place recognition t s more distinctive than a corner E.g. MSER LOG DOG SFT SURF CenSurE Davide Scaramuzza Universit of Zurich Robotics and Perception Group - rpg.ifi.uzh.ch
37 The Moravec Corner detector 1980 How do we identif corners? We can easil recognize the point b looing through a small window Shifting a window in an direction should give a large change in intensit e.g. in SSD in at least directions flat region: no intensit change i.e. SSD 0 in all directions edge : no change along the edge direction i.e. SSD 0 along edge but 0 in other directions corner : significant change in at least directions i.e. SSD 0 in all directions H. Moravec Obstacle Avoidance and Navigation in the Real World b a Seeing Robot Rover PhD thesis Chapter 5 Stanford Universit Computer Science Department
38 Corner detection Ke observation: in the region around a corner image gradient has two or more dominant directions Corners are repeatable and distinctive C.Harris and M.Stephens. "A Combined Corner and Edge Detector Proceedings of the 4th Alve Vision Conference: pages
39 The Moravec Corner detector 1980 Sums of squares of differences of piels adjacent in each of four directions horizontal vertical and two diagonals over each window are calculated and the window's interest measure is the minimum of these four sums. [Moravec 80 Ch. 5] H. Moravec Obstacle Avoidance and Navigation in the Real World b a Seeing Robot Rover PhD thesis Chapter 5 Stanford Universit Computer Science Department
40 The Harris Corner detector 1988 t implements the Moravec corner detector without having to phsicall shift the window but rather b just looing at the patch itself b using differential calculus. C.Harris and M.Stephens. "A Combined Corner and Edge Detector Proceedings of the 4th Alve Vision Conference: pages
41 Consider the reference patch centered at and the shifted window centered at. The patch has size P. The Sum of Squared Differences between them is: Let and. Approimating with a 1 st order Talor epansion: This produces the approimation + + P SSD P SSD How do we implement this? This is a simple quadratic function in two variables Δ Δ 41
42 This can be written in a matri form as + P SSD M SSD How do we implement this? P SSD P M 4
43 This can be written in a matri form as + P SSD M SSD How do we implement this? P M Alternative wa to write M nd moment matri Notice that these are NOT matri products but piel-wise products! 43 P SSD
44 What does this matri reveal? First consider an edge or a flat region. We can conclude that if either λ is close to 0 then this is not a corner. Now let s consider an ais-aligned corner: This means dominant gradient directions are at 45 degrees with and aes What if we have a corner that is not aligned with the image aes? 4 cos 4 -s 4 s 4 cos cos 4 s 4 -s 4 cos 1 in in in in M M M Corner Edge Flat region 44
45 General Case Since M is smmetric it can alwas be decomposed into M R R 0 M const We can visualize as an ellipse with ais lengths determined b the eigenvalues and the two aes orientations determined b R i.e. the eigenvectors of M The two eigenvectors identif the directions of largest and smallest changes of SSD SSD direction of the fastest change of SSD direction of the slowest change of SSD ma -1/ min -1/ 45
46 How to compute λ 1 λ R from M Eigenvalue/eigenvector review You can easil prove that λ 1 λ are the eigenvalues of M. The eigenvectors and eigenvalues of a square matri A are the vectors and scalars λ that satisf: A The scalar is the eigenvalue corresponding to The eigenvalues are found b solving: det A 0 n our case A M is a matri so we have m11 det m1 m1 m 0 The solution is: λ 1 1 m 11 + m ± 4m 1 m 1 + m 11 m Once ou now ou find the two eigenvectors i.e. the two columns of R b solving: m11 m1 m1 m 0 46
47 Visualization of nd moment matrices 47
48 Visualization of nd moment matrices NB: the ellipses here are plotted proportionall to the eigenvalues and not as iso-ssd ellipses as eplained before. So small ellipses here denote a flat region and big ones a corner.
49 nterpreting the eigenvalues Classification of image points using eigenvalues of M A corner can then be identified b checing whether the minimum of the two eigenvalues of M is larger than a certain user-defined threshold R min 1 > threshold R is called cornerness function The corner detector using this criterion is called «Shi-Tomasi» detector J. Shi and C. Tomasi June "Good Features to Trac". 9th EEE Conference on Computer Vision and Pattern Recognition Edge >> 1 Corner 1 and are large R > threshold SSD increases in all directions 1 and are small; SSD is almost constant in all directions Flat region Edge 1 >> 49 1
50 nterpreting the eigenvalues Computation of λ 1 and λ is epensive Harris & Stephens suggested using a different cornerness function: R det M trace M is a magic number in the range 0.04 to 0.15 Edge >> 1 Corner 1 and are large R > threshold SSD increases in all directions Flat region Edge 1 >> 1 50
51 Harris Corner Detector Algorithm: 1. Compute derivatives in and directions e.g. with Sobel filter. Compute 3. Convolve with a bo filter to get σ σ σ which are the entries of the matri M optionall use a Gaussian filter instead of a bo filter to avoid aliasing and give more weight to the central piels 4. Compute Harris Corner Measure R according to Shi-Tomasi or Harris 5. Find points with large corner response R > threshold 6. Tae the points of local maima of R 51
52 Harris Corner Detector mage Cornerness response R 5
53 Harris vs. Shi-Tomasi Shi-Tomasi operator Harris operator 53
54 Harris Detector: Worflow 54
55 Harris Detector: Worflow Compute corner response R 55
56 Harris Detector: Worflow Find points with large corner response: R > threshold 56
57 Harris Detector: Worflow Tae onl the points of local maima of thresholded R non-maima suppression 57
58 Harris Detector: Worflow 58
59 Harris Detector: Some Properties How does the size of the Harris detector affect the performance? Repeatabilit: How does the Harris detector behave to common image transformations? Can it re-detect the same image patches Harris corners when the image ehibits changes in Rotation View-point Scale zoom llumination? Solution: dentif properties of detector & adapt accordingl 59
60 Harris Detector: Some Properties Rotation invariance mage 1 mage Ellipse rotates but its shape i.e. eigenvalues remains the same Corner response R is invariant to image rotation 60
61 Harris Detector: Some Properties But: non-invariant to image scale! mage 1 mage All points will be classified as edges Corner! 61
62 Harris Detector: Some Properties Qualit of Harris detector for different scale changes Repeatabilit # correspondences detected # correspondences present Scaling the image b ~18% of correspondences get matched
63 Summar things to remember Filters as templates Correlation as a scalar product Similarit metrics: NCC ZNCC SSD ZSSD SAD ZSAD Census Transform Point feature detection Properties and invariance to transformations Challenges: rotation scale view-point and illumination changes Etraction Moravec Harris and Shi-Tomasi Rotation invariance Reading: Ch. 4.1 and Ch. 8.1 of Szelisi boo Ch. 4 of Autonomous Mobile Robots boo Ch of Peter Core boo
64 Understanding Chec: Are ou able to: Eplain what is template matching and how it is implemented? Eplain what are the limitations of template matching? Can ou use it to recognize cars? llustrate the similarit metrics SSD SAD NCC and Census transform? What is the intuitive eplanation behind SSD and NCC? Eplain what are good features to trac? n particular can ou eplain what are corners and blobs together with their pros and cons? Eplain the Harris corner detector? n particular: Use the Moravec definition of corner edge and flat region. Show how to get the second moment matri from the definition of SSD and first order approimation show that this is a quadratic epression and what is the intrinsic interpretation of the second moment matri using an ellipse? What is the M matri lie for an edge for a flat region for an ais-aligned 90-degree corner and for a non-ais aligned 90-degree corner? What do the eigenvalues of M reveal? Can ou compare Harris detection with Shi-Tomasi detection? Can ou eplain whether the Harris detector is invariant to illumination or scale changes? What is the repeatabilit of the Harris detector after rescaling b a factor of?
Keypoint extraction: Corners Harris Corners Pkwy, Charlotte, NC
Kepoint etraction: Corners 9300 Harris Corners Pkw Charlotte NC Wh etract kepoints? Motivation: panorama stitching We have two images how do we combine them? Wh etract kepoints? Motivation: panorama stitching
More informationPerception III: Filtering, Edges, and Point-features
Perception : Filtering, Edges, and Point-features Davide Scaramuzza Universit of Zurich Margarita Chli, Paul Furgale, Marco Hutter, Roland Siegwart 1 Toda s outline mage filtering Smoothing Edge detection
More informationCEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt.
CEE598 - Visual Sensing for Civil nfrastructure Eng. & Mgmt. Session 9- mage Detectors, Part Mani Golparvar-Fard Department of Civil and Environmental Engineering 3129D, Newmark Civil Engineering Lab e-mail:
More informationInstance-level l recognition. Cordelia Schmid INRIA
nstance-level l recognition Cordelia Schmid NRA nstance-level recognition Particular objects and scenes large databases Application Search photos on the web for particular places Find these landmars...in
More informationInstance-level recognition: Local invariant features. Cordelia Schmid INRIA, Grenoble
nstance-level recognition: ocal invariant features Cordelia Schmid NRA Grenoble Overview ntroduction to local features Harris interest points + SSD ZNCC SFT Scale & affine invariant interest point detectors
More informationInstance-level recognition: Local invariant features. Cordelia Schmid INRIA, Grenoble
nstance-level recognition: ocal invariant features Cordelia Schmid NRA Grenoble Overview ntroduction to local features Harris interest points + SSD ZNCC SFT Scale & affine invariant interest point detectors
More informationInstance-level recognition: Local invariant features. Cordelia Schmid INRIA, Grenoble
nstance-level recognition: ocal invariant features Cordelia Schmid NRA Grenoble Overview ntroduction to local features Harris interest t points + SSD ZNCC SFT Scale & affine invariant interest point detectors
More informationFeature extraction: Corners and blobs
Featre etraction: Corners and blobs Wh etract featres? Motiation: panorama stitching We hae two images how do we combine them? Wh etract featres? Motiation: panorama stitching We hae two images how do
More informationFeature extraction: Corners and blobs
Feature extraction: Corners and blobs Review: Linear filtering and edge detection Name two different kinds of image noise Name a non-linear smoothing filter What advantages does median filtering have over
More informationEdges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise
Edges and Scale Image Features From Sandlot Science Slides revised from S. Seitz, R. Szeliski, S. Lazebnik, etc. Origin of Edges surface normal discontinuity depth discontinuity surface color discontinuity
More informationInstance-level l recognition. Cordelia Schmid & Josef Sivic INRIA
nstance-level l recognition Cordelia Schmid & Josef Sivic NRA nstance-level recognition Particular objects and scenes large databases Application Search photos on the web for particular places Find these
More informationRecap: edge detection. Source: D. Lowe, L. Fei-Fei
Recap: edge detection Source: D. Lowe, L. Fei-Fei Canny edge detector 1. Filter image with x, y derivatives of Gaussian 2. Find magnitude and orientation of gradient 3. Non-maximum suppression: Thin multi-pixel
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Review of Edge Detectors #2 Today s Lecture Interest Points Detection What do we mean with Interest Point Detection in an Image Goal:
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Last Lecture : Edge Detection Preprocessing of image is desired to eliminate or at least minimize noise effects There is always tradeoff
More informationCorners, Blobs & Descriptors. With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros
Corners, Blobs & Descriptors With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros Motivation: Build a Panorama M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 How do we build panorama?
More informationVlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems
1 Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Perception Concepts Vision Chapter 4 (textbook) Sections 4.3 to 4.5 What is the course
More information6.869 Advances in Computer Vision. Prof. Bill Freeman March 1, 2005
6.869 Advances in Computer Vision Prof. Bill Freeman March 1 2005 1 2 Local Features Matching points across images important for: object identification instance recognition object class recognition pose
More informationCS4670: Computer Vision Kavita Bala. Lecture 7: Harris Corner Detec=on
CS4670: Computer Vision Kavita Bala Lecture 7: Harris Corner Detec=on Announcements HW 1 will be out soon Sign up for demo slots for PA 1 Remember that both partners have to be there We will ask you to
More information* h + = Lec 05: Interesting Points Detection. Image Analysis & Retrieval. Outline. Image Filtering. Recap of Lec 04 Image Filtering Edge Features
age Analsis & Retrieval Outline CS/EE 5590 Special Topics (Class ds: 44873, 44874) Fall 06, M/W 4-5:5p@Bloch 00 Lec 05: nteresting Points Detection Recap of Lec 04 age Filtering Edge Features Hoework Harris
More informationInterest Operators. All lectures are from posted research papers. Harris Corner Detector: the first and most basic interest operator
Interest Operators All lectures are from posted research papers. Harris Corner Detector: the first and most basic interest operator SIFT interest point detector and region descriptor Kadir Entrop Detector
More informationOptical flow. Subhransu Maji. CMPSCI 670: Computer Vision. October 20, 2016
Optical flow Subhransu Maji CMPSC 670: Computer Vision October 20, 2016 Visual motion Man slides adapted from S. Seitz, R. Szeliski, M. Pollefes CMPSC 670 2 Motion and perceptual organization Sometimes,
More informationMotion estimation. Digital Visual Effects Yung-Yu Chuang. with slides by Michael Black and P. Anandan
Motion estimation Digital Visual Effects Yung-Yu Chuang with slides b Michael Black and P. Anandan Motion estimation Parametric motion image alignment Tracking Optical flow Parametric motion direct method
More informationImage Analysis. Feature extraction: corners and blobs
Image Analysis Feature extraction: corners and blobs Christophoros Nikou cnikou@cs.uoi.gr Images taken from: Computer Vision course by Svetlana Lazebnik, University of North Carolina at Chapel Hill (http://www.cs.unc.edu/~lazebnik/spring10/).
More informationMathematics 309 Conic sections and their applicationsn. Chapter 2. Quadric figures. ai,j x i x j + b i x i + c =0. 1. Coordinate changes
Mathematics 309 Conic sections and their applicationsn Chapter 2. Quadric figures In this chapter want to outline quickl how to decide what figure associated in 2D and 3D to quadratic equations look like.
More informationOverview. Introduction to local features. Harris interest points + SSD, ZNCC, SIFT. Evaluation and comparison of different detectors
Overview Introduction to local features Harris interest points + SSD, ZNCC, SIFT Scale & affine invariant interest point detectors Evaluation and comparison of different detectors Region descriptors and
More informationAdvances in Computer Vision. Prof. Bill Freeman. Image and shape descriptors. Readings: Mikolajczyk and Schmid; Belongie et al.
6.869 Advances in Computer Vision Prof. Bill Freeman March 3, 2005 Image and shape descriptors Affine invariant features Comparison of feature descriptors Shape context Readings: Mikolajczyk and Schmid;
More informationLecture 04 Image Filtering
Institute of Informatics Institute of Neuroinformatics Lecture 04 Image Filtering Davide Scaramuzza 1 Lab Exercise 2 - Today afternoon Room ETH HG E 1.1 from 13:15 to 15:00 Work description: your first
More informationDetectors part II Descriptors
EECS 442 Computer vision Detectors part II Descriptors Blob detectors Invariance Descriptors Some slides of this lectures are courtesy of prof F. Li, prof S. Lazebnik, and various other lecturers Goal:
More informationSIFT keypoint detection. D. Lowe, Distinctive image features from scale-invariant keypoints, IJCV 60 (2), pp , 2004.
SIFT keypoint detection D. Lowe, Distinctive image features from scale-invariant keypoints, IJCV 60 (), pp. 91-110, 004. Keypoint detection with scale selection We want to extract keypoints with characteristic
More informationCorner detection: the basic idea
Corner detection: the basic idea At a corner, shifting a window in any direction should give a large change in intensity flat region: no change in all directions edge : no change along the edge direction
More informationINTEREST POINTS AT DIFFERENT SCALES
INTEREST POINTS AT DIFFERENT SCALES Thank you for the slides. They come mostly from the following sources. Dan Huttenlocher Cornell U David Lowe U. of British Columbia Martial Hebert CMU Intuitively, junctions
More informationExtract useful building blocks: blobs. the same image like for the corners
Extract useful building blocks: blobs the same image like for the corners Here were the corners... Blob detection in 2D Laplacian of Gaussian: Circularly symmetric operator for blob detection in 2D 2 g=
More informationOverview. Harris interest points. Comparing interest points (SSD, ZNCC, SIFT) Scale & affine invariant interest points
Overview Harris interest points Comparing interest points (SSD, ZNCC, SIFT) Scale & affine invariant interest points Evaluation and comparison of different detectors Region descriptors and their performance
More informationSURF Features. Jacky Baltes Dept. of Computer Science University of Manitoba WWW:
SURF Features Jacky Baltes Dept. of Computer Science University of Manitoba Email: jacky@cs.umanitoba.ca WWW: http://www.cs.umanitoba.ca/~jacky Salient Spatial Features Trying to find interest points Points
More informationEdge Detection. Image Processing - Computer Vision
Image Processing - Lesson 10 Edge Detection Image Processing - Computer Vision Low Level Edge detection masks Gradient Detectors Compass Detectors Second Derivative - Laplace detectors Edge Linking Image
More informationImage Processing 1 (IP1) Bildverarbeitung 1
MIN-Fakultät Fachbereich Informatik Arbeitsbereich SAV/BV KOGS Image Processing 1 IP1 Bildverarbeitung 1 Lecture : Object Recognition Winter Semester 015/16 Slides: Prof. Bernd Neumann Slightly revised
More informationCS5670: Computer Vision
CS5670: Computer Vision Noah Snavely Lecture 5: Feature descriptors and matching Szeliski: 4.1 Reading Announcements Project 1 Artifacts due tomorrow, Friday 2/17, at 11:59pm Project 2 will be released
More informationProperties of detectors Edge detectors Harris DoG Properties of descriptors SIFT HOG Shape context
Lecture 10 Detectors and descriptors Properties of detectors Edge detectors Harris DoG Properties of descriptors SIFT HOG Shape context Silvio Savarese Lecture 10-16-Feb-15 From the 3D to 2D & vice versa
More informationBlobs & Scale Invariance
Blobs & Scale Invariance Prof. Didier Stricker Doz. Gabriele Bleser Computer Vision: Object and People Tracking With slides from Bebis, S. Lazebnik & S. Seitz, D. Lowe, A. Efros 1 Apertizer: some videos
More informationLecture 12. Local Feature Detection. Matching with Invariant Features. Why extract features? Why extract features? Why extract features?
Lecture 1 Why extract eatures? Motivation: panorama stitching We have two images how do we combine them? Local Feature Detection Guest lecturer: Alex Berg Reading: Harris and Stephens David Lowe IJCV We
More informationOverview. Introduction to local features. Harris interest points + SSD, ZNCC, SIFT. Evaluation and comparison of different detectors
Overview Introduction to local features Harris interest points + SSD, ZNCC, SIFT Scale & affine invariant interest point detectors Evaluation and comparison of different detectors Region descriptors and
More informationInvariant local features. Invariant Local Features. Classes of transformations. (Good) invariant local features. Case study: panorama stitching
Invariant local eatures Invariant Local Features Tuesday, February 6 Subset o local eature types designed to be invariant to Scale Translation Rotation Aine transormations Illumination 1) Detect distinctive
More informationCSE 473/573 Computer Vision and Image Processing (CVIP)
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu inwogu@buffalo.edu Lecture 11 Local Features 1 Schedule Last class We started local features Today More on local features Readings for
More informationFeature detectors and descriptors. Fei-Fei Li
Feature detectors and descriptors Fei-Fei Li Feature Detection e.g. DoG detected points (~300) coordinates, neighbourhoods Feature Description e.g. SIFT local descriptors (invariant) vectors database of
More informationBlob Detection CSC 767
Blob Detection CSC 767 Blob detection Slides: S. Lazebnik Feature detection with scale selection We want to extract features with characteristic scale that is covariant with the image transformation Blob
More informationFeature detectors and descriptors. Fei-Fei Li
Feature detectors and descriptors Fei-Fei Li Feature Detection e.g. DoG detected points (~300) coordinates, neighbourhoods Feature Description e.g. SIFT local descriptors (invariant) vectors database of
More informationLecture 6: Finding Features (part 1/2)
Lecture 6: Finding Features (part 1/2) Professor Fei- Fei Li Stanford Vision Lab Lecture 6 -! 1 What we will learn today? Local invariant features MoHvaHon Requirements, invariances Keypoint localizahon
More informationEigenvectors and Eigenvalues 1
Ma 2015 page 1 Eigenvectors and Eigenvalues 1 In this handout, we will eplore eigenvectors and eigenvalues. We will begin with an eploration, then provide some direct eplanation and worked eamples, and
More information10.2 The Unit Circle: Cosine and Sine
0. The Unit Circle: Cosine and Sine 77 0. The Unit Circle: Cosine and Sine In Section 0.., we introduced circular motion and derived a formula which describes the linear velocit of an object moving on
More informationImage matching. by Diva Sian. by swashford
Image matching by Diva Sian by swashford Harder case by Diva Sian by scgbt Invariant local features Find features that are invariant to transformations geometric invariance: translation, rotation, scale
More informationLocal Features (contd.)
Motivation Local Features (contd.) Readings: Mikolajczyk and Schmid; F&P Ch 10 Feature points are used also or: Image alignment (homography, undamental matrix) 3D reconstruction Motion tracking Object
More informationLoG Blob Finding and Scale. Scale Selection. Blobs (and scale selection) Achieving scale covariance. Blob detection in 2D. Blob detection in 2D
Achieving scale covariance Blobs (and scale selection) Goal: independently detect corresponding regions in scaled versions of the same image Need scale selection mechanism for finding characteristic region
More informationInterest Point Detection. Lecture-4
nterest Point Detection Lectre-4 Contents Harris Corner Detector Sm o Sqares Dierences (SSD Corrleation Talor Series Eigen Vectors and Eigen Vales nariance and co-ariance What is an interest point Epressie
More informationIntroduction to Computer Vision
Introduction to Computer Vision Michael J. Black Oct. 2009 Lecture 10: Images as vectors. Appearance-based models. News Assignment 1 parts 3&4 extension. Due tomorrow, Tuesday, 10/6 at 11am. Goals Images
More informationIdentifying second degree equations
Chapter 7 Identifing second degree equations 71 The eigenvalue method In this section we appl eigenvalue methods to determine the geometrical nature of the second degree equation a 2 + 2h + b 2 + 2g +
More informationCS 3710: Visual Recognition Describing Images with Features. Adriana Kovashka Department of Computer Science January 8, 2015
CS 3710: Visual Recognition Describing Images with Features Adriana Kovashka Department of Computer Science January 8, 2015 Plan for Today Presentation assignments + schedule changes Image filtering Feature
More informationUNCORRECTED SAMPLE PAGES. 3Quadratics. Chapter 3. Objectives
Chapter 3 3Quadratics Objectives To recognise and sketch the graphs of quadratic polnomials. To find the ke features of the graph of a quadratic polnomial: ais intercepts, turning point and ais of smmetr.
More informationReview Topics for MATH 1400 Elements of Calculus Table of Contents
Math 1400 - Mano Table of Contents - Review - page 1 of 2 Review Topics for MATH 1400 Elements of Calculus Table of Contents MATH 1400 Elements of Calculus is one of the Marquette Core Courses for Mathematical
More informationAchieving scale covariance
Achieving scale covariance Goal: independently detect corresponding regions in scaled versions of the same image Need scale selection mechanism for finding characteristic region size that is covariant
More informationf(x) = 2x 2 + 2x - 4
4-1 Graphing Quadratic Functions What You ll Learn Scan the tet under the Now heading. List two things ou will learn about in the lesson. 1. Active Vocabular 2. New Vocabular Label each bo with the terms
More information= x. Algebra II Notes Quadratic Functions Unit Graphing Quadratic Functions. Math Background
Algebra II Notes Quadratic Functions Unit 3.1 3. Graphing Quadratic Functions Math Background Previousl, ou Identified and graphed linear functions Applied transformations to parent functions Graphed quadratic
More informationLecture Outline. Basics of Spatial Filtering Smoothing Spatial Filters. Sharpening Spatial Filters
1 Lecture Outline Basics o Spatial Filtering Smoothing Spatial Filters Averaging ilters Order-Statistics ilters Sharpening Spatial Filters Laplacian ilters High-boost ilters Gradient Masks Combining Spatial
More informationLESSON #42 - INVERSES OF FUNCTIONS AND FUNCTION NOTATION PART 2 COMMON CORE ALGEBRA II
LESSON #4 - INVERSES OF FUNCTIONS AND FUNCTION NOTATION PART COMMON CORE ALGEBRA II You will recall from unit 1 that in order to find the inverse of a function, ou must switch and and solve for. Also,
More informationScale & Affine Invariant Interest Point Detectors
Scale & Affine Invariant Interest Point Detectors Krystian Mikolajczyk and Cordelia Schmid Presented by Hunter Brown & Gaurav Pandey, February 19, 2009 Roadmap: Motivation Scale Invariant Detector Affine
More informationAnalytic Geometry in Three Dimensions
Analtic Geometr in Three Dimensions. The Three-Dimensional Coordinate Sstem. Vectors in Space. The Cross Product of Two Vectors. Lines and Planes in Space The three-dimensional coordinate sstem is used
More informationMath 123 Summary of Important Algebra & Trigonometry Concepts Chapter 1 & Appendix D, Stewart, Calculus Early Transcendentals
Math Summar of Important Algebra & Trigonometr Concepts Chapter & Appendi D, Stewart, Calculus Earl Transcendentals Function a rule that assigns to each element in a set D eactl one element, called f (
More informationES.1803 Topic 16 Notes Jeremy Orloff
ES803 Topic 6 Notes Jerem Orloff 6 Eigenalues, diagonalization, decoupling This note coers topics that will take us seeral classes to get through We will look almost eclusiel at 2 2 matrices These hae
More informationComputer Vision & Digital Image Processing
Computer Vision & Digital Image Processing Image Segmentation Dr. D. J. Jackson Lecture 6- Image segmentation Segmentation divides an image into its constituent parts or objects Level of subdivision depends
More informationTENSOR TRANSFORMATION OF STRESSES
GG303 Lecture 18 9/4/01 1 TENSOR TRANSFORMATION OF STRESSES Transformation of stresses between planes of arbitrar orientation In the 2-D eample of lecture 16, the normal and shear stresses (tractions)
More informationMachine vision, spring 2018 Summary 4
Machine vision Summary # 4 The mask for Laplacian is given L = 4 (6) Another Laplacian mask that gives more importance to the center element is given by L = 8 (7) Note that the sum of the elements in the
More informationINF Introduction to classifiction Anne Solberg Based on Chapter 2 ( ) in Duda and Hart: Pattern Classification
INF 4300 151014 Introduction to classifiction Anne Solberg anne@ifiuiono Based on Chapter 1-6 in Duda and Hart: Pattern Classification 151014 INF 4300 1 Introduction to classification One of the most challenging
More informationLesson 04. KAZE, Non-linear diffusion filtering, ORB, MSER. Ing. Marek Hrúz, Ph.D.
Lesson 04 KAZE, Non-linear diffusion filtering, ORB, MSER Ing. Marek Hrúz, Ph.D. Katedra Kybernetiky Fakulta aplikovaných věd Západočeská univerzita v Plzni Lesson 04 KAZE ORB: an efficient alternative
More information1.5. Analyzing Graphs of Functions. The Graph of a Function. What you should learn. Why you should learn it. 54 Chapter 1 Functions and Their Graphs
0_005.qd /7/05 8: AM Page 5 5 Chapter Functions and Their Graphs.5 Analzing Graphs of Functions What ou should learn Use the Vertical Line Test for functions. Find the zeros of functions. Determine intervals
More informationChapter 5: Systems of Equations
Chapter : Sstems of Equations Section.: Sstems in Two Variables... 0 Section. Eercises... 9 Section.: Sstems in Three Variables... Section. Eercises... Section.: Linear Inequalities... Section.: Eercises.
More informationUNCORRECTED. To recognise the rules of a number of common algebraic relations: y = x 1 y 2 = x
5A galler of graphs Objectives To recognise the rules of a number of common algebraic relations: = = = (rectangular hperbola) + = (circle). To be able to sketch the graphs of these relations. To be able
More informationEcon Slides from Lecture 8
Econ 205 Sobel Econ 205 - Slides from Lecture 8 Joel Sobel September 1, 2010 Computational Facts 1. det AB = det BA = det A det B 2. If D is a diagonal matrix, then det D is equal to the product of its
More informationLecture 6: Edge Detection. CAP 5415: Computer Vision Fall 2008
Lecture 6: Edge Detection CAP 5415: Computer Vision Fall 2008 Announcements PS 2 is available Please read it by Thursday During Thursday lecture, I will be going over it in some detail Monday - Computer
More informationLESSON 35: EIGENVALUES AND EIGENVECTORS APRIL 21, (1) We might also write v as v. Both notations refer to a vector.
LESSON 5: EIGENVALUES AND EIGENVECTORS APRIL 2, 27 In this contet, a vector is a column matri E Note 2 v 2, v 4 5 6 () We might also write v as v Both notations refer to a vector (2) A vector can be man
More informationAdvanced Features. Advanced Features: Topics. Jana Kosecka. Slides from: S. Thurn, D. Lowe, Forsyth and Ponce. Advanced features and feature matching
Advanced Features Jana Kosecka Slides from: S. Thurn, D. Lowe, Forsyth and Ponce Advanced Features: Topics Advanced features and feature matching Template matching SIFT features Haar features 2 1 Features
More informationLaplacian Filters. Sobel Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters
Sobel Filters Note that smoothing the image before applying a Sobel filter typically gives better results. Even thresholding the Sobel filtered image cannot usually create precise, i.e., -pixel wide, edges.
More information6.4 graphs OF logarithmic FUnCTIOnS
SECTION 6. graphs of logarithmic functions 9 9 learning ObjeCTIveS In this section, ou will: Identif the domain of a logarithmic function. Graph logarithmic functions. 6. graphs OF logarithmic FUnCTIOnS
More informationMachine vision. Summary # 4. The mask for Laplacian is given
1 Machine vision Summary # 4 The mask for Laplacian is given L = 0 1 0 1 4 1 (6) 0 1 0 Another Laplacian mask that gives more importance to the center element is L = 1 1 1 1 8 1 (7) 1 1 1 Note that the
More informationRoadmap. Introduction to image analysis (computer vision) Theory of edge detection. Applications
Edge Detection Roadmap Introduction to image analysis (computer vision) Its connection with psychology and neuroscience Why is image analysis difficult? Theory of edge detection Gradient operator Advanced
More informationSIFT: Scale Invariant Feature Transform
1 SIFT: Scale Invariant Feature Transform With slides from Sebastian Thrun Stanford CS223B Computer Vision, Winter 2006 3 Pattern Recognition Want to find in here SIFT Invariances: Scaling Rotation Illumination
More informationEECS150 - Digital Design Lecture 15 SIFT2 + FSM. Recap and Outline
EECS150 - Digital Design Lecture 15 SIFT2 + FSM Oct. 15, 2013 Prof. Ronald Fearing Electrical Engineering and Computer Sciences University of California, Berkeley (slides courtesy of Prof. John Wawrzynek)
More informationReview: critical point or equivalently f a,
Review: a b f f a b f a b critical point or equivalentl f a, b A point, is called a of if,, 0 A local ma or local min must be a critical point (but not conversel) 0 D iscriminant (or Hessian) f f D f f
More informationVector Fields. Field (II) Field (V)
Math 1a Vector Fields 1. Match the following vector fields to the pictures, below. Eplain our reasoning. (Notice that in some of the pictures all of the vectors have been uniforml scaled so that the picture
More informationLecture 7: Finding Features (part 2/2)
Lecture 7: Finding Features (part 2/2) Professor Fei- Fei Li Stanford Vision Lab Lecture 7 -! 1 What we will learn today? Local invariant features MoHvaHon Requirements, invariances Keypoint localizahon
More informationUnit 10 - Graphing Quadratic Functions
Unit - Graphing Quadratic Functions PREREQUISITE SKILLS: students should be able to add, subtract and multipl polnomials students should be able to factor polnomials students should be able to identif
More informationEdge Detection. Introduction to Computer Vision. Useful Mathematics Funcs. The bad news
Edge Detection Introduction to Computer Vision CS / ECE 8B Thursday, April, 004 Edge detection (HO #5) Edge detection is a local area operator that seeks to find significant, meaningful changes in image
More information4 The Cartesian Coordinate System- Pictures of Equations
The Cartesian Coordinate Sstem- Pictures of Equations Concepts: The Cartesian Coordinate Sstem Graphs of Equations in Two Variables -intercepts and -intercepts Distance in Two Dimensions and the Pthagorean
More information10.3 Solving Nonlinear Systems of Equations
60 CHAPTER 0 Conic Sections Identif whether each equation, when graphed, will be a parabola, circle, ellipse, or hperbola. Then graph each equation.. - 7 + - =. = +. = + + 6. + 9 =. 9-9 = 6. 6 - = 7. 6
More informationCamera calibration. Outline. Pinhole camera. Camera projection models. Nonlinear least square methods A camera calibration tool
Outline Camera calibration Camera projection models Camera calibration i Nonlinear least square methods A camera calibration tool Applications Digital Visual Effects Yung-Yu Chuang with slides b Richard
More informationStatistical Geometry Processing Winter Semester 2011/2012
Statistical Geometry Processing Winter Semester 2011/2012 Linear Algebra, Function Spaces & Inverse Problems Vector and Function Spaces 3 Vectors vectors are arrows in space classically: 2 or 3 dim. Euclidian
More informationCh 5 Alg 2 L2 Note Sheet Key Do Activity 1 on your Ch 5 Activity Sheet.
Ch Alg L Note Sheet Ke Do Activit 1 on our Ch Activit Sheet. Chapter : Quadratic Equations and Functions.1 Modeling Data With Quadratic Functions You had three forms for linear equations, ou will have
More informationUnconstrained Multivariate Optimization
Unconstrained Multivariate Optimization Multivariate optimization means optimization of a scalar function of a several variables: and has the general form: y = () min ( ) where () is a nonlinear scalar-valued
More information3.2 LOGARITHMIC FUNCTIONS AND THEIR GRAPHS
Section. Logarithmic Functions and Their Graphs 7. LOGARITHMIC FUNCTIONS AND THEIR GRAPHS Ariel Skelle/Corbis What ou should learn Recognize and evaluate logarithmic functions with base a. Graph logarithmic
More information5.6 RATIOnAl FUnCTIOnS. Using Arrow notation. learning ObjeCTIveS
CHAPTER PolNomiAl ANd rational functions learning ObjeCTIveS In this section, ou will: Use arrow notation. Solve applied problems involving rational functions. Find the domains of rational functions. Identif
More information11.4 Polar Coordinates
11. Polar Coordinates 917 11. Polar Coordinates In Section 1.1, we introduced the Cartesian coordinates of a point in the plane as a means of assigning ordered pairs of numbers to points in the plane.
More information