Additional Pointers. Introduction to Computer Vision. Convolution. Area operations: Linear filtering
|
|
- Joan Bernadette Hoover
- 5 years ago
- Views:
Transcription
1 Additional Pointers Introduction to Computer Vision CS / ECE 181B andout #4 : Available this afternoon Midterm: May 6, 2004 W #2 due tomorrow Ack: Prof. Matthew Turk for the lecture slides. See my ECE 178 class web page See the review chapters from Gonzalez and Woods (available on the 181b web) A good understanding of linear filtering and convolution is essential in developing computer vision algorithms. Topics I recommend for additional study (that I will not be able to discuss in detail during lectures)--> sampling of signals, ourier transform, quantization of signals. 2 Area operations: Linear filtering Point, local, and global operations Each kind has its purposes Much of computer vision analysis starts with local area operations and then builds from there Texture, edges, contours, shape, etc. Perhaps at multiple scales Linear filtering is an important class of local operators Convolution Correlation ourier (and other) transforms Sampling and aliasing issues Convolution The response of a linear shift-invariant system can be described by the convolution operation R ij = Output image R u,v i u,j v uv Convolution filter kernel Input image M 1 N 1 ij = mni m, j n m= 0 n= 0 R = * = Convolution notations 3 4
2 Convolution Convolution R M 1 N 1 ij = mni m, j n m= 0 n= 0 Think of 2D convolution as the following procedure or every pixel (i,j): Line up the image at (i,j) with the filter kernel lip the kernel in both directions (vertical and horizontal) Multiply and sum (dot product) to get output value R(i,j) or every (i,j) location in the output image R, there is a summation over the local area (i,j) 5 R 4,4 = 0,0 4,4 + 0,1 4,3 + 0,2 4,2 + = -1*222+0*170+1*149+ 1,0 3,4 + 1,1 3,3 + 1,2 3,2 + -2*173+0*147+2* *149+0*198+1*221 2,0 2,4 + 2,1 2,3 + 2,2 2,2 6 = 63 Convolution: example Spatial frequency and ourier transforms n x(m,n) m n h(m,n) m h(-m, -n) h(1-m, n) A discrete image can be thought of as a regular sampling of a 2D continuous function The basis function used in sampling is, conceptually, an impulse function, shifted to various image locations Can be implemented as a convolution y(1,0) = Σ k,l x(k,l)h(1-k, -l) = n y(m,n)= m = 3 verify! 7 8
3 Spatial frequency and ourier transforms We could use a different basis function (or basis set) to sample the image Let s instead use 2D sinusoid functions at various frequencies (scales) and orientations Can also be thought of as a convolution (or dot product) ourier transform ( u, v) = 2 R g( x, y) e i2π ( ux+ vy) dxdy or a given (u, v), this is a dot product between the whole image g(x,y) and the complex sinusoid exp(-i2π (ux+vy)) exp(iθ) = cosθ + i sinθ (u,v) is a complete description of the image g(x,y) Spatial frequency components (u, v) define the scale and orientation of the sinusoidal basis filters requency of the sinusoid: (u 2 +v 2 ) 1/2 Orientation of the sinusoid: θ = tan -1 (v/u) 9 Lower frequency igher frequency 10 (u,v) requency and orientation v (u,v) requency and orientation v Point represents: (0,0) Increasing spatial frequency Orientation θ (u 1,v 1 ) u u (u 2,v 2 ) 11 12
4 ourier transform The output (u,v) is a complex image (real and imaginary components) (u,v) = R(u,v) + i I(u,v) It can also be considered to comprise a phase and magnitude (u,v))2 Original Magnitude Phase (u,v))2]1/2 Magnitude: (u,v) = [( R + ( I Phase: φ ((u,v)) = tan-1(i (u,v) / R (u,v)) v (u,v) location indicates frequency and orientation u (u,v) values indicate magnitude and phase 13 Low-pass filtering via T 14 igh-pass filtering via T Grey = zero Absolute value 15 16
5 ourier transform facts The T is linear and invertible (inverse T) A fast method for computing the T exists (the T) The T of a Gaussian is a Gaussian (f * g) = ( f ) ( g ) (f g) = k ( f ) * ( g ) (δ(x,y)) = 1 (See Table 7.1) Sampling and aliasing Analog signals (images) can be represented accurately and perfectly reconstructed is the sampling rate is high enough 2 samples per cycle of the highest frequency component in the signal (image) If the sampling rate is not high enough (i.g., the image has components over the Nyquist frequency) Bad things happen! This is called aliasing Smooth things can look jagged Patterns can look very different Colors can go astray Wagon wheels can move backwards (temporal sampling) Examples 19 Original 20
6 iltering and subsampling iltering and sub-sampling iltered then Subsampled Subsampled iltered then Subsampled Subsampled Sampling in 1-D The bottom line 1 D X(u) igh frequencies lead to trouble with sampling x(t) Time domain requency Solution: suppress high frequencies before sampling Multiply the T of the image with a mask that filters out high frequency, or Convolve with a low-pass filter (commonly a Gaussian) s(t) T s(t) 1/T x s (t) = x(t) s(t) = Σ x(kt) δ (t-kt) X s (f) 1/T 23 24
7 ilter and subsample Image pyramid So if you want to sample an image at a certain rate (e.g., resample a 640x480 image to make it 160x120), but the image has high frequency components over the Nyquist frequency, what can you do? Level 3 Get rid of those high frequencies by low-pass filtering! Level 2 This is a common operation in imaging and graphics: ilter and subsample Image pyramid: Shows an image at multiple scales Level 1 Each one a filtered and subsampled version of the previous Complete pyramid has (1+log 2 N) levels (where N is image height or width) Image pyramids Image pyramids are useful in object detection/recognition, image compression, signal processing, etc. Gaussian pyramid ilter with a Gaussian Low-pass pyramid Laplacian pyramid ilter with the difference of Gaussians (at different scales) Band-pass pyramid Wavelet pyramid ilter with wavelets Gaussian pyramid 27 28
8 Wavelet Transform Example Original Gaussian pyramid Low pass igh pass - horizontal Laplacian pyramid igh pass - vertical igh pass - both Pyramid filters (1D view) Spatial frequency G(x) The ourier transform gives us a precise way to define, represent, and measure spatial frequency in images G 1 (x)- G 2 (x) Other transforms give similar descriptions: Discrete Cosine Transform (DCT) used in JPEG Wavelet transforms very popular G(x) sin(x) Because of the T/convolution relationship (f * g) = ( f ) ( g ) convolutions can be implemented via ourier transforms! f * g = -1 { ( f ) ( g ) } or large kernels, this can be much more efficient 31 32
9 Convolution and correlation Back to convolution/correlation Convolution (or T/IT pair) is equivalent to linear filtering Think of the filter kernel as a pattern, and convolution checks the response of the pattern at every point in the image At each point, it is a dot product of the local image area with the filter kernel M 1 N 1 Rij = mni m, j n m= 0 n= 0 Conceptually, the image responds best to the pattern of the filter kernel (similarity) An edge kernel will produce high responses at edges, a face kernel will produce high responses at faces, etc. 33 Convolution and correlation or a given filter kernel, what image values really do give the largest output value? All white maximum pixel values What image values will give a zero output? All zeros or, any local vector of values that is perpendicular to the kernel vector 34 9-dimensional vectors θ = k = cosθ k Image = vector = point Correlation as a dot product An m by n image (or image patch) can be reorganized as a mn by 1 vector, or as a point in mn-dimensional space a d b e 2x3 image c f a b c d e f ( a, b, c, d, e, f ) 6-dimensional point? f 1 f 2 f 3??? f 4 f 5 f 6??? f 7 f 8 f 9?? h 1 h 2 h 3 h 4 h 5 h 6 h 7 h 8 h 9 At this location, * equals the dot product of two 9-dimensional vectors 6x1 vector f 1 f 2 h 1 h 2 f 3 h 3 f 4 f 5 dot h 4 h 5 = f T h = Σ f i h i f 6 h 6 f 7 h 7 35 f 8 h 8 f 9 h 9 36
10 inding patterns in images via correlation Correlation gives us a way to find patterns in images Task: ind the pattern in the image Approach: Convolve (correlate) and ind the maximum value of the output image That location is the best match is called a matched filter Minimize d 2 Another way: Calculate the distance d between the image patch and the pattern d 2 = Σ( i - i ) 2 Approach: d The location with minimum d 2 defines the best match This is quite expensive 37 Assume fixed (more or less) Correlation ixed So minimizing d 2 is approximately equivalent to maximizing the correlation 38 Normalized correlation Problems with these two approaches: Correlation responds best to an all white patch (maximum pixel values) Both techniques are sensitive to scaling of the image Normalized correlation solves these problems 9-dimensional vectors h 1 h 2 h 3? f 1 f 2 f 3?? h 4 h 5 h 6? f 4 f 5 f 6?? h 7 h 8 h 9? f 7 f 8 f 9?? θ k = k = cosθ39 Normalized correlation We don t really want white to give the maximum output, we want the maximum output to be when = Or when the angle θ is zero Normalized correlation measures the angle θ between and What if the image values are doubled? alved? It is independent of the magnitude (brightness) of the image R = cosθ = What if the image values are doubled? alved? R is independent of the magnitude (brightness) of the image 40
11 Normalized correlation Normalized correlation measures the angle θ between and What if the image values are doubled? alved? What if the template values are doubled? alved? Normalized correlation output is independent of the magnitude (brightness) of the image R = cosθ = Drawback: More expensive than correlation Specialized hardware implementations 41
I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University. Computer Vision: 4. Filtering
I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University Computer Vision: 4. Filtering Outline Impulse response and convolution. Linear filter and image pyramid. Textbook: David A. Forsyth
More informationEdge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005
Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005 Gradients and edges Points of sharp change in an image are interesting: change in reflectance change in object change
More informationEdge Detection. Computer Vision P. Schrater Spring 2003
Edge Detection Computer Vision P. Schrater Spring 2003 Simplest Model: (Canny) Edge(x) = a U(x) + n(x) U(x)? x=0 Convolve image with U and find points with high magnitude. Choose value by comparing with
More informationEdge Detection. Introduction to Computer Vision. Useful Mathematics Funcs. The bad news
Edge Detection Introduction to Computer Vision CS / ECE 8B Thursday, April, 004 Edge detection (HO #5) Edge detection is a local area operator that seeks to find significant, meaningful changes in image
More informationLinear Operators and Fourier Transform
Linear Operators and Fourier Transform DD2423 Image Analysis and Computer Vision Mårten Björkman Computational Vision and Active Perception School of Computer Science and Communication November 13, 2013
More informationDISCRETE FOURIER TRANSFORM
DD2423 Image Processing and Computer Vision DISCRETE FOURIER TRANSFORM Mårten Björkman Computer Vision and Active Perception School of Computer Science and Communication November 1, 2012 1 Terminology:
More informationCITS 4402 Computer Vision
CITS 4402 Computer Vision Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh, CEO at Mapizy (www.mapizy.com) and InFarm (www.infarm.io) Lecture 04 Greyscale Image Analysis Lecture 03 Summary Images as 2-D signals
More informationFrequency2: Sampling and Aliasing
CS 4495 Computer Vision Frequency2: Sampling and Aliasing Aaron Bobick School of Interactive Computing Administrivia Project 1 is due tonight. Submit what you have at the deadline. Next problem set stereo
More informationMIT 2.71/2.710 Optics 10/31/05 wk9-a-1. The spatial frequency domain
10/31/05 wk9-a-1 The spatial frequency domain Recall: plane wave propagation x path delay increases linearly with x λ z=0 θ E 0 x exp i2π sinθ + λ z i2π cosθ λ z plane of observation 10/31/05 wk9-a-2 Spatial
More informationLecture 6: Edge Detection. CAP 5415: Computer Vision Fall 2008
Lecture 6: Edge Detection CAP 5415: Computer Vision Fall 2008 Announcements PS 2 is available Please read it by Thursday During Thursday lecture, I will be going over it in some detail Monday - Computer
More informationSYDE 575: Introduction to Image Processing. Image Compression Part 2: Variable-rate compression
SYDE 575: Introduction to Image Processing Image Compression Part 2: Variable-rate compression Variable-rate Compression: Transform-based compression As mentioned earlier, we wish to transform image data
More information6.869 Advances in Computer Vision. Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018
6.869 Advances in Computer Vision Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018 1 Sampling Sampling Pixels Continuous world 3 Sampling 4 Sampling 5 Continuous image f (x, y) Sampling
More informationConvolution and Linear Systems
CS 450: Introduction to Digital Signal and Image Processing Bryan Morse BYU Computer Science Introduction Analyzing Systems Goal: analyze a device that turns one signal into another. Notation: f (t) g(t)
More informationCS 4495 Computer Vision. Frequency and Fourier Transforms. Aaron Bobick School of Interactive Computing. Frequency and Fourier Transform
CS 4495 Computer Vision Frequency and Fourier Transforms Aaron Bobick School of Interactive Computing Administrivia Project 1 is (still) on line get started now! Readings for this week: FP Chapter 4 (which
More informationDiscrete Fourier Transform
Discrete Fourier Transform DD2423 Image Analysis and Computer Vision Mårten Björkman Computational Vision and Active Perception School of Computer Science and Communication November 13, 2013 Mårten Björkman
More informationFILTERING IN THE FREQUENCY DOMAIN
1 FILTERING IN THE FREQUENCY DOMAIN Lecture 4 Spatial Vs Frequency domain 2 Spatial Domain (I) Normal image space Changes in pixel positions correspond to changes in the scene Distances in I correspond
More informationVlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems
1 Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Perception Concepts Vision Chapter 4 (textbook) Sections 4.3 to 4.5 What is the course
More informationImage Filtering. Slides, adapted from. Steve Seitz and Rick Szeliski, U.Washington
Image Filtering Slides, adapted from Steve Seitz and Rick Szeliski, U.Washington The power of blur All is Vanity by Charles Allen Gillbert (1873-1929) Harmon LD & JuleszB (1973) The recognition of faces.
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Spring 2014 TTh 14:30-15:45 CBC C313 Lecture 05 Image Processing Basics 13/02/04 http://www.ee.unlv.edu/~b1morris/ecg782/
More informationCEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt.
CEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt. Session 8- Linear Filters From Spatial Domain to Frequency Domain Mani Golparvar-Fard Department of Civil and Environmental Engineering 329D,
More informationThinking in Frequency
09/05/17 Thinking in Frequency Computational Photography University of Illinois Derek Hoiem Administrative Matlab/linear algebra tutorial tomorrow, planned for 6:30pm Probably 1214 DCL (will send confirmation
More informationDigital Image Processing
Digital Image Processing Image Transforms Unitary Transforms and the 2D Discrete Fourier Transform DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE LONDON What is this
More informationAnnouncements. Filtering. Image Filtering. Linear Filters. Example: Smoothing by Averaging. Homework 2 is due Apr 26, 11:59 PM Reading:
Announcements Filtering Homework 2 is due Apr 26, :59 PM eading: Chapter 4: Linear Filters CSE 52 Lecture 6 mage Filtering nput Output Filter (From Bill Freeman) Example: Smoothing by Averaging Linear
More informationLecture 3: Linear Filters
Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)
More informationImages have structure at various scales
Images have structure at various scales Frequency Frequency of a signal is how fast it changes Reflects scale of structure A combination of frequencies 0.1 X + 0.3 X + 0.5 X = Fourier transform Can we
More informationMultimedia Networking ECE 599
Multimedia Networking ECE 599 Prof. Thinh Nguyen School of Electrical Engineering and Computer Science Based on lectures from B. Lee, B. Girod, and A. Mukherjee 1 Outline Digital Signal Representation
More informationFrequency Filtering CSC 767
Frequency Filtering CSC 767 Outline Fourier transform and frequency domain Frequency view of filtering Hybrid images Sampling Slide: Hoiem Why does the Gaussian give a nice smooth image, but the square
More informationLecture 3: Linear Filters
Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)
More informationEdges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise
Edges and Scale Image Features From Sandlot Science Slides revised from S. Seitz, R. Szeliski, S. Lazebnik, etc. Origin of Edges surface normal discontinuity depth discontinuity surface color discontinuity
More informationReading. 3. Image processing. Pixel movement. Image processing Y R I G Q
Reading Jain, Kasturi, Schunck, Machine Vision. McGraw-Hill, 1995. Sections 4.-4.4, 4.5(intro), 4.5.5, 4.5.6, 5.1-5.4. 3. Image processing 1 Image processing An image processing operation typically defines
More informationComputer Vision Lecture 3
Computer Vision Lecture 3 Linear Filters 03.11.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Demo Haribo Classification Code available on the class website...
More informationKey Intuition: invertibility
Introduction to Fourier Analysis CS 510 Lecture #6 January 30, 2017 In the extreme, a square wave Graphic from http://www.mechatronics.colostate.edu/figures/4-4.jpg 2 Fourier Transform Formally, the Fourier
More informationRoadmap. Introduction to image analysis (computer vision) Theory of edge detection. Applications
Edge Detection Roadmap Introduction to image analysis (computer vision) Its connection with psychology and neuroscience Why is image analysis difficult? Theory of edge detection Gradient operator Advanced
More informationTemplates, Image Pyramids, and Filter Banks
Templates, Image Pyramids, and Filter Banks 09/9/ Computer Vision James Hays, Brown Slides: Hoiem and others Review. Match the spatial domain image to the Fourier magnitude image 2 3 4 5 B A C D E Slide:
More informationEdge Detection. CS 650: Computer Vision
CS 650: Computer Vision Edges and Gradients Edge: local indication of an object transition Edge detection: local operators that find edges (usually involves convolution) Local intensity transitions are
More informationAdvanced Features. Advanced Features: Topics. Jana Kosecka. Slides from: S. Thurn, D. Lowe, Forsyth and Ponce. Advanced features and feature matching
Advanced Features Jana Kosecka Slides from: S. Thurn, D. Lowe, Forsyth and Ponce Advanced Features: Topics Advanced features and feature matching Template matching SIFT features Haar features 2 1 Features
More informationLecture 04 Image Filtering
Institute of Informatics Institute of Neuroinformatics Lecture 04 Image Filtering Davide Scaramuzza 1 Lab Exercise 2 - Today afternoon Room ETH HG E 1.1 from 13:15 to 15:00 Work description: your first
More informationFiltering and Edge Detection
Filtering and Edge Detection Local Neighborhoods Hard to tell anything from a single pixel Example: you see a reddish pixel. Is this the object s color? Illumination? Noise? The next step in order of complexity
More informationReview for Exam 1. Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA
Review for Exam Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 0003 March 26, 204 Abstract Here are some things you need to know for the in-class
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Review of Edge Detectors #2 Today s Lecture Interest Points Detection What do we mean with Interest Point Detection in an Image Goal:
More informationIntroduction to Computer Vision. 2D Linear Systems
Introduction to Computer Vision D Linear Systems Review: Linear Systems We define a system as a unit that converts an input function into an output function Independent variable System operator or Transfer
More informationSpatial Enhancement Region operations: k'(x,y) = F( k(x-m, y-n), k(x,y), k(x+m,y+n) ]
CEE 615: Digital Image Processing Spatial Enhancements 1 Spatial Enhancement Region operations: k'(x,y) = F( k(x-m, y-n), k(x,y), k(x+m,y+n) ] Template (Windowing) Operations Template (window, box, kernel)
More informationG52IVG, School of Computer Science, University of Nottingham
Image Transforms Fourier Transform Basic idea 1 Image Transforms Fourier transform theory Let f(x) be a continuous function of a real variable x. The Fourier transform of f(x) is F ( u) f ( x)exp[ j2πux]
More informationECE Digital Image Processing and Introduction to Computer Vision
ECE592-064 Digital Image Processing and Introduction to Computer Vision Depart. of ECE, NC State University Instructor: Tianfu (Matt) Wu Spring 2017 Outline Recap, image degradation / restoration Template
More information3. Lecture. Fourier Transformation Sampling
3. Lecture Fourier Transformation Sampling Some slides taken from Digital Image Processing: An Algorithmic Introduction using Java, Wilhelm Burger and Mark James Burge Separability ² The 2D DFT can be
More informationOutline. Convolution. Filtering
Filtering Outline Convolution Filtering Logistics HW1 HW2 - out tomorrow Recall: what is a digital (grayscale) image? Matrix of integer values Images as height fields Let s think of image as zero-padded
More informationWhy does a lower resolution image still make sense to us? What do we lose? Image:
2D FREQUENCY DOMAIN The slides are from several sources through James Hays (Brown); Srinivasa Narasimhan (CMU); Silvio Savarese (U. of Michigan); Bill Freeman and Antonio Torralba (MIT), including their
More informationCSCI 1290: Comp Photo
CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. Capture Frequency - Rolling `Shutter James
More informationMultiscale Image Transforms
Multiscale Image Transforms Goal: Develop filter-based representations to decompose images into component parts, to extract features/structures of interest, and to attenuate noise. Motivation: extract
More informationFourier Matching. CS 510 Lecture #7 February 8 th, 2013
Fourier Matching CS 510 Lecture #7 February 8 th, 2013 Details are on the assignments page you have un4l Monday Programming Assignment #1 Source (Target) Images Templates Le4 Eye Right Eye Le4 Ear Nose
More informationSubsampling and image pyramids
Subsampling and image pyramids http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 3 Course announcements Homework 0 and homework 1 will be posted tonight. - Homework 0 is not required
More informationDigital Image Processing. Filtering in the Frequency Domain
2D Linear Systems 2D Fourier Transform and its Properties The Basics of Filtering in Frequency Domain Image Smoothing Image Sharpening Selective Filtering Implementation Tips 1 General Definition: System
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Last Lecture : Edge Detection Preprocessing of image is desired to eliminate or at least minimize noise effects There is always tradeoff
More informationLaplacian Filters. Sobel Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters
Sobel Filters Note that smoothing the image before applying a Sobel filter typically gives better results. Even thresholding the Sobel filtered image cannot usually create precise, i.e., -pixel wide, edges.
More informationEdge Detection in Computer Vision Systems
1 CS332 Visual Processing in Computer and Biological Vision Systems Edge Detection in Computer Vision Systems This handout summarizes much of the material on the detection and description of intensity
More informationIntroduction to Fourier Analysis Part 2. CS 510 Lecture #7 January 31, 2018
Introduction to Fourier Analysis Part 2 CS 510 Lecture #7 January 31, 2018 OpenCV on CS Dept. Machines 2/4/18 CSU CS 510, Ross Beveridge & Bruce Draper 2 In the extreme, a square wave Graphic from http://www.mechatronics.colostate.edu/figures/4-4.jpg
More informationLecture 7: Edge Detection
#1 Lecture 7: Edge Detection Saad J Bedros sbedros@umn.edu Review From Last Lecture Definition of an Edge First Order Derivative Approximation as Edge Detector #2 This Lecture Examples of Edge Detection
More informationConvolution Spatial Aliasing Frequency domain filtering fundamentals Applications Image smoothing Image sharpening
Frequency Domain Filtering Correspondence between Spatial and Frequency Filtering Fourier Transform Brief Introduction Sampling Theory 2 D Discrete Fourier Transform Convolution Spatial Aliasing Frequency
More informationThe Frequency Domain : Computational Photography Alexei Efros, CMU, Fall Many slides borrowed from Steve Seitz
The Frequency Domain 15-463: Computational Photography Alexei Efros, CMU, Fall 2008 Somewhere in Cinque Terre, May 2005 Many slides borrowed from Steve Seitz Salvador Dali Gala Contemplating the Mediterranean
More informationGBS765 Electron microscopy
GBS765 Electron microscopy Lecture 1 Waves and Fourier transforms 10/14/14 9:05 AM Some fundamental concepts: Periodicity! If there is some a, for a function f(x), such that f(x) = f(x + na) then function
More informationModule 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals
Module 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals Objectives Scope of this lecture: If a Continuous Time (C.T.) signal is to be uniquely represented
More informationThe Frequency Domain, without tears. Many slides borrowed from Steve Seitz
The Frequency Domain, without tears Many slides borrowed from Steve Seitz Somewhere in Cinque Terre, May 2005 CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2016
More informationThe Frequency Domain. Many slides borrowed from Steve Seitz
The Frequency Domain Many slides borrowed from Steve Seitz Somewhere in Cinque Terre, May 2005 15-463: Computational Photography Alexei Efros, CMU, Spring 2010 Salvador Dali Gala Contemplating the Mediterranean
More informationReview of Linear System Theory
Review of Linear System Theory The following is a (very) brief review of linear system theory and Fourier analysis. I work primarily with discrete signals. I assume the reader is familiar with linear algebra
More informationIntroduction to Computer Vision
Introduction to Computer Vision Michael J. Black Oct. 2009 Lecture 10: Images as vectors. Appearance-based models. News Assignment 1 parts 3&4 extension. Due tomorrow, Tuesday, 10/6 at 11am. Goals Images
More informationImage Filtering, Edges and Image Representation
Image Filtering, Edges and Image Representation Capturing what s important Req reading: Chapter 7, 9 F&P Adelson, Simoncelli and Freeman (handout online) Opt reading: Horn 7 & 8 FP 8 February 19, 8 A nice
More informationCS Sampling and Aliasing. Analog vs Digital
CS 112 - Sampling and Aliasing Aditi Majumder, CS 112, Winter 2007 Slide 1 Analog vs Digital God has created the world analog Man has created digital world Aditi Majumder, CS 112, Winter 2007 Slide 2 1
More informationRepresentation of 1D Function
Bioengineering 280A Principles of Biomedical Imaging Fall Quarter 2005 Linear Systems Lecture 2 Representation of 1D Function From the sifting property, we can write a 1D function as g(x) = g(ξ)δ(x ξ)dξ.
More informationLucas-Kanade Optical Flow. Computer Vision Carnegie Mellon University (Kris Kitani)
Lucas-Kanade Optical Flow Computer Vision 16-385 Carnegie Mellon University (Kris Kitani) I x u + I y v + I t =0 I x = @I @x I y = @I u = dx v = dy I @y t = @I dt dt @t spatial derivative optical flow
More informationToday s lecture. Local neighbourhood processing. The convolution. Removing uncorrelated noise from an image The Fourier transform
Cris Luengo TD396 fall 4 cris@cbuuse Today s lecture Local neighbourhood processing smoothing an image sharpening an image The convolution What is it? What is it useful for? How can I compute it? Removing
More informationBasics on 2-D 2 D Random Signal
Basics on -D D Random Signal Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview Last Time: Fourier Analysis for -D signals Image enhancement via spatial filtering
More informationFourier series: Any periodic signals can be viewed as weighted sum. different frequencies. view frequency as an
Image Enhancement in the Frequency Domain Fourier series: Any periodic signals can be viewed as weighted sum of sinusoidal signals with different frequencies Frequency Domain: view frequency as an independent
More informationImage Enhancement in the frequency domain. GZ Chapter 4
Image Enhancement in the frequency domain GZ Chapter 4 Contents In this lecture we will look at image enhancement in the frequency domain The Fourier series & the Fourier transform Image Processing in
More informationWavelets and Multiresolution Processing
Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,
More informationFrequency, Vibration, and Fourier
Lecture 22: Frequency, Vibration, and Fourier Computer Graphics CMU 15-462/15-662, Fall 2015 Last time: Numerical Linear Algebra Graphics via linear systems of equations Why linear? Have to solve BIG problems
More informationComputer Vision. Filtering in the Frequency Domain
Computer Vision Filtering in the Frequency Domain Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2016/2017 Introduction
More informationIntelligent Visual Prosthesis
Orientation sensor (IMU) Intelligent Visual Prosthesis Depth image-based obstacle detection Depth camera Wideangle RGB camera Simultaneous object recognition, localization, and hand tracking New projects:
More informationDiscrete Fourier Transform
Last lecture I introduced the idea that any function defined on x 0,..., N 1 could be written a sum of sines and cosines. There are two different reasons why this is useful. The first is a general one,
More information6.003: Signals and Systems. Sampling and Quantization
6.003: Signals and Systems Sampling and Quantization December 1, 2009 Last Time: Sampling and Reconstruction Uniform sampling (sampling interval T ): x[n] = x(nt ) t n Impulse reconstruction: x p (t) =
More informationChapter 4 Image Enhancement in the Frequency Domain
Chapter 4 Image Enhancement in the Frequency Domain Yinghua He School of Computer Science and Technology Tianjin University Background Introduction to the Fourier Transform and the Frequency Domain Smoothing
More informationContents. Signals as functions (1D, 2D)
Fourier Transform The idea A signal can be interpreted as en electromagnetic wave. This consists of lights of different color, or frequency, that can be split apart usign an optic prism. Each component
More informationTotal Variation Image Edge Detection
Total Variation Image Edge Detection PETER NDAJAH Graduate School of Science and Technology, Niigata University, 8050, Ikarashi 2-no-cho, Nishi-ku, Niigata, 950-28, JAPAN ndajah@telecom0.eng.niigata-u.ac.jp
More informationOptics for Engineers Chapter 11
Optics for Engineers Chapter 11 Charles A. DiMarzio Northeastern University Nov. 212 Fourier Optics Terminology Field Plane Fourier Plane C Field Amplitude, E(x, y) Ẽ(f x, f y ) Amplitude Point Spread
More informationNeural networks and optimization
Neural networks and optimization Nicolas Le Roux INRIA 8 Nov 2011 Nicolas Le Roux (INRIA) Neural networks and optimization 8 Nov 2011 1 / 80 1 Introduction 2 Linear classifier 3 Convolutional neural networks
More informationDESIGN OF MULTI-DIMENSIONAL DERIVATIVE FILTERS. Eero P. Simoncelli
Published in: First IEEE Int l Conf on Image Processing, Austin Texas, vol I, pages 790--793, November 1994. DESIGN OF MULTI-DIMENSIONAL DERIVATIVE FILTERS Eero P. Simoncelli GRASP Laboratory, Room 335C
More informationIntroduction to Computer Vision
Introduction to Computer Vision Michael J. Black Sept 2009 Lecture 8: Pyramids and image derivatives Goals Images as functions Derivatives of images Edges and gradients Laplacian pyramids Code for lecture
More informationMachine vision. Summary # 4. The mask for Laplacian is given
1 Machine vision Summary # 4 The mask for Laplacian is given L = 0 1 0 1 4 1 (6) 0 1 0 Another Laplacian mask that gives more importance to the center element is L = 1 1 1 1 8 1 (7) 1 1 1 Note that the
More informationCSE 473/573 Computer Vision and Image Processing (CVIP)
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu inwogu@buffalo.edu Lecture 11 Local Features 1 Schedule Last class We started local features Today More on local features Readings for
More information2. the basis functions have different symmetries. 1 k = 0. x( t) 1 t 0 x(t) 0 t 1
In the next few lectures, we will look at a few examples of orthobasis expansions that are used in modern signal processing. Cosine transforms The cosine-i transform is an alternative to Fourier series;
More informationDESIGNING CNN GENES. Received January 23, 2003; Revised April 2, 2003
Tutorials and Reviews International Journal of Bifurcation and Chaos, Vol. 13, No. 10 (2003 2739 2824 c World Scientific Publishing Company DESIGNING CNN GENES MAKOTO ITOH Department of Information and
More informationFourier Transform and Frequency Domain
Fourier Transform and Frequency Domain http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 3 (part 2) Overview of today s lecture Some history. Fourier series. Frequency domain. Fourier
More informationMathematics for Graphics and Vision
Mathematics for Graphics and Vision Steven Mills March 3, 06 Contents Introduction 5 Scalars 6. Visualising Scalars........................ 6. Operations on Scalars...................... 6.3 A Note on
More informationCOMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017
COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University PRINCIPAL COMPONENT ANALYSIS DIMENSIONALITY
More informationCAP 5415 Computer Vision
CAP 545 Computer Vision Dr. Mubarak Sa Univ. o Central Florida Filtering Lecture-2 Contents Filtering/Smooting/Removing Noise Convolution/Correlation Image Derivatives Histogram Some Matlab Functions General
More informationLecture 4 Filtering in the Frequency Domain. Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2016
Lecture 4 Filtering in the Frequency Domain Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2016 Outline Background From Fourier series to Fourier transform Properties of the Fourier
More informationOptics for Engineers Chapter 11
Optics for Engineers Chapter 11 Charles A. DiMarzio Northeastern University Apr. 214 Fourier Optics Terminology Apr. 214 c C. DiMarzio (Based on Optics for Engineers, CRC Press) slides11r1 1 Fourier Optics
More informationLinear Diffusion and Image Processing. Outline
Outline Linear Diffusion and Image Processing Fourier Transform Convolution Image Restoration: Linear Filtering Diffusion Processes for Noise Filtering linear scale space theory Gauss-Laplace pyramid for
More informationTRACKING and DETECTION in COMPUTER VISION Filtering and edge detection
Technischen Universität München Winter Semester 0/0 TRACKING and DETECTION in COMPUTER VISION Filtering and edge detection Slobodan Ilić Overview Image formation Convolution Non-liner filtering: Median
More informationComputer Vision & Digital Image Processing. Periodicity of the Fourier transform
Computer Vision & Digital Image Processing Fourier Transform Properties, the Laplacian, Convolution and Correlation Dr. D. J. Jackson Lecture 9- Periodicity of the Fourier transform The discrete Fourier
More informationMachine vision, spring 2018 Summary 4
Machine vision Summary # 4 The mask for Laplacian is given L = 4 (6) Another Laplacian mask that gives more importance to the center element is given by L = 8 (7) Note that the sum of the elements in the
More information