Computational Photography
|
|
- Benjamin Lawrence
- 5 years ago
- Views:
Transcription
1 Computational Photography Si Lu Spring onal_photography.htm 04/0/208
2 Last Time o Digital Camera History of Camera Controlling Camera o Photography Concepts
3 Today o Filters and its applications noisy image naïve denoising Gaussian blur better denoising edge-preserving filter Slide credit: Sylvain Paris and Frédo Durand
4 Slide credit: D. Hoiem The raster image (pixel matrix)
5 The raster image (pixel matrix) Slide credit: D. Hoiem
6 Perception of Intensity Slide credit: C. Dyer
7 Perception of Intensity Slide credit: C. Dyer
8 Color Image R G B Slide credit: D. Hoiem
9 Image Filtering o Image filtering: compute function of local neighborhood at each pixel position o One type of Local operator, Neighborhood operator, Window operator o Useful for: Enhancing images o Noise reduction, smooth, resize, increase contrast, etc. Extracting information from images o Texture, edges, distinctive points, etc. Detecting patterns o Template matching, e.g., eye template Slide credit: C. Dyer Source: D. Hoiem
10 Blurring in the Real World Camera shake = * Source: Fergus, et al. Removing Camera Shake from a Single Photograph, SIGGRAPH 2006 Bokeh: Blur in out-of-focus regions of image Slide credit: C. Dyer Source:
11 Image Correlation Filtering o Select a filter g g is called a filter, mask, kernel, or template o Center filter g at each pixel in image f o Multiply weights by corresponding pixels o Set resulting value in output image h o Linear filtering is sum of dot product at each pixel position o Filtering operation called cross-correlation, and denoted h = f g Slide credit: C. Dyer
12 Example: Box Filter g[, ] Slide credit: David Lowe
13 Image Filtering g[, ] f [.,.] h[.,.] h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
14 Image Filtering g[, ] f [.,.] h[.,.] h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
15 Image Filtering g[, ] f [.,.] h[.,.] h[ m, n] g[ k, l] k, l f [ m k, n l] Credit: S. Seitz
16 Image Filtering g[, ] f [.,.] h[.,.] h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
17 Image Filtering g[, ] f [.,.] h[.,.] h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
18 Image Filtering g[, ] f [.,.] h[.,.] ? h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
19 Image Filtering g[, ] f [.,.] h[.,.] ? h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
20 g[ Image Filtering, ] f [.,.] h[.,.] h[ m, n] k, l g[ k, l] f [ m k, n l] Credit: S. Seitz
21 Box Filter What does it do? Replaces each pixel with an average of its neighborhood g[, ] Achieves smoothing effect (i.e., removes sharp features) Weaknesses: Blocky results Axis-aligned streaks Slide credit: David Lowe
22 Smoothing with Box Filter Slide credit: C. Dyer
23 Properties of Smoothing Filters o Smoothing Values all positive Sum to constant regions same as input Amount of smoothing proportional to mask size Removes high-frequency components low-pass filter Slide credit: C. Dyer
24 Gaussian Filtering o Weight contributions of neighboring pixels by nearness x 5, = o Constant factor at front makes volume sum to o Convolve each row of image with D kernel to produce new image then convolve each column of new image with same D kernel to yield output image Slide credit: Christopher Rasmussen
25 Smoothing with a Gaussian o Smoothing with a box actually doesn t compare at all well with a defocused lens o Most obvious difference is that a single point of light viewed in a defocused lens looks like a fuzzy blob; but the averaging process would give a little square o Gaussian is isotropic (i.e., rotationally symmetric) o A Gaussian gives a good model of a fuzzy blob o It closely models many physical processes (the sum of many small effects) Slide by D.A. Forsyth
26 What does Blurring take away? Slide credit: C. Dyer original
27 What does Blurring take away? Slide credit: C. Dyer smoothed (5x5 Gaussian)
28 Smoothing with Gaussian Filter
29 Smoothing with Box Filter
30 input Slide by S. Paris
31 box average Slide by S. Paris
32 Gaussian blur Slide by S. Paris
33 Gaussian Filters o What parameters matter here? o Standard deviation,, of Gaussian: determines extent of smoothing σ = 2 with 30 x 30 kernel σ = 5 with 30 x 30 kernel Source: D. Hoiem
34 Slide credit: C. Dyer
35 Smoothing with a Gaussian Parameter σ is the scale / width / spread of the Gaussian kernel, and controls the amount of smoothing Slide credit: C. Dyer for sigma=:3:0 h = fspecial('gaussian, hsize, sigma); out = imfilter(im, h); imshow(out); pause; end
36 Gaussian filters = pixel = 5 pixels = 0 pixels = 30 pixels Slide credit: C. Dyer
37 Gaussian Filters o What parameters matter here? o Size of kernel or mask σ = 5 with 0 x 0 kernel σ = 5 with 30 x 30 kernel Slide credit: C. Dyer
38 How big should the filter be? o Gaussian function has infinite support but need a finite-size kernel o Values at edges should be near 0 o 98.8% of area under Gaussian in mask of size 5σ x 5σ o In practice, use mask of size 2k+ x 2k+ where k 3 o Normalize output by dividing by sum of all weights Slide credit: C. Dyer
39 Sharpening Filters ? Original (Note that filter sums to ) Source: D. Lowe
40 Sharpening Filters ? Original (Note that filter sums to ) Source: D. Lowe
41 Sharpening Filters Original Sharpening filter - Sharpen an out of focus image by subtracting a multiple of a blurred version Source: D. Lowe
42 Sharpening Source: D. Lowe
43 Sharpening by Unsharp Masking o h = f + k(f * g) where k is a small positive constant and g = called a Laplacian mask o Called unsharp masking in photography
44 Sharpening using Unsharp Mask Filter Original Filtered result Slide credit: C. Dyer
45 Application: Edge Detection Sobel Slide credit: C. Dyer Vertical Edge (absolute value)
46 Application: Edge Detection Sobel Slide credit: C. Dyer Horizontal Edge (absolute value)
47 Application: Hybrid Images Gaussian Filter I I G G (-G 2 ) I 2 Laplacian Filter unit impulse GaussianLaplacian of Gaussian A. Oliva, A. Torralba, P.G. Schyns, Hybrid Images, SIGGRAPH 2006
48
49 Application: XDoG Filters Input XDoG Input XDoG Gaussian filtering results Winnemoller, H., XDoG: advanced image stylization with extended Difference-of-Gaussians NPAR 20
50 Application: Painterly Filters o Many methods have been proposed to make a photo look like a painting o Today we look at one: Painterly-Rendering with Brushes of Multiple Sizes o Basic ideas: Build painting one layer at a time, from biggest to smallest brushes At each layer, add detail missing from previous layer A. Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, SIGGRAPH 998. Slide credit: S. Chenney
51 Algorithm function paint(sourceimage,r... R n ) // take source and several brush sizes { canvas := a new constant color image // paint the canvas with decreasing sized brushes for each brush radius R i, from largest to smallest do { // Apply Gaussian smoothing with a filter of size const * radius // Brush is intended to catch features at this scale referenceimage = sourceimage * G(fs R i ) // Paint a layer paintlayer(canvas, referenceimage, Ri) } return canvas } Slide credit: S. Chenney
52 Algorithm 2 procedure paintlayer(canvas,referenceimage, R) // Add a layer of strokes { S := a new set of strokes, initially empty D := difference(canvas,referenceimage) // euclidean distance at every pixel for x=0 to imagewidth stepsize grid do // step in size that depends on brush radius for y=0 to imageheight stepsize grid do { // sum the error near (x,y) M := the region (x-grid/2..x+grid/2, y-grid/2..y+grid/2) areaerror := sum(d i,j for i,j in M) / grid 2 if (areaerror > T) then { // find the largest error point (x,y) := max D i,j in M s :=makestroke(r,x,y,referenceimage) add s to S } } paint all strokes in S on the canvas, in random order } Slide credit: S. Chenney
53 Results Original Biggest brush Medium brush added Finest brush added Slide credit: S. Chenney
54 More filters (3 mins Break) Slide credit: S. Chenney
55 Filter Re-cap noisy image naïve denoising Gaussian blur better denoising edge-preserving filter Slide credit: Sylvain Paris and Frédo Durand
56 Median Filter Replace pixel by the median value of its neighbors No new pixel values introduced Removes spikes: good for impulse, salt & pepper noise Slide credit: C. Dyer
57 Median Filter Salt and pepper noise Median filtered Slide credit: M. Hebert, C. Dyer Plots of a row of the image Matlab: output im = medfilt2(im, [h w])
58 Median Filter o Median filter is edge preserving Slide credit: C. Dyer
59 Slide credit: C. Dyer
60 input 9x9 median filter output Slide credit: C. Dyer images by J. Plush
61 Bilateral filter o Tomasi and Manduci CCV98.pdf o Related to SUSAN filter [Smith and Brady 95] Digital-TV [Chan, Osher and Chen 200] sigma filter Slide credit: F. Durand
62 Start with Gaussian filtering o Here, input is a step function + noise J f I output input Slide credit: F. Durand
63 Gaussian filter as weighted average o Weight of x depends on distance to x J(x) f (x,x) I(x) x x x x x output input Slide credit: F. Durand
64 The problem of edges o Here, x o It is too different pollutes our estimate J(x) J(x) f (x,x) I(x) x x x x x output input Slide credit: F. Durand
65 Principle of Bilateral filtering [Tomasi and Manduchi 998] o Penalty g on the intensity difference J(x) k(x) f (x,x) g(i(x) I(x)) I(x) x x x I(x) output Slide credit: F. Durand input
66 Bilateral filtering [Tomasi and Manduchi 998] o Spatial Gaussian f J(x) k(x) f (x,x)g(i(x) I(x)) x I(x) x x x output input Slide credit: F. Durand
67 Bilateral filtering [Tomasi and Manduchi 998] o Spatial Gaussian f o Gaussian g on the intensity difference J(x) k(x) f (x,x) g(i(x) I(x))I(x) x x x I(x) output input Slide credit: F. Durand
68 Normalization factor [Tomasi and Manduchi 998] o k(x)= J(x) k(x) f (x,x) g(i(x) I(x)) x f (x,x) g(i(x) I(x)) I(x) x output input Slide credit: F. Durand
69 Blur from averaging across edges input * output * * Same Gaussian kernel everywhere. Slide credit: P. Sylvain
70 Bilateral filter: no averaging across edges input * output * * The kernel shape depends on the image content. Slide credit: P. Sylvain
71 Parameter for intensity difference Gaussian g r = 0. r = 0.25 r = (Gaussian blur) input s = 2 Parameter for spatial distance Gaussian f s = 6 s = 8 Slide credit: P. Sylvain
72 Parameter for intensity difference Gaussian g r = 0. r = 0.25 r = (Gaussian blur) input s = 2 Parameter for spatial distance Gaussian f s = 6 s = 8 Slide credit: P. Sylvain
73 Result Input Output Tomasi and Manduchi 998
74 Other view o The bilateral filter uses the 3D distance Slide credit: F. Durand
75 Speed o Direct bilateral filtering is slow (minutes) o Accelerations exist: Subsampling in space & range o Durand & Dorsey 2002 o Paris & Durand 2006 Limit to box kernel & intelligent maintenance of histogram o Weiss 2006 Slide credit: F. Durand
76 Local filters o Compute a new value at each pixel using its neighboring pixels o Box filter o Gaussian filter o Median filter o Bilateral filter
77 Non-local means filter o Compute a new value at each pixel from the whole image final value at pixel i weight of pixel j value at pixel j Buades, A., Coll, B., Morel, J.-M. A non-local algorithm for image denoising. CVPR 2005
78 Weight : patch centered at pixel i : patch centered at pixel j Similar pixel neighborhoods give a large weight Reprint from Buades et al. 2005
79 Input Gaussian Anisotropic Total variation Neighborhood NL-means Reprint from Buades et al. 2005
80 Non-local means filter o High-quality o Slow Fast non-local means algorithms available o BM3D:
81 BM3D o Image denoising by sparse 3-D transformdomain collaborative filtering (TIP 2007)
82 BM3D o Patch-based o Non-local method o Two-stage denoising o Collaborative denoising o Denoise in frequency domain
83 BM3D
84 BM3D o Results An Analysis and Implementation of the BM3D Image Denoising Method
85 BM3D An Analysis and Implementation of the BM3D Image Denoising Method
86 Video de-noise o We know how to de-noise an image o How about video? E. P. Bennett and L. McMillan. Video Enhancement using Per-pixel Virtual Exposures SIGGRAPH 2005
87 Gaussian filter in video cube o Blurring artifacts Not edge-preserving Motion blur
88 Bilateral filter in video cube o Cannot remove shot noise Reprint from [Bennett and McMillan 2005]
89 ASTA Filter [Bennett and McMillan 05] o Build upon bilateral filter o Find similar pixels in a video cube for filtering Patch-based similarity measurement o Adaptive Spatial-temporal Accumulation Filter Prefer temporal neighbors
90 Patch-based similarity measurement frame pt frame st
91 Similarity measure Reprint from [Bennett and McMillan 2005]
92 Adaptive Filtering Reprint from [Bennett and McMillan 2005]
93 Results (filtering + tone mapping) Input Naïve method ASTA Reprint from [Bennett and McMillan 2005]
94 Next Time o Color o Lighting
Computer Vision Lecture 3
Computer Vision Lecture 3 Linear Filters 03.11.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Demo Haribo Classification Code available on the class website...
More informationTemplates, Image Pyramids, and Filter Banks
Templates, Image Pyramids, and Filter Banks 09/9/ Computer Vision James Hays, Brown Slides: Hoiem and others Review. Match the spatial domain image to the Fourier magnitude image 2 3 4 5 B A C D E Slide:
More informationLecture 04 Image Filtering
Institute of Informatics Institute of Neuroinformatics Lecture 04 Image Filtering Davide Scaramuzza 1 Lab Exercise 2 - Today afternoon Room ETH HG E 1.1 from 13:15 to 15:00 Work description: your first
More informationThe Frequency Domain, without tears. Many slides borrowed from Steve Seitz
The Frequency Domain, without tears Many slides borrowed from Steve Seitz Somewhere in Cinque Terre, May 2005 CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2016
More informationTaking derivative by convolution
Taking derivative by convolution Partial derivatives with convolution For 2D function f(x,y), the partial derivative is: For discrete data, we can approximate using finite differences: To implement above
More informationECE Digital Image Processing and Introduction to Computer Vision. Outline
2/9/7 ECE592-064 Digital Image Processing and Introduction to Computer Vision Depart. of ECE, NC State University Instructor: Tianfu (Matt) Wu Spring 207. Recap Outline 2. Sharpening Filtering Illustration
More informationReview Smoothing Spatial Filters Sharpening Spatial Filters. Spatial Filtering. Dr. Praveen Sankaran. Department of ECE NIT Calicut.
Spatial Filtering Dr. Praveen Sankaran Department of ECE NIT Calicut January 7, 203 Outline 2 Linear Nonlinear 3 Spatial Domain Refers to the image plane itself. Direct manipulation of image pixels. Figure:
More informationFast Local Laplacian Filters: Theory and Applications
Fast Local Laplacian Filters: Theory and Applications Mathieu Aubry (INRIA, ENPC), Sylvain Paris (Adobe), Sam Hasinoff (Google), Jan Kautz (UCL), and Frédo Durand (MIT) Input Unsharp Mask, not edge-aware
More informationImage Noise: Detection, Measurement and Removal Techniques. Zhifei Zhang
Image Noise: Detection, Measurement and Removal Techniques Zhifei Zhang Outline Noise measurement Filter-based Block-based Wavelet-based Noise removal Spatial domain Transform domain Non-local methods
More informationCSE 473/573 Computer Vision and Image Processing (CVIP)
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu inwogu@buffalo.edu Lecture 11 Local Features 1 Schedule Last class We started local features Today More on local features Readings for
More informationTRACKING and DETECTION in COMPUTER VISION Filtering and edge detection
Technischen Universität München Winter Semester 0/0 TRACKING and DETECTION in COMPUTER VISION Filtering and edge detection Slobodan Ilić Overview Image formation Convolution Non-liner filtering: Median
More informationGradient-domain image processing
Gradient-domain image processing http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 10 Course announcements Homework 3 is out. - (Much) smaller
More informationCEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt.
CEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt. Session 8- Linear Filters From Spatial Domain to Frequency Domain Mani Golparvar-Fard Department of Civil and Environmental Engineering 329D,
More informationCS 3710: Visual Recognition Describing Images with Features. Adriana Kovashka Department of Computer Science January 8, 2015
CS 3710: Visual Recognition Describing Images with Features Adriana Kovashka Department of Computer Science January 8, 2015 Plan for Today Presentation assignments + schedule changes Image filtering Feature
More informationColorado School of Mines Image and Multidimensional Signal Processing
Image and Multidimensional Signal Processing Professor William Hoff Department of Electrical Engineering and Computer Science Spatial Filtering Main idea Spatial filtering Define a neighborhood of a pixel
More informationComputer Vision Lecture 3
Demo Haribo Classification Computer Vision Lecture 3 Linear Filters 23..24 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Code available on the class website...
More informationLecture 7: Edge Detection
#1 Lecture 7: Edge Detection Saad J Bedros sbedros@umn.edu Review From Last Lecture Definition of an Edge First Order Derivative Approximation as Edge Detector #2 This Lecture Examples of Edge Detection
More informationLecture 3: Linear Filters
Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)
More informationCITS 4402 Computer Vision
CITS 4402 Computer Vision Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh, CEO at Mapizy (www.mapizy.com) and InFarm (www.infarm.io) Lecture 04 Greyscale Image Analysis Lecture 03 Summary Images as 2-D signals
More informationIntroduction to Nonlinear Image Processing
Introduction to Nonlinear Image Processing 1 IPAM Summer School on Computer Vision July 22, 2013 Iasonas Kokkinos Center for Visual Computing Ecole Centrale Paris / INRIA Saclay Mean and median 2 Observations
More informationLecture 3: Linear Filters
Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)
More informationLocal enhancement. Local Enhancement. Local histogram equalized. Histogram equalized. Local Contrast Enhancement. Fig 3.23: Another example
Local enhancement Local Enhancement Median filtering Local Enhancement Sometimes Local Enhancement is Preferred. Malab: BlkProc operation for block processing. Left: original tire image. 0/07/00 Local
More informationSubsampling and image pyramids
Subsampling and image pyramids http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 3 Course announcements Homework 0 and homework 1 will be posted tonight. - Homework 0 is not required
More informationAnnouncements. Filtering. Image Filtering. Linear Filters. Example: Smoothing by Averaging. Homework 2 is due Apr 26, 11:59 PM Reading:
Announcements Filtering Homework 2 is due Apr 26, :59 PM eading: Chapter 4: Linear Filters CSE 52 Lecture 6 mage Filtering nput Output Filter (From Bill Freeman) Example: Smoothing by Averaging Linear
More informationI Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University. Computer Vision: 4. Filtering
I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University Computer Vision: 4. Filtering Outline Impulse response and convolution. Linear filter and image pyramid. Textbook: David A. Forsyth
More informationRecap of Monday. Linear filtering. Be aware of details for filter size, extrapolation, cropping
Recap of Monday Linear filtering h[ m, n] k, l f [ k, l] I[ m Not a matrix multiplication Sum over Hadamard product k, n l] Can smooth, sharpen, translate (among many other uses) 1 1 1 1 1 1 1 1 1 Be aware
More informationSlow mo guys Saccades. https://youtu.be/fmg9zohesgq?t=4s
Slow mo guys Saccades https://youtu.be/fmg9zohesgq?t=4s Thinking in Frequency Computer Vision James Hays Slides: Hoiem, Efros, and others Recap of Wednesday Linear filtering is dot product at each position
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Review of Edge Detectors #2 Today s Lecture Interest Points Detection What do we mean with Interest Point Detection in an Image Goal:
More informationLocal Enhancement. Local enhancement
Local Enhancement Local Enhancement Median filtering (see notes/slides, 3.5.2) HW4 due next Wednesday Required Reading: Sections 3.3, 3.4, 3.5, 3.6, 3.7 Local Enhancement 1 Local enhancement Sometimes
More informationImage Filtering. Slides, adapted from. Steve Seitz and Rick Szeliski, U.Washington
Image Filtering Slides, adapted from Steve Seitz and Rick Szeliski, U.Washington The power of blur All is Vanity by Charles Allen Gillbert (1873-1929) Harmon LD & JuleszB (1973) The recognition of faces.
More informationECE Digital Image Processing and Introduction to Computer Vision
ECE592-064 Digital Image Processing and Introduction to Computer Vision Depart. of ECE, NC State University Instructor: Tianfu (Matt) Wu Spring 2017 Outline Recap, image degradation / restoration Template
More informationVlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems
1 Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Perception Concepts Vision Chapter 4 (textbook) Sections 4.3 to 4.5 What is the course
More informationLinear Diffusion. E9 242 STIP- R. Venkatesh Babu IISc
Linear Diffusion Derivation of Heat equation Consider a 2D hot plate with Initial temperature profile I 0 (x, y) Uniform (isotropic) conduction coefficient c Unit thickness (along z) Problem: What is temperature
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Last Lecture : Edge Detection Preprocessing of image is desired to eliminate or at least minimize noise effects There is always tradeoff
More informationEdge Detection. Introduction to Computer Vision. Useful Mathematics Funcs. The bad news
Edge Detection Introduction to Computer Vision CS / ECE 8B Thursday, April, 004 Edge detection (HO #5) Edge detection is a local area operator that seeks to find significant, meaningful changes in image
More informationEdges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise
Edges and Scale Image Features From Sandlot Science Slides revised from S. Seitz, R. Szeliski, S. Lazebnik, etc. Origin of Edges surface normal discontinuity depth discontinuity surface color discontinuity
More informationDigital Image Processing. Lecture 6 (Enhancement) Bu-Ali Sina University Computer Engineering Dep. Fall 2009
Digital Image Processing Lecture 6 (Enhancement) Bu-Ali Sina University Computer Engineering Dep. Fall 009 Outline Image Enhancement in Spatial Domain Spatial Filtering Smoothing Filters Median Filter
More informationReading. 3. Image processing. Pixel movement. Image processing Y R I G Q
Reading Jain, Kasturi, Schunck, Machine Vision. McGraw-Hill, 1995. Sections 4.-4.4, 4.5(intro), 4.5.5, 4.5.6, 5.1-5.4. 3. Image processing 1 Image processing An image processing operation typically defines
More informationToday s lecture. Local neighbourhood processing. The convolution. Removing uncorrelated noise from an image The Fourier transform
Cris Luengo TD396 fall 4 cris@cbuuse Today s lecture Local neighbourhood processing smoothing an image sharpening an image The convolution What is it? What is it useful for? How can I compute it? Removing
More informationSuper-Resolution. Shai Avidan Tel-Aviv University
Super-Resolution Shai Avidan Tel-Aviv University Slide Credits (partial list) Ric Szelisi Steve Seitz Alyosha Efros Yacov Hel-Or Yossi Rubner Mii Elad Marc Levoy Bill Freeman Fredo Durand Sylvain Paris
More informationScreen-space processing Further Graphics
Screen-space processing Rafał Mantiuk Computer Laboratory, University of Cambridge Cornell Box and tone-mapping Rendering Photograph 2 Real-world scenes are more challenging } The match could not be achieved
More informationThinking in Frequency
09/05/17 Thinking in Frequency Computational Photography University of Illinois Derek Hoiem Administrative Matlab/linear algebra tutorial tomorrow, planned for 6:30pm Probably 1214 DCL (will send confirmation
More informationStability of Recursive Gaussian Filtering for Piecewise Linear Bilateral Filtering
Stability of Recursive Gaussian Filtering for Piecewise Linear Bilateral Filtering Koichiro Watanabe, Yoshihiro Maeda, and Norishige Fukushima Nagoya Institute of Technology, Nagoya, Japan fukushima@nitech.ac.jp
More informationFrequency Filtering CSC 767
Frequency Filtering CSC 767 Outline Fourier transform and frequency domain Frequency view of filtering Hybrid images Sampling Slide: Hoiem Why does the Gaussian give a nice smooth image, but the square
More informationImage Enhancement: Methods. Digital Image Processing. No Explicit definition. Spatial Domain: Frequency Domain:
Image Enhancement: No Explicit definition Methods Spatial Domain: Linear Nonlinear Frequency Domain: Linear Nonlinear 1 Spatial Domain Process,, g x y T f x y 2 For 1 1 neighborhood: Contrast Enhancement/Stretching/Point
More informationBlob Detection CSC 767
Blob Detection CSC 767 Blob detection Slides: S. Lazebnik Feature detection with scale selection We want to extract features with characteristic scale that is covariant with the image transformation Blob
More informationIntroduction to Computer Vision. 2D Linear Systems
Introduction to Computer Vision D Linear Systems Review: Linear Systems We define a system as a unit that converts an input function into an output function Independent variable System operator or Transfer
More informationOutline. Convolution. Filtering
Filtering Outline Convolution Filtering Logistics HW1 HW2 - out tomorrow Recall: what is a digital (grayscale) image? Matrix of integer values Images as height fields Let s think of image as zero-padded
More informationReview for Exam 1. Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA
Review for Exam Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 0003 March 26, 204 Abstract Here are some things you need to know for the in-class
More informationImage preprocessing in spatial domain
Image preprocessing in spatial domain Sharpening, image derivatives, Laplacian, edges Revision: 1.2, dated: May 25, 2007 Tomáš Svoboda Czech Technical University, Faculty of Electrical Engineering Center
More informationHistogram Processing
Histogram Processing The histogram of a digital image with gray levels in the range [0,L-] is a discrete function h ( r k ) = n k where r k n k = k th gray level = number of pixels in the image having
More informationSingle Exposure Enhancement and Reconstruction. Some slides are from: J. Kosecka, Y. Chuang, A. Efros, C. B. Owen, W. Freeman
Single Exposure Enhancement and Reconstruction Some slides are from: J. Kosecka, Y. Chuang, A. Efros, C. B. Owen, W. Freeman 1 Reconstruction as an Inverse Problem Original image f Distortion & Sampling
More informationWhy does a lower resolution image still make sense to us? What do we lose? Image:
2D FREQUENCY DOMAIN The slides are from several sources through James Hays (Brown); Srinivasa Narasimhan (CMU); Silvio Savarese (U. of Michigan); Bill Freeman and Antonio Torralba (MIT), including their
More informationLPA-ICI Applications in Image Processing
LPA-ICI Applications in Image Processing Denoising Deblurring Derivative estimation Edge detection Inverse halftoning Denoising Consider z (x) =y (x)+η (x), wherey is noise-free image and η is noise. assume
More informationIMAGE ENHANCEMENT II (CONVOLUTION)
MOTIVATION Recorded images often exhibit problems such as: blurry noisy Image enhancement aims to improve visual quality Cosmetic processing Usually empirical techniques, with ad hoc parameters ( whatever
More informationEfficient Beltrami Filtering of Color Images via Vector Extrapolation
Efficient Beltrami Filtering of Color Images via Vector Extrapolation Lorina Dascal, Guy Rosman, and Ron Kimmel Computer Science Department, Technion, Institute of Technology, Haifa 32000, Israel Abstract.
More informationNonlinear diffusion filtering on extended neighborhood
Applied Numerical Mathematics 5 005) 1 11 www.elsevier.com/locate/apnum Nonlinear diffusion filtering on extended neighborhood Danny Barash Genome Diversity Center, Institute of Evolution, University of
More informationIntroduction to Computer Vision
Introduction to Computer Vision Michael J. Black Sept 2009 Lecture 8: Pyramids and image derivatives Goals Images as functions Derivatives of images Edges and gradients Laplacian pyramids Code for lecture
More informationFeature extraction: Corners and blobs
Feature extraction: Corners and blobs Review: Linear filtering and edge detection Name two different kinds of image noise Name a non-linear smoothing filter What advantages does median filtering have over
More informationSOS Boosting of Image Denoising Algorithms
SOS Boosting of Image Denoising Algorithms Yaniv Romano and Michael Elad The Technion Israel Institute of technology Haifa 32000, Israel The research leading to these results has received funding from
More informationDetectors part II Descriptors
EECS 442 Computer vision Detectors part II Descriptors Blob detectors Invariance Descriptors Some slides of this lectures are courtesy of prof F. Li, prof S. Lazebnik, and various other lecturers Goal:
More informationEdge Detection in Computer Vision Systems
1 CS332 Visual Processing in Computer and Biological Vision Systems Edge Detection in Computer Vision Systems This handout summarizes much of the material on the detection and description of intensity
More informationThe Frequency Domain. Many slides borrowed from Steve Seitz
The Frequency Domain Many slides borrowed from Steve Seitz Somewhere in Cinque Terre, May 2005 15-463: Computational Photography Alexei Efros, CMU, Spring 2010 Salvador Dali Gala Contemplating the Mediterranean
More informationEdge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005
Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005 Gradients and edges Points of sharp change in an image are interesting: change in reflectance change in object change
More informationSIFT keypoint detection. D. Lowe, Distinctive image features from scale-invariant keypoints, IJCV 60 (2), pp , 2004.
SIFT keypoint detection D. Lowe, Distinctive image features from scale-invariant keypoints, IJCV 60 (), pp. 91-110, 004. Keypoint detection with scale selection We want to extract keypoints with characteristic
More informationBlobs & Scale Invariance
Blobs & Scale Invariance Prof. Didier Stricker Doz. Gabriele Bleser Computer Vision: Object and People Tracking With slides from Bebis, S. Lazebnik & S. Seitz, D. Lowe, A. Efros 1 Apertizer: some videos
More informationPerception III: Filtering, Edges, and Point-features
Perception : Filtering, Edges, and Point-features Davide Scaramuzza Universit of Zurich Margarita Chli, Paul Furgale, Marco Hutter, Roland Siegwart 1 Toda s outline mage filtering Smoothing Edge detection
More informationMATHEMATICAL MODEL OF IMAGE DEGRADATION. = s
MATHEMATICAL MODEL OF IMAGE DEGRADATION H s u v G s u v F s u v ^ F u v G u v H s u v Gaussian Kernel Source: C. Rasmussen Gaussian filters pixel 5 pixels 0 pixels 30 pixels Gaussian filter Removes high-frequency
More informationEmpirical Mean and Variance!
Global Image Properties! Global image properties refer to an image as a whole rather than components. Computation of global image properties is often required for image enhancement, preceding image analysis.!
More informationCorners, Blobs & Descriptors. With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros
Corners, Blobs & Descriptors With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros Motivation: Build a Panorama M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 How do we build panorama?
More informationEdge Detection. Computer Vision P. Schrater Spring 2003
Edge Detection Computer Vision P. Schrater Spring 2003 Simplest Model: (Canny) Edge(x) = a U(x) + n(x) U(x)? x=0 Convolve image with U and find points with high magnitude. Choose value by comparing with
More information6.869 Advances in Computer Vision. Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018
6.869 Advances in Computer Vision Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018 1 Sampling Sampling Pixels Continuous world 3 Sampling 4 Sampling 5 Continuous image f (x, y) Sampling
More informationDigital Image Processing: Sharpening Filtering in Spatial Domain CSC Biomedical Imaging and Analysis Dr. Kazunori Okada
Homework Exercise Start project coding work according to the project plan Adjust project plans according to my comments (reply ilearn threads) New Exercise: Install VTK & FLTK. Find a simple hello world
More informationBasics on 2-D 2 D Random Signal
Basics on -D D Random Signal Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview Last Time: Fourier Analysis for -D signals Image enhancement via spatial filtering
More informationImage enhancement by non-local reverse heat equation
Image enhancement by non-local reverse heat equation Antoni Buades 1, Bartomeu Coll 2, and Jean-Michel Morel 3 1 Dpt Matematiques i Informatica Univ. Illes Balears Ctra Valldemossa km 7.5, 07122 Palma
More informationGeneralized Laplacian as Focus Measure
Generalized Laplacian as Focus Measure Muhammad Riaz 1, Seungjin Park, Muhammad Bilal Ahmad 1, Waqas Rasheed 1, and Jongan Park 1 1 School of Information & Communications Engineering, Chosun University,
More informationLinear Operators and Fourier Transform
Linear Operators and Fourier Transform DD2423 Image Analysis and Computer Vision Mårten Björkman Computational Vision and Active Perception School of Computer Science and Communication November 13, 2013
More informationProperties of detectors Edge detectors Harris DoG Properties of descriptors SIFT HOG Shape context
Lecture 10 Detectors and descriptors Properties of detectors Edge detectors Harris DoG Properties of descriptors SIFT HOG Shape context Silvio Savarese Lecture 10-16-Feb-15 From the 3D to 2D & vice versa
More informationHarris Corner Detector
Multimedia Computing: Algorithms, Systems, and Applications: Feature Extraction By Dr. Yu Cao Department of Computer Science The University of Massachusetts Lowell Lowell, MA 01854, USA Part of the slides
More informationFast and Robust Pyramid-based Image Processing MATHIEU AUBRY, SYLVAIN PARIS, SAMUEL W. HASINOFF, JAN KAUTZ, and FR DO DURAND
Computer Science and Artificial Intelligence Laboratory Technical Report MIT-CSAIL-TR-211-49 November 15, 211 Fast and Robust Pyramid-based Image Processing MATHIEU AUBRY, SYLVAIN PARIS, SAMUEL W. HASINOFF,
More informationMachine vision, spring 2018 Summary 4
Machine vision Summary # 4 The mask for Laplacian is given L = 4 (6) Another Laplacian mask that gives more importance to the center element is given by L = 8 (7) Note that the sum of the elements in the
More informationLaplacian Filters. Sobel Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters. Laplacian Filters
Sobel Filters Note that smoothing the image before applying a Sobel filter typically gives better results. Even thresholding the Sobel filtered image cannot usually create precise, i.e., -pixel wide, edges.
More informationPartial Differential Equations and Image Processing. Eshed Ohn-Bar
Partial Differential Equations and Image Processing Eshed Ohn-Bar OBJECTIVES In this presentation you will 1) Learn what partial differential equations are and where do they arise 2) Learn how to discretize
More informationMedical Image Analysis
Medical Image Analysis CS 593 / 791 Computer Science and Electrical Engineering Dept. West Virginia University 20th January 2006 Outline 1 Discretizing the heat equation 2 Outline 1 Discretizing the heat
More informationImage processing and nonparametric regression
Image processing and nonparametric regression Rencontres R BoRdeaux 2012 B. Thieurmel Collaborators : P.A. Cornillon, N. Hengartner, E. Matzner-Løber, B. Wolhberg 2 Juillet 2012 Rencontres R BoRdeaux 2012
More informationITK Filters. Thresholding Edge Detection Gradients Second Order Derivatives Neighborhood Filters Smoothing Filters Distance Map Image Transforms
ITK Filters Thresholding Edge Detection Gradients Second Order Derivatives Neighborhood Filters Smoothing Filters Distance Map Image Transforms ITCS 6010:Biomedical Imaging and Visualization 1 ITK Filters:
More informationSingle-Image-Based Rain and Snow Removal Using Multi-guided Filter
Single-Image-Based Rain and Snow Removal Using Multi-guided Filter Xianhui Zheng 1, Yinghao Liao 1,,WeiGuo 2, Xueyang Fu 2, and Xinghao Ding 2 1 Department of Electronic Engineering, Xiamen University,
More informationIntensity Transformations and Spatial Filtering: WHICH ONE LOOKS BETTER? Intensity Transformations and Spatial Filtering: WHICH ONE LOOKS BETTER?
: WHICH ONE LOOKS BETTER? 3.1 : WHICH ONE LOOKS BETTER? 3.2 1 Goal: Image enhancement seeks to improve the visual appearance of an image, or convert it to a form suited for analysis by a human or a machine.
More informationSpatially adaptive alpha-rooting in BM3D sharpening
Spatially adaptive alpha-rooting in BM3D sharpening Markku Mäkitalo and Alessandro Foi Department of Signal Processing, Tampere University of Technology, P.O. Box FIN-553, 33101, Tampere, Finland e-mail:
More informationMedical Image Analysis
Medical Image Analysis CS 593 / 791 Computer Science and Electrical Engineering Dept. West Virginia University 23rd January 2006 Outline 1 Recap 2 Edge Enhancement 3 Experimental Results 4 The rest of
More informationA Localized Linearized ROF Model for Surface Denoising
1 2 3 4 A Localized Linearized ROF Model for Surface Denoising Shingyu Leung August 7, 2008 5 Abstract 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 1 Introduction CT/MRI scan becomes a very
More informationImage Stitching II. Linda Shapiro CSE 455
Image Stitching II Linda Shapiro CSE 455 RANSAC for Homography Initial Matched Points RANSAC for Homography Final Matched Points RANSAC for Homography Image Blending What s wrong? Feathering + 1 0 1 0
More informationLecture Outline. Basics of Spatial Filtering Smoothing Spatial Filters. Sharpening Spatial Filters
1 Lecture Outline Basics o Spatial Filtering Smoothing Spatial Filters Averaging ilters Order-Statistics ilters Sharpening Spatial Filters Laplacian ilters High-boost ilters Gradient Masks Combining Spatial
More informationA TWO STAGE DYNAMIC TRILATERAL FILTER REMOVING IMPULSE PLUS GAUSSIAN NOISE
International Journal of Information Technology and Knowledge Management January June 009, Volume, No. 1, pp. 9-13 A TWO STAGE DYNAMIC TRILATERAL FILTER REMOVING IMPULSE PLUS GAUSSIAN NOISE Neha Jain *
More informationMachine vision. Summary # 4. The mask for Laplacian is given
1 Machine vision Summary # 4 The mask for Laplacian is given L = 0 1 0 1 4 1 (6) 0 1 0 Another Laplacian mask that gives more importance to the center element is L = 1 1 1 1 8 1 (7) 1 1 1 Note that the
More informationFiltering, Frequency, and Edges
CS450: Introduction to Computer Vision Filtering, Frequency, and Edges Various slides from previous courses by: D.A. Forsyth (Berkeley / UIUC), I. Kokkinos (Ecole Centrale / UCL). S. Lazebnik (UNC / UIUC),
More informationProf. Mohd Zaid Abdullah Room No:
EEE 52/4 Advnced Digital Signal and Image Processing Tuesday, 00-300 hrs, Data Com. Lab. Friday, 0800-000 hrs, Data Com. Lab Prof. Mohd Zaid Abdullah Room No: 5 Email: mza@usm.my www.eng.usm.my Electromagnetic
More informationExtract useful building blocks: blobs. the same image like for the corners
Extract useful building blocks: blobs the same image like for the corners Here were the corners... Blob detection in 2D Laplacian of Gaussian: Circularly symmetric operator for blob detection in 2D 2 g=
More informationThe Frequency Domain : Computational Photography Alexei Efros, CMU, Fall Many slides borrowed from Steve Seitz
The Frequency Domain 15-463: Computational Photography Alexei Efros, CMU, Fall 2008 Somewhere in Cinque Terre, May 2005 Many slides borrowed from Steve Seitz Salvador Dali Gala Contemplating the Mediterranean
More information