Bayesian Approach for Inverse Problem in Microwave Tomography
|
|
- Horace James
- 5 years ago
- Views:
Transcription
1 Bayesian Approach for Inverse Problem in Microwave Tomography Hacheme Ayasso Ali Mohammad-Djafari Bernard Duchêne Laboratoire des Signaux et Systèmes, UMRS (CNRS-SUPELEC-UNIV PARIS SUD 11), 3 rue Joliot-Curie, F Gif-sur-Yvette cedex, France Journées Problèmes Inverses et Optimisation de Forme décembre 2008
2 Introduction Microwave Tomography: Reconstruction of unknown object (electrical permetivity and conductivity) from several measurement around it. S Interaction between incident field and object Scattered field measurement around the object y z x Several source positions Several excitation frequencies E inc D Application: Medical imaging (Breast Cancer), burried object detection, NDT H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
3 General Context Forward Model E scat = S (χ) E scat : scatter field measurement around the object (data) χ : unknown object (contrast function) under test S : system transfere function (Forward Model). Difficulties 1 Calculating χ given E scat & S An ill-posed inverse problem (Hadamard). 2 S is non-linear. 3 High computational cost. Proposed Method 1 Bayesian inference framework with Gauss-Markov Potts priors 2 Joint source contrast estimation 3 Careful choice of calculation methods & parallel programing H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
4 Outline 1 Forward Model Formulation Difficulties Gradiant-FFT methods Validation 2 Bayesian Inversion Approach Formulation Prior Model Iterative Linearization Joint estimation 3 Conclusion 4 References H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
5 1. Forward Model H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
6 Forward Formulation(Continuous) Using the integral equation representation for electrical field ( E scat ( r) = ) r r G( r, r )χ( r ) E( r )d r, k 2 0 ( E( r) = E inc ( r) ) k0 2 r r G( r, r )χ( r ) E( r )d r, D D r S r D S χ( r) = ω 2 ε 0 µ 0 ε r (r) + iωµ 0 σ(r) E( r), r D: total field in the domain of interest D E scat, r S: scatter field in measuement domain S Foward problem: χ, E inc E scat, Inverse problem: E scat, E inc χ E inc y z D x H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
7 Forward Formulation(Discretization) Two derivatives G (particular consideration for non-integrable singularity) ( E scat ( r) = G( r, r ) + 1 ) D k0 2 r r G( r, r ) χ( r ) E( r )d r Method of Moments (MoM), Cubical voxels E, χ constants inside the voxel Green Dyadic function is calculated on a sphere with the same size of a voxel Discret model, ɛ c & ɛ o Measurement, model, and discretization errors E scat = G o (X E) + ɛ o (Observation) E = E inc + G c (X E) + ɛ c (Coupling) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
8 Difficulties 1 Nonlinear forward model calculate E ( ( ) ) E scat = G o X I G c X T 1 E inc + ɛ 2 A = ( I G c X T ) Large full complex matrix Memory problem. E = A 1 E inc High computational cost Solution: Gradiant-FFT Method Cost Min required(one frequency!) voxel per axe n 64 X 2 n 3 N f 0.5Me = 1.5MB E ou E inc N = 6 n 3 N f 1.5Me = 12MB G c ou A 18 n 6 N f 1.2Te = 10TB GE (Mem/Cal) O(N 2 )/O(N 3 ) 10TB/0.5Em CG (Mem/Cal) O(N)/O(K N 2 ) 12MB/K 10Tm CG-FFT O(N)/O(K N log(n)) 12MB/10Mm H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
9 Gradiant-FFT methods Solve large complex linear system E inc = ( E G c (X E) ) = A (E) G c (X E) Discret Convolution product G o is diagonal in Fourier domain (Need for zero padding circularity ) Forward operator Adjoint operator A (E) = E FT 1 ( FT (G c ) FT (X E) ) A (E) = E X FT 1 ( FT (G c ) FT (E) ) BiCGSTAB-FFT [Xu2002] High convergence speed compared to classsical CG-FFTs method H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
10 Validation Comparaison with scattered field real data. Amplitude H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
11 Validation Comparaison with scattered field real data. Phase H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
12 2.Bayesian Inversion Approach H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
13 Formulation Bayes Formula p ( X E scat ; M ) = p ( E scat X ; M ) p (X M) p ( E scat M ) Errors Model p(ɛ) Likelihood p(e scat X ; M) Prior information over the contrast p(x M) Model Evidence p(e scat M) Estimation MAP : ˆX = argmax(p(x E; M)) X MP : ˆX = E(X ) p(x E scat ;M) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
14 Prior Model Prior information: objects are composed of a finite number of homogeneous materials Hidden field representing materials z Homogeneity within a class p(x z) N (µ z, v z ) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
15 Prior Model Prior information: objects are composed of a finite number of homogeneous materials Hidden field representing materials z Spatial dependency between hidden field sites Potts prior p(z) Independent prior for X z Mixture of Independent Gaussians (MIG) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
16 Prior Model Prior information: objects are composed of a finite number of homogeneous materials Hidden field representing materials z Spatial dependency between hidden field sites Potts prior p(z) Gauss markov prior for X z Mixture of Gauss-Markov (MGM) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
17 Hierarchical Model Partialy unsupervised approach Estimation of most of the model hyperparameter Object MIG : p(x (r) z(r) = k, m k, v k ) = N (m k, v k ) MGM : p(x (r) z(r), m k, v k, f (r ), z(r ), r V(r)) = N (µ z(r), v z(r)) Hidden field m 0, v 0 a 0,b 0 a e0,b e0 h P p(z γ) exp r R Φ(z(r)) + 1 γ P P i 2 r R r V(r) δ(z(r) z(r )) m k v k v 0 Hyper-parameters: p(m k m 0, v 0) = N (m 0, v 0), k p(v 1 k a 0, b 0) = G(a 0, b 0), k p(α α 0) = D(α 0,, α 0) p(vɛ 1 a e0, b e0 ) = G(a e0, b e0 ) α k X z k S + + E scat Constants(Hyper-hyperparameter): m 0, v 0, a 0, b 0, α 0, a e0, b e0, γ α 0 H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
18 Iterative Linearization Nonlinear Forward model Estimate the total field E in alternance with the contrast X and other model parameters. Algorithm 1 Initial guess for total field E = E inc (Born approximation) and Model parameter 2 E itr 1, z itr 1, θ itr 1 MAP X itr (A linear inverse problem) p(x itr E itr 1, E scat, z itr 1, θ itr 1 ) p(e scat X itr, E itr 1, z itr 1, θ itr 1 )p(x E itr 1, z itr 1, θ itr 1 ) 3 X itr Forward Model 4 X itr MAP E itr z itr, θ itr (segmentation problem) p(z itr, θ itr X itr ) p(x itr z itr, θ itr )p(z itr, θ itr ) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
19 Alternated Estimation (Application 1) MIG prior with independent hidden field sites: Sphere (a) BIM (Real Part) (b) BIM (imaginary Part) (c) Bayesian(Real Part) (d) Bayesian (Imaginary Part) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
20 Alternated Estimation (Application 2) Two spheres: (a) BIM (Real Part) (b) BIM (imaginary Part) (c) Bayesian(Real Part) (d) Bayesian (Imaginary Part) H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
21 Perspective: Joint Estimation Iterative estimation Low contrast, Local minimum solution Nonlinear forward model (but bilinear) Joint estimation of current density J = X E and Contrast X E scat = G o J + ɛ o Observation J = X E inc + X G c J + ɛ o Contrast-Coupling Joint posterior of currents J, contrast X, hidden field z, and hyperparameters θ p(j, X, z, θ E scat ) p(e scat J, X )p(j X )p(x z, θ)p(z θ)p(θ) Observation p(e scat J, X ), Contrast-Coupling p(j X ) Prior model p(x zu), p(z θ), p(θ) Estimator Stochastic sampling or Variational Bayes technique H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
22 Conclusion Microwave Tomography: Nonlinear ill-posed inverse problem with high computational cost. BiCGSTAB-FFT method for forward problem. Bayesian framework for inverse problem. Hierarchical mixture model to account for the knowmedge of number of materials and piecewise homogeneity prior information. Iterative estimation: better results than conventional methods Perspective: Joint estimation of current density, contrast, hidden field, and hyperparameters Application of Variational Bayes approximation technique for the posterior H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
23 References H. Ayasso, B. Duchêne, A. Mohammad-Djafari, A Bayesian approach to microwave imaging in a 3-D configuration,in OIPE, O. Féron, B. Duchêne, A. Mohammad-Djafari, Microwave imaging of inhomogeneous objects made of a finite number of dielectric and conductive materials from experimental data, Inverse Problems, vol. 21, no. 6, 2005, pp. S95 S115. O. Féron, B. Duchêne, A. Mohammad-Djafari, Microwave imaging of piecewise constant objects in a 2D-TE configuration, Int. J. Appl. Electromagn. Mechan., vol. 26, 2007, pp X. Xu, Q.H. Liu, et Z.W. Zhang, The stabilized biconjugate gradient fast Fourier transform method for electromagnetic scattering, Antennas and Propagation Society International Symposium, IEEE, vol. 2, H. Ayasso, A. Mohammad-Djafari, Variational Bayes With Gauss-Markov-Potts Prior Models For Joint Image Restoration And Segmentation, in VISSAP, H.AYASSO & al. (LSS(CNRS-SUPELEC-UPS)) Bayesian Microwave Tomography Reconstruction Nantes, Decemeber / 23
Bayesian Microwave Breast Imaging
Bayesian Microwave Breast Imaging Leila Gharsalli 1 Hacheme Ayasso 2 Bernard Duchêne 1 Ali Mohammad-Djafari 1 1 Laboratoire des Signaux et Systèmes (L2S) (UMR8506: CNRS-SUPELEC-Univ Paris-Sud) Plateau
More informationBayesian X-ray Computed Tomography using a Three-level Hierarchical Prior Model
L. Wang, A. Mohammad-Djafari, N. Gac, MaxEnt 16, Ghent, Belgium. 1/26 Bayesian X-ray Computed Tomography using a Three-level Hierarchical Prior Model Li Wang, Ali Mohammad-Djafari, Nicolas Gac Laboratoire
More informationHierarchical prior models for scalable Bayesian Tomography
A. Mohammad-Djafari, Hierarchical prior models for scalable Bayesian Tomography, WSTL, January 25-27, 2016, Szeged, Hungary. 1/45. Hierarchical prior models for scalable Bayesian Tomography Ali Mohammad-Djafari
More informationVARIATIONAL BAYES WITH GAUSS-MARKOV-POTTS PRIOR MODELS FOR JOINT IMAGE RESTORATION AND SEGMENTATION
VARIATIONAL BAYES WITH GAUSS-MARKOV-POTTS PRIOR MODELS FOR JOINT IMAGE RESTORATION AND SEGMENTATION Hacheme AYASSO and Ali MOHAMMAD-DJAFARI Laboratoire des Signaux et Systèmes, UMR 8506 (CNRS-SUPELEC-UPS)
More informationInverse Problems: From Regularization to Bayesian Inference
1 / 42 Inverse Problems: From Regularization to Bayesian Inference An Overview on Prior Modeling and Bayesian Computation Application to Computed Tomography Ali Mohammad-Djafari Groupe Problèmes Inverses
More informationBayesian inference methods for sources separation
A. Mohammad-Djafari, BeBec2012, February 22-23, 2012, Berlin, Germany, 1/12. Bayesian inference methods for sources separation Ali Mohammad-Djafari Laboratoire des Signaux et Systèmes, UMR8506 CNRS-SUPELEC-UNIV
More informationInverse Problems: From Regularization Theory to Probabilistic and Bayesian Inference
A. Mohammad-Djafari, Inverse Problems: From Regularization to Bayesian Inference, Pôle signaux, 1/11. Inverse Problems: From Regularization Theory to Probabilistic and Bayesian Inference Ali Mohammad-Djafari
More informationSUPREME: a SUPer REsolution Mapmaker for Extended emission
SUPREME: a SUPer REsolution Mapmaker for Extended emission Hacheme Ayasso 1,2 Alain Abergel 2 Thomas Rodet 3 François Orieux 2,3,4 Jean-François Giovannelli 5 Karin Dassas 2 Boualam Hasnoun 1 1 GIPSA-LAB
More informationA. Mohammad-Djafari, Bayesian Discrete Tomography from a few number of projections, Mars 21-23, 2016, Polytechnico de Milan, Italy.
A. Mohammad-Djafari, Bayesian Discrete Tomography from a few number of projections, Mars 21-23, 2016, Polytechnico de Milan, Italy. 1. A Student-t based sparsity enforcing hierarchical prior for linear
More informationScalar electromagnetic integral equations
Scalar electromagnetic integral equations Uday K Khankhoje Abstract This brief note derives the two dimensional scalar electromagnetic integral equation starting from Maxwell s equations, and shows how
More informationIN THE reconstruction of material shapes and properties, we
1704 IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, VOL. 46, NO. 11, NOVEMBER 1998 Nonlinear Inversion in TE Scattering Bert Jan Kooij and Peter M. van den Berg Abstract A method for reconstructing
More informationApproximate Bayesian Computation for Big Data
A. Mohammad-Djafari, Approximate Bayesian Computation for Big Data, Tutorial at MaxEnt 2016, July 10-15, Gent, Belgium. 1/63. Approximate Bayesian Computation for Big Data Ali Mohammad-Djafari Laboratoire
More informationBayesian inference for Machine Learning, Inverse Problems and Big Data: from Basics to Computational algorithms
A. Mohammad-Djafari, Approximate Bayesian Computation for Big Data, Seminar 2016, Nov. 21-25, Aix-Marseille Univ. 1/76. Bayesian inference for Machine Learning, Inverse Problems and Big Data: from Basics
More informationInverse problems in imaging and computer vision
1 / 62. Inverse problems in imaging and computer vision From deterministic methods to probabilistic Bayesian inference Ali Mohammad-Djafari Groupe Problèmes Inverses Laboratoire des Signaux et Systèmes
More informationModified 2 gradient method and modified Born method for solving a two-dimensional inverse scattering problem
INSTITUTE OF PHYSICS PUBLISHING Inverse Problems 17 (2001) 1671 1688 INVERSE PROBLEMS PII: S0266-5611(01)24165-3 Modified 2 gradient method and modified Born method for solving a two-dimensional inverse
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationMAXIMUM ENTROPIES COPULAS
MAXIMUM ENTROPIES COPULAS Doriano-Boris Pougaza & Ali Mohammad-Djafari Groupe Problèmes Inverses Laboratoire des Signaux et Systèmes (UMR 8506 CNRS - SUPELEC - UNIV PARIS SUD) Supélec, Plateau de Moulon,
More informationBreast Cancer Detection by Scattering of Electromagnetic Waves
57 MSAS'2006 Breast Cancer Detection by Scattering of Electromagnetic Waves F. Seydou & T. Seppänen University of Oulu Department of Electrical and Information Engineering P.O. Box 3000, 9040 Oulu Finland
More informationInverse problem and optimization
Inverse problem and optimization Laurent Condat, Nelly Pustelnik CNRS, Gipsa-lab CNRS, Laboratoire de Physique de l ENS de Lyon Decembre, 15th 2016 Inverse problem and optimization 2/36 Plan 1. Examples
More informationPart 1: Expectation Propagation
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 1: Expectation Propagation Tom Heskes Machine Learning Group, Institute for Computing and Information Sciences Radboud
More informationNon-Parametric Bayes
Non-Parametric Bayes Mark Schmidt UBC Machine Learning Reading Group January 2016 Current Hot Topics in Machine Learning Bayesian learning includes: Gaussian processes. Approximate inference. Bayesian
More informationEntropy, Information Theory, Information Geometry and Bayesian Inference in Data, Signal and Image Processing and Inverse Problems
Entropy 2015, 17, 3989-4027; doi:10.3390/e17063989 OPEN ACCESS entropy ISSN 1099-4300 www.mdpi.com/journal/entropy Article Entropy, Information Theory, Information Geometry and Bayesian Inference in Data,
More informationPart 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior Tom Heskes joint work with Marcel van Gerven
More informationThe Kalman Filter ImPr Talk
The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman
More informationBayesian Knowledge Fusion in Prognostics and Health Management A Case Study
Bayesian Knowledge Fusion in Prognostics and Health Management A Case Study Masoud Rabiei Mohammad Modarres Center for Risk and Reliability University of Maryland-College Park Ali Moahmamd-Djafari Laboratoire
More informationQuantitative Microwave Imaging Based on a Huber regularization
Quantitative Microwave Imaging Based on a Huber regularization Funing Bai, Wilfried Philips and Aleksandra Pižurica Department of Telecommunications and Information Processing (IPI-TELIN-iMinds) Ghent
More informationRegularization, maximum entropy and probabilistic methods in mass spectrometry data processing problems
International Journal of Mass Spectrometry 215 (2002) 175 193 Regularization, maximum entropy and probabilistic methods in mass spectrometry data processing problems A. Mohammad-Djafari, J.-F. Giovannelli,
More informationEddy Current Modelling for Inspection of Riveted Structures in Aeronautics
Eddy Current Modelling for Inspection of Riveted Structures in Aeronautics Séverine Paillard, Grégoire Pichenot, Marc Lambert, Hubert Voillaume To cite this version: Séverine Paillard, Grégoire Pichenot,
More informationAn example of Bayesian reasoning Consider the one-dimensional deconvolution problem with various degrees of prior information.
An example of Bayesian reasoning Consider the one-dimensional deconvolution problem with various degrees of prior information. Model: where g(t) = a(t s)f(s)ds + e(t), a(t) t = (rapidly). The problem,
More informationPatterns of Scalable Bayesian Inference Background (Session 1)
Patterns of Scalable Bayesian Inference Background (Session 1) Jerónimo Arenas-García Universidad Carlos III de Madrid jeronimo.arenas@gmail.com June 14, 2017 1 / 15 Motivation. Bayesian Learning principles
More informationBetter restore the recto side of a document with an estimation of the verso side: Markov model and inference with graph cuts
June 23 rd 2008 Better restore the recto side of a document with an estimation of the verso side: Markov model and inference with graph cuts Christian Wolf Laboratoire d InfoRmatique en Image et Systèmes
More informationCOMPLEX SIGNALS are used in various areas of signal
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 45, NO. 2, FEBRUARY 1997 411 Second-Order Statistics of Complex Signals Bernard Picinbono, Fellow, IEEE, and Pascal Bondon, Member, IEEE Abstract The second-order
More informationImage restoration. An example in astronomy
Image restoration Convex approaches: penalties and constraints An example in astronomy Jean-François Giovannelli Groupe Signal Image Laboratoire de l Intégration du Matériau au Système Univ. Bordeaux CNRS
More informationVariable selection for model-based clustering
Variable selection for model-based clustering Matthieu Marbac (Ensai - Crest) Joint works with: M. Sedki (Univ. Paris-sud) and V. Vandewalle (Univ. Lille 2) The problem Objective: Estimation of a partition
More informationp(d θ ) l(θ ) 1.2 x x x
p(d θ ).2 x 0-7 0.8 x 0-7 0.4 x 0-7 l(θ ) -20-40 -60-80 -00 2 3 4 5 6 7 θ ˆ 2 3 4 5 6 7 θ ˆ 2 3 4 5 6 7 θ θ x FIGURE 3.. The top graph shows several training points in one dimension, known or assumed to
More informationWEAK FORM NONUNIFORM FAST FOURIER TRANSFORM METHOD FOR SOLVING VOLUME INTEGRAL EQUATIONS
Progress In Electromagnetics Research, PIER 89, 275 289, 2009 WEAK FORM NONUNIFORM FAST FOURIER TRANSFORM METHOD FOR SOLING OLUME INTEGRAL EQUATIONS Z. H. Fan, R. S. Chen, H. Chen, and D. Z. Ding Department
More informationConstruction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting
Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting Anne Philippe Laboratoire de Mathématiques Jean Leray Université de Nantes Workshop EDF-INRIA,
More informationInvestigation and Development of Algorithms and Techniques for Microwave Tomography. Puyan Mojabi. Doctor of Philosophy
Investigation and Development of Algorithms and Techniques for Microwave Tomography by Puyan Mojabi A Thesis submitted to the Faculty of Graduate Studies of The University of Manitoba in partial fulfilment
More informationWidely Linear Estimation with Complex Data
Widely Linear Estimation with Complex Data Bernard Picinbono, Pascal Chevalier To cite this version: Bernard Picinbono, Pascal Chevalier. Widely Linear Estimation with Complex Data. IEEE Transactions on
More informationPILCO: A Model-Based and Data-Efficient Approach to Policy Search
PILCO: A Model-Based and Data-Efficient Approach to Policy Search (M.P. Deisenroth and C.E. Rasmussen) CSC2541 November 4, 2016 PILCO Graphical Model PILCO Probabilistic Inference for Learning COntrol
More informationBayesian Image Segmentation Using MRF s Combined with Hierarchical Prior Models
Bayesian Image Segmentation Using MRF s Combined with Hierarchical Prior Models Kohta Aoki 1 and Hiroshi Nagahashi 2 1 Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology
More informationProgress In Electromagnetics Research C, Vol. 24, , 2011
Progress In Electromagnetics Research C, Vol. 24, 173 183, 2011 STUDY OF THE RADIATED POLARIZATIO OF A ATEA ARRAY WITH CIRCULAR GEOMETRY K. Louertani 1, *, R. Guinvarc h 2,. Ribière-Tharaud 3, and M. Hélier
More informationProbabilistic Reasoning in Deep Learning
Probabilistic Reasoning in Deep Learning Dr Konstantina Palla, PhD palla@stats.ox.ac.uk September 2017 Deep Learning Indaba, Johannesburgh Konstantina Palla 1 / 39 OVERVIEW OF THE TALK Basics of Bayesian
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationSTA414/2104. Lecture 11: Gaussian Processes. Department of Statistics
STA414/2104 Lecture 11: Gaussian Processes Department of Statistics www.utstat.utoronto.ca Delivered by Mark Ebden with thanks to Russ Salakhutdinov Outline Gaussian Processes Exam review Course evaluations
More informationImage restoration: edge preserving
Image restoration: edge preserving Convex penalties Jean-François Giovannelli Groupe Signal Image Laboratoire de l Intégration du Matériau au Système Univ. Bordeaux CNRS BINP 1 / 32 Topics Image restoration,
More informationThe Bayesian approach to inverse problems
The Bayesian approach to inverse problems Youssef Marzouk Department of Aeronautics and Astronautics Center for Computational Engineering Massachusetts Institute of Technology ymarz@mit.edu, http://uqgroup.mit.edu
More informationREDUCTION OF ELETROMAGNETIC PERTURBATIONS BY OPTIMIZING THE PRINTED CIRCUIT BOARD
REDUCTION OF ELETROMAGNETIC PERTURBATIONS BY OPTIMIZING THE PRINTED CIRCUIT BOARD J Taki, M Bensetti, D Sadarnac To cite this version: J Taki, M Bensetti, D Sadarnac. REDUCTION OF ELETROMAGNETIC PERTURBATIONS
More informationAuto-Encoding Variational Bayes
Auto-Encoding Variational Bayes Diederik P Kingma, Max Welling June 18, 2018 Diederik P Kingma, Max Welling Auto-Encoding Variational Bayes June 18, 2018 1 / 39 Outline 1 Introduction 2 Variational Lower
More informationIterative regularization of nonlinear ill-posed problems in Banach space
Iterative regularization of nonlinear ill-posed problems in Banach space Barbara Kaltenbacher, University of Klagenfurt joint work with Bernd Hofmann, Technical University of Chemnitz, Frank Schöpfer and
More informationVariational Inference via Stochastic Backpropagation
Variational Inference via Stochastic Backpropagation Kai Fan February 27, 2016 Preliminaries Stochastic Backpropagation Variational Auto-Encoding Related Work Summary Outline Preliminaries Stochastic Backpropagation
More informationg-priors for Linear Regression
Stat60: Bayesian Modeling and Inference Lecture Date: March 15, 010 g-priors for Linear Regression Lecturer: Michael I. Jordan Scribe: Andrew H. Chan 1 Linear regression and g-priors In the last lecture,
More informationIntegrated Non-Factorized Variational Inference
Integrated Non-Factorized Variational Inference Shaobo Han, Xuejun Liao and Lawrence Carin Duke University February 27, 2014 S. Han et al. Integrated Non-Factorized Variational Inference February 27, 2014
More informationProbability and Estimation. Alan Moses
Probability and Estimation Alan Moses Random variables and probability A random variable is like a variable in algebra (e.g., y=e x ), but where at least part of the variability is taken to be stochastic.
More informationEfficient Likelihood-Free Inference
Efficient Likelihood-Free Inference Michael Gutmann http://homepages.inf.ed.ac.uk/mgutmann Institute for Adaptive and Neural Computation School of Informatics, University of Edinburgh 8th November 2017
More informationMCMC Sampling for Bayesian Inference using L1-type Priors
MÜNSTER MCMC Sampling for Bayesian Inference using L1-type Priors (what I do whenever the ill-posedness of EEG/MEG is just not frustrating enough!) AG Imaging Seminar Felix Lucka 26.06.2012 , MÜNSTER Sampling
More informationBayesian Inference and MCMC
Bayesian Inference and MCMC Aryan Arbabi Partly based on MCMC slides from CSC412 Fall 2018 1 / 18 Bayesian Inference - Motivation Consider we have a data set D = {x 1,..., x n }. E.g each x i can be the
More informationProbabilistic & Unsupervised Learning
Probabilistic & Unsupervised Learning Week 2: Latent Variable Models Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc ML/CSML, Dept Computer Science University College
More informationSession 3A4 Microwave Imaging for NDE/NDT Applications
Session 3A4 Microwave Imaging for NDE/NDT Applications Issues and Problems in 3D Microwave Tomography (and Possible Answers) I. Catapano (Istituto per il Rilevamento Elettromagnetico Dell Ambiente IREA-CNR,
More informationIntroduction to Probabilistic Graphical Models: Exercises
Introduction to Probabilistic Graphical Models: Exercises Cédric Archambeau Xerox Research Centre Europe cedric.archambeau@xrce.xerox.com Pascal Bootcamp Marseille, France, July 2010 Exercise 1: basics
More informationIntroduction into Bayesian statistics
Introduction into Bayesian statistics Maxim Kochurov EF MSU November 15, 2016 Maxim Kochurov Introduction into Bayesian statistics EF MSU 1 / 7 Content 1 Framework Notations 2 Difference Bayesians vs Frequentists
More informationStatistical techniques for data analysis in Cosmology
Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction
More informationSimulation of Electromagnetic Fields: The Finite-Difference Time-Domain (FDTD) Method and Its Applications
Simulation of Electromagnetic Fields: The Finite-Difference Time-Domain (FDTD) Method and Its Applications Veysel Demir, Ph.D. demir@ceet.niu.edu Department of Electrical Engineering, Northern Illinois
More informationGraphical Models for Collaborative Filtering
Graphical Models for Collaborative Filtering Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Sequence modeling HMM, Kalman Filter, etc.: Similarity: the same graphical model topology,
More informationSummary STK 4150/9150
STK4150 - Intro 1 Summary STK 4150/9150 Odd Kolbjørnsen May 22 2017 Scope You are expected to know and be able to use basic concepts introduced in the book. You knowledge is expected to be larger than
More informationLecture 9: PGM Learning
13 Oct 2014 Intro. to Stats. Machine Learning COMP SCI 4401/7401 Table of Contents I Learning parameters in MRFs 1 Learning parameters in MRFs Inference and Learning Given parameters (of potentials) and
More informationA 3D Model for Eddy Current Inspection in Aeronautics: Application to Riveted Structures
A 3D Model for Eddy Current Inspection in Aeronautics: Application to Riveted Structures Séverine Paillard, Grégoire Pichenot, Marc Lambert, Hubert Voillaume To cite this version: Séverine Paillard, Grégoire
More informationDensity Estimation. Seungjin Choi
Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/
More informationAlgorithmisches Lernen/Machine Learning
Algorithmisches Lernen/Machine Learning Part 1: Stefan Wermter Introduction Connectionist Learning (e.g. Neural Networks) Decision-Trees, Genetic Algorithms Part 2: Norman Hendrich Support-Vector Machines
More informationThe Metropolis-Hastings Algorithm. June 8, 2012
The Metropolis-Hastings Algorithm June 8, 22 The Plan. Understand what a simulated distribution is 2. Understand why the Metropolis-Hastings algorithm works 3. Learn how to apply the Metropolis-Hastings
More informationParticle MCMC for Bayesian Microwave Control
Particle MCMC for Bayesian Microwave Control P. Minvielle 1, A. Todeschini 2, F. Caron 3, P. Del Moral 4, 1 CEA-CESTA, 33114 Le Barp, France 2 INRIA Bordeaux Sud-Ouest, 351, cours de la Liberation, 33405
More informationElectromagnetic (EM) Waves
Electromagnetic (EM) Waves Short review on calculus vector Outline A. Various formulations of the Maxwell equation: 1. In a vacuum 2. In a vacuum without source charge 3. In a medium 4. In a dielectric
More informationInverse problems and uncertainty quantification in remote sensing
1 / 38 Inverse problems and uncertainty quantification in remote sensing Johanna Tamminen Finnish Meterological Institute johanna.tamminen@fmi.fi ESA Earth Observation Summer School on Earth System Monitoring
More informationLecture 13 Fundamentals of Bayesian Inference
Lecture 13 Fundamentals of Bayesian Inference Dennis Sun Stats 253 August 11, 2014 Outline of Lecture 1 Bayesian Models 2 Modeling Correlations Using Bayes 3 The Universal Algorithm 4 BUGS 5 Wrapping Up
More informationDeblurring Jupiter (sampling in GLIP faster than regularized inversion) Colin Fox Richard A. Norton, J.
Deblurring Jupiter (sampling in GLIP faster than regularized inversion) Colin Fox fox@physics.otago.ac.nz Richard A. Norton, J. Andrés Christen Topics... Backstory (?) Sampling in linear-gaussian hierarchical
More informationExtensions of Bayesian Networks. Outline. Bayesian Network. Reasoning under Uncertainty. Features of Bayesian Networks.
Extensions of Bayesian Networks Outline Ethan Howe, James Lenfestey, Tom Temple Intro to Dynamic Bayesian Nets (Tom Exact inference in DBNs with demo (Ethan Approximate inference and learning (Tom Probabilistic
More informationForward and inverse wave problems:quantum billiards and brain imaging p.1
Forward and inverse wave problems: Quantum billiards and brain imaging Alex Barnett barnett@cims.nyu.edu. Courant Institute Forward and inverse wave problems:quantum billiards and brain imaging p.1 The
More informationLecture 3: Machine learning, classification, and generative models
EE E6820: Speech & Audio Processing & Recognition Lecture 3: Machine learning, classification, and generative models 1 Classification 2 Generative models 3 Gaussian models Michael Mandel
More informationELECTROMAGNETIC SCATTERING BY MIXED CONDUCTING/DIELECTRIC OBJECTS USING HIGHER-ORDER MOM
Progress In Electromagnetics Research, PIER 66, 51 63, 2006 ELECTROMAGNETIC SCATTERING BY MIXED CONDUCTING/DIELECTRIC OBJECTS USING HIGHER-ORDER MOM S. G. Wang, X. P. Guan, D. W. Wang, X. Y. Ma, and Y.
More informationLEAST SQUARES FILTERING ALGORITHM FOR REAC- TIVE NEAR FIELD PROBE CORRECTION
Progress In Electromagnetics Research B, Vol 42, 225 243, 2012 LEAST SQUARES FILTERING ALGORITHM FOR REAC- TIVE NEAR FIELD PROBE CORRECTION M A Moutaouekkil 1, *, A Ziyyat 1, M Serhir 2, and D Picard 2
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 218 Outlines Overview Introduction Linear Algebra Probability Linear Regression 1
More informationIterative Methods for Ill-Posed Problems
Iterative Methods for Ill-Posed Problems Based on joint work with: Serena Morigi Fiorella Sgallari Andriy Shyshkov Salt Lake City, May, 2007 Outline: Inverse and ill-posed problems Tikhonov regularization
More informationProgress In Electromagnetics Research Symposium 2005, Hangzhou, China, August
Progress In Electromagnetics Research Symposium 2005, Hangzhou, China, August 22-26 115 A Noel Technique for Localizing the Scatterer in Inerse Profiling of Two Dimensional Circularly Symmetric Dielectric
More informationMMD GAN 1 Fisher GAN 2
MMD GAN 1 Fisher GAN 1 Chun-Liang Li, Wei-Cheng Chang, Yu Cheng, Yiming Yang, and Barnabás Póczos (CMU, IBM Research) Youssef Mroueh, and Tom Sercu (IBM Research) Presented by Rui-Yi(Roy) Zhang Decemeber
More informationRegularized Regression A Bayesian point of view
Regularized Regression A Bayesian point of view Vincent MICHEL Director : Gilles Celeux Supervisor : Bertrand Thirion Parietal Team, INRIA Saclay Ile-de-France LRI, Université Paris Sud CEA, DSV, I2BM,
More informationOutline. 1 Introduction. 2 Problem and solution. 3 Bayesian tracking model of group debris. 4 Simulation results. 5 Conclusions
Outline 1 Introduction 2 Problem and solution 3 Bayesian tracking model of group debris 4 Simulation results 5 Conclusions Problem The limited capability of the radar can t always satisfy the detection
More informationA FULL WAVE THREE DIMENSIONAL ANALYSIS OF FOREST REMOTE SENSING USING VHF ELECTROMAGNETIC WAVE
Progress In Electromagnetics Research, PIER 38, 311 331, 2002 A FULL WAVE THREE DIMENSIONAL ANALYSIS OF FOREST REMOTE SENSING USING VHF ELECTROMAGNETIC WAVE L. Angot, H. Roussel, andw. Tabbara Département
More informationDynamic System Identification using HDMR-Bayesian Technique
Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in
More informationBayesian Deep Learning
Bayesian Deep Learning Mohammad Emtiyaz Khan AIP (RIKEN), Tokyo http://emtiyaz.github.io emtiyaz.khan@riken.jp June 06, 2018 Mohammad Emtiyaz Khan 2018 1 What will you learn? Why is Bayesian inference
More information! #! % && ( ) ) +++,. # /0 % 1 /21/ 3 && & 44&, &&7 4/ 00
! #! % && ( ) ) +++,. # /0 % 1 /21/ 3 &&4 2 05 6. 4& 44&, &&7 4/ 00 8 IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, VOL. 56, NO. 2, FEBRUARY 2008 345 Moment Method Analysis of an Archimedean Spiral Printed
More informationWavelet Based Image Restoration Using Cross-Band Operators
1 Wavelet Based Image Restoration Using Cross-Band Operators Erez Cohen Electrical Engineering Department Technion - Israel Institute of Technology Supervised by Prof. Israel Cohen 2 Layout Introduction
More informationSpatial Bayesian Nonparametrics for Natural Image Segmentation
Spatial Bayesian Nonparametrics for Natural Image Segmentation Erik Sudderth Brown University Joint work with Michael Jordan University of California Soumya Ghosh Brown University Parsing Visual Scenes
More informationBAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA
BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci
More informationSatellite image deconvolution using complex wavelet packets
Satellite image deconvolution using complex wavelet packets André Jalobeanu, Laure Blanc-Féraud, Josiane Zerubia ARIANA research group INRIA Sophia Antipolis, France CNRS / INRIA / UNSA www.inria.fr/ariana
More informationStatistical inference of the time-varying structure of gene-regulation networks
Statistical inference of the time-varying structure of gene-regulation networks S. Lèbre 1, J. Becq 2, F. Devaux 3, M. Stumpf 4, G. Lelandais 2 1 LSIIT, CNRS UMR 7005, University of Strasbourg, 2 DSIMB,
More information13. Nonlinear least squares
L. Vandenberghe ECE133A (Fall 2018) 13. Nonlinear least squares definition and examples derivatives and optimality condition Gauss Newton method Levenberg Marquardt method 13.1 Nonlinear least squares
More informationVariational inference
Simon Leglaive Télécom ParisTech, CNRS LTCI, Université Paris Saclay November 18, 2016, Télécom ParisTech, Paris, France. Outline Introduction Probabilistic model Problem Log-likelihood decomposition EM
More informationOutline Lecture 2 2(32)
Outline Lecture (3), Lecture Linear Regression and Classification it is our firm belief that an understanding of linear models is essential for understanding nonlinear ones Thomas Schön Division of Automatic
More informationModelling of Specimen Interaction with Ferrite Cored Coils by Coupling Semi-Analytical and Numerical Techniques
Modelling of Specimen Interaction with Ferrite Cored Coils by Coupling Semi-Analytical and Numerical Techniques A. Skarlatos, E. Demaldent, A. Vigneron and C. Reboud 25 th 28 th of June, Bratislava, Slovak
More informationChapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)
HW 1 due today Parameter Estimation Biometrics CSE 190 Lecture 7 Today s lecture was on the blackboard. These slides are an alternative presentation of the material. CSE190, Winter10 CSE190, Winter10 Chapter
More information