Spiral CT Image Reconstruction Using Alternating Minimization Methods

Size: px
Start display at page:

Download "Spiral CT Image Reconstruction Using Alternating Minimization Methods"

Transcription

1 Spiral CT Image Reonsruion Using Alernaing Minimizaion Mehods Shenu Yan Thesis Advisor: Dr. O Sullivan Washingon Universi S. Louis Missouri leroni Ssems & Signals Researh Laboraor Ma 9 24

2 Conen CT inroduion Alernaing Minimizaion mehod Pose searh of high-densi obje Inomplee projeion daa Conlusion and fuure work Ma 9 24

3 CT Developmen Ma 9 24

4 Aenuaion funion µ µ Z µ µ Z Z ρ ρ Z is he aomi number of he maerial or issue Ma 9 24

5 Deeors Daa olleion Y 768 Soure Posiion 48 X Ma 9 24

6 Ma 9 24 Aenuaion Funion and Beer s Law Z µ µ θ p sin os d d p + + θ θ δ µ θ θ p e I I Radon Transform Beer s Law D spae 3D spae θ

7 Sandard reonsruion mehod Cenral slie heorem D FT of projeion daa P ρ θ 2D FT of aenuaion funion j 2πρ osθ + 2 sinθ p θ e d j 2π u + 2u2 Μ u u2 µ 2 e dd2 P ρ θ Μ u u Filered bak projeion 2 µ π 2 P ρ θ ρ e j2πρ dρ dθ Ma 9 24

8 Muli-slie Spiral CT deeor β γ fous Pih: p d S d: he able feed per roaion S: he oal widh of he ollimaed beam q 3 2 η q Advanages VS onvenional CT z Rapid sanning Ma 9 24 Redue Moion Arifas

9 Image and Measuremen Spaes 2-D 3-D Spiral Image Spae X: X X X 2 X X X 2 X 3 Daa Spae Y: Y S D Soure S posiion is speified b fan angle β. Deeor D speified onl b γ. Y S Soure S is speified b β and Pih D Deeor D speified b γ and deeor row inde q. Ma 9 24

10 Poin Spread Funion D D 3 D 2 D 4 z fous F poin spread funion h : average pah of he onebeam hrough he voel D 4 Ma 9 24 indees he image voel 2 3 indees he soure-deeor pair β γ q D D 3 D 2

11 Convenional reonsruion mehod for spiral CT daa Addiional sep: Z-inerpolaion Reonsru he images in 2D plane Cause he sair-sep arifas Nonlinear effes Ma 9 24

12 Conen CT inroduion Alernaing Minimizaion mehod Pose searh of high-densi obje Inomplee projeion daa Conlusion and fuure Work Ma 9 24

13 Referenes J. A. Fessler. Saisial image reonsruion mehods for ransmission omograph. In Handbook of Medial Imaging Volume 2. Medial Image Proessing and Analsis h. 5 SPI 2. J. A. O Sullivan and J. Bena. Alernaing minimizaion algorihms for ransmission omograph. Submied o I Trans. Med. Imaging. Ma 9 24

14 Model for Transmission CT Soure I I Obje µ Deeor g : nergies ranging from 9-2 kev I : Mean number of soure phoons µ: Aenuaion funion; he image we are ring o esimae Ma 9 24 g I ep h µ +σ

15 Ma 9 24 Opimizaion Problem: min Id g Two families: Ε h I q q ep : : µ : d p p d L AM Algorihm g q : : Saisial Model { } [ ] Y d g g d d l! ln : : ln : Y g d g d d g d I : : ln : Rewrie problem min min min q p I g d I d L p q 5

16 Ma 9 24 AM Algorihm X k k h I q ˆ ep : ˆ µ X k h I ˆ ep µ + ' ': ˆ : ˆ : ˆ k k k q d q p σ Y k k p h b : ˆ ~ µ Y k k q h b : ˆ ˆ µ Ieraive updae of he esimae ˆ ~ ln ˆ ˆ b b Z k k k k + where X Z h µ

17 perimens for Spiral CT Image spae: mm Projeion daa spae per roaion: 58 soure 68 deeor Deeor row number: 8 Collimaionslie widh:.75 mm Pih: 2 Travel of able per san roaion: 2 mm Roaion number: 2 PMMA Clinder wih Low-densi Objes - PMMA:.229/mm 2- Nlon:.295/mm 3- Teflon:.423/mm Viewing window size [.6.2] Telflon PMMA Ma 9 24 Nlon

18 Reonsrued Resuls from Low-densi noiseless Snhei daa afer AM 2 8 OS Ieraions 5h 6h 9h 2h 7h 8h 2h 22h Ma 9 24

19 Reonsrued Resuls from Low-densi Real daa afer AM 5 Ieraions 5h 6h 7h Ma h 9h 2h Too oarse sampling inerval and high pih value Voel sphere no real sphere in snhei daa

20 Reonsrued Resuls from High-densi noiseless Snhei daa afer AM 8/5 8 OS Ieraions 7h 8h 7h 8h 9h 2h 9h 2h Ma 9 24

21 Conen CT inroduion Alernaing Minimizaion mehod Pose searh of high-densi obje Inomplee projeion daa Conlusion and fuure work Ma 9 24

22 Referenes D. L. Snder J. A. O Sullivan R. J. Murph e al. Deblurring subje o nonnegaivi onsrains when known funions are presen wih appliaion o objeonsrained ompuerized omograph. I Trans. Med. Imaging 2: 9-7 O. 2. Ma 9 24

23 Inorporaing Prior Knowledge Prior Knowledge Assumpion: Aenuaion oeffiiens/geomer are known a pose posiion and orienaion is known One rigid obje individual pars are fied Appliaion amples Hip prosheses Brahherap appliaors Denal fillings Prosae seeds e. Ma 9 24

24 Orale Tes for 3D Snhei Daa wih High-densi Objes Orale mehod: A eah ieraion use AM algorihm o solve for he image hen subsiue in he known voel values. AM 8 Ieraion 8 OS AM Orale 8 8 OS Ma 9 24

25 AM wih Pose Searh Define rue piel value: a known :θ+ -a unknown ; a :θ + b Rederive algorihm wih onsrain: * a Soluion: AM ˆ k Z ln ~ b bˆ k k For some θ : ˆ k + : θ ma [ : θ ] AM a Searh he opimal θ whih resuls in he bes image Ma 9 24 θ arg min θ S2 I [ ˆ : ] k + d g θ

26 Mahemaial Desripion of he Pose 2-dimensional Case Roae & Translae θ 2 ϕ 2 R SO 2 ϖ ~ T {} T { R} ϖ ϖ R + where os ϕ : R sin ϕ ϖ T 2 ϖ R θ V 3 3 mari sin ϕ os ϕ Two onseuive operaions: Ma 9 24 { B} T{ a} T{ A} T{ b} T ϖ B A + a + b ϖ BA + Ba + b B b A a BA Ba + b

27 Ma 9 24 Calulae he gradiens of he pose parameers in S2 spae Searh direion Gradien Searh Mehod os sin sin os e R ϕ ϕ ϕ ϕ ϕ where h F h F F f i i h i i lim + ε ε ϕ ε ϕ ε ε ε R e F e F R F F f + lim Re lim 2 R R f f f f f F θ

28 Ma 9 24 Sele he sep size for eah parameer wrien in mari S Gradien Searh Mehod Coninued R R S S S S S S 2 Ge he hange for pose T f S f S e R R θ Updae he new pose new θ old θ θ old old T f S new new R f S e R R R

29 Pose Searh Resuls Ma 9 24

30 AMPS Resuls True Phanom FBP AM 2 22 OS SYN Ma 9 24 AMPS 2 22 OS SYN AMPS 2 22 OS RAL

31 Conen CT inroduion Alernaing Minimizaion mehod Pose searh of high-densi obje Inomplee projeion daa Conlusion and fuure work Ma 9 24

32 Mask for high-densi obje Ma 9 24 AMPS 2 22 OS RAL AM 2 22 OS Inomplee daa RAL

33 Sanned obje ouside he sanner FOV FBP AM 5 22 OS Ma 9 24

34 Sanned obje ouside of FOV Ma 9 24 FBP AM 5 22 OS

35 Conen CT inroduion Alernaing Minimizaion mehod Pose searh of high-densi obje Inomplee projeion daa Conlusion and fuure work Ma 9 24

36 Conlusion and fuure work Avoid he inerpolaion sep when reonsruing he image from spiral CT daa Grea improvemen in onvergene rae when he AM algorihm inlude prior informaion pose searh in hree-dimensional image reonsruion More real daa eperimens for spiral CT Ma 9 24

37 Ma 9 24 Thank You!

Optimal Transform: The Karhunen-Loeve Transform (KLT)

Optimal Transform: The Karhunen-Loeve Transform (KLT) Opimal ransform: he Karhunen-Loeve ransform (KL) Reall: We are ineresed in uniary ransforms beause of heir nie properies: energy onservaion, energy ompaion, deorrelaion oivaion: τ (D ransform; assume separable)

More information

Optimal Dynamic Pricing Strategies for High Occupancy/Toll (HOT) Lanes

Optimal Dynamic Pricing Strategies for High Occupancy/Toll (HOT) Lanes Opimal Dynami Priing Sraegies for High Oupany/oll HO Lanes Yingyan Lou, Yafeng Yin and Jorge A. Laval Deparmen of Civil and Coasal Engineering, Universiy of Florida Shool of Civil and Environmenal Engineering,

More information

Lawrence Livermore National Laboratory. 1 LLNL-PRES-xxxxxx

Lawrence Livermore National Laboratory. 1 LLNL-PRES-xxxxxx Lawrene Livermore Naional Laboraor 1 LLNL-PRES- RTE as a TSO makes deisions using ools based on modeling of he power ssem simulaion and opimizaion. Reliabili rieria N-1 => Wha if analsis Requiremens: full

More information

An Inventory Model for Weibull Time-Dependence. Demand Rate with Completely Backlogged. Shortages

An Inventory Model for Weibull Time-Dependence. Demand Rate with Completely Backlogged. Shortages Inernaional Mahemaial Forum, 5, 00, no. 5, 675-687 An Invenory Model for Weibull Time-Dependene Demand Rae wih Compleely Baklogged Shorages C. K. Tripahy and U. Mishra Deparmen of Saisis, Sambalpur Universiy

More information

The Role of Pitch Filter in Pulse-by-Pulse Reoptimization of the LP Synthesis Filter. Allam Mousa

The Role of Pitch Filter in Pulse-by-Pulse Reoptimization of the LP Synthesis Filter. Allam Mousa An-Najah Univ. J. Res. (N. S), Vol. 6 (2), 2002 The Role of Pih Filer in Pulse-by-Pulse Reopimizaion of he LP Synhesis Filer Allam Mousa Deparmen of Elerial Enineerin, An-Najah Naional Universiy, Nablus,

More information

CoE4TN3 Image Processing

CoE4TN3 Image Processing CoE4T3 Imae Processin Imae Reisraion Imae Reisraion Throuh Transform A B f Imae reisraion provides ransformaion of a source imae space o he are imae space. The are imae ma be of differen modaliies from

More information

The Special Theory of Relativity Chapter II

The Special Theory of Relativity Chapter II The Speial Theory of Relaiiy Chaper II 1. Relaiisi Kinemais. Time dilaion and spae rael 3. Lengh onraion 4. Lorenz ransformaions 5. Paradoes? Simulaneiy/Relaiiy If one obserer sees he eens as simulaneous,

More information

Theory of! Partial Differential Equations-I!

Theory of! Partial Differential Equations-I! hp://users.wpi.edu/~grear/me61.hml! Ouline! Theory o! Parial Dierenial Equaions-I! Gréar Tryggvason! Spring 010! Basic Properies o PDE!! Quasi-linear Firs Order Equaions! - Characerisics! - Linear and

More information

Theory of! Partial Differential Equations!

Theory of! Partial Differential Equations! hp://www.nd.edu/~gryggva/cfd-course/! Ouline! Theory o! Parial Dierenial Equaions! Gréar Tryggvason! Spring 011! Basic Properies o PDE!! Quasi-linear Firs Order Equaions! - Characerisics! - Linear and

More information

Differential Equations

Differential Equations Mah 21 (Fall 29) Differenial Equaions Soluion #3 1. Find he paricular soluion of he following differenial equaion by variaion of parameer (a) y + y = csc (b) 2 y + y y = ln, > Soluion: (a) The corresponding

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

The Special Theory of Relativity

The Special Theory of Relativity The Speial Theor of Relaii The Speial Theor of Relaii Chaper I. Conradiions in phsis?. Galilean Transformaions of lassial mehanis 3. The effe on Mawell s equaions ligh 4. Mihelson-Morle eperimen 5. insein

More information

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,

More information

The Rosenblatt s LMS algorithm for Perceptron (1958) is built around a linear neuron (a neuron with a linear

The Rosenblatt s LMS algorithm for Perceptron (1958) is built around a linear neuron (a neuron with a linear In The name of God Lecure4: Percepron and AALIE r. Majid MjidGhoshunih Inroducion The Rosenbla s LMS algorihm for Percepron 958 is buil around a linear neuron a neuron ih a linear acivaion funcion. Hoever,

More information

Kalman filtering for maximum likelihood estimation given corrupted observations.

Kalman filtering for maximum likelihood estimation given corrupted observations. alman filering maimum likelihood esimaion given corruped observaions... Holmes Naional Marine isheries Service Inroducion he alman filer is used o eend likelihood esimaion o cases wih hidden saes such

More information

Dimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2

Dimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2 Daa-driven modelling. Par. Daa-driven Arificial di Neural modelling. Newors Par Dimiri Solomaine Arificial neural newors D.P. Solomaine. Daa-driven modelling par. 1 Arificial neural newors ANN: main pes

More information

Probabilistic Robotics

Probabilistic Robotics Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae

More information

κt π = (5) T surrface k BASELINE CASE

κt π = (5) T surrface k BASELINE CASE II. BASELINE CASE PRACICAL CONSIDERAIONS FOR HERMAL SRESSES INDUCED BY SURFACE HEAING James P. Blanhard Universi of Wisonsin Madison 15 Engineering Dr. Madison, WI 5376-169 68-63-391 blanhard@engr.is.edu

More information

Teacher Quality Policy When Supply Matters: Online Appendix

Teacher Quality Policy When Supply Matters: Online Appendix Teaher Qualiy Poliy When Supply Maers: Online Appendix Jesse Rohsein July 24, 24 A Searh model Eah eaher draws a single ouside job offer eah year. If she aeps he offer, she exis eahing forever. The ouside

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

PHYS-3301 Lecture 5. Chapter 2. Announcement. Sep. 12, Special Relativity. What about y and z coordinates? (x - direction of motion)

PHYS-3301 Lecture 5. Chapter 2. Announcement. Sep. 12, Special Relativity. What about y and z coordinates? (x - direction of motion) Announemen Course webpage hp://www.phys.u.edu/~slee/33/ Tebook PHYS-33 Leure 5 HW (due 9/4) Chaper, 6, 36, 4, 45, 5, 5, 55, 58 Sep., 7 Chaper Speial Relaiiy. Basi Ideas. Consequenes of Einsein s Posulaes

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Primal-Dual Splitting: Recent Improvements and Variants

Primal-Dual Splitting: Recent Improvements and Variants Primal-Dual Spliing: Recen Improvemens and Varians 1 Thomas Pock and 2 Anonin Chambolle 1 Insiue for Compuer Graphics and Vision, TU Graz, Ausria 2 CMAP & CNRS École Polyechnique, France The proximal poin

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

Estimation of Poses with Particle Filters

Estimation of Poses with Particle Filters Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU

More information

This is an example to show you how SMath can calculate the movement of kinematic mechanisms.

This is an example to show you how SMath can calculate the movement of kinematic mechanisms. Dec :5:6 - Kinemaics model of Simple Arm.sm This file is provided for educaional purposes as guidance for he use of he sofware ool. I is no guaraeed o be free from errors or ommissions. The mehods and

More information

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018 MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Lecture 9: September 25

Lecture 9: September 25 0-725: Opimizaion Fall 202 Lecure 9: Sepember 25 Lecurer: Geoff Gordon/Ryan Tibshirani Scribes: Xuezhi Wang, Subhodeep Moira, Abhimanu Kumar Noe: LaTeX emplae couresy of UC Berkeley EECS dep. Disclaimer:

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

PULSE-STREAM MODELS IN TIME-OF-FLIGHT IMAGING

PULSE-STREAM MODELS IN TIME-OF-FLIGHT IMAGING PULSE-STREAM MODELS IN TIME-OF-FLIGHT IMAGING Adrien Besson, Dimiris Perdios, Yves Wiaux, Jean-Philippe Thiran, Signal Proessing Laboraory LTS5), Eole Polyehnique Fédérale de Lausanne, Swizerland Insiue

More information

Lecture 10 - Model Identification

Lecture 10 - Model Identification Lecure - odel Idenificaion Wha is ssem idenificaion? Direc impulse response idenificaion Linear regression Regularizaion Parameric model ID nonlinear LS Conrol Engineering - Wha is Ssem Idenificaion? Experimen

More information

Introduction to Mobile Robotics

Introduction to Mobile Robotics Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel

More information

Data Fusion using Kalman Filter. Ioannis Rekleitis

Data Fusion using Kalman Filter. Ioannis Rekleitis Daa Fusion using Kalman Filer Ioannis Rekleiis Eample of a arameerized Baesian Filer: Kalman Filer Kalman filers (KF represen poserior belief b a Gaussian (normal disribuion A -d Gaussian disribuion is

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

12 TH STD - MATHEMATICS

12 TH STD - MATHEMATICS e e e e e e e e e e a TH STD - MATHEMATICS HALF YEARLY EXAMINATION 7 b) d) ANSWER KEY (8 - - 7) ONE MARK QUESTIONS : X k n ( a d j I ) d) no soluion 5 d) d) has onl rivial soluion onl if rank of he oeffiien

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

Ecological Archives E A1. Meghan A. Duffy, Spencer R. Hall, Carla E. Cáceres, and Anthony R. Ives.

Ecological Archives E A1. Meghan A. Duffy, Spencer R. Hall, Carla E. Cáceres, and Anthony R. Ives. Ecological Archives E9-95-A1 Meghan A. Duffy, pencer R. Hall, Carla E. Cáceres, and Anhony R. ves. 29. Rapid evoluion, seasonaliy, and he erminaion of parasie epidemics. Ecology 9:1441 1448. Appendix A.

More information

Polarization Quadrature Interferometer

Polarization Quadrature Interferometer Laboraor for dapive Opics Rev 1: 5/11/04 UCO Lic Observaor Rev : 9/1/04 Polarizaion Quadraure nerferomeer Donald Gavel, UCSC Laboraor for dapive Opics This memo describes a Mach-Zehnder inerferomeer seup

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

Anti-Disturbance Control for Multiple Disturbances

Anti-Disturbance Control for Multiple Disturbances Workshop a 3 ACC Ani-Disurbance Conrol for Muliple Disurbances Lei Guo (lguo@buaa.edu.cn) Naional Key Laboraory on Science and Technology on Aircraf Conrol, Beihang Universiy, Beijing, 9, P.R. China. Presened

More information

Supplement for Stochastic Convex Optimization: Faster Local Growth Implies Faster Global Convergence

Supplement for Stochastic Convex Optimization: Faster Local Growth Implies Faster Global Convergence Supplemen for Sochasic Convex Opimizaion: Faser Local Growh Implies Faser Global Convergence Yi Xu Qihang Lin ianbao Yang Proof of heorem heorem Suppose Assumpion holds and F (w) obeys he LGC (6) Given

More information

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*) Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

Development of Sound Source Localization System using Explicit Adaptive Time Delay Estimation

Development of Sound Source Localization System using Explicit Adaptive Time Delay Estimation ICCAS Ocober 6-9, Muju Resor, Jeonbuk, Korea Developmen of Sound Source Localizaion Sysem using Explici Adapive Time Delay Esimaion Doh-Hyoung Kim and Yongjin Park Deparmen of Mechanical Engineering, KAIST,

More information

Linear Gaussian State Space Models

Linear Gaussian State Space Models Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying

More information

A Bayesian Approach to Spectral Analysis

A Bayesian Approach to Spectral Analysis Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2

More information

Mathematical Foundations -1- Choice over Time. Choice over time. A. The model 2. B. Analysis of period 1 and period 2 3

Mathematical Foundations -1- Choice over Time. Choice over time. A. The model 2. B. Analysis of period 1 and period 2 3 Mahemaial Foundaions -- Choie over Time Choie over ime A. The model B. Analysis of period and period 3 C. Analysis of period and period + 6 D. The wealh equaion 0 E. The soluion for large T 5 F. Fuure

More information

MA Study Guide #1

MA Study Guide #1 MA 66 Su Guide #1 (1) Special Tpes of Firs Order Equaions I. Firs Order Linear Equaion (FOL): + p() = g() Soluion : = 1 µ() [ ] µ()g() + C, where µ() = e p() II. Separable Equaion (SEP): dx = h(x) g()

More information

3 at MAC 1140 TEST 3 NOTES. 5.1 and 5.2. Exponential Functions. Form I: P is the y-intercept. (0, P) When a > 1: a = growth factor = 1 + growth rate

3 at MAC 1140 TEST 3 NOTES. 5.1 and 5.2. Exponential Functions. Form I: P is the y-intercept. (0, P) When a > 1: a = growth factor = 1 + growth rate 1 5.1 and 5. Eponenial Funcions Form I: Y Pa, a 1, a > 0 P is he y-inercep. (0, P) When a > 1: a = growh facor = 1 + growh rae The equaion can be wrien as The larger a is, he seeper he graph is. Y P( 1

More information

Applications in Industry (Extended) Kalman Filter. Week Date Lecture Title

Applications in Industry (Extended) Kalman Filter. Week Date Lecture Title hp://elec34.com Applicaions in Indusry (Eended) Kalman Filer 26 School of Informaion echnology and Elecrical Engineering a he Universiy of Queensland Lecure Schedule: Week Dae Lecure ile 29-Feb Inroducion

More information

Ordinary dierential equations

Ordinary dierential equations Chaper 5 Ordinary dierenial equaions Conens 5.1 Iniial value problem........................... 31 5. Forward Euler's mehod......................... 3 5.3 Runge-Kua mehods.......................... 36

More information

( ) 2. Review Exercise 2. cos θ 2 3 = = 2 tan. cos. 2 x = = x a. Since π π, = 2. sin = = 2+ = = cotx. 2 sin θ 2+

( ) 2. Review Exercise 2. cos θ 2 3 = = 2 tan. cos. 2 x = = x a. Since π π, = 2. sin = = 2+ = = cotx. 2 sin θ 2+ Review Eercise sin 5 cos sin an cos 5 5 an 5 9 co 0 a sinθ 6 + 4 6 + sin θ 4 6+ + 6 + 4 cos θ sin θ + 4 4 sin θ + an θ cos θ ( ) + + + + Since π π, < θ < anθ should be negaive. anθ ( + ) Pearson Educaion

More information

An EM algorithm for maximum likelihood estimation given corrupted observations. E. E. Holmes, National Marine Fisheries Service

An EM algorithm for maximum likelihood estimation given corrupted observations. E. E. Holmes, National Marine Fisheries Service An M algorihm maimum likelihood esimaion given corruped observaions... Holmes Naional Marine Fisheries Service Inroducion M algorihms e likelihood esimaion o cases wih hidden saes such as when observaions

More information

a. Show that these lines intersect by finding the point of intersection. b. Find an equation for the plane containing these lines.

a. Show that these lines intersect by finding the point of intersection. b. Find an equation for the plane containing these lines. Mah A Final Eam Problems for onsideraion. Show all work for credi. Be sure o show wha you know. Given poins A(,,, B(,,, (,, 4 and (,,, find he volume of he parallelepiped wih adjacen edges AB, A, and A.

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Let us start with a two dimensional case. We consider a vector ( x,

Let us start with a two dimensional case. We consider a vector ( x, Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our

More information

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms

More information

2016 Possible Examination Questions. Robotics CSCE 574

2016 Possible Examination Questions. Robotics CSCE 574 206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he

More information

Dynamic System In Biology

Dynamic System In Biology Compuaional Siene and Engineering Dnami Ssem In Biolog Yang Cao Deparmen of Compuer Siene hp://ourses.s.v.edu/~s644 Ouline Compuaional Siene and Engineering Single Speies opulaion Model Malhus Model Logisi

More information

Air Traffic Forecast Empirical Research Based on the MCMC Method

Air Traffic Forecast Empirical Research Based on the MCMC Method Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,

More information

Generalized electromagnetic energy-momentum tensor and scalar curvature of space at the location of charged particle

Generalized electromagnetic energy-momentum tensor and scalar curvature of space at the location of charged particle Generalized eleromagnei energy-momenum ensor and salar urvaure of spae a he loaion of harged parile A.L. Kholmeskii 1, O.V. Missevih and T. Yarman 3 1 Belarus Sae Universiy, Nezavisimosi Avenue, 0030 Minsk,

More information

Then. 1 The eigenvalues of A are inside R = n i=1 R i. 2 Union of any k circles not intersecting the other (n k)

Then. 1 The eigenvalues of A are inside R = n i=1 R i. 2 Union of any k circles not intersecting the other (n k) Ger sgorin Circle Chaper 9 Approimaing Eigenvalues Per-Olof Persson persson@berkeley.edu Deparmen of Mahemaics Universiy of California, Berkeley Mah 128B Numerical Analysis (Ger sgorin Circle) Le A be

More information

The Contradiction within Equations of Motion with Constant Acceleration

The Contradiction within Equations of Motion with Constant Acceleration The Conradicion wihin Equaions of Moion wih Consan Acceleraion Louai Hassan Elzein Basheir (Daed: July 7, 0 This paper is prepared o demonsrae he violaion of rules of mahemaics in he algebraic derivaion

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

Network Newton Distributed Optimization Methods

Network Newton Distributed Optimization Methods Nework Newon Disribued Opimizaion Mehods Aryan Mokhari, Qing Ling, and Alejandro Ribeiro Absrac We sudy he problem of minimizing a sum of convex objecive funcions where he componens of he objecive are

More information

Mean Square Projection Error Gradient-based Variable Forgetting Factor FAPI

Mean Square Projection Error Gradient-based Variable Forgetting Factor FAPI 3rd Inernaional Conference on Advances in Elecrical and Elecronics Engineering (ICAEE'4) Feb. -, 4 Singapore Mean Square Projecion Error Gradien-based Variable Forgeing Facor FAPI Young-Kwang Seo, Jong-Woo

More information

Review - Quiz # 1. 1 g(y) dy = f(x) dx. y x. = u, so that y = xu and dy. dx (Sometimes you may want to use the substitution x y

Review - Quiz # 1. 1 g(y) dy = f(x) dx. y x. = u, so that y = xu and dy. dx (Sometimes you may want to use the substitution x y Review - Quiz # 1 (1) Solving Special Tpes of Firs Order Equaions I. Separable Equaions (SE). d = f() g() Mehod of Soluion : 1 g() d = f() (The soluions ma be given implicil b he above formula. Remember,

More information

A HILL-CLIMBING COMBINATORIAL ALGORITHM FOR CONSTRUCTING N-POINT D-OPTIMAL EXACT DESIGNS

A HILL-CLIMBING COMBINATORIAL ALGORITHM FOR CONSTRUCTING N-POINT D-OPTIMAL EXACT DESIGNS J. Sa. Appl. Pro., o., 33-46 33 Journal of Saisis Appliaions & Probabiliy An Inernaional Journal @ SP aural Sienes Publishing Cor. A HILL-CLIMBIG COMBIATORIAL ALGORITHM FOR COSTRUCTIG -POIT D-OPTIMAL EXACT

More information

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should Cambridge Universiy Press 978--36-60033-7 Cambridge Inernaional AS and A Level Mahemaics: Mechanics Coursebook Excerp More Informaion Chaper The moion of projeciles In his chaper he model of free moion

More information

ELE 538B: Large-Scale Optimization for Data Science. Quasi-Newton methods. Yuxin Chen Princeton University, Spring 2018

ELE 538B: Large-Scale Optimization for Data Science. Quasi-Newton methods. Yuxin Chen Princeton University, Spring 2018 ELE 538B: Large-Scale Opimizaion for Daa Science Quasi-Newon mehods Yuxin Chen Princeon Universiy, Spring 208 00 op ff(x (x)(k)) f p 2 L µ f 05 k f (xk ) k f (xk ) =) f op ieraions converges in only 5

More information

The RTD Measurement on a Submerged Bio-Reactor using a Radioisotope Tracer and the RTD Analysis

The RTD Measurement on a Submerged Bio-Reactor using a Radioisotope Tracer and the RTD Analysis 1 Inernaional Journal of Conrol, Auomaion, and Sysems Vol. 1, No. No., June 3 he RD Measuremen on a Submerged Bio-Reaor using a Radioisoope raer and he RD Analysis Seungkwon Shin, Jongbum Kim, Sunghee

More information

Understanding the asymptotic behaviour of empirical Bayes methods

Understanding the asymptotic behaviour of empirical Bayes methods Undersanding he asympoic behaviour of empirical Bayes mehods Boond Szabo, Aad van der Vaar and Harry van Zanen EURANDOM, 11.10.2011. Conens 2/20 Moivaion Nonparameric Bayesian saisics Signal in Whie noise

More information

KEY. Math 334 Midterm I Fall 2008 sections 001 and 003 Instructor: Scott Glasgow

KEY. Math 334 Midterm I Fall 2008 sections 001 and 003 Instructor: Scott Glasgow 1 KEY Mah 4 Miderm I Fall 8 secions 1 and Insrucor: Sco Glasgow Please do NOT wrie on his eam. No credi will be given for such work. Raher wrie in a blue book, or on our own paper, preferabl engineering

More information

CS376 Computer Vision Lecture 6: Optical Flow

CS376 Computer Vision Lecture 6: Optical Flow CS376 Compuer Vision Lecure 6: Opical Flow Qiing Huang Feb. 11 h 2019 Slides Credi: Krisen Grauman and Sebasian Thrun, Michael Black, Marc Pollefeys Opical Flow mage racking 3D compuaion mage sequence

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

TRANSMISSION LINES AND WAVEGUIDES. Uniformity along the Direction of Propagation

TRANSMISSION LINES AND WAVEGUIDES. Uniformity along the Direction of Propagation TRANSMISSION LINES AND WAVEGUIDES Uniformi along he Direion of Propagaion Definiion: Transmission Line TL is he erm o desribe ransmission ssems wih wo or more mealli onduors eleriall insulaed from eah

More information

Probabilistic Robotics SLAM

Probabilistic Robotics SLAM Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map

More information

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19 Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible

More information

ME 391 Mechanical Engineering Analysis

ME 391 Mechanical Engineering Analysis Fall 04 ME 39 Mechanical Engineering Analsis Eam # Soluions Direcions: Open noes (including course web posings). No books, compuers, or phones. An calculaor is fair game. Problem Deermine he posiion of

More information

Has the Business Cycle Changed? Evidence and Explanations. Appendix

Has the Business Cycle Changed? Evidence and Explanations. Appendix Has he Business Ccle Changed? Evidence and Explanaions Appendix Augus 2003 James H. Sock Deparmen of Economics, Harvard Universi and he Naional Bureau of Economic Research and Mark W. Wason* Woodrow Wilson

More information

mywbut.com Lesson 11 Study of DC transients in R-L-C Circuits

mywbut.com Lesson 11 Study of DC transients in R-L-C Circuits mywbu.om esson Sudy of DC ransiens in R--C Ciruis mywbu.om Objeives Be able o wrie differenial equaion for a d iruis onaining wo sorage elemens in presene of a resisane. To develop a horough undersanding

More information

Tom Heskes and Onno Zoeter. Presented by Mark Buller

Tom Heskes and Onno Zoeter. Presented by Mark Buller Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004 Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure

More information

Solutions for Assignment 2

Solutions for Assignment 2 Faculy of rs and Science Universiy of Torono CSC 358 - Inroducion o Compuer Neworks, Winer 218 Soluions for ssignmen 2 Quesion 1 (2 Poins): Go-ack n RQ In his quesion, we review how Go-ack n RQ can be

More information

Scheduling of Crude Oil Movements at Refinery Front-end

Scheduling of Crude Oil Movements at Refinery Front-end Scheduling of Crude Oil Movemens a Refinery Fron-end Ramkumar Karuppiah and Ignacio Grossmann Carnegie Mellon Universiy ExxonMobil Case Sudy: Dr. Kevin Furman Enerprise-wide Opimizaion Projec March 15,

More information

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2 Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary

More information

Idealize Bioreactor CSTR vs. PFR... 3 Analysis of a simple continuous stirred tank bioreactor... 4 Residence time distribution... 4 F curve:...

Idealize Bioreactor CSTR vs. PFR... 3 Analysis of a simple continuous stirred tank bioreactor... 4 Residence time distribution... 4 F curve:... Idealize Bioreaor CSTR vs. PFR... 3 Analysis of a simple oninuous sirred ank bioreaor... 4 Residene ime disribuion... 4 F urve:... 4 C urve:... 4 Residene ime disribuion or age disribuion... 4 Residene

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec

More information

Probabilistic Robotics SLAM

Probabilistic Robotics SLAM Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map

More information

Linear Quadratic Regulator (LQR) - State Feedback Design

Linear Quadratic Regulator (LQR) - State Feedback Design Linear Quadrai Regulaor (LQR) - Sae Feedbak Design A sysem is expressed in sae variable form as x = Ax + Bu n m wih x( ) R, u( ) R and he iniial ondiion x() = x A he sabilizaion problem using sae variable

More information

Chapter 1 Relativity

Chapter 1 Relativity Chaper Relaii - Posulaes of Speial Relaii and Loren Transformaion The s posulae: The laws of phsis ma be epressed in equaions haing he same form in all frames of referene moing a onsan eloi wih respe o

More information

B Signals and Systems I Solutions to Midterm Test 2. xt ()

B Signals and Systems I Solutions to Midterm Test 2. xt () 34-33B Signals and Sysems I Soluions o Miderm es 34-33B Signals and Sysems I Soluions o Miderm es ednesday Marh 7, 7:PM-9:PM Examiner: Prof. Benoi Boule Deparmen of Elerial and Compuer Engineering MGill

More information

Kinematics and kinematic functions

Kinematics and kinematic functions Kinemaics and kinemaic funcions Kinemaics deals wih he sudy of four funcions (called kinemaic funcions or KFs) ha mahemaically ransform join variables ino caresian variables and vice versa Direc Posiion

More information

Three Dimensional Coordinate Geometry

Three Dimensional Coordinate Geometry HKCWCC dvned evel Pure Mhs. / -D Co-Geomer Three Dimensionl Coordine Geomer. Coordine of Poin in Spe Z XOX, YOY nd ZOZ re he oordine-es. P,, is poin on he oordine plne nd is lled ordered riple. P,, X Y

More information