Tutorial on Image Reconstruction Based on Weighted Sum (WS) Filter Approach: From Single Image to Multi-Frame Image

Size: px
Start display at page:

Download "Tutorial on Image Reconstruction Based on Weighted Sum (WS) Filter Approach: From Single Image to Multi-Frame Image"

Transcription

1 AU J.. 3(): (Oct. 009) utoral on Image Reconstructon Based on Weghted Sum (WS) Flter Approach: From Sngle Image to ult-frame Image Vorapoj Patanavjt Department of Computer and Network Engneerng, Faculty of Engneerng Assumpton Unversty, Bangkok, haland E-mal: Abstract For large magnfcaton factors, the pror classcal smoothness leads to overly smooth results wth very lttle hgh-frequency content. he classcal mage restoratons are falng to reconstruct the desred mage. Consequently, the Recognton-Based Restoraton s desred for these purposes and one of the most effectve technques s of a weghted sum (WS) flter. hs paper revews the research framework of weghted sum (WS) flter approach for mage reconstructon. hs research framework frst starts wth the Hard-Partton-based Weghted Sum (HP-WS) flter proposed n 999 and then consequently revews the Subspace HP-WS (S-HPWS) usng PCA (Prncpal Component Analyss) Flter proposed n 005, he Soft-Partton-based Weghted Sum (SP-WS) proposed n 006, and the fast Adaptve Wener Flter proposed n 007. he paper revews each flter technque n terms of ts computatonal concepts, demonstrates parameter optmzaton from the pont of vew of the mathematcal analyss, and dscusses advantages and dsadvantages. Keywords: Dgtal mage processng, dgtal mage reconstructon, weghted sum (WS) flter, super resoluton reconstructon (SRR).. Introducton ypcally, dgtal mages are nvarably degraded by many phenomena that lmt mage resoluton and utlty durng acquston (Harde 007). Consequently, there are many tradeoffs to be consdered durng desgnng an magng system for mage acquston (Narayanan et al. 007). For hgh spatal bandwdth, a focal plane array (FPA) wth suffcently small detector spacng s requred to sample the scene at the Nyqust rate. (Narayanan et al. 007). However, fabrcaton complextes and correspondng cost may be the lmtng factor (Narayanan et al. 007). For these reasons, many magng systems produce mages sufferng from alasng artfacts resultng from undersamplng (Narayanan et al. 007). he lnear flters are notorous for ntroducng blur when appled to nonstatonary sgnals (such as edge nformaton) n an attempt to reduce the nose. (Barner et al. 999) However, the nonlnear flters tradtonally offer lttle or no mprovement over lnear flters n the case of Gaussan nose (Barner et al. 999). he Weghted Sum flter approach dea s based on parttonng the observaton mage usng vector quantzaton (VQ) and then approprate weghtng coeffcents are appled to each parttoned mage. hs secton roughly revews the Weghted Sum flter approach. Barner et al. (999) proposed the sngle mage restoraton algorthm usng Hard-Partton-based Weghted Sum (HP-WS) flter. he observed mage s parttoned nto several blocks and each block s quantzed n order to select the most proper flter coeffcent for that block to acheve restoraton. he weghts are turned by tranng on a representatve mage and the two-state suboptmal tranng s proposed to determne optmzng weghts. Alam et al. (000) proposed the SRR algorthm for the nfrared mages. he gradent-based regstraton s used for each observed R mage and a weghted nearest-neghbor approach s used for placng Revew Artcle 75

2 AU J.. 3(): (Oct. 009) the frame onto a unform grd to form a hghresoluton mage. Subsequently, the Wener flter s used for deblurrng the fnal hghresoluton mage. ater, n et al. (005, 005b) proposed the sngle mage restoraton algorthm (recognton-based) usng Subspace HP-WS (S-HPWS) flter. he observaton vectors nto a subspace usng PCA (Prncpal Component Analyss) are used n order to reduce the computatonal burden, especally for large wndow szes. Due to the nondfferentable characterstcs, the global optmzaton of HP-WS s dffcult to acheve. Consequently, n et al. (006) proposed a novel radal bass functon nterpretaton of the Soft-Partton-based Weghted Sum (SP-WS) flters and presented an effcent optmzaton procedure based on the gradent method (both the quas-newton method and the steepest descent method). Next, Shao and Barner (006) proposed the sngle mage restoraton algorthm usng Soft-Partton-based Weghted Sum (SP-WS) flter. hus, an analytcal soluton for the global optmzaton s easy to obtan due to the dfferentable SP-WS flter functon. oreover, they compared the proposed SP-WS soluton and the HP-WS soluton computed by two-state suboptmal tranng and by GA algorthm. Narayanan et al. (007) proposed the fast recognton-based SRR algorthm usng Hard-Partton-based Weghted Sum (HP-WS) flter. Due to computatonal complexty, the HP-WS flter s Block Block Observaton Vector { x( n) or x( nx, ny) Blockng ncorporated n ths algorthm nstead of the SP-WS flter. Hence, HP-WS flters are employed to smultaneously perform nonunform nterpolaton and perform deconvoluton of the system s pont spread functon (PSF). Subsequently, Harde (007) proposed the fast SRR algorthm usng the fast recognton-based SRR algorthm wth Adaptve Wener Flter. he postons of the R pxels are not quantzed to a fnte grd as wth some prevous technques and the weghts for each HR pxel are desgned to mnmze the SE and they depend on the relatve postons of the surroundng R pxels. he parametrc statstcal model s used for these correlatons that ultmately defne the flter weghts.. Introducton to Hard-Partton- Based Weghted Sum (HP-WS) Flter (Barner et al. 999) hs secton wll frst revew the concept of the HP-WS flter that s desgned for the sngle mage restoraton algorthm. hs algorthm frst separates the observed mage usng VQ (Vector Quantzaton) and the parttoned mage wll be fltered. ater, the mathematcal analyss of the parameter optmzaton s presented. Fnally, the advantage and the dsadvantage are dscussed. x ( n, n ) x y 5 5 pxels excographc 5 pxels 5 x VQ,,, { Ω Ω K Ω Optmum Wndow Coeffcent ˆ d = w x Fg.. Imagng system, or observaton model of Hard-Partton-Based Weghted Sum (HP-WS) Flter. Revew Artcle 76 Ω w

3 AU J.. 3(): (Oct. 009). he Concept of Hard-Partton-Based Weghted Sum (HP-WS) Flter he man procedure of the HP-WS Flter s shown as follows and n Fg.. x n or { (, ) x y blocks ( x( n ) or ( x, he observed mage ( x n n ) wll be parttoned nto small consstng of 5x5 pxels. Each block ( x n n ) that are x n or ( x, x n n ) wll be vector quantzed n order to determne the best texture smlarty from VQ Code Book ( Ω ) wth a hard threshold. After determnng Ω, the process wll select the most matchng flter w for that block of the observed mage ( x( n ) or ( x, x n n ). he sets of VQ Code Book ( Ω ) and coeffcent flter w are calculated from the tranng set of mages.. athematcal Analyss of the Parameter Optmzaton hs secton revews the optmzaton of flter coeffcents from mathematcal pont of vew. d n s the estmated mage Assume that and { Assume that FPWS F PWS x = wp( x ) x x n s the observed mage. x s the fltered mage. where wp( x ) s the coeffcent of flter. he cost functon ( J ) of SE (ean Square Error) s defned as ( ) J = E d F PWS x, J = Ed w x I( x Ω), = d ( d) I( x Ω) = J = E, + I ( Ω) x = E( d ) E( d) I( x Ω) = J =, E I + ( Ω) x = σ d E w d x I( x Ω) = J =, + E I( x Ω) xw = σ d E( d I( Ω) ) w x x = P J =, + E( I( Ω) ) w x x x w = R J = σ d w P+ w R w, = = where R = E Ω xx x and P = E d x x Ω. One can determne the flter coeffcent that mnmzes the cost functon as n J = ( J) = 0, w w σ d w P = = 0, w + w R w = ( σ d) + w P w w = 443 = 0 = 0, + w R w w = 0 w P w = = 0, + w R w w = + P R w = 0, = = Revew Artcle 77

4 AU J.. 3(): (Oct. 009) P + R w = 0, = = R w = P, = = R w = P, w = R P or w = R P..3 he Advantage and the Dsadvantage Although ths algorthm can be effectvely appled on the mage, an analytcal soluton for the global optmzaton s dffcult to obtan due to the non-dfferentable HP-WS flter functon. 3. Introducton to Subspace HP-WS (S-HPWS) usng PCA (Prncpal Component Analyss) Flter (n et al. 005, 005b) hs secton revews the sngle mage restoraton algorthm usng Subspace HP-WS (S-HPWS) flter. hs secton wll frst revew the concept of S-HPWS Flter that separates the observed mage usng VQ (Vector Quantzaton) wth a subsequent fltraton of the parttoned mage. ater, the mathematcal analyss of the parameter optmzaton s Block Block Observaton Vector { x( n) or x( nx, ny) Blockng x ( n, n ) x y presented. Fnally, the advantage and the dsadvantage are dscussed. 3. he Concept of Subspace Hard- Partton-Based Weghted Sum (S-HPWS) Flter he man procedure of the S-HPWS Flter s shown as follows and n Fg.. x n or { (, ) x y blocks ( x( n ) or ( x, he observed mage ( x n n ) wll be parttoned nto small consstng of 5 pxels. Each block ( x n n ) that are x n or ( x, x n n ) wll be havng a reduced number of pxels from 5 pxels to 5 pxels usng PCA process. PCA nformaton (5 pxels) wll be vector quantzed n order to determne the best texture smlarty from VQ Code Book ( Ω ). After determnng Ω, the process wll select the most matchng flter w for that block of observed mage ( x( n ) or ( x, x n n ). he set of VQ Code Book ( Ω ) and excographc x PCA A VQ pxels { Ω, Ω, K, Ω ( 5 pxels) Optmum Wndow Coeffcent Ω w K pxels ( 5 pxels) dˆ = w x Fg.. Imagng system, or observaton model of Subspace Hard-Partton-Based Weghted Sum (S- HPWS) Flter. Revew Artcle 78

5 AU J.. 3(): (Oct. 009) coeffcent flter w are calculated from the tranng set of mages. 3. athematcal Analyss of the Parameter Optmzaton he parameter optmzaton s closely smlar to the HP-WS parameter optmzaton. 3.3 he Advantage and the Dsadvantage he observaton vectors nto a subspace are usng PCA (Prncpal Component Analyss) n order to reduce the computatonal burden, especally for large wndow szes. Due to the non-dfferentable characterstcs, a global optmzaton of HP-WS s dffcult to acheve. 4. Introducton to Soft-Partton- Based Weghted Sum (SP-WS) Flter (Shao and Barner 006) hs secton revews the Soft-Parttonbased Weghted Sum (SP-WS) flter that s desgned for sngle mage restoraton. hs secton wll frst revew the concept of SP-WS Flter that separates the observed mage usng VQ (Vector Quantzaton) wth a subsequent fltraton of the parttoned mage. ater, the mathematcal analyss of the parameter optmzaton s presented. Fnally, the advantage and the dsadvantage are dscussed. 4. he Concept of Soft-Partton-Based Weghted Sum (SP-WS) Flter he man procedure of the SP-WS Flter s shown as follows and n Fg. 3. x n or { (, ) x y blocks ( x( n ) or ( x, he observed mage ( x n n ) wll be parttoned nto small consstng of 5x5 pxels. Each block ( x n n ) that are x n or ( x, x n n ) wll be vector quantzed n order to determne the best texture smlarty from VQ Code Book ( Ω ) wth soft threshold. After determnng Ω, the process wll select the most matchng flter w for that block of the observed mage ( x( n ) or ( x, x n n ). he sets of VQ Code Book ( Ω ) and coeffcent flter w are calculated from the tranng set of mages. 4. athematcal Analyss of the Parameter Optmzaton (n et al. 006) hs secton presents the optmzaton of flter coeffcents from mathematcal pont of vew: Block Block Observaton Vector { x( n) or x( nx, ny) x ( n, n ) x y excographc Blockng 5 Soft-VQ { Ω Ω K Ω,,, 5 pxels Optmum Wndow 5 pxels Coeffcent x Ω w 5 dˆ = w x Fg. 3. Imagng system, or observaton model of Soft-Partton-Based Weghted Sum (SP-WS) Flter. Revew Artcle 79

6 AU J.. 3(): (Oct. 009) ( wcs,, ) = ( ) Soft PWS, (,, ) = { Soft PWS + Soft PWS E{ d E{ df Soft PWS ( wcs,, ) =, + E{ FSoft PWS E{ d E{ df Soft PWS ( wcs,, ) =, + E{ FSoft PWS σ E{ df Soft PWS ( wcs,, ) =, + E{ FSoft PWS ( wcs,, ) = σ { % + {( % ), ( wcs,, ) = σ w { x + { xw ( wcs,, ) = σ w { x + w { xx w J E d F J wcs E d df F, J J J J E d E J E d% E %%, J E d% E %%, J σ wcs,, = wp % + wrw %. 4.. athematcal Analyss of the Flter Coeffcent Optmzaton: One can determne the flter coeffcent that mnmzes the cost functon as { J ( wcs) = { σ wp+ wrw % n,, n %, w w J (,, ) = { σ + wcs wp % w w wrw %, { σ { wp% w w J ( wcs,, ) =, w + { wrw % w J ( wcs,, ) = 0 p% + Rw %, w 0= p% + Rw %, Rw % = p%, Rw % = p%, w = R% p%. 4.. athematcal Analyss of the VQ Code Book Optmzaton: One can determne the VQ Code Book ( c ) that mnmzes the cost functon as show schematcally n Fg. 4 (due to the complexty of equatons). ( wcs,, ) = σ { Soft PWS + { Soft PWS J E df E F { J( wcs) = σ E{ df + E{ F ax,, ax Soft PWS Soft PWS c c { J( wcs,, ) = σ E{ dfsoft PWS + E{ FSoft PWS { { J( wcs,, ) = + E{ dfsoft PWS + E FSoft PWS σ { { { J( wcs,, ) = 0 E{ dfsoft PWS + E FSoft PWS { J(,, ) E d { F { wcs = Soft PWS + E FSoft PWS { J(,, ) E d { FSoft PWS E F wcs = + Soft PWS { FSoft PWS { J(,, ) E d { FSoft PWS E F wcs = + Soft PWS { FSoft PWS Fg. 4. athematcal analyss of VQ Code Book optmzaton. Revew Artcle 80

7 AU J.. 3(): (Oct. 009) { J( wcs,, ) = E ( d FSoft PWS ) { FSoft PWS { J( wcs,, ) = E ( d F Soft PWS ) exp( β) = γ γ exp( β) exp( β) { γ = = { J(,, ) E ( d F c c wcs = Soft PWS ) γ exp( β) exp( β ) exp( β) = = γ k= { J(,, ) E ( d F c wcs = Soft PWS ) γ ( A8) ( β ) exp { exp( β) exp( β) = γ { J(,, ) E ( d F c wcs = Soft PWS ) γ ( β ) exp exp( β) { β exp( β) { β = γ { J(,, ) E ( d F c wcs = Soft PWS ) γ exp β x c x c exp( β) exp( β) = γ s s { J( wcs,, ) = E ( d F Soft PWS ) γ ( β ) x c exp w x x c exp( β) exp( β) = γ { J(,, ) E ( d F s = s wcs Soft PWS ) γ { J( wcs,, ) = E ( d F Soft PWS ) ( ) ( ) exp( β) ( ) exp( β) s s = γ ( β ) x c x c exp w x γ ( ) ( β ) ( β ) exp exp { J( wcs,, ) = E ( d FSoft PWS ) x c w x c s γ γ = ( x c ) { J( wcs,, ) = E ( d F ) ( ˆ Soft PWS p ( x) )( FSoft PWS ) s k { J(,, ) = 4E ( d FSoft PWS ) x c ( FSoft PWS ) exp x c exp x c wcs s k = s sk Fg. 4. athematcal analyss of VQ Code Book optmzaton (contnued). Revew Artcle 8

8 AU J.. 3(): (Oct. 009) 4..3 athematcal Analyss of the Radal Bass Parameter Optmzaton: One can determne the Radal Bass Parameter ( s ) that mnmzes the followng cost functon: ( wcs,, ) de ( d FSoft PWS ) dj =. ds ds he parameter optmzaton s closely smlar to the VQ Code Book optmzaton n Secton 4.. and consequently the optmzed radal bass parameter (s ) s { J ( wcs,, ) x c ( d FSoft PWS ) s = E ( FSoft PWS) x c exp s x ck exp k = sk 4.3 he Advantage and the Dsadvantage he Soft-Partton-Based Weghted Sum (SP-WS) flters represent a mult-kernel flterng scheme that combnes lnear flterng theory wth data adaptve observaton space parttonng. hs method has proven effectve n treatng both unform and detaled components of non-statonary mages n the case of Gaussan nose. (Barner et al. 999) 5. Introducton to SRR Algorthm usng HP-WS Flter (Narayanan et al. 007) hs secton revews the SRR (Super Resoluton Reconstructon) algorthm to produce hgh-resoluton vdeo from lowresoluton (R) vdeo usng partton-based weghted sum (HP-WS) flters. Due to computatonal complexty, the HP-WS flter s ncorporated n ths algorthm nstead of the SP-WS flter. Hence, HP-WS flters are employed to smultaneously perform nonunform nterpolaton and perform deconvoluton of the system s PSF. he PWS approach uses the R frames to partally populate an HR grd based on regstraton of the R frames. However, unlke more tradtonal methods, PWS flters are then employed to perform non-unform nterpolaton and mage restoraton smultaneously. hs secton wll frst revew the concept of SRR algorthm (usng HP-WS flters) that separates the observed mage usng VQ wth a subsequent fltraton of the parttoned mage. ater, the mathematcal analyss of the parameter optmzaton s presented. Fnally, the advantage and the dsadvantage are dscussed. 5. he Concept of SRR algorthm usng Hard-Partton-Based Weghted Sum (HP- WS) Flter he man procedure of the SP-WS Flter s shown as follows and n Fg. 5. S n or { he observed mage ( { (, ) x y S n n ) wll be parttoned nto small overlapped blocks ( S n or S( nx ny), ) that are consstng of 5x5 pxels. Each estmated block or reconstructed block ( x( n ) or x( nx, n ) of 3x3 pxels wll be vector quantzed n order to determne the best texture smlarty from VQ Code Book ( Ω ) wth soft threshold. After determnng Ω, the process wll select the most matchng flter w for that block of observed mage ( x( n ) or ( x, x n n ). he sets of VQ Code Book ( Ω ) and coeffcent flter w are calculated from the tranng set of mages. Revew Artcle 8

9 AU J.. 3(): (Oct. 009) 5. athematcal Analyss of the Parameter Optmzaton he optmzaton of flter coeffcents from mathematcal pont of vew s smlar to the parameter optmzaton n Secton.. combned wth a low computatonally complexty and hghly parallel structure, makes t attractve for real-tme SR enhancement of vdeo. For arbtrary moton, the complexty of the PWS method ncreases. 5.3 he Advantage and the Dsadvantage he SRR algorthm usng HP-WS flters can be appled to vdeo applcatons. Narayanan et al. (007) beleve that the good performance of the proposed PWS SR method, S S Observaton Image Observaton Image Observaton Image 3 Observaton Image 4 V - V -3 V -4 Regstraton Regstraton Regstraton 7 pxels Nonunform Interpolaton 7 pxels N = 5 x ( n, n ) x y x 5 N = Block 3 3 Block Blockng ( Overlappng) 5 pxels excographc 5 pxels VQ { Ω Ω K Ω,,, Optmum Wndow Coeffcent Ω w Hgh Resoluton Image { x( n) or x( nx, ny) 5 pxels = % p( ), j xn n y n w x n 3 pxels 3 pxels Fg. 5. Imagng system, or observaton model of SRR algorthm usng Hard-Partton-Based Weghted Sum (S-HPWS) Flter. Revew Artcle 83

10 AU J.. 3(): (Oct. 009) 6. Introducton to Fast SRR Algorthm usng HP-WS Flter (Harde 008) hs secton revews the Fast SRR Algorthm usng HP-WS Flter that s desgned for mult-frame mage restoraton. hs secton wll frst revew the concept of fast SRR algorthm usng HP-WS flters that separates the observed mage usng VQ wth a subsequent fltraton of the parttoned mage. ater, the mathematcal analyss of the parameter optmzaton s presented. Fnally, the advantage and the dsadvantage are dscussed. 6. he Concept of fast SRR algorthm usng Hard-Partton-Based Weghted Sum (HP- WS) Flter he man procedure of the SP-WS Flter s shown as follows and n Fg. 6. S n or { he observed mage ( { (, ) x y S n n ) wll be parttoned nto small overlapped blocks ( S n or S( nx ny) that are consstng of 5x5 pxels., ) 5 pxels 5 pxels K Observaton Image θ V - Observaton Image θ 3 V -3 Observaton Image 3 θ P ( V -P ) Observaton Image P Parameter urnng Regstraton Regstraton K Regstraton Nonunform Interpolaton K ( 75 pxels) pxels (, ) r x y = σ ρ dd d x + y g g (, ) r x y ff (, ) r x y df σ n Block Block g g Hgh Resoluton Image { x( n) or x( nx, ny) Block g Blockng ( Overlappng) 30 pxels ( 6mes) g, g, g, g, g = = g, K g,75 excographc 30 pxels 900 pxels dˆ = W g Wndow Statstcs R Wndow Wegths w = R P P w Combne Outputs Fg. 6. Imagng system, or observaton model of fast SRR algorthm usng Hard-Partton-Based Weghted Sum (S-HPWS) Flter. ẑ Revew Artcle 84

11 AU J.. 3(): (Oct. 009) Each estmated block or reconstructed block ( x( n ) or x( nx, n ) of 3x3 pxels wll be vector quantzed n order to determne the best texture smlarty from VQ Code Book ( Ω ) wth soft threshold. After determnng Ω, the process wll select the most matchng flter w for that block of observed mage ( x( n ) or ( x, x n n ). he sets of VQ Code Book ( Ω ) and coeffcent flter w are calculated from the tranng set of mages. 6. athematcal Analyss of the Parameter Optmzaton he P and R optmzaton of flter coeffcents from mathematcal pont of vew s shown schematcally n Fg. 7 (due to the complexty of equatons). 6.3 he Advantage and the Dsadvantage he algorthm has a low computatonal R = E ff { gg { R = E f + n f + n { R = E ff + nn + fn + nf R = E ff + E nn + E fn + E nf σ R = E ff + I n (, ) = (, ) (, ) (, ) r x y r x y h x y h x y dd = 0 = 0 complexty and may be readly sutable for real-tme and/or near real-tme processng applcatons for translatonal moton, but the computatonal complexty goes up sgnfcantly wth other moton models. However, regardless of the moton model, the algorthm lends tself to parallel mplementaton (Harde 007). 7. Concludng Remarks hs artcle surveys the theory of mage reconstructon based on Weghted Sum (WS) flter approach, an alternatve reconstructon paradgm that goes aganst the common wsdom n tradtonal reconstructon. Weghted Sum (WS) flter theory asserts that one can recover certan sgnals and mages from far fewer samples or measurements than tradtonal methods use (Candès and Wakn 008). he author s ntent n ths artcle s to provde an overvew of the basc Weghted Sum (WS) flter that emerged n recent research works, present the key mathematcal deas underlyng ts theory, and survey a couple P = E { gd df { P = E f + n d P = E fd + nd E P = E fd + nd 443 P = E { fd (, ) = (, ) (, ) r x y r x y h x y dd = 0 x + y, = = ( 0.75) r x y σ ρ σ dd d d x + y x + y, = = ( 0.75) r x y σ ρ σ dd d d x + y R = σ E ff + σ I d n P = σ E { fd d W = R P n W = E W = σd E{ ff + σ ni σd E fd { ff + I E { fd σ d σ Fg. 7. athematcal analyss of parameter optmzaton. Revew Artcle 85

12 AU J.. 3(): (Oct. 009) of mportant results n the feld. he author s goal s to explan the Weghted Sum (WS) flter as planly as possble, and so ths artcle s manly of a tutoral nature. Consequently, the comprehensve coverage gven n ths artcle should lead to further research n reconstructon algorthms, as well as new applcatons. he author hopes that the readers wll enjoy ther journey through the theory and applcatons of mage reconstructon based on the Weghted Sum (WS) flter approach. Acknowledgement hs paper partally descrbes the foundaton of a research project afflated wth Assumpton Unversty of haland enttled, Vdeo enhancement usng an teratve SRR based on a robust stochastc estmaton wth an mproved observaton model, that has been supported by Research Grant for New Scholar (RG58063) from RF (ha Research Fund) and CHE (Commsson on Hgher Educaton). References Alam,.S.; Bognar, J.G.; Harde, R.C.; and Yasuda, B.J Infrared mage regstraton and hgh-resoluton reconstructon usng multple translatonally shfted alased vdeo frames. IEEE rans. on Instrumentaton and easurement 49(5): Barner, K.E.; Sarhan, A..; and Harde, R.C Partton-based weghted sum flters for mage restoraton. IEEE rans. on Image ng 8(5): Candès, E.J.; and Wakn,.B An ntroducton to compressve samplng. IEEE Sgnal ng ag. 5(): -30, arch. Harde, R A fast mage super-resoluton algorthm usng an adaptve Wener flter. IEEE rans. on Image ng 6():, n, Y.; Harde, R.C.; and Barner, K.E Subspace partton weghted sum flters for mage deconvoluton. Proc. IEEE Int. Conf. on Acoustcs, Speech, and Sgnal ng (ICASSP'05), IEEE Sgnal ng Socety, Pscataway, NJ, USA. n, Y.; Harde, R.C.; and Barner, K.E. 005b. Subspace partton weghted sum flters for mage restoraton. IEEE Sgnal ng etters (9): n, Y.; Harde, R.C.; Sheng, Q.; Shao,.; and Barner, K.E Improved optmzaton of soft partton weghted sum flters and ther applcaton to mage restoraton. Appled Optcs 45():, Narayanan, B.; Harde, R.C.; Barner, K.E.; and Shao, A computatonally effcent super-resoluton algorthm for vdeo processng usng partton flters. IEEE rans. on Crcuts and Systems for Vdeo echnology 7(5): Shao,.; and Barner, K.E Optmzaton of partton-based weghted sum flters and ther applcaton to mage denosng. IEEE rans. on Image ng 5(7):, Revew Artcle 86

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Microwave Diversity Imaging Compression Using Bioinspired

Microwave Diversity Imaging Compression Using Bioinspired Mcrowave Dversty Imagng Compresson Usng Bonspred Neural Networks Youwe Yuan 1, Yong L 1, Wele Xu 1, Janghong Yu * 1 School of Computer Scence and Technology, Hangzhou Danz Unversty, Hangzhou, Zhejang,

More information

Feb 14: Spatial analysis of data fields

Feb 14: Spatial analysis of data fields Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Change Detection: Current State of the Art and Future Directions

Change Detection: Current State of the Art and Future Directions Change Detecton: Current State of the Art and Future Drectons Dapeng Olver Wu Electrcal & Computer Engneerng Unversty of Florda http://www.wu.ece.ufl.edu/ Outlne Motvaton & problem statement Change detecton

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING 1 ADVANCED ACHINE LEARNING ADVANCED ACHINE LEARNING Non-lnear regresson technques 2 ADVANCED ACHINE LEARNING Regresson: Prncple N ap N-dm. nput x to a contnuous output y. Learn a functon of the type: N

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

GEMINI GEneric Multimedia INdexIng

GEMINI GEneric Multimedia INdexIng GEMINI GEnerc Multmeda INdexIng Last lecture, LSH http://www.mt.edu/~andon/lsh/ Is there another possble soluton? Do we need to perform ANN? 1 GEnerc Multmeda INdexIng dstance measure Sub-pattern Match

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Analytical Gradient Evaluation of Cost Functions in. General Field Solvers: A Novel Approach for. Optimization of Microwave Structures

Analytical Gradient Evaluation of Cost Functions in. General Field Solvers: A Novel Approach for. Optimization of Microwave Structures IMS 2 Workshop Analytcal Gradent Evaluaton of Cost Functons n General Feld Solvers: A Novel Approach for Optmzaton of Mcrowave Structures P. Harscher, S. Amar* and R. Vahldeck and J. Bornemann* Swss Federal

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

De-noising Method Based on Kernel Adaptive Filtering for Telemetry Vibration Signal of the Vehicle Test Kejun ZENG

De-noising Method Based on Kernel Adaptive Filtering for Telemetry Vibration Signal of the Vehicle Test Kejun ZENG 6th Internatonal Conference on Mechatroncs, Materals, Botechnology and Envronment (ICMMBE 6) De-nosng Method Based on Kernel Adaptve Flterng for elemetry Vbraton Sgnal of the Vehcle est Kejun ZEG PLA 955

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering,

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering, COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION Erdem Bala, Dept. of Electrcal and Computer Engneerng, Unversty of Delaware, 40 Evans Hall, Newar, DE, 976 A. Ens Cetn,

More information

A NEW DISCRETE WAVELET TRANSFORM

A NEW DISCRETE WAVELET TRANSFORM A NEW DISCRETE WAVELET TRANSFORM ALEXANDRU ISAR, DORINA ISAR Keywords: Dscrete wavelet, Best energy concentraton, Low SNR sgnals The Dscrete Wavelet Transform (DWT) has two parameters: the mother of wavelets

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Parameter Estimation for Dynamic System using Unscented Kalman filter

Parameter Estimation for Dynamic System using Unscented Kalman filter Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

MULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN

MULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN MULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN S. Chtwong, S. Wtthayapradt, S. Intajag, and F. Cheevasuvt Faculty of Engneerng, Kng Mongkut s Insttute of Technology

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

An Algorithm to Solve the Inverse Kinematics Problem of a Robotic Manipulator Based on Rotation Vectors

An Algorithm to Solve the Inverse Kinematics Problem of a Robotic Manipulator Based on Rotation Vectors An Algorthm to Solve the Inverse Knematcs Problem of a Robotc Manpulator Based on Rotaton Vectors Mohamad Z. Al-az*, Mazn Z. Othman**, and Baker B. Al-Bahr* *AL-Nahran Unversty, Computer Eng. Dep., Baghdad,

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

Uncertainty in measurements of power and energy on power networks

Uncertainty in measurements of power and energy on power networks Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:

More information

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland

More information

SYNTHETIC aperture radar (SAR) uses the relative motion

SYNTHETIC aperture radar (SAR) uses the relative motion 512 IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 3, NO. 4, OCTOBER 2006 SAR Mnmum-Entropy Autofocus Usng an Adaptve-Order Polynomal Model Junfeng Wang and Xngzhao Lu Abstract A new algorthm s presented

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Tutorial 2. COMP4134 Biometrics Authentication. February 9, Jun Xu, Teaching Asistant

Tutorial 2. COMP4134 Biometrics Authentication. February 9, Jun Xu, Teaching Asistant Tutoral 2 COMP434 ometrcs uthentcaton Jun Xu, Teachng sstant csjunxu@comp.polyu.edu.hk February 9, 207 Table of Contents Problems Problem : nswer the questons Problem 2: Power law functon Problem 3: Convoluton

More information

CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER. In real environmental conditions the speech signal may be

CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER. In real environmental conditions the speech signal may be 55 CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER 4.1 Introducton In real envronmental condtons the speech sgnal may be supermposed by the envronmental nterference. In general, the spectrum

More information

The Two-scale Finite Element Errors Analysis for One Class of Thermoelastic Problem in Periodic Composites

The Two-scale Finite Element Errors Analysis for One Class of Thermoelastic Problem in Periodic Composites 7 Asa-Pacfc Engneerng Technology Conference (APETC 7) ISBN: 978--6595-443- The Two-scale Fnte Element Errors Analyss for One Class of Thermoelastc Problem n Perodc Compostes Xaoun Deng Mngxang Deng ABSTRACT

More information

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING Qn Wen, Peng Qcong 40 Lab, Insttuton of Communcaton and Informaton Engneerng,Unversty of Electronc Scence and Technology

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Digital Audio Signal Processing DASP. Lecture-2: Noise Reduction-I. Single-Channel Noise Reduction. Marc Moonen

Digital Audio Signal Processing DASP. Lecture-2: Noise Reduction-I. Single-Channel Noise Reduction. Marc Moonen Dgtal Audo Sgnal Processng DASP Lecture-: Nose Reducton-I Sngle-Channel Nose Reducton Marc Moonen Dept. E.E./ESA-SADIUS, KU Leuven marc.moonen@kuleuven.be homes.esat.kuleuven.be/~moonen/ Sngle-Channel

More information

Impulse Noise Removal Technique Based on Fuzzy Logic

Impulse Noise Removal Technique Based on Fuzzy Logic Impulse Nose Removal Technque Based on Fuzzy Logc 1 Mthlesh Atulkar, 2 A.S. Zadgaonkar and 3 Sanjay Kumar C V Raman Unversty, Kota, Blaspur, Inda 1 m.atulkar@gmal.com, 2 arunzad28@hotmal.com, 3 sanrapur@redffmal.com

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information

Handout: Large Eddy Simulation I. Introduction to Subgrid-Scale (SGS) Models

Handout: Large Eddy Simulation I. Introduction to Subgrid-Scale (SGS) Models Handout: Large Eddy mulaton I 058:68 Turbulent flows G. Constantnescu Introducton to ubgrd-cale (G) Models G tresses should depend on: Local large-scale feld or Past hstory of local flud (va PDE) Not all

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Identification of Linear Partial Difference Equations with Constant Coefficients

Identification of Linear Partial Difference Equations with Constant Coefficients J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents

More information

IMAGE DENOISING USING NEW ADAPTIVE BASED MEDIAN FILTER

IMAGE DENOISING USING NEW ADAPTIVE BASED MEDIAN FILTER Sgnal & Image Processng : An Internatonal Journal (SIPIJ) Vol.5, No.4, August 2014 IMAGE DENOISING USING NEW ADAPTIVE BASED MEDIAN FILTER Suman Shrestha 1, 2 1 Unversty of Massachusetts Medcal School,

More information

arxiv:cs.cv/ Jun 2000

arxiv:cs.cv/ Jun 2000 Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve

More information

Irregular vibrations in multi-mass discrete-continuous systems torsionally deformed

Irregular vibrations in multi-mass discrete-continuous systems torsionally deformed (2) 4 48 Irregular vbratons n mult-mass dscrete-contnuous systems torsonally deformed Abstract In the paper rregular vbratons of dscrete-contnuous systems consstng of an arbtrary number rgd bodes connected

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

CSC 411 / CSC D11 / CSC C11

CSC 411 / CSC D11 / CSC C11 18 Boostng s a general strategy for learnng classfers by combnng smpler ones. The dea of boostng s to take a weak classfer that s, any classfer that wll do at least slghtly better than chance and use t

More information

TOPICS MULTIPLIERLESS FILTER DESIGN ELEMENTARY SCHOOL ALGORITHM MULTIPLICATION

TOPICS MULTIPLIERLESS FILTER DESIGN ELEMENTARY SCHOOL ALGORITHM MULTIPLICATION 1 2 MULTIPLIERLESS FILTER DESIGN Realzaton of flters wthout full-fledged multplers Some sldes based on support materal by W. Wolf for hs book Modern VLSI Desgn, 3 rd edton. Partly based on followng papers:

More information

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

IV. Performance Optimization

IV. Performance Optimization IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton

More information

Fourier Transform. Additive noise. Fourier Tansform. I = S + N. Noise doesn t depend on signal. We ll consider:

Fourier Transform. Additive noise. Fourier Tansform. I = S + N. Noise doesn t depend on signal. We ll consider: Flterng Announcements HW2 wll be posted later today Constructng a mosac by warpng mages. CSE252A Lecture 10a Flterng Exampel: Smoothng by Averagng Kernel: (From Bll Freeman) m=2 I Kernel sze s m+1 by m+1

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

CSE4210 Architecture and Hardware for DSP

CSE4210 Architecture and Hardware for DSP 4210 Archtecture and Hardware for DSP Lecture 1 Introducton & Number systems Admnstratve Stuff 4210 Archtecture and Hardware for DSP Text: VLSI Dgtal Sgnal Processng Systems: Desgn and Implementaton. K.

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

CS 468 Lecture 16: Isometry Invariance and Spectral Techniques

CS 468 Lecture 16: Isometry Invariance and Spectral Techniques CS 468 Lecture 16: Isometry Invarance and Spectral Technques Justn Solomon Scrbe: Evan Gawlk Introducton. In geometry processng, t s often desrable to characterze the shape of an object n a manner that

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

Mixed Noise Suppression in Color Images by Signal-Dependent LMS L-Filters

Mixed Noise Suppression in Color Images by Signal-Dependent LMS L-Filters 46 R. HUDEC MIXED OISE SUPPRESSIO I COLOR IMAGES BY SIGAL-DEPEDET LMS L-FILTERS Mxed ose Suppresson n Color Images by Sgnal-Dependent LMS L-Flters Róbert HUDEC Dept. of Telecommuncatons Unversty of Žlna

More information

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1 Average Decson hreshold of CA CFAR and excson CFAR Detectors n the Presence of Strong Pulse Jammng Ivan G. Garvanov and Chrsto A. Kabachev Insttute of Informaton echnologes Bulgaran Academy of Scences

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012 MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information

1 Derivation of Point-to-Plane Minimization

1 Derivation of Point-to-Plane Minimization 1 Dervaton of Pont-to-Plane Mnmzaton Consder the Chen-Medon (pont-to-plane) framework for ICP. Assume we have a collecton of ponts (p, q ) wth normals n. We want to determne the optmal rotaton and translaton

More information