Transforms that are commonly used are separable
|
|
- Josephine Hudson
- 5 years ago
- Views:
Transcription
1 Trasforms s Trasforms that are commoly used are separable Eamples: Two-dmesoal DFT DCT DST adamard We ca the use -D trasforms computg the D separable trasforms: Take -D trasform of the rows > rows ( ) Take -D trasform of colums of rows ( ) > ( ) EEE 58
2 The D Dscrete Fourer Trasform (D DFT) p ( ) The DFT cossts of samples of the DTFT at ω ω ( L ) L ( ) ω ω perodcty space (or tme) doma (ad frequecy doma) sequece ( ) eteded perodcally wth horzotal perod of ad vertcal perod of ( ) ( ) ( ) ( ) But we restrct ourselves to the ma perod to recover the orgal sgal EEE 58
3 D DFT. ( ) ( ) DFT ( ) ( ) j j e e ( ) ( ) j j e e EEE 58
4 D DFT Utary DFT (Symmetrc Form): y ( y ) ( ) ( ) j j e e ( ) ( ) j j e e ( ) e e j j Φ ( ) ( ) Φ Φ separable ( ) Φ e j where EEE 58
5 D DFT ote: ( ) ( ) c samples of perod betwee [ ) of DTFT DTFT perodc of perod D DFT of a mage: [) of DTFT ( ) 5 ( ) D DFT magtude EEE 58 ( )
6 D DFT ote: ( ) samples of perod betwee [) of DTFT c DTFT perodc of perod D DFT of a mage: ( ) 5 D DFT magtude EEE 58 ( )
7 D DFT For coveece use the shorthad otato W e j j a a W e D DFT Separable ca use oly D DFTs ( ) ( ) ( ) ( ) W ( ) ( ) W EEE 58
8 D DFT Matr Represetato: ˆ F where F are utary matrces ad F T F W But: ote: F symmetrc F utary ˆ T F F * F * F F F T F * T F F F * F F F W EEE 58
9 D DFT Wth the DFT lear shfts ad lear covolutos are replaced by crcular shfts ad crcular covolutos Crcularty s deoted usg modulo operator otato: () modulo If r () the r - ote: (-) (-) Crcular shft: ( ) ( ) ) m m m m W W ( ) Crcular covoluto same as lear covoluto but shftg correspods to crcular shft ad flppg correspods to crcular reverse (-) - ( ) h( ) ( ) ( ) EEE 58
10 D DFT Cojugate symmetry for real mages ( ) ( ) ( ) ( ) ( ) ( ) ( ) * * real ( ) ( ) ( ) ( ) * pck the > de lyg perod - Replace * EEE 58
11 D DFT Cojugate symmetry about - ( ) half of the coeffcets are redudat ad eed ot be stored - The DFT s a fast trasform DFT separable Trasformato ca be performed usg ( ) D DFTs for a mage Each D DFT of sze requres log comple multplcatos ad adds (CMADs) usg a FFT mplemetato DFT ca be performed log log log O( log ) operatos matr rows DFT matr colums DFT If O ( log )operatos EEE 58
12 The D Dscrete Cose Trasform (D DCT) e sc ete Cos e a s o ( C ) Advatages: Real trasform (for real mages) Real trasform (for real mages) Coeffcets early ucorrelated Ecellet Eergy Compacto There are dfferet types of DCTs but here we are terested There are dfferet types of DCTs but here we are terested a utary trasform type where the trasformato matrces are such that: C C Type IV ( ) ( ) ( ) ( ) ( ) ( ) DCT cos cos C C ( ) C where EEE 58
13 D DCT ( ) ( ) C ( ) C ( ) ( ) ( ) DCT cos cos Iverse ad Forward DCT are the same DCT separable ca use D trasforms D DCT of a mage ( ) D DCT magtude ( ) ote: A real trasform oly ygoes half way aroud the Ut Crcle EEE 58
14 D DCT ( ) ( ) C ( ) C ( ) ( ) ( ) DCT cos cos Iverse ad Forward DCT are the same DCT separable ca use D trasforms D DCT of a mage ( ) D DCT magtude ( ) ote: A real trasform oly ygoes half way aroud the Ut Crcle EEE 58
15 D DCT Dsadvatage: The DCT does ot have ce covoluto ad modulato propertes. DCT ca be related to DFT ad computed va FFTs DCT related to DFT of symmetrc eteso of a sequece O ( ) operatos eeded for a mage. log Fast trasform. EEE 58
16 D DCT Matr Represetato C { ( )} C where C ( ) cos ( ) C utary ad real C orthogoal C real ad orthogoal C - C T ad C C * ˆ C T C C C ˆ ˆ * * T T CC EEE 58
17 D DCT ote: f C C C orthogoal ˆ C T C CC ˆ T Iterpretato of DCT DFT perodc eteso of sequeces DCT symmetrc ad perodc eteso of sequeces (ma perod symmetrc) EEE 58
18 D DCT Cosder a mage ( ) - g h I d e f a b c - Symmetrcally eted mage about - ad - aes - a b c d e f g h g h d e f a b c c b a f e d h g h g f e d c b a EEE 58 - y( ) ( ) ( ) ( -- ) ( -- )
19 D DCT ow take DFT of y( ) ote that ths s a pot DFT DCT ca be epressed terms of DFT Ca use FFT to make a fast DCT mplemetato wth O( ) operatos for a mage log Compare DFT to DCT ( ) 5 ( ) ( ) ( ) EEE 58
20 D DST (Dscrete Se Trasform) S ( sc ete S e a s o ) Defto: ( ) ( ) ( )( ) ( )( ) DST s s ˆ Propertes smlar to DCT (separable real fast trasform) but also symmetrc faster trasform ( ) ( )( ) ( ) T S S Φ Φ s Very good eergy compacto but less tha DCT ( ) S S Φ EEE 58
21 D DST Iverse ad forward trasforms are the same ( ) ˆ ( ) s ( )( ) s ( )( ) DST Matr represetato ˆ S T S S S S symmetrc where S ˆ S subde correspods to drectos S subde correspods to drectos sce utary S ad S real ad symmetrc ( ) ( ) { S ( )} s EEE 58
22 D Dscrete adamard a d Trasform Based o a matr descrpto (Typcally defed terms of a matr) Very effcet: matr elemets (ad thus elemets of bass vectors) take oly the bary values ± well-suted for DSP ca be mplemeted wthout multplers Symmetrc trasform Defto: For a mage (( ) wth (power of ) T ˆ log *T s also real ad orthogoal - T ˆ where are matrces where ad usually 3 work o mage blocks of sze respectvely EEE 58
23 D Dscrete adamard Trasform sc ete ada a d a s o geerated usg the roecker product ad the core matr by the followg recurso Eample: EEE 58
24 D Dscrete adamard a d Trasform Frequecy terpretato Lets look at the 4 4 matr: low frequecy bass vector hgh h frequecy bass vector md frequecy bass vector md frequecy bass vector Sequecy # of sg chages Recall that for susodal sgals frequecy ca be defed terms of zero crossg or sg chages The bass vectors of a adamard matr ca be obtaed by samplg a class of fuctos called the Walsh fuctos whch ca take oly the bary values ± ad whch form a complete orthoormal bass L adamard trasform also called Walsh- adamard trasform 3 EEE 58
25 D Dscrete adamard a d Trasform Sequecy umber of zero crossgs of a Walsh fucto trastos (sg chages) a bass vector of Geerally we order the bass vectors (row or colums sce T ) terms of creasg sequecy Ths s called Walsh-ordered adamard d Trasform (f bass vectors ordered) d) EEE 58
26 D Dscrete adamard a d Trasform Trasform terpretato Orgal trasformed o ce covoluto ad modulato propertes but very fast trasform. adamard epressed terms of roecker products ad also as sparse matrces t ca be mplemeted O( log ) addtos ad subtractos. EEE 58
Signal,autocorrelation -0.6
Sgal,autocorrelato Phase ose p/.9.3.7. -.5 5 5 5 Tme Sgal,autocorrelato Phase ose p/.5..7.3 -. -.5 5 5 5 Tme Sgal,autocorrelato. Phase ose p/.9.3.7. -.5 5 5 5 Tme Sgal,autocorrelato. Phase ose p/.8..6.
More information4 Inner Product Spaces
11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key
More informationAlgorithms Theory, Solution for Assignment 2
Juor-Prof. Dr. Robert Elsässer, Marco Muñz, Phllp Hedegger WS 2009/200 Algorthms Theory, Soluto for Assgmet 2 http://lak.formatk.u-freburg.de/lak_teachg/ws09_0/algo090.php Exercse 2. - Fast Fourer Trasform
More informationL5 Polynomial / Spline Curves
L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationIII-16 G. Brief Review of Grand Orthogonality Theorem and impact on Representations (Γ i ) l i = h n = number of irreducible representations.
III- G. Bref evew of Grad Orthogoalty Theorem ad mpact o epresetatos ( ) GOT: h [ () m ] [ () m ] δδ δmm ll GOT puts great restrcto o form of rreducble represetato also o umber: l h umber of rreducble
More informationx y exp λ'. x exp λ 2. x exp 1.
egecosmcd Egevalue-egevector of the secod dervatve operator d /d hs leads to Fourer seres (se, cose, Legedre, Bessel, Chebyshev, etc hs s a eample of a systematc way of geeratg a set of mutually orthogoal
More informationDescriptive Statistics
Page Techcal Math II Descrptve Statstcs Descrptve Statstcs Descrptve statstcs s the body of methods used to represet ad summarze sets of data. A descrpto of how a set of measuremets (for eample, people
More informationEECE 301 Signals & Systems
EECE 01 Sgals & Systems Prof. Mark Fowler Note Set #9 Computg D-T Covoluto Readg Assgmet: Secto. of Kame ad Heck 1/ Course Flow Dagram The arrows here show coceptual flow betwee deas. Note the parallel
More information1 Lyapunov Stability Theory
Lyapuov Stablty heory I ths secto we cosder proofs of stablty of equlbra of autoomous systems. hs s stadard theory for olear systems, ad oe of the most mportat tools the aalyss of olear systems. It may
More information18.413: Error Correcting Codes Lab March 2, Lecture 8
18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse
More informationPascal-Interpolation-Based Noninteger Delay Filter and Low-Complexity Realization
SOONTORNWONG, S CHIVAREECHA, ASCAL-INTEROLATION-BASE NONINTEGER ELAY FILTER ascal-iterpolato-based Noteger elay Flter ad Low-Complety Realzato arya SOONTORNWONG, Sorawat CHIVAREECHA ept of Telecommucato
More informationLog1 Contest Round 2 Theta Complex Numbers. 4 points each. 5 points each
01 Log1 Cotest Roud Theta Complex Numbers 1 Wrte a b Wrte a b form: 1 5 form: 1 5 4 pots each Wrte a b form: 65 4 4 Evaluate: 65 5 Determe f the followg statemet s always, sometmes, or ever true (you may
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationCODING & MODULATION Prof. Ing. Anton Čižmár, PhD.
CODING & MODULATION Prof. Ig. Ato Čžmár, PhD. also from Dgtal Commucatos 4th Ed., J. G. Proaks, McGraw-Hll It. Ed. 00 CONTENT. PROBABILITY. STOCHASTIC PROCESSES Probablty ad Stochastc Processes The theory
More information1 Onto functions and bijections Applications to Counting
1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of
More informationResearch Article A New Derivation and Recursive Algorithm Based on Wronskian Matrix for Vandermonde Inverse Matrix
Mathematcal Problems Egeerg Volume 05 Artcle ID 94757 7 pages http://ddoorg/055/05/94757 Research Artcle A New Dervato ad Recursve Algorthm Based o Wroska Matr for Vadermode Iverse Matr Qu Zhou Xja Zhag
More informationAN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET
AN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET Abstract. The Permaet versus Determat problem s the followg: Gve a matrx X of determates over a feld of characterstc dfferet from
More informationSome Different Perspectives on Linear Least Squares
Soe Dfferet Perspectves o Lear Least Squares A stadard proble statstcs s to easure a respose or depedet varable, y, at fed values of oe or ore depedet varables. Soetes there ests a deterstc odel y f (,,
More informationQR Factorization and Singular Value Decomposition COS 323
QR Factorzato ad Sgular Value Decomposto COS 33 Why Yet Aother Method? How do we solve least-squares wthout currg codto-squarg effect of ormal equatos (A T A A T b) whe A s sgular, fat, or otherwse poorly-specfed?
More informationMOLECULAR VIBRATIONS
MOLECULAR VIBRATIONS Here we wsh to vestgate molecular vbratos ad draw a smlarty betwee the theory of molecular vbratos ad Hückel theory. 1. Smple Harmoc Oscllator Recall that the eergy of a oe-dmesoal
More information1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.
CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationPolyphase Filters. Section 12.4 Porat
Polyphase Flters Secto.4 Porat .4 Polyphase Flters Polyphase s a way of dog saplg-rate coverso that leads to very effcet pleetatos. But ore tha that, t leads to very geeral vewpots that are useful buldg
More informationExercises for Square-Congruence Modulo n ver 11
Exercses for Square-Cogruece Modulo ver Let ad ab,.. Mark True or False. a. 3S 30 b. 3S 90 c. 3S 3 d. 3S 4 e. 4S f. 5S g. 0S 55 h. 8S 57. 9S 58 j. S 76 k. 6S 304 l. 47S 5347. Fd the equvalece classes duced
More informationRademacher Complexity. Examples
Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed
More information1. A real number x is represented approximately by , and we are told that the relative error is 0.1 %. What is x? Note: There are two answers.
PROBLEMS A real umber s represeted appromately by 63, ad we are told that the relatve error s % What s? Note: There are two aswers Ht : Recall that % relatve error s What s the relatve error volved roudg
More informationApplication of Legendre Bernstein basis transformations to degree elevation and degree reduction
Computer Aded Geometrc Desg 9 79 78 www.elsever.com/locate/cagd Applcato of Legedre Berste bass trasformatos to degree elevato ad degree reducto Byug-Gook Lee a Yubeom Park b Jaechl Yoo c a Dvso of Iteret
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationUnit 9. The Tangent Bundle
Ut 9. The Taget Budle ========================================================================================== ---------- The taget sace of a submafold of R, detfcato of taget vectors wth dervatos at
More informationChapter 11 Systematic Sampling
Chapter stematc amplg The sstematc samplg techue s operatoall more coveet tha the smple radom samplg. It also esures at the same tme that each ut has eual probablt of cluso the sample. I ths method of
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationA Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line
HUR Techcal Report 000--9 verso.05 / Frak Borg (borgbros@ett.f) A Study of the Reproducblty of Measuremets wth HUR Leg Eteso/Curl Research Le A mportat property of measuremets s that the results should
More informationCarbonyl Groups. University of Chemical Technology, Beijing , PR China;
Electroc Supplemetary Materal (ESI) for Physcal Chemstry Chemcal Physcs Ths joural s The Ower Socetes 0 Supportg Iformato A Theoretcal Study of Structure-Solublty Correlatos of Carbo Doxde Polymers Cotag
More informationb. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.
.46. a. The frst varable (X) s the frst umber the par ad s plotted o the horzotal axs, whle the secod varable (Y) s the secod umber the par ad s plotted o the vertcal axs. The scatterplot s show the fgure
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More information2C09 Design for seismic and climate changes
2C09 Desg for sesmc ad clmate chages Lecture 08: Sesmc aalyss of elastc MDOF systems Aurel Strata, Poltehca Uversty of Tmsoara 06/04/2017 Europea Erasmus Mudus Master Course Sustaable Costructos uder atural
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationG S Power Flow Solution
G S Power Flow Soluto P Q I y y * 0 1, Y y Y 0 y Y Y 1, P Q ( k) ( k) * ( k 1) 1, Y Y PQ buses * 1 P Q Y ( k1) *( k) ( k) Q Im[ Y ] 1 P buses & Slack bus ( k 1) *( k) ( k) Y 1 P Re[ ] Slack bus 17 Calculato
More informationCOS 341 Discrete Mathematics. Exponential Generating Functions
COS 341 Dscrete Mathematcs Epoetal Geeratg Fuctos 1 Read the tetbook Trouble keepg pace? Optoal referece tet (Rose) has may more solved eercses ad practce problems Start early o homework assgmets Come
More informationDIFFERENTIAL GEOMETRIC APPROACH TO HAMILTONIAN MECHANICS
DIFFERENTIAL GEOMETRIC APPROACH TO HAMILTONIAN MECHANICS Course Project: Classcal Mechacs (PHY 40) Suja Dabholkar (Y430) Sul Yeshwath (Y444). Itroducto Hamltoa mechacs s geometry phase space. It deals
More informationAnalysis of Lagrange Interpolation Formula
P IJISET - Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue, December 4. www.jset.com ISS 348 7968 Aalyss of Lagrage Iterpolato Formula Vjay Dahya PDepartmet of MathematcsMaharaja Surajmal
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationSection l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58
Secto.. 6l 34 6h 667899 7l 44 7h Stem=Tes 8l 344 Leaf=Oes 8h 5557899 9l 3 9h 58 Ths dsplay brgs out the gap the data: There are o scores the hgh 7's. 6. a. beams cylders 9 5 8 88533 6 6 98877643 7 488
More informationMA/CSSE 473 Day 27. Dynamic programming
MA/CSSE 473 Day 7 Dyamc Programmg Bomal Coeffcets Warshall's algorthm (Optmal BSTs) Studet questos? Dyamc programmg Used for problems wth recursve solutos ad overlappg subproblems Typcally, we save (memoze)
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationCorrelation and Regression Analysis
Chapter V Correlato ad Regresso Aalss R. 5.. So far we have cosdered ol uvarate dstrbutos. Ma a tme, however, we come across problems whch volve two or more varables. Ths wll be the subject matter of the
More informationQ-analogue of a Linear Transformation Preserving Log-concavity
Iteratoal Joural of Algebra, Vol. 1, 2007, o. 2, 87-94 Q-aalogue of a Lear Trasformato Preservg Log-cocavty Daozhog Luo Departmet of Mathematcs, Huaqao Uversty Quazhou, Fua 362021, P. R. Cha ldzblue@163.com
More informationSupervised learning: Linear regression Logistic regression
CS 57 Itroducto to AI Lecture 4 Supervsed learg: Lear regresso Logstc regresso Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 57 Itro to AI Data: D { D D.. D D Supervsed learg d a set of eamples s
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More information2D DSP Basics: 2D Systems
- Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity
More informationPROJECTION PROBLEM FOR REGULAR POLYGONS
Joural of Mathematcal Sceces: Advaces ad Applcatos Volume, Number, 008, Pages 95-50 PROJECTION PROBLEM FOR REGULAR POLYGONS College of Scece Bejg Forestry Uversty Bejg 0008 P. R. Cha e-mal: sl@bjfu.edu.c
More informationLecture 07: Poles and Zeros
Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto
More informationd dt d d dt dt Also recall that by Taylor series, / 2 (enables use of sin instead of cos-see p.27 of A&F) dsin
Learzato of the Swg Equato We wll cover sectos.5.-.6 ad begg of Secto 3.3 these otes. 1. Sgle mache-fte bus case Cosder a sgle mache coected to a fte bus, as show Fg. 1 below. E y1 V=1./_ Fg. 1 The admttace
More informationChapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II
CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh
More informationDKA method for single variable holomorphic functions
DKA method for sgle varable holomorphc fuctos TOSHIAKI ITOH Itegrated Arts ad Natural Sceces The Uversty of Toushma -, Mamhosama, Toushma, 770-8502 JAPAN Abstract: - Durad-Kerer-Aberth (DKA method for
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationKLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames
KLT Tracker Tracker. Detect Harrs corers the frst frame 2. For each Harrs corer compute moto betwee cosecutve frames (Algmet). 3. Lk moto vectors successve frames to get a track 4. Itroduce ew Harrs pots
More information3D Geometry for Computer Graphics. Lesson 2: PCA & SVD
3D Geometry for Computer Graphcs Lesso 2: PCA & SVD Last week - egedecomposto We wat to lear how the matrx A works: A 2 Last week - egedecomposto If we look at arbtrary vectors, t does t tell us much.
More informationSupport vector machines II
CS 75 Mache Learg Lecture Support vector maches II Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Learl separable classes Learl separable classes: here s a hperplae that separates trag staces th o error
More informationUniform DFT Filter Banks 1/27
.. Ufor FT Flter Baks /27 Ufor FT Flter Baks We ll look at 5 versos of FT-based flter baks all but the last two have serous ltatos ad are t practcal. But they gve a ce trasto to the last two versos whch
More informationMATH 247/Winter Notes on the adjoint and on normal operators.
MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say
More informationGG313 GEOLOGICAL DATA ANALYSIS
GG33 GEOLOGICAL DATA ANALYSIS 3 GG33 GEOLOGICAL DATA ANALYSIS LECTURE NOTES PAUL WESSEL SECTION 3 LINEAR (MATRIX ALGEBRA OVERVIEW OF MATRIX ALGEBRA (or All you ever wated to kow about Lear Algebra but
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationA tighter lower bound on the circuit size of the hardest Boolean functions
Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the
More informationSupport vector machines
CS 75 Mache Learg Lecture Support vector maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 75 Mache Learg Outle Outle: Algorthms for lear decso boudary Support vector maches Mamum marg hyperplae.
More informationA scalar t is an eigenvalue of A if and only if t satisfies the characteristic equation of A: det (A ti) =0
Chapter 5 a glace: Let e a lear operator whose stadard matrx s wth sze x. he, a ozero vector x s sad to e a egevector of ad f there exsts a scalar sch that (x) x x. he scalar s called a egevale of (or
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationHybrid RNS-to-Binary Converter for the Moduli Set {2 2n, 2 n -1, 2 n +1, 2 n+1-1}
Research Joural of Appled Sceces, Egeerg ad echology 6(): 07-0, 0 ISSN: 00-759; e-issn: 00-767 Mawell Scetfc Orgazato, 0 Submtted: November, 0 Accepted: Jauary 9, 0 ublshed: July 5, 0 Hybrd RNS-to-Bary
More informationNumerical Analysis Formulae Booklet
Numercal Aalyss Formulae Booklet. Iteratve Scemes for Systems of Lear Algebrac Equatos:.... Taylor Seres... 3. Fte Dfferece Approxmatos... 3 4. Egevalues ad Egevectors of Matrces.... 3 5. Vector ad Matrx
More informationEntropy ISSN by MDPI
Etropy 2003, 5, 233-238 Etropy ISSN 1099-4300 2003 by MDPI www.mdp.org/etropy O the Measure Etropy of Addtve Cellular Automata Hasa Aı Arts ad Sceces Faculty, Departmet of Mathematcs, Harra Uversty; 63100,
More informationBinary classification: Support Vector Machines
CS 57 Itroducto to AI Lecture 6 Bar classfcato: Support Vector Maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 57 Itro to AI Supervsed learg Data: D { D, D,.., D} a set of eamples D, (,,,,,
More informationComplex Numbers Primer
Complex Numbers Prmer Before I get started o ths let me frst make t clear that ths documet s ot teded to teach you everythg there s to kow about complex umbers. That s a subject that ca (ad does) take
More informationLecture 5: Interpolation. Polynomial interpolation Rational approximation
Lecture 5: Iterpolato olyomal terpolato Ratoal appromato Coeffcets of the polyomal Iterpolato: Sometme we kow the values of a fucto f for a fte set of pots. Yet we wat to evaluate f for other values perhaps
More informationTaylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific
CIS 54 - Iterpolato Roger Crawfs Basc Scearo We are able to prod some fucto, but do ot kow what t really s. Ths gves us a lst of data pots: [x,f ] f(x) f f + x x + August 2, 25 OSU/CIS 54 3 Taylor s Seres
More informationSome Notes on the Probability Space of Statistical Surveys
Metodološk zvezk, Vol. 7, No., 200, 7-2 ome Notes o the Probablty pace of tatstcal urveys George Petrakos Abstract Ths paper troduces a formal presetato of samplg process usg prcples ad cocepts from Probablty
More informationSingular Value Decomposition. Linear Algebra (3) Singular Value Decomposition. SVD and Eigenvectors. Solving LEs with SVD
Sgular Value Decomosto Lear Algera (3) m Cootes Ay m x matrx wth m ca e decomosed as follows Dagoal matrx A UWV m x x Orthogoal colums U U I w1 0 0 w W M M 0 0 x Orthoormal (Pure rotato) VV V V L 0 L 0
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationLikewise, properties of the optimal policy for equipment replacement & maintenance problems can be used to reduce the computation.
Whe solvg a vetory repleshmet problem usg a MDP model, kowg that the optmal polcy s of the form (s,s) ca reduce the computatoal burde. That s, f t s optmal to replesh the vetory whe the vetory level s,
More information= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n
.. Soluto of Problem. M s obvously cotuous o ], [ ad ], [. Observe that M x,..., x ) M x,..., x ) )..) We ext show that M s odecreasg o ], [. Of course.) mles that M s odecreasg o ], [ as well. To show
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More informationComputational Geometry
Problem efto omputatoal eometry hapter 6 Pot Locato Preprocess a plaar map S. ve a query pot p, report the face of S cotag p. oal: O()-sze data structure that eables O(log ) query tme. pplcato: Whch state
More informationSolutions to problem set ); (, ) (
Solutos to proble set.. L = ( yp p ); L = ( p p ); y y L, L = yp p, p p = yp p, + p [, p ] y y y = yp + p = L y Here we use for eaple that yp, p = yp p p yp = yp, p = yp : factors that coute ca be treated
More informationCS 1675 Introduction to Machine Learning Lecture 12 Support vector machines
CS 675 Itroducto to Mache Learg Lecture Support vector maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Mdterm eam October 9, 7 I-class eam Closed book Stud materal: Lecture otes Correspodg chapters
More informationConstruction of 1-Resilient Boolean Functions with Very Good Nonlinearity
See dscussos, stats, ad author profles for ths publcato at: https://www.researchgate.et/publcato/220738927 Costructo of 1-Reslet Boolea Fuctos wth Very Good Nolearty CONFERENCE PAPER LECTURE NOTES IN COMPUTER
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More information( ) ( ) A number of the form x+iy, where x & y are integers and i = 1 is called a complex number.
A umber of the form y, where & y are tegers ad s called a comple umber. Dfferet Forms )Cartesa Form y )Polar Form ( cos s ) r or r cs )Epoetal Form r e Demover s Theorem If s ay teger the cos s cos s If
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationApplying the condition for equilibrium to this equilibrium, we get (1) n i i =, r G and 5 i
CHEMICAL EQUILIBRIA The Thermodyamc Equlbrum Costat Cosder a reversble reacto of the type 1 A 1 + 2 A 2 + W m A m + m+1 A m+1 + Assgg postve values to the stochometrc coeffcets o the rght had sde ad egatve
More informationB-spline curves. 1. Properties of the B-spline curve. control of the curve shape as opposed to global control by using a special set of blending
B-sple crve Copyrght@, YZU Optmal Desg Laboratory. All rghts reserved. Last pdated: Yeh-Lag Hs (--9). ote: Ths s the corse materal for ME Geometrc modelg ad compter graphcs, Ya Ze Uversty. art of ths materal
More informationThe Lie Algebra of Smooth Sections of a T-bundle
IST Iteratoal Joural of Egeerg Scece, Vol 7, No3-4, 6, Page 8-85 The Le Algera of Smooth Sectos of a T-udle Nadafhah ad H R Salm oghaddam Astract: I ths artcle, we geeralze the cocept of the Le algera
More informationVLSI Implementation of High-Performance CORDIC-Based Vector Interpolator in Power-Aware 3-D Graphic Systems
Proceedgs of the 6th WSEAS Iteratoal Coferece o Istrumetato, Measuremet, Crcuts & Systems, Hagzhou, Cha, Aprl 5-7, 7 7 VLSI Implemetato of Hgh-Performace CORDIC-Based Vector Iterpolator Power-Aware 3-D
More informationMatrix Algebra Tutorial With Examples in Matlab
Matr Algebra Tutoral Wth Eamples Matlab by Klaus Moelter Departmet of Agrcultural ad Appled Ecoomcs Vrga Tech emal: moelter@vt.edu web: http://faculty.ageco.vt.edu/moelter/ Specfcally desged as a / day
More information