Least Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters

Size: px
Start display at page:

Download "Least Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters"

Transcription

1 Leas Squares Fg LSQF wh a complcaed fuco Theeampleswehavelookedasofarhavebeelearheparameers ha we have bee rg o deerme e.g. slope, ercep. For he case where he fuco s lear he parameers we ca fd a aalc soluo usg e.g. mar verso for a sragh le he mar s. However, we ofe ecouer he case where he fuco s o-lear some of he parameers, e.g. he fuco lab 5: / A, B, C,,, Ae B C Ths fuco s lear A, B,C, bu o-lear σ ad μ. Oher eamples of fucos wh a o-lear parameer are: / A / A Ae For mos o-lear fucos we cao wre dow a soluo for he parameers a closed form usg, for eample, he echques of lear algebra.e. marces. Usuall o-lear problems are solved umercall o a compuer. Somemes b a chage of varables we ca ur a o-lear problem o a lear oe. We wll do hs Lab 6 whe he lfeme of Ba37 s measured. R. Kass/Sp5 P3700/Lecure 8

2 Deermao of a Lfeme Lab 6 The amou of a radoacve subsace as a fuco of me s gve b: 0 e / = he amou of he subsace prese a me. 0 = amou of he subsace a he begg of he eperme = 0. = he lfeme of he subsace. We ca ur hs o-lear problem o a lear oe b a chage of varables Take he aural log of boh sdes of he above epoeal equao: =l =l 0 -/=C+D ow a lear problem he parameers C ad D! I fac s jus a sragh le! = -/D To measure he lfeme Lab 6 we frs f for D he slope & he rasform D o =-/D. R. Kass/Sp5 P3700/Lecure 8

3 Lfeme Daa = l D / D secods The ercep s gve b: C = 4.77 = l 0 or 0 = 7.9 = R= l[ Y ] me, R. Kass/Sp5 P3700/Lecure 8 3

4 Fd he values 0 ad akg o accou he uceraes he daa pos. Weghed formulas are Talor P98 ad Prob. 8.9 w =/ The ucera he umber of radoacve decas s govered b Posso sascs. The umber of cous a b s assumed o be he average of a Posso dsrbuo: = = Varace The varace of = l ca be calculaed usg propagao of errors: The slope & ercep from a sragh le f ha cludes uceraes he daa pos: / l / / / l l =4 75 ad = l l If all he 's are he same =4.75 ad = = -/ = -/ = 0.7 sec To calculae he error o he lfeme τ, we frs mus calculae he error o he slope, β: : he he epressos are decal o he uweghed case / / R. Kass/Sp5 P3700/Lecure 8 4 The epermeall deermed lfeme s: = 0.7 ±.3 sec / / 3

5 Leas Squares Fg-Epoeal Eample We ca calculae he o see how good he daa fs a epoeal deca dsrbuo: For hs problem: l 0 = =.73 ad = 0.7 sec / 0e 0 / 0 0 / 0e e 5.6 Posso appromao Mahemaca Calculao: Do[{csq=csq+c[]-a*Ep[-[]/au]^/a*Ep[-[]/au]},{,,0}] Pr["The ch sq per dof s ",csq/8] v=-cdf[chsquaredsrbuo[8],csq]; Pr["The ch sq prob. s ",00*v,"%"] 8 DOF sce we calculaed 0 & from he 0 daa pos The ch sq per dof s.96 The ch sq prob. s 4.9 % Ths s o such a good f sce he probabl s ol ~4.9%. R. Kass/Sp5 P3700/Lecure 8 5

6 The Error o he Mea Error o he mea revew from Lecure 4 Queso: If we have a se of measuremes of he same qua: Q f f m m f m q Wha's he bes wa o combe hese measuremes? How o calculae he varace oce we combe he measuremes? Assumg Gaussa sascs, he Mamum Lkelhood Mehod sas combe he... measuremes as: / / weghed average If all he varaces = = 3.. are he same: uweghed average The varace of he weghed average ca be calculaed usg propagao of errors: / / Ad he dervaves are: 4 / / / / R. Kass/Sp5 P3700/Lecure 8 6 =error he weghed mea

7 If all he varaces are he same: / The error he mea ges smaller as he umber of measuremes creases. Do' cofuse he error he mea wh he sadard devao of he dsrbuo! If we make more measuremes: The sadard devao of he gaussa dsrbuo remas he same, BUT he error he mea decreases Lecure 4 Eample: Two epermes measure he mass of he proo: Eperme measures m p=950±5 MeV Eperme measures m p =936±5 MeV Usg jus he average of he wo epermes we fd: m p = /=943MeV p Usg he weghed average of he wo epermes we fd: m p =950/5 +936/5 //5 +/5 =937 MeV ad he varace: =//5 +/5 =4MeV =4.9 =5 MeV Sce eperme was more precse ha eperme we would epec he fal resul o be closer o eperme s value. m p =937±5 MeV R. Kass/Sp5 P3700/Lecure 8 7

The Poisson Process Properties of the Poisson Process

The Poisson Process Properties of the Poisson Process Posso Processes Summary The Posso Process Properes of he Posso Process Ierarrval mes Memoryless propery ad he resdual lfeme paradox Superposo of Posso processes Radom seleco of Posso Pos Bulk Arrvals ad

More information

Solution set Stat 471/Spring 06. Homework 2

Solution set Stat 471/Spring 06. Homework 2 oluo se a 47/prg 06 Homework a Whe he upper ragular elemes are suppressed due o smmer b Le Y Y Y Y A weep o he frs colum o oba: A ˆ b chagg he oao eg ad ec YY weep o he secod colum o oba: Aˆ YY weep o

More information

Density estimation III. Linear regression.

Density estimation III. Linear regression. Lecure 6 Mlos Hauskrec mlos@cs.p.eu 539 Seo Square Des esmao III. Lear regresso. Daa: Des esmao D { D D.. D} D a vecor of arbue values Obecve: r o esmae e uerlg rue probabl srbuo over varables X px usg

More information

Chapter 8. Simple Linear Regression

Chapter 8. Simple Linear Regression Chaper 8. Smple Lear Regresso Regresso aalyss: regresso aalyss s a sascal mehodology o esmae he relaoshp of a respose varable o a se of predcor varable. whe here s jus oe predcor varable, we wll use smple

More information

Determination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction

Determination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction refeed Soluos for R&D o Desg Deermao of oe Equao arameers Soluos for R&D o Desg December 4, 0 refeed orporao Yosho Kumagae refeed Iroduco hyscal propery daa s exremely mpora for performg process desg ad

More information

14. Poisson Processes

14. Poisson Processes 4. Posso Processes I Lecure 4 we roduced Posso arrvals as he lmg behavor of Bomal radom varables. Refer o Posso approxmao of Bomal radom varables. From he dscusso here see 4-6-4-8 Lecure 4 " arrvals occur

More information

(1) Cov(, ) E[( E( ))( E( ))]

(1) Cov(, ) E[( E( ))( E( ))] Impac of Auocorrelao o OLS Esmaes ECON 3033/Evas Cosder a smple bvarae me-seres model of he form: y 0 x The four key assumpos abou ε hs model are ) E(ε ) = E[ε x ]=0 ) Var(ε ) =Var(ε x ) = ) Cov(ε, ε )

More information

The ray paths and travel times for multiple layers can be computed using ray-tracing, as demonstrated in Lab 3.

The ray paths and travel times for multiple layers can be computed using ray-tracing, as demonstrated in Lab 3. C. Trael me cures for mulple reflecors The ray pahs ad rael mes for mulple layers ca be compued usg ray-racg, as demosraed Lab. MATLAB scrp reflec_layers_.m performs smple ray racg. (m) ref(ms) ref(ms)

More information

Midterm Exam. Tuesday, September hour, 15 minutes

Midterm Exam. Tuesday, September hour, 15 minutes Ecoomcs of Growh, ECON560 Sa Fracsco Sae Uvers Mchael Bar Fall 203 Mderm Exam Tuesda, Sepember 24 hour, 5 mues Name: Isrucos. Ths s closed boo, closed oes exam. 2. No calculaors of a d are allowed. 3.

More information

The Linear Regression Of Weighted Segments

The Linear Regression Of Weighted Segments The Lear Regresso Of Weghed Segmes George Dael Maeescu Absrac. We proposed a regresso model where he depede varable s made o up of pos bu segmes. Ths suao correspods o he markes hroughou he da are observed

More information

Cyclone. Anti-cyclone

Cyclone. Anti-cyclone Adveco Cycloe A-cycloe Lorez (963) Low dmesoal aracors. Uclear f hey are a good aalogy o he rue clmae sysem, bu hey have some appealg characerscs. Dscusso Is he al codo balaced? Is here a al adjusme

More information

FORCED VIBRATION of MDOF SYSTEMS

FORCED VIBRATION of MDOF SYSTEMS FORCED VIBRAION of DOF SSES he respose of a N DOF sysem s govered by he marx equao of moo: ] u C] u K] u 1 h al codos u u0 ad u u 0. hs marx equao of moo represes a sysem of N smulaeous equaos u ad s me

More information

Fault Tolerant Computing. Fault Tolerant Computing CS 530 Probabilistic methods: overview

Fault Tolerant Computing. Fault Tolerant Computing CS 530 Probabilistic methods: overview Probably 1/19/ CS 53 Probablsc mehods: overvew Yashwa K. Malaya Colorado Sae Uversy 1 Probablsc Mehods: Overvew Cocree umbers presece of uceray Probably Dsjo eves Sascal depedece Radom varables ad dsrbuos

More information

Density estimation III.

Density estimation III. Lecure 4 esy esmao III. Mlos Hauskrec mlos@cs..edu 539 Seo Square Oule Oule: esy esmao: Mamum lkelood ML Bayesa arameer esmaes MP Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Eoeal

More information

Density estimation III.

Density estimation III. Lecure 6 esy esmao III. Mlos Hausrec mlos@cs..eu 539 Seo Square Oule Oule: esy esmao: Bomal srbuo Mulomal srbuo ormal srbuo Eoeal famly aa: esy esmao {.. } a vecor of arbue values Objecve: ry o esmae e

More information

Linear Regression Linear Regression with Shrinkage

Linear Regression Linear Regression with Shrinkage Lear Regresso Lear Regresso h Shrkage Iroduco Regresso meas predcg a couous (usuall scalar oupu from a vecor of couous pus (feaures x. Example: Predcg vehcle fuel effcec (mpg from 8 arbues: Lear Regresso

More information

COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION

COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION Eldesoky E. Affy. Faculy of Eg. Shbee El kom Meoufa Uv. Key word : Raylegh dsrbuo, leas squares mehod, relave leas squares, leas absolue

More information

AML710 CAD LECTURE 12 CUBIC SPLINE CURVES. Cubic Splines Matrix formulation Normalised cubic splines Alternate end conditions Parabolic blending

AML710 CAD LECTURE 12 CUBIC SPLINE CURVES. Cubic Splines Matrix formulation Normalised cubic splines Alternate end conditions Parabolic blending CUIC SLINE CURVES Cubc Sples Marx formulao Normalsed cubc sples Alerae ed codos arabolc bledg AML7 CAD LECTURE CUIC SLINE The ame sple comes from he physcal srume sple drafsme use o produce curves A geeral

More information

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1) Aoucemes Reags o E-reserves Proec roosal ue oay Parameer Esmao Bomercs CSE 9-a Lecure 6 CSE9a Fall 6 CSE9a Fall 6 Paer Classfcao Chaer 3: Mamum-Lelhoo & Bayesa Parameer Esmao ar All maerals hese sles were

More information

Density estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square

Density estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square Lecure 5 esy esmao Mlos Hauskrec mlos@cs..edu 539 Seo Square esy esmaos ocs: esy esmao: Mamum lkelood ML Bayesa arameer esmaes M Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Noaramerc

More information

Least squares and motion. Nuno Vasconcelos ECE Department, UCSD

Least squares and motion. Nuno Vasconcelos ECE Department, UCSD Leas squares ad moo uo Vascocelos ECE Deparme UCSD Pla for oda oda we wll dscuss moo esmao hs s eresg wo was moo s ver useful as a cue for recogo segmeao compresso ec. s a grea eample of leas squares problem

More information

FALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below.

FALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below. Jorge A. Ramírez HOMEWORK NO. 6 - SOLUTION Problem 1.: Use he Sorage-Idcao Mehod o roue he Ipu hydrograph abulaed below. Tme (h) Ipu Hydrograph (m 3 /s) Tme (h) Ipu Hydrograph (m 3 /s) 0 0 90 450 6 50

More information

EE 6885 Statistical Pattern Recognition

EE 6885 Statistical Pattern Recognition EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://www.ee.columba.edu/~sfchag Lecure 5 (9//05 4- Readg Model Parameer Esmao ML Esmao, Chap. 3. Mure of Gaussa ad EM Referece Boo, HTF Chap. 8.5 Teboo,

More information

Continuous Time Markov Chains

Continuous Time Markov Chains Couous me Markov chas have seay sae probably soluos f a oly f hey are ergoc, us lke scree me Markov chas. Fg he seay sae probably vecor for a couous me Markov cha s o more ffcul ha s he scree me case,

More information

Real-Time Systems. Example: scheduling using EDF. Feasibility analysis for EDF. Example: scheduling using EDF

Real-Time Systems. Example: scheduling using EDF. Feasibility analysis for EDF. Example: scheduling using EDF EDA/DIT6 Real-Tme Sysems, Chalmers/GU, 0/0 ecure # Updaed February, 0 Real-Tme Sysems Specfcao Problem: Assume a sysem wh asks accordg o he fgure below The mg properes of he asks are gve he able Ivesgae

More information

Lecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination

Lecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination Lecure 3 Topc : Drbuo, hypohe eg, ad ample ze deermao The Sude - drbuo Coder a repeaed drawg of ample of ze from a ormal drbuo of mea. For each ample, compue,,, ad aoher ac,, where: The ac he devao of

More information

Comparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution

Comparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution Joural of Mahemacs ad Sascs 6 (2): 1-14, 21 ISSN 1549-3644 21 Scece Publcaos Comarso of he Bayesa ad Maxmum Lkelhood Esmao for Webull Dsrbuo Al Omar Mohammed Ahmed, Hadeel Salm Al-Kuub ad Noor Akma Ibrahm

More information

8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall

8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall 8. Queueg sysems lec8. S-38.45 - Iroduco o Teleraffc Theory - Fall 8. Queueg sysems Coes Refresher: Smle eleraffc model M/M/ server wag laces M/M/ servers wag laces 8. Queueg sysems Smle eleraffc model

More information

QR factorization. Let P 1, P 2, P n-1, be matrices such that Pn 1Pn 2... PPA

QR factorization. Let P 1, P 2, P n-1, be matrices such that Pn 1Pn 2... PPA QR facorzao Ay x real marx ca be wre as AQR, where Q s orhogoal ad R s upper ragular. To oba Q ad R, we use he Householder rasformao as follows: Le P, P, P -, be marces such ha P P... PPA ( R s upper ragular.

More information

Final Exam Applied Econometrics

Final Exam Applied Econometrics Fal Eam Appled Ecoomercs. 0 Sppose we have he followg regresso resl: Depede Varable: SAT Sample: 437 Iclded observaos: 437 Whe heeroskedasc-cosse sadard errors & covarace Varable Coeffce Sd. Error -Sasc

More information

4. THE DENSITY MATRIX

4. THE DENSITY MATRIX 4. THE DENSTY MATRX The desy marx or desy operaor s a alerae represeao of he sae of a quaum sysem for whch we have prevously used he wavefuco. Alhough descrbg a quaum sysem wh he desy marx s equvale o

More information

Fundamentals of Speech Recognition Suggested Project The Hidden Markov Model

Fundamentals of Speech Recognition Suggested Project The Hidden Markov Model . Projec Iroduco Fudameals of Speech Recogo Suggesed Projec The Hdde Markov Model For hs projec, s proposed ha you desg ad mpleme a hdde Markov model (HMM) ha opmally maches he behavor of a se of rag sequeces

More information

( ) ( ) Weibull Distribution: k ti. u u. Suppose t 1, t 2, t n are times to failure of a group of n mechanisms. The likelihood function is

( ) ( ) Weibull Distribution: k ti. u u. Suppose t 1, t 2, t n are times to failure of a group of n mechanisms. The likelihood function is Webll Dsbo: Des Bce Dep of Mechacal & Idsal Egeeg The Uvesy of Iowa pdf: f () exp Sppose, 2, ae mes o fale of a gop of mechasms. The lelhood fco s L ( ;, ) exp exp MLE: Webll 3//2002 page MLE: Webll 3//2002

More information

-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for

-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for Assgme Sepha Brumme Ocober 8h, 003 9 h semeser, 70544 PREFACE I 004, I ed o sped wo semesers o a sudy abroad as a posgraduae exchage sude a he Uversy of Techology Sydey, Ausrala. Each opporuy o ehace my

More information

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No.

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No. www.jecs. Ieraoal Joural Of Egeerg Ad Compuer Scece ISSN: 19-74 Volume 5 Issue 1 Dec. 16, Page No. 196-1974 Sofware Relably Model whe mulple errors occur a a me cludg a faul correco process K. Harshchadra

More information

Partial Molar Properties of solutions

Partial Molar Properties of solutions Paral Molar Properes of soluos A soluo s a homogeeous mxure; ha s, a soluo s a oephase sysem wh more ha oe compoe. A homogeeous mxures of wo or more compoes he gas, lqud or sold phase The properes of a

More information

Suppose we have observed values t 1, t 2, t n of a random variable T.

Suppose we have observed values t 1, t 2, t n of a random variable T. Sppose we have obseved vales, 2, of a adom vaable T. The dsbo of T s ow o belog o a cea ype (e.g., expoeal, omal, ec.) b he veco θ ( θ, θ2, θp ) of ow paamees assocaed wh s ow (whee p s he mbe of ow paamees).

More information

Mathematical Formulation

Mathematical Formulation Mahemacal Formulao The purpose of a fe fferece equao s o appromae he paral ffereal equao (PE) whle maag he physcal meag. Eample PE: p c k FEs are usually formulae by Taylor Seres Epaso abou a po a eglecg

More information

RATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA

RATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA The 7 h Ieraoal as of Sascs ad Ecoomcs Prague Sepember 9-0 Absrac RATIO ESTIMATORS USING HARATERISTIS OF POISSON ISTRIBUTION WITH APPLIATION TO EARTHQUAKE ATA Gamze Özel Naural pulaos bolog geecs educao

More information

Solution. The straightforward approach is surprisingly difficult because one has to be careful about the limits.

Solution. The straightforward approach is surprisingly difficult because one has to be careful about the limits. ose ad Varably Homewor # (8), aswers Q: Power spera of some smple oses A Posso ose A Posso ose () s a sequee of dela-fuo pulses, eah ourrg depedely, a some rae r (More formally, s a sum of pulses of wdh

More information

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01 ECO 745, Homework 6 Le Cabrera. Assume that the followg data come from the lear model: ε ε ~ N, σ,,..., -6. -.5 7. 6.9 -. -. -.9. -..6.4.. -.6 -.7.7 Fd the mamum lkelhood estmates of,, ad σ ε s.6. 4. ε

More information

Moments of Order Statistics from Nonidentically Distributed Three Parameters Beta typei and Erlang Truncated Exponential Variables

Moments of Order Statistics from Nonidentically Distributed Three Parameters Beta typei and Erlang Truncated Exponential Variables Joural of Mahemacs ad Sascs 6 (4): 442-448, 200 SSN 549-3644 200 Scece Publcaos Momes of Order Sascs from Nodecally Dsrbued Three Parameers Bea ype ad Erlag Trucaed Expoeal Varables A.A. Jamoom ad Z.A.

More information

Interval Estimation. Consider a random variable X with a mean of X. Let X be distributed as X X

Interval Estimation. Consider a random variable X with a mean of X. Let X be distributed as X X ECON 37: Ecoomercs Hypohess Tesg Iervl Esmo Wh we hve doe so fr s o udersd how we c ob esmors of ecoomcs reloshp we wsh o sudy. The queso s how comforble re we wh our esmors? We frs exme how o produce

More information

Some Probability Inequalities for Quadratic Forms of Negatively Dependent Subgaussian Random Variables

Some Probability Inequalities for Quadratic Forms of Negatively Dependent Subgaussian Random Variables Joural of Sceces Islamc epublc of Ira 6(: 63-67 (005 Uvers of ehra ISSN 06-04 hp://scecesuacr Some Probabl Iequales for Quadrac Forms of Negavel Depede Subgaussa adom Varables M Am A ozorga ad H Zare 3

More information

The Mean Residual Lifetime of (n k + 1)-out-of-n Systems in Discrete Setting

The Mean Residual Lifetime of (n k + 1)-out-of-n Systems in Discrete Setting Appled Mahemacs 4 5 466-477 Publshed Ole February 4 (hp//wwwscrporg/oural/am hp//dxdoorg/436/am45346 The Mea Resdual Lfeme of ( + -ou-of- Sysems Dscree Seg Maryam Torab Sahboom Deparme of Sascs Scece ad

More information

CS344: Introduction to Artificial Intelligence

CS344: Introduction to Artificial Intelligence C344: Iroduco o Arfcal Iellgece Puhpa Bhaacharyya CE Dep. IIT Bombay Lecure 3 3 32 33: Forward ad bacward; Baum elch 9 h ad 2 March ad 2 d Aprl 203 Lecure 27 28 29 were o EM; dae 2 h March o 8 h March

More information

Key words: Fractional difference equation, oscillatory solutions,

Key words: Fractional difference equation, oscillatory solutions, OSCILLATION PROPERTIES OF SOLUTIONS OF FRACTIONAL DIFFERENCE EQUATIONS Musafa BAYRAM * ad Ayd SECER * Deparme of Compuer Egeerg, Isabul Gelsm Uversy Deparme of Mahemacal Egeerg, Yldz Techcal Uversy * Correspodg

More information

EE 6885 Statistical Pattern Recognition

EE 6885 Statistical Pattern Recognition EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://.ee.columba.edu/~sfchag Lecure 8 (/8/05 8- Readg Feaure Dmeso Reduco PCA, ICA, LDA, Chaper 3.8, 0.3 ICA Tuoral: Fal Exam Aapo Hyväre ad Erkk Oja,

More information

Solution of Impulsive Differential Equations with Boundary Conditions in Terms of Integral Equations

Solution of Impulsive Differential Equations with Boundary Conditions in Terms of Integral Equations Joural of aheacs ad copuer Scece (4 39-38 Soluo of Ipulsve Dffereal Equaos wh Boudary Codos Ters of Iegral Equaos Arcle hsory: Receved Ocober 3 Acceped February 4 Avalable ole July 4 ohse Rabba Depare

More information

PubH 7440 Spring 2010 Midterm 2 April

PubH 7440 Spring 2010 Midterm 2 April ubh 7440 Sprg 00 Mderm Aprl roblem a: Because \hea^_ s a lear combao of ormal radom arables wll also be ormal. Thus he mea ad arace compleel characerze he dsrbuo. We also use ha he Z ad \hea^{-}_ are depede.

More information

Upper Bound For Matrix Operators On Some Sequence Spaces

Upper Bound For Matrix Operators On Some Sequence Spaces Suama Uer Bou formar Oeraors Uer Bou For Mar Oeraors O Some Sequece Saces Suama Dearme of Mahemacs Gaah Maa Uersy Yogyaara 558 INDONESIA Emal: suama@ugmac masomo@yahoocom Isar D alam aer aa susa masalah

More information

Big O Notation for Time Complexity of Algorithms

Big O Notation for Time Complexity of Algorithms BRONX COMMUNITY COLLEGE of he Ciy Uiversiy of New York DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE CSI 33 Secio E01 Hadou 1 Fall 2014 Sepember 3, 2014 Big O Noaio for Time Complexiy of Algorihms Time

More information

Pricing of CDO s Based on the Multivariate Wang Transform*

Pricing of CDO s Based on the Multivariate Wang Transform* Prcg of DO s Based o he Mulvarae Wag Trasform* ASTIN 2009 olloquum @ Helsk 02 Jue 2009 Masaak Kma Tokyo Meropola versy/ Kyoo versy Emal: kma@mu.ac.p hp://www.comp.mu.ac.p/kmam * Jo Work wh Sh-ch Moomya

More information

For the plane motion of a rigid body, an additional equation is needed to specify the state of rotation of the body.

For the plane motion of a rigid body, an additional equation is needed to specify the state of rotation of the body. The kecs of rgd bodes reas he relaoshps bewee he exeral forces acg o a body ad he correspodg raslaoal ad roaoal moos of he body. he kecs of he parcle, we foud ha wo force equaos of moo were requred o defe

More information

Efficient Estimators for Population Variance using Auxiliary Information

Efficient Estimators for Population Variance using Auxiliary Information Global Joural of Mahemacal cece: Theor ad Praccal. IN 97-3 Volume 3, Number (), pp. 39-37 Ieraoal Reearch Publcao Houe hp://www.rphoue.com Effce Emaor for Populao Varace ug Aular Iformao ubhah Kumar Yadav

More information

Quantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state)

Quantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state) Pro. O. B. Wrgh, Auum Quaum Mechacs II Lecure Tme-depede perurbao heory Tme-depede perurbao heory (degeerae or o-degeerae sarg sae) Cosder a sgle parcle whch, s uperurbed codo wh Hamloa H, ca exs a superposo

More information

Modeling and Predicting Sequences: HMM and (may be) CRF. Amr Ahmed Feb 25

Modeling and Predicting Sequences: HMM and (may be) CRF. Amr Ahmed Feb 25 Modelg d redcg Sequeces: HMM d m be CRF Amr Ahmed 070 Feb 25 Bg cure redcg Sgle Lbel Ipu : A se of feures: - Bg of words docume - Oupu : Clss lbel - Topc of he docume - redcg Sequece of Lbels Noo Noe:

More information

Quantitative Portfolio Theory & Performance Analysis

Quantitative Portfolio Theory & Performance Analysis 550.447 Quaave Porfolo heory & Performace Aalyss Week February 4 203 Coceps. Assgme For February 4 (hs Week) ead: A&L Chaper Iroduco & Chaper (PF Maageme Evrome) Chaper 2 ( Coceps) Seco (Basc eur Calculaos)

More information

θ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions:

θ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions: Paramerc coug process models Cosder coug processes: N,,..., ha cou he occurreces of a eve of eres for dvduals Iesy processes: Lelhood λ ( ;,,..., N { } λ < Log-lelhood: l( log L( Score fucos: U ( l( log

More information

Competitive Facility Location Problem with Demands Depending on the Facilities

Competitive Facility Location Problem with Demands Depending on the Facilities Aa Pacc Maageme Revew 4) 009) 5-5 Compeve Facl Locao Problem wh Demad Depedg o he Facle Shogo Shode a* Kuag-Yh Yeh b Hao-Chg Ha c a Facul of Bue Admrao Kobe Gau Uver Japa bc Urba Plag Deparme Naoal Cheg

More information

NOTE ON SIMPLE AND LOGARITHMIC RETURN

NOTE ON SIMPLE AND LOGARITHMIC RETURN Appled udes Agrbusess ad Commerce AAC Ceer-r ublshg House, Debrece DOI:.94/AAC/27/-2/6 CIENIFIC AE NOE ON IME AND OGAIHMIC EUN aa Mskolcz Uversy of Debrece, Isue of Accoug ad Face mskolczpaa@gmal.com Absrac:

More information

Asymptotic Behavior of Solutions of Nonlinear Delay Differential Equations With Impulse

Asymptotic Behavior of Solutions of Nonlinear Delay Differential Equations With Impulse P a g e Vol Issue7Ver,oveber Global Joural of Scece Froer Research Asypoc Behavor of Soluos of olear Delay Dffereal Equaos Wh Ipulse Zhag xog GJSFR Classfcao - F FOR 3 Absrac Ths paper sudes he asypoc

More information

Use of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean

Use of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean Amerca Joural of Operaoal esearch 06 6(: 69-75 DOI: 0.59/.aor.06060.0 Use of o-coveoal Measures of Dsperso for Improve Esmao of Populao Mea ubhash Kumar aav.. Mshra * Alok Kumar hukla hak Kumar am agar

More information

Assessing Normality. Assessing Normality. Assessing Normality. Assessing Normality. Normal Probability Plot for Normal Distribution.

Assessing Normality. Assessing Normality. Assessing Normality. Assessing Normality. Normal Probability Plot for Normal Distribution. Assessg Normaly No All Couous Radom Varables are Normally Dsrbued I s Impora o Evaluae how Well he Daa Se Seems o be Adequaely Approxmaed by a Normal Dsrbuo Cosruc Chars Assessg Normaly For small- or moderae-szed

More information

The Signal, Variable System, and Transformation: A Personal Perspective

The Signal, Variable System, and Transformation: A Personal Perspective The Sgal Varable Syem ad Traformao: A Peroal Perpecve Sherv Erfa 35 Eex Hall Faculy of Egeerg Oule Of he Talk Iroduco Mahemacal Repreeao of yem Operaor Calculu Traformao Obervao O Laplace Traform SSB A

More information

Photon Statistics. photons/s. Light beam stream of photons Difference with classical waves relies on different statistical properties

Photon Statistics. photons/s. Light beam stream of photons Difference with classical waves relies on different statistical properties hoo Sascs Lgh beam sream of phoos Dfferece wh classcal waves reles o dffere sascal properes Average cou rae correspods o Iesy of lgh beam Acual cou rae flucuaes from measureme o measureme The pulse aure

More information

Pricing Asian Options with Fourier Convolution

Pricing Asian Options with Fourier Convolution Prcg Asa Opos wh Fourer Covoluo Cheg-Hsug Shu Deparme of Compuer Scece ad Iformao Egeerg Naoal Tawa Uversy Coes. Iroduco. Backgroud 3. The Fourer Covoluo Mehod 3. Seward ad Hodges facorzao 3. Re-ceerg

More information

Regression Approach to Parameter Estimation of an Exponential Software Reliability Model

Regression Approach to Parameter Estimation of an Exponential Software Reliability Model Amerca Joural of Theorecal ad Appled Sascs 06; 5(3): 80-86 hp://www.scecepublshggroup.com/j/ajas do: 0.648/j.ajas.060503. ISSN: 36-8999 (Pr); ISSN: 36-9006 (Ole) Regresso Approach o Parameer Esmao of a

More information

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!) i+1,q - [(! ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL The frs hng o es n wo-way ANOVA: Is here neracon? "No neracon" means: The man effecs model would f. Ths n urn means: In he neracon plo (wh A on he horzonal

More information

Extremal graph theory II: K t and K t,t

Extremal graph theory II: K t and K t,t Exremal graph heory II: K ad K, Lecure Graph Theory 06 EPFL Frak de Zeeuw I his lecure, we geeralize he wo mai heorems from he las lecure, from riagles K 3 o complee graphs K, ad from squares K, o complee

More information

Mathematical Statistics. Chapter VIII Sampling Distributions and the Central Limit Theorem

Mathematical Statistics. Chapter VIII Sampling Distributions and the Central Limit Theorem Mahmacal ascs 8 Chapr VIII amplg Dsrbos ad h Cral Lm Thorm Fcos of radom arabls ar sall of rs sascal applcao Cosdr a s of obsrabl radom arabls L For ampl sppos h arabls ar a radom sampl of s from a poplao

More information

Solving Non-Linear Rational Expectations Models: Approximations based on Taylor Expansions

Solving Non-Linear Rational Expectations Models: Approximations based on Taylor Expansions Work progress Solvg No-Lear Raoal Expecaos Models: Approxmaos based o Taylor Expasos Rober Kollma (*) Deparme of Ecoomcs, Uversy of Pars XII 6, Av. du Gééral de Gaulle; F-94 Créel Cedex; Frace rober_kollma@yahoo.com;

More information

Learning of Graphical Models Parameter Estimation and Structure Learning

Learning of Graphical Models Parameter Estimation and Structure Learning Learg of Grahal Models Parameer Esmao ad Sruure Learg e Fukumzu he Isue of Sasal Mahemas Comuaoal Mehodology Sasal Iferee II Work wh Grahal Models Deermg sruure Sruure gve by modelg d e.g. Mxure model

More information

ε. Therefore, the estimate

ε. Therefore, the estimate Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model

More information

Anouncements. Conjugate Gradients. Steepest Descent. Outline. Steepest Descent. Steepest Descent

Anouncements. Conjugate Gradients. Steepest Descent. Outline. Steepest Descent. Steepest Descent oucms Couga Gas Mchal Kazha (6.657) Ifomao abou h Sma (6.757) hav b pos ol: hp://www.cs.hu.u/~msha Tch Spcs: o M o Tusay afoo. o Two paps scuss ach w. o Vos fo w s caa paps u by Thusay vg. Oul Rvw of Sps

More information

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should

More information

As evident from the full-sample-model, we continue to assume that individual errors are identically and

As evident from the full-sample-model, we continue to assume that individual errors are identically and Maxmum Lkelhood smao Greee Ch.4; App. R scrp modsa, modsb If we feel safe makg assumpos o he sascal dsrbuo of he error erm, Maxmum Lkelhood smao (ML) s a aracve alerave o Leas Squares for lear regresso

More information

STK3100 and STK4100 Autumn 2017

STK3100 and STK4100 Autumn 2017 SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs

More information

VARIATIONAL ITERATION METHOD FOR DELAY DIFFERENTIAL-ALGEBRAIC EQUATIONS. Hunan , China,

VARIATIONAL ITERATION METHOD FOR DELAY DIFFERENTIAL-ALGEBRAIC EQUATIONS. Hunan , China, Mahemacal ad Compuaoal Applcaos Vol. 5 No. 5 pp. 834-839. Assocao for Scefc Research VARIATIONAL ITERATION METHOD FOR DELAY DIFFERENTIAL-ALGEBRAIC EQUATIONS Hoglag Lu Aguo Xao Yogxag Zhao School of Mahemacs

More information

EMA5001 Lecture 3 Steady State & Nonsteady State Diffusion - Fick s 2 nd Law & Solutions

EMA5001 Lecture 3 Steady State & Nonsteady State Diffusion - Fick s 2 nd Law & Solutions EMA5 Lecue 3 Seady Sae & Noseady Sae ffuso - Fck s d Law & Soluos EMA 5 Physcal Popees of Maeals Zhe heg (6) 3 Noseady Sae ff Fck s d Law Seady-Sae ffuso Seady Sae Seady Sae = Equlbum? No! Smlay: Sae fuco

More information

Lecture VI Regression

Lecture VI Regression Lecure VI Regresson (Lnear Mehods for Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure VI: MLSC - Dr. Sehu Vjayakumar Lnear Regresson Model M

More information

CSE 5526: Introduction to Neural Networks Linear Regression

CSE 5526: Introduction to Neural Networks Linear Regression CSE 556: Itroducto to Neural Netorks Lear Regresso Part II 1 Problem statemet Part II Problem statemet Part II 3 Lear regresso th oe varable Gve a set of N pars of data , appromate d by a lear fucto

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Mixed Integral Equation of Contact Problem in Position and Time

Mixed Integral Equation of Contact Problem in Position and Time Ieraoal Joural of Basc & Appled Sceces IJBAS-IJENS Vol: No: 3 ed Iegral Equao of Coac Problem Poso ad me. A. Abdou S. J. oaquel Deparme of ahemacs Faculy of Educao Aleadra Uversy Egyp Deparme of ahemacs

More information

Brownian Motion and Stochastic Calculus. Brownian Motion and Stochastic Calculus

Brownian Motion and Stochastic Calculus. Brownian Motion and Stochastic Calculus Browa Moo Sochasc Calculus Xogzh Che Uversy of Hawa a Maoa earme of Mahemacs Seember, 8 Absrac Ths oe s abou oob decomoso he bascs of Suare egrable margales Coes oob-meyer ecomoso Suare Iegrable Margales

More information

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5 TPG460 Reservor Smulaon 08 page of 5 DISCRETIZATIO OF THE FOW EQUATIOS As we already have seen, fne dfference appromaons of he paral dervaves appearng n he flow equaons may be obaned from Taylor seres

More information

IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS

IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS Vol.7 No.4 (200) p73-78 Joural of Maageme Scece & Sascal Decso IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS TIANXIANG YAO AND ZAIWU GONG College of Ecoomcs &

More information

OLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17

OLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17 OLS bias for ecoomeric models wih errors-i-variables. The Lucas-criique Supplemeary oe o Lecure 7 RNy May 6, 03 Properies of OLS i RE models I Lecure 7 we discussed he followig example of a raioal expecaios

More information

CHAPTER 6. d. With success = observation greater than 10, x = # of successes = 4, and

CHAPTER 6. d. With success = observation greater than 10, x = # of successes = 4, and CHAPTR 6 Secto 6.. a. We use the samle mea, to estmate the oulato mea µ. Σ 9.80 µ 8.407 7 ~ 7. b. We use the samle meda, 7 (the mddle observato whe arraged ascedg order. c. We use the samle stadard devato,

More information

Machine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB

Machine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB ache Learg 0-70/5 70/5-78 78 all 006 Iroduco o Regresso Erc g Lecure 3 Sepember 9 006 Readg: Chap. 3 C Iferece wh he Jo Compue Codoals 0.4 0. P lu eadhead P lu eadhead P eadhead 0.7 0. 0.05 0.05 0.05 0.05

More information

Multiple Choice Test. Chapter Adequacy of Models for Regression

Multiple Choice Test. Chapter Adequacy of Models for Regression Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to

More information

Section l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58

Section l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58 Secto.. 6l 34 6h 667899 7l 44 7h Stem=Tes 8l 344 Leaf=Oes 8h 5557899 9l 3 9h 58 Ths dsplay brgs out the gap the data: There are o scores the hgh 7's. 6. a. beams cylders 9 5 8 88533 6 6 98877643 7 488

More information

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1 STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal

More information

Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models

Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models Ieraoal Bomerc Coferece 22/8/3, Kobe JAPAN Survval Predco Based o Compoud Covarae uder Co Proporoal Hazard Models PLoS ONE 7. do:.37/oural.poe.47627. hp://d.plos.org/.37/oural.poe.47627 Takesh Emura Graduae

More information

Fresnel Dragging Explained

Fresnel Dragging Explained Fresel Draggig Explaied 07/05/008 Decla Traill Decla@espace.e.au The Fresel Draggig Coefficie required o explai he resul of he Fizeau experime ca be easily explaied by usig he priciples of Eergy Field

More information

Statistics: Part 1 Parameter Estimation

Statistics: Part 1 Parameter Estimation Hery Sar ad Joh W. Woods, robably, Sascs, ad Radom ables for geers, h ed., earso ducao Ic., 0. ISBN: 978-0-3-33-6 Chaer 6 Sascs: ar arameer smao Secos 6. Iroduco 30 Ideede, Idecally Dsrbued (..d.) Observaos

More information

Centroids Method of Composite Areas

Centroids Method of Composite Areas Cetrods Method of Composte reas small boy swallowed some cos ad was take to a hosptal. Whe hs gradmother telephoed to ask how he was a urse sad 'No chage yet'. Cetrods Prevously, we developed a geeral

More information

Optimal Eye Movement Strategies in Visual Search (Supplement)

Optimal Eye Movement Strategies in Visual Search (Supplement) Opmal Eye Moveme Sraeges Vsual Search (Suppleme) Jr Naemk ad Wlso S. Gesler Ceer for Percepual Sysems ad Deparme of Psychology, Uversy of exas a Aus, Aus X 787 Here we derve he deal searcher for he case

More information

Pure Math 30: Explained!

Pure Math 30: Explained! ure Mah : Explaied! www.puremah.com 6 Logarihms Lesso ar Basic Expoeial Applicaios Expoeial Growh & Decay: Siuaios followig his ype of chage ca be modeled usig he formula: (b) A = Fuure Amou A o = iial

More information

Kernel-based Methods and Support Vector Machines

Kernel-based Methods and Support Vector Machines Kerel-based Methods ad Support Vector Maches Larr Holder CptS 570 Mache Learg School of Electrcal Egeerg ad Computer Scece Washgto State Uverst Refereces Muller et al. A Itroducto to Kerel-Based Learg

More information