CSCE 478/878 Lecture 4: Experimental Design and Analysis. Stephen Scott. 3 Building a tree on the training set Introduction. Outline.
|
|
- Deirdre Carson
- 5 years ago
- Views:
Transcription
1 In Homewok, you ae (supposedly) Choosing a data set 2 Extacting a test set of size > 3 3 Building a tee on the taining set 4 Testing on the test set 5 Repoting the accuacy (Adapted fom Ethem Alpaydin and Tom Mitchell) Does the epoted accuacy exactly match the genealization pefomance of the tee? If a tee has eo % and an A has eo %, is the tee absolutely bette? / 35 sscott@cse.unl.edu 2 / 35 Why o why not? How about the algoithms in geneal? Setting of pefomance evaluation eo and confidence intevals Paied t tests and coss-validation to compae leaning algoithms pefomance measues Confusion matices ROC analysis Pecision-ecall cuves Befoe setting up an expeiment, need to undestand exactly what the goal is Estimate the genealization pefomance of a hypothesis Tuning a leaning algoithm s paametes two leaning algoithms on a specific task Etc. Will neve be able to answe the question with % cetainty Due to vaiances in taining set selection, test set selection, etc. Will choose an estimato fo the quantity in question, detemine the pobability distibution of the estimato, and bound the pobability that the estimato is way off Estimato needs to wok egadless of distibution of taining/testing data 3 / 35 4 / 35 Setting (cont d) Types of 5 / 35 eed to note that, in addition to statistical vaiations, what we detemine is limited to the application that we ae studying E.g., if naïve Bayes bette than ID3 on spam filteing, that means nothing about face ecognition In planning expeiments, need to ensue that taining data not used fo evaluation I.e., don t test on the taining set! Will bias the pefomance estimato Also holds fo validation set used to pune DT, tune paametes, etc. Validation set seves as pat of taining set, but not used fo model building Types of 6 / 35 Fo now, focus on staightfowad, / classification eo Fo hypothesis h, ecall the two types of classification eo fom Chapte 2: Empiical eo (o sample eo) is faction of set V that h gets wong: eo V (h) X (C(x) 6= h(x)), V x2v whee (C(x) 6= h(x)) is if C(x) 6= h(x), and othewise Genealization eo (o tue eo) is pobability that a new, andomly selected, instance is misclassified by h eo D (h) P [C(x) 6= h(x)], x2d whee D is pobability distibution instances ae dawn fom Why do we cae about eo V (h)?
2 Tue Tue (cont d) Types of Bias: If T is taining set, eo T (h) is optimistically biased bias E[eo T (h)] eo D (h) Fo unbiased estimate (bias = ), h and V must be chosen independently ) don t test on the taining set! (By the way, this is distinct fom inductive bias) Vaiance: Even with unbiased V, eo V (h) may still vay fom eo D (h) Types of Expeiment: Choose sample V of size accoding to distibution D 2 Measue eo V (h) eo V (h) is a andom vaiable (i.e., esult of an expeiment) eo V (h) is an unbiased estimato fo eo D (h) Given obseved eo V (h), what can we conclude about eo D (h)? 7 / 35 8 / 35 (cont d) If V contains examples, dawn independently of h and each othe 3 If V contains examples, dawn independently of h and each othe 3 Then with appoximately 95% pobability, eo D (h) lies in Then with appoximately c% pobability, eo D (h) lies in Types of 9 / 35 eov (h)( eo V (h)) eo V (h) ±.96 E.g. hypothesis h misclassifies 2 of the 4 examples in test set V: eo V (h) = 2 4 =.3 Then with appox. 95% confidence, eo D (h) 2 [58,.442] Types of / 35 Why? eov (h)( eo V (h)) eo V (h) ± z c %: 5% 68% 8% 9% 95% 98% 99% z c : eo V (h) is a Random Vaiable Binomial Pobability Distibution Types of / 35 Repeatedly un the expeiment, each with diffeent andomly dawn V (each of size ) Pobability of obseving misclassified examples: P() P() = Binomial distibution fo n = 4, p = eo D (h) ( eo D (h)) I.e., let eo D (h) be pobability of heads in biased coin, then P() =pob. of getting heads out of flips Types of 2 / 35 P() = p ( p)! =!( )! p ( p) Pobability P() of heads in coin flips, if p = P(heads) Expected, o mean value of X, E[X] (= # heads on flips = # mistakes on test exs), is X E[X] ip(i) =p = eo D (h) Vaiance of X is i= Va(X) E[(X E[X]) 2 ]=p( p) Standad deviation of X, X, is q E[(X E[X]) 2 ]= p p( p) X
3 Appoximate Binomial Dist. with omal omal Pobability Distibution Types of 3 / 35 eo V (h) =/ is binomially distibuted, with mean µ eov (h) = eo D (h) (i.e., unbiased est.) standad deviation eov (h) eod (h)( eo D (h)) eo V (h) = (inceasing deceases vaiance) Want to compute confidence inteval = inteval centeed at eo D (h) containing c% of the weight unde the distibution Appoximate binomial by nomal (Gaussian) dist: mean µ eov (h) = eo D (h) standad deviation eov (h) eov (h)( eo V (h)) eo V (h) Types of 4 / omal distibution with mean, standad deviation ! p(x) = p exp x µ The pobability that X will fall into the inteval (a, b) is given by R b a p(x) dx Expected, o mean value of X, E[X], is E[X] =µ Vaiance is Va(X) = 2, standad deviation is X = omal Pobability Distibution (cont d) omal Pobability Distibution (cont d) Types of % of aea (pobability) lies in µ ±.28 c% of aea (pobability) lies in µ ± z c c%: 5% 68% 8% 9% 95% 98% 99% z c : Types of Can also have one-sided bounds: c% of aea lies <µ+ z c o >µ z c, whee z c = z ( c)/2 c%: 5% 68% 8% 9% 95% 98% 99% z c: / 35 6 / 35 Revisited Cental Limit Theoem Types of 7 / 35 If V contains 3 examples, indep. of h and each othe Then with appoximately 95% pobability, eo V (h) lies in eod (h)( eo D (h)) eo D (h) ±.96 Equivalently, eo D (h) lies in eod (h)( eo D (h)) eo V (h) ±.96 which is appoximately eov (h)( eo V (h)) eo V (h) ±.96 (One-sided bounds yield uppe o lowe eo bounds) Types of 8 / 35 How can we justify appoximation? Conside set of iid andom vaiables Y,...,Y, all fom abitay pobability distibution with mean µ and finite vaiance 2. Define sample mean Ȳ (/) P n i= Y i Ȳ is itself a andom vaiable, i.e., esult of an expeiment (e.g., eo S (h) =/) Cental Limit Theoem: As!, the distibution govening Ȳ appoaches nomal distibution with mean µ and vaiance 2 / Thus the distibution of eo S (h) is appoximately nomal fo lage, and its expected value is eo D (h) (Rule of thumb: 3 when estimato s distibution is binomial; might need to be lage fo othe distibutions)
4 Calculating Types of Pick paamete to estimate: eo D (h) 2 Choose an estimato: eo V (h) 3 Detemine pobability distibution that govens estimato: eo V (h) govened by binomial distibution, appoximated by nomal when 3 4 Find inteval (L, U) such that c% of pobability mass falls in the inteval Could have L = o U = Use table of z c o z c values (if distibution nomal) Distibution What if we want to compae two leaning algoithms L and L 2 (e.g., ID3 vs k-neaest neighbo) on a specific application? Insufficient to simply compae eo ates on a single test set Use K-fold coss validation and a paied t test 9 / 35 2 / 35 K-Fold Coss Validation K-Fold Coss Validation (cont d) Distibution 2 / 35 Patition data set X into K equal-sized subsets X, X 2,...,X K, whee X i 3 2 Fo i fom to K, do (Use X i fo testing, and est fo taining) V i = X i 2 T i = X\X i 3 Tain leaning algoithm L on T i to get h i 4 Tain leaning algoithm L 2 on T i to get h 2 i 5 Let p j i be eo of hj i on test set V i 6 p i = p i p 2 i 3 diffeence estimate p =(/K) P K i p i Distibution 22 / 35 ow estimate confidence that tue expected eo diffeence < ) Confidence that L is bette than L 2 on leaning task Use one-sided test, with confidence deived fom student s t distibution with K degees of feedom With appoximately c% pobability, tue diffeence of expected eo between L and L 2 is at most whee p + t c,k s p v u s p t KX (p i p) 2 K(K ) i= Distibution (One-Sided Test) Caveat Distibution If p + t c,k s p < ou assetion that L has less eo than L 2 is suppoted with confidence c So if K-fold CV used, compute p, look up t c,k and check if p < t c,k s p One-sided test; says nothing about L 2 ove L Distibution Say you want to show that leaning algoithm L pefoms bette than algoithms L 2, L 3, L 4, L 5 If you use K-fold CV to show supeio pefomance of L ove each of L 2,...,L 5 at 95% confidence, thee s a 5% chance each one is wong ) Thee s a 2% chance that at least one is wong ) Ou oveall confidence is only 8% eed to account fo this, o use moe appopiate test 23 / / 35
5 Moe Specific Confusion Matices Confusion Matices ROC Cuves Pecision-Recall Cuves So fa, we ve looked at a single eo ate to compae hypotheses/leaning algoithms/etc. This may not tell the whole stoy: test examples: 2 positive, 98 negative h gets 2/2 pos coect, 965/98 neg coect, fo accuacy of ( )/(2 + 98) =.967 Petty impessive, except that always pedicting negative yields accuacy =.98 Would we athe have h 2, which gets 9/2 pos coect and 93/98 neg, fo accuacy =.949? Depends on how impotant the positives ae, i.e., fequency in pactice and/o cost (e.g., cance diagnosis) Confusion Matices ROC Cuves Pecision-Recall Cuves Beak down eo into type: tue positive, etc. Pedicted Class Tue Class Positive egative Total Positive tp : tue positive fn : false negative p egative fp : false positive tn : tue negative n Total p n Genealizes to multiple classes Allows one to quickly assess which classes ae missed the most, and into what othe class 25 / / 35 ROC Cuves ROC Cuves Plotting tp vesus fp Confusion Matices ROC Cuves Pecision-Recall Cuves 27 / 35 Conside an A o SVM omally theshold at, but what if we changed it? Keeping weight vecto constant while changing theshold = holding hypeplane s slope fixed while moving along its nomal vecto b ped all! ped all + I.e., get a set of classifies, one pe labeling of test set Simila situation with any classifie with confidence value, e.g., pobability-based Confusion Matices ROC Cuves Pecision-Recall Cuves 28 / 35 Conside the always hyp. What is fp? What is tp? What about the always + hyp? In between the extemes, we plot TP vesus FP by soting the test examples by the confidence values Ex Confidence label Ex Confidence label x x x x x x x x x x ROC Cuves Plotting tp vesus fp (cont d) ROC Cuves Convex Hull TP x5 x TP ID3 naive Bayes Confusion Matices ROC Cuves Pecision-Recall Cuves x FP Confusion Matices ROC Cuves Pecision-Recall Cuves The convex hull of the ROC cuve yields a collection of classifies, each optimal unde diffeent conditions If FP cost = F cost, then daw a line with slope / P at (, ) and dag it towads convex hull until you touch it; that s you opeating point Can use as a classifie any pat of the hull since can andomly select between two classifies FP 29 / 35 3 / 35
6 ROC Cuves Convex Hull ROC Cuves Miscellany Confusion Matices ROC Cuves Pecision-Recall Cuves 3 / 35 TP ID3 naive Bayes Can also compae cuves against single-point classifies when no cuves In plot, ID3 bette than ou SVM iff negatives scace; nb neve bette FP Confusion Matices ROC Cuves Pecision-Recall Cuves 32 / 35 What is the wost possible ROC cuve? One metic fo measuing a cuve s goodness: aea unde cuve (AUC): P x +2P P x 2 I(h(x +) > h(x )) P i.e., ank all examples by confidence in + pediction, count the numbe of times a positively-labeled example (fom P) is anked above a negatively-labeled one (fom ), then nomalize What is the best value? Distibution appoximately nomal if P, >, so can find confidence intevals Catching on as a bette scala measue of pefomance than eo ate ROC analysis possible (though ticky) with multi-class poblems ROC Cuves Miscellany (cont d) Pecision-Recall Cuves Confusion Matices ROC Cuves Pecision-Recall Cuves Can use ROC cuve to modify classifies, e.g., e-label decision tees What does ROC stand fo? Receive Opeating Chaacteistic fom signal detection theoy, whee binay signals ae coupted by noise Use plots to detemine how to set theshold to detemine pesence of signal Theshold too high: miss tue hits (tp low), too low: too many false alams (fp high) Altenative to ROC: cost cuves Confusion Matices ROC Cuves Pecision-Recall Cuves Conside infomation etieval task, e.g., web seach pecision = tp/p = faction of etieved that ae positive ecall = tp/p = faction of positives etieved 33 / / 35 Pecision-Recall Cuves (cont d) As with ROC, can vay theshold to tade off pecision against ecall Can compae cuves based on containment Confusion Matices ROC Cuves Pecision-Recall Cuves 35 / 35 Use F -measue to combine at a specific point, whee weights pecision vs ecall: F ( + 2 pecision ecall ) ( 2 pecision)+ecall
Regularization. Stephen Scott and Vinod Variyam. Introduction. Outline. Machine. Learning. Problems. Measuring. Performance.
leaning can geneally be distilled to an optimization poblem Choose a classifie (function, hypothesis) fom a set of functions that minimizes an objective function Clealy we want pat of this function to
More informationStephen Scott.
1 / 35 (Adapted from Ethem Alpaydin and Tom Mitchell) sscott@cse.unl.edu In Homework 1, you are (supposedly) 1 Choosing a data set 2 Extracting a test set of size > 30 3 Building a tree on the training
More informationRegularization. CSCE 970 Lecture 3: Regularization. Stephen Scott and Vinod Variyam. Introduction. Outline
Other Measures 1 / 52 sscott@cse.unl.edu learning can generally be distilled to an optimization problem Choose a classifier (function, hypothesis) from a set of functions that minimizes an objective function
More information4/18/2005. Statistical Learning Theory
Statistical Leaning Theoy Statistical Leaning Theoy A model of supevised leaning consists of: a Envionment - Supplying a vecto x with a fixed but unknown pdf F x (x b Teache. It povides a desied esponse
More informationGoodness-of-fit for composite hypotheses.
Section 11 Goodness-of-fit fo composite hypotheses. Example. Let us conside a Matlab example. Let us geneate 50 obsevations fom N(1, 2): X=nomnd(1,2,50,1); Then, unning a chi-squaed goodness-of-fit test
More informationThe Substring Search Problem
The Substing Seach Poblem One algoithm which is used in a vaiety of applications is the family of substing seach algoithms. These algoithms allow a use to detemine if, given two chaacte stings, one is
More informationNuclear Medicine Physics 02 Oct. 2007
Nuclea Medicine Physics Oct. 7 Counting Statistics and Eo Popagation Nuclea Medicine Physics Lectues Imaging Reseach Laboatoy, Radiology Dept. Lay MacDonald 1//7 Statistics (Summaized in One Slide) Type
More informationMultiple Experts with Binary Features
Multiple Expets with Binay Featues Ye Jin & Lingen Zhang Decembe 9, 2010 1 Intoduction Ou intuition fo the poect comes fom the pape Supevised Leaning fom Multiple Expets: Whom to tust when eveyone lies
More informationRevision of Lecture Eight
Revision of Lectue Eight Baseband equivalent system and equiements of optimal tansmit and eceive filteing: (1) achieve zeo ISI, and () maximise the eceive SNR Thee detection schemes: Theshold detection
More information6 Matrix Concentration Bounds
6 Matix Concentation Bounds Concentation bounds ae inequalities that bound pobabilities of deviations by a andom vaiable fom some value, often its mean. Infomally, they show the pobability that a andom
More informationMULTILAYER PERCEPTRONS
Last updated: Nov 26, 2012 MULTILAYER PERCEPTRONS Outline 2 Combining Linea Classifies Leaning Paametes Outline 3 Combining Linea Classifies Leaning Paametes Implementing Logical Relations 4 AND and OR
More informationNumerical Integration
MCEN 473/573 Chapte 0 Numeical Integation Fall, 2006 Textbook, 0.4 and 0.5 Isopaametic Fomula Numeical Integation [] e [ ] T k = h B [ D][ B] e B Jdsdt In pactice, the element stiffness is calculated numeically.
More informationRandom Variables and Probability Distribution Random Variable
Random Vaiables and Pobability Distibution Random Vaiable Random vaiable: If S is the sample space P(S) is the powe set of the sample space, P is the pobability of the function then (S, P(S), P) is called
More informationF-IF Logistic Growth Model, Abstract Version
F-IF Logistic Gowth Model, Abstact Vesion Alignments to Content Standads: F-IFB4 Task An impotant example of a model often used in biology o ecology to model population gowth is called the logistic gowth
More informationNotes on McCall s Model of Job Search. Timothy J. Kehoe March if job offer has been accepted. b if searching
Notes on McCall s Model of Job Seach Timothy J Kehoe Mach Fv ( ) pob( v), [, ] Choice: accept age offe o eceive b and seach again next peiod An unemployed oke solves hee max E t t y t y t if job offe has
More information3.1 Random variables
3 Chapte III Random Vaiables 3 Random vaiables A sample space S may be difficult to descibe if the elements of S ae not numbes discuss how we can use a ule by which an element s of S may be associated
More informationValue Prediction with FA. Chapter 8: Generalization and Function Approximation. Adapt Supervised Learning Algorithms. Backups as Training Examples [ ]
Chapte 8: Genealization and Function Appoximation Objectives of this chapte:! Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat.! Oveview of function
More informationΔt The textbook chooses to say that the average velocity is
1-D Motion Basic I Definitions: One dimensional motion (staight line) is a special case of motion whee all but one vecto component is zeo We will aange ou coodinate axis so that the x-axis lies along the
More informationChapter 8: Generalization and Function Approximation
Chapte 8: Genealization and Function Appoximation Objectives of this chapte: Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat. Oveview of function
More informationAlternative Tests for the Poisson Distribution
Chiang Mai J Sci 015; 4() : 774-78 http://epgsciencecmuacth/ejounal/ Contibuted Pape Altenative Tests fo the Poisson Distibution Manad Khamkong*[a] and Pachitjianut Siipanich [b] [a] Depatment of Statistics,
More informationSurveillance Points in High Dimensional Spaces
Société de Calcul Mathématique SA Tools fo decision help since 995 Suveillance Points in High Dimensional Spaces by Benad Beauzamy Januay 06 Abstact Let us conside any compute softwae, elying upon a lage
More informationEstimation of the Correlation Coefficient for a Bivariate Normal Distribution with Missing Data
Kasetsat J. (Nat. Sci. 45 : 736-74 ( Estimation of the Coelation Coefficient fo a Bivaiate Nomal Distibution with Missing Data Juthaphon Sinsomboonthong* ABSTRACT This study poposes an estimato of the
More informationLecture 8 - Gauss s Law
Lectue 8 - Gauss s Law A Puzzle... Example Calculate the potential enegy, pe ion, fo an infinite 1D ionic cystal with sepaation a; that is, a ow of equally spaced chages of magnitude e and altenating sign.
More informationand the correct answer is D.
@. Assume the pobability of a boy being bon is the same as a gil. The pobability that in a family of 5 childen thee o moe childen will be gils is given by A) B) C) D) Solution: The pobability of a gil
More information1. Review of Probability.
1. Review of Pobability. What is pobability? Pefom an expeiment. The esult is not pedictable. One of finitely many possibilities R 1, R 2,, R k can occu. Some ae pehaps moe likely than othes. We assign
More informationCentral Coverage Bayes Prediction Intervals for the Generalized Pareto Distribution
Statistics Reseach Lettes Vol. Iss., Novembe Cental Coveage Bayes Pediction Intevals fo the Genealized Paeto Distibution Gyan Pakash Depatment of Community Medicine S. N. Medical College, Aga, U. P., India
More informationHypothesis Test and Confidence Interval for the Negative Binomial Distribution via Coincidence: A Case for Rare Events
Intenational Jounal of Contempoay Mathematical Sciences Vol. 12, 2017, no. 5, 243-253 HIKARI Ltd, www.m-hikai.com https://doi.og/10.12988/ijcms.2017.7728 Hypothesis Test and Confidence Inteval fo the Negative
More information6 PROBABILITY GENERATING FUNCTIONS
6 PROBABILITY GENERATING FUNCTIONS Cetain deivations pesented in this couse have been somewhat heavy on algeba. Fo example, detemining the expectation of the Binomial distibution (page 5.1 tuned out to
More informationA Probabilistic Approach to Susceptibility Measurement in a Reverberation Chamber
A Pobabilistic Appoach to Susceptibility Measuement in a Revebeation Chambe Emmanuel Amado, Chistophe Lemoine, Philippe Besnie To cite this vesion: Emmanuel Amado, Chistophe Lemoine, Philippe Besnie. A
More informationFresnel Diffraction. monchromatic light source
Fesnel Diffaction Equipment Helium-Neon lase (632.8 nm) on 2 axis tanslation stage, Concave lens (focal length 3.80 cm) mounted on slide holde, iis mounted on slide holde, m optical bench, micoscope slide
More informationSpatial Point Patterns. Potential questions. Application areas. Examples in pictures:
Spatial Point Pattens Obseved locations of events: datum is the location Majo shift in inteest fom pevious mateial! Up to now, location has been fixed point o fixed aea, Location abitay o happenstance,
More informationInformation Retrieval (Relevance Feedback & Query Expansion)
Infomation Retieval (Relevance Feedback & Quey Epansion) Fabio Aiolli http://www.math.unipd.it/~aiolli Dipatimento di Matematica Univesità di Padova Anno Accademico 1 Relevance feedback and quey epansion
More informationFALL 2006 EXAM C SOLUTIONS
FALL 006 EXAM C SOLUTIONS Question # Key: E With n + = 6, we need the 0.3(6) = 4.8 and 0.65(6) = 0.4 smallest obsevations. They ae 0.(80) + 0.8(350) = 336 and 0.6(450) + 0.4(490) = 466. The equations to
More informationMultiple Criteria Secretary Problem: A New Approach
J. Stat. Appl. Po. 3, o., 9-38 (04 9 Jounal of Statistics Applications & Pobability An Intenational Jounal http://dx.doi.og/0.785/jsap/0303 Multiple Citeia Secetay Poblem: A ew Appoach Alaka Padhye, and
More informationLecture 7 Topic 5: Multiple Comparisons (means separation)
Lectue 7 Topic 5: Multiple Compaisons (means sepaation) ANOVA: H 0 : µ 1 = µ =... = µ t H 1 : The mean of at least one teatment goup is diffeent If thee ae moe than two teatments in the expeiment, futhe
More informationA Converse to Low-Rank Matrix Completion
A Convese to Low-Rank Matix Completion Daniel L. Pimentel-Alacón, Robet D. Nowak Univesity of Wisconsin-Madison Abstact In many pactical applications, one is given a subset Ω of the enties in a d N data
More informationSome technical details on confidence. intervals for LIFT measures in data. mining
Some technical details on confidence intevals fo LIFT measues in data mining Wenxin Jiang and Yu Zhao June 2, 2014 Abstact A LIFT measue, such as the esponse ate, lift, o the pecentage of captued esponse,
More informationOn the Poisson Approximation to the Negative Hypergeometric Distribution
BULLETIN of the Malaysian Mathematical Sciences Society http://mathusmmy/bulletin Bull Malays Math Sci Soc (2) 34(2) (2011), 331 336 On the Poisson Appoximation to the Negative Hypegeometic Distibution
More informationLET a random variable x follows the two - parameter
INTERNATIONAL JOURNAL OF MATHEMATICS AND SCIENTIFIC COMPUTING ISSN: 2231-5330, VOL. 5, NO. 1, 2015 19 Shinkage Bayesian Appoach in Item - Failue Gamma Data In Pesence of Pio Point Guess Value Gyan Pakash
More informationPearson s Chi-Square Test Modifications for Comparison of Unweighted and Weighted Histograms and Two Weighted Histograms
Peason s Chi-Squae Test Modifications fo Compaison of Unweighted and Weighted Histogams and Two Weighted Histogams Univesity of Akueyi, Bogi, v/noduslód, IS-6 Akueyi, Iceland E-mail: nikolai@unak.is Two
More informationStanford University CS259Q: Quantum Computing Handout 8 Luca Trevisan October 18, 2012
Stanfod Univesity CS59Q: Quantum Computing Handout 8 Luca Tevisan Octobe 8, 0 Lectue 8 In which we use the quantum Fouie tansfom to solve the peiod-finding poblem. The Peiod Finding Poblem Let f : {0,...,
More informationChem 453/544 Fall /08/03. Exam #1 Solutions
Chem 453/544 Fall 3 /8/3 Exam # Solutions. ( points) Use the genealized compessibility diagam povided on the last page to estimate ove what ange of pessues A at oom tempeatue confoms to the ideal gas law
More informationDetermining solar characteristics using planetary data
Detemining sola chaacteistics using planetay data Intoduction The Sun is a G-type main sequence sta at the cente of the Sola System aound which the planets, including ou Eath, obit. In this investigation
More information2. Electrostatics. Dr. Rakhesh Singh Kshetrimayum 8/11/ Electromagnetic Field Theory by R. S. Kshetrimayum
2. Electostatics D. Rakhesh Singh Kshetimayum 1 2.1 Intoduction In this chapte, we will study how to find the electostatic fields fo vaious cases? fo symmetic known chage distibution fo un-symmetic known
More information33. 12, or its reciprocal. or its negative.
Page 6 The Point is Measuement In spite of most of what has been said up to this point, we did not undetake this poject with the intent of building bette themometes. The point is to measue the peson. Because
More informationQIP Course 10: Quantum Factorization Algorithm (Part 3)
QIP Couse 10: Quantum Factoization Algoithm (Pat 3 Ryutaoh Matsumoto Nagoya Univesity, Japan Send you comments to yutaoh.matsumoto@nagoya-u.jp Septembe 2018 @ Tokyo Tech. Matsumoto (Nagoya U. QIP Couse
More informationST 501 Course: Fundamentals of Statistical Inference I. Sujit K. Ghosh.
ST 501 Couse: Fundamentals of Statistical Infeence I Sujit K. Ghosh sujit.ghosh@ncsu.edu Pesented at: 2229 SAS Hall, Depatment of Statistics, NC State Univesity http://www.stat.ncsu.edu/people/ghosh/couses/st501/
More information( ) F α. a. Sketch! r as a function of r for fixed θ. For the sketch, assume that θ is roughly the same ( )
. An acoustic a eflecting off a wav bounda (such as the sea suface) will see onl that pat of the bounda inclined towad the a. Conside a a with inclination to the hoizontal θ (whee θ is necessail positive,
More informationPsychometric Methods: Theory into Practice Larry R. Price
ERRATA Psychometic Methods: Theoy into Pactice Lay R. Pice Eos wee made in Equations 3.5a and 3.5b, Figue 3., equations and text on pages 76 80, and Table 9.1. Vesions of the elevant pages that include
More informationPhysics 235 Chapter 5. Chapter 5 Gravitation
Chapte 5 Gavitation In this Chapte we will eview the popeties of the gavitational foce. The gavitational foce has been discussed in geat detail in you intoductoy physics couses, and we will pimaily focus
More informationTeachers notes. Beyond the Thrills excursions. Worksheets in this book. Completing the worksheets
Beyond the Thills excusions Teaches notes Physics is the science of how the wold (and Univese) woks. Luna Pak Sydney is a lage hands-on physics laboatoy full of fee falling objects, otating systems and
More informationTopic 5. Mean separation: Multiple comparisons [ST&D Ch.8, except 8.3]
5.1 Topic 5. Mean sepaation: Multiple compaisons [ST&D Ch.8, except 8.3] 5. 1. Basic concepts In the analysis of vaiance, the null hypothesis that is tested is always that all means ae equal. If the F
More informationAnalysis of spatial correlations in marked point processes
Analysis of spatial coelations in maked point pocesses with application to micogeogaphic economical data Joint wok with W. Bachat-Schwaz, F. Fleische, P. Gabanik, V. Schmidt and W. Walla Stefanie Eckel
More informationTemporal-Difference Learning
.997 Decision-Making in Lage-Scale Systems Mach 17 MIT, Sping 004 Handout #17 Lectue Note 13 1 Tempoal-Diffeence Leaning We now conside the poblem of computing an appopiate paamete, so that, given an appoximation
More informationDirected Regression. Benjamin Van Roy Stanford University Stanford, CA Abstract
Diected Regession Yi-hao Kao Stanfod Univesity Stanfod, CA 94305 yihaoao@stanfod.edu Benjamin Van Roy Stanfod Univesity Stanfod, CA 94305 bv@stanfod.edu Xiang Yan Stanfod Univesity Stanfod, CA 94305 xyan@stanfod.edu
More informationASTR415: Problem Set #6
ASTR45: Poblem Set #6 Cuan D. Muhlbege Univesity of Mayland (Dated: May 7, 27) Using existing implementations of the leapfog and Runge-Kutta methods fo solving coupled odinay diffeential equations, seveal
More informationLecture 28: Convergence of Random Variables and Related Theorems
EE50: Pobability Foundations fo Electical Enginees July-Novembe 205 Lectue 28: Convegence of Random Vaiables and Related Theoems Lectue:. Kishna Jagannathan Scibe: Gopal, Sudhasan, Ajay, Swamy, Kolla An
More information1) (A B) = A B ( ) 2) A B = A. i) A A = φ i j. ii) Additional Important Properties of Sets. De Morgan s Theorems :
Additional Impotant Popeties of Sets De Mogan s Theoems : A A S S Φ, Φ S _ ( A ) A ) (A B) A B ( ) 2) A B A B Cadinality of A, A, is defined as the numbe of elements in the set A. {a,b,c} 3, { }, while
More informationMath 301: The Erdős-Stone-Simonovitz Theorem and Extremal Numbers for Bipartite Graphs
Math 30: The Edős-Stone-Simonovitz Theoem and Extemal Numbes fo Bipatite Gaphs May Radcliffe The Edős-Stone-Simonovitz Theoem Recall, in class we poved Tuán s Gaph Theoem, namely Theoem Tuán s Theoem Let
More informationMarkscheme May 2017 Calculus Higher level Paper 3
M7/5/MATHL/HP3/ENG/TZ0/SE/M Makscheme May 07 Calculus Highe level Pape 3 pages M7/5/MATHL/HP3/ENG/TZ0/SE/M This makscheme is the popety of the Intenational Baccalaueate and must not be epoduced o distibuted
More informationQuantum Fourier Transform
Chapte 5 Quantum Fouie Tansfom Many poblems in physics and mathematics ae solved by tansfoming a poblem into some othe poblem with a known solution. Some notable examples ae Laplace tansfom, Legende tansfom,
More informationResearch Design - - Topic 17 Multiple Regression & Multiple Correlation: Two Predictors 2009 R.C. Gardner, Ph.D.
Reseach Design - - Topic 7 Multiple Regession & Multiple Coelation: Two Pedictos 009 R.C. Gadne, Ph.D. Geneal Rationale and Basic Aithmetic fo two pedictos Patial and semipatial coelation Regession coefficients
More informationMATHEMATICS GRADE 12 SESSION 38 (LEARNER NOTES)
EXAM PREPARATION PAPER (A) Leane Note: In this session you will be given the oppotunity to wok on a past examination pape (Feb/Ma 010 DoE Pape ). The pape consists of 1 questions. Question 1, and will
More informationExploration of the three-person duel
Exploation of the thee-peson duel Andy Paish 15 August 2006 1 The duel Pictue a duel: two shootes facing one anothe, taking tuns fiing at one anothe, each with a fixed pobability of hitting his opponent.
More informationB. Spherical Wave Propagation
11/8/007 Spheical Wave Popagation notes 1/1 B. Spheical Wave Popagation Evey antenna launches a spheical wave, thus its powe density educes as a function of 1, whee is the distance fom the antenna. We
More informationINTRODUCTION. 2. Vectors in Physics 1
INTRODUCTION Vectos ae used in physics to extend the study of motion fom one dimension to two dimensions Vectos ae indispensable when a physical quantity has a diection associated with it As an example,
More informationBayesian Congestion Control over a Markovian Network Bandwidth Process
Bayesian Congestion Contol ove a Makovian Netwok Bandwidth Pocess Paisa Mansouifad,, Bhaska Kishnamachai, Taa Javidi Ming Hsieh Depatment of Electical Engineeing, Univesity of Southen Califonia, Los Angeles,
More informationEM-2. 1 Coulomb s law, electric field, potential field, superposition q. Electric field of a point charge (1)
EM- Coulomb s law, electic field, potential field, supeposition q ' Electic field of a point chage ( ') E( ) kq, whee k / 4 () ' Foce of q on a test chage e at position is ee( ) Electic potential O kq
More informationTopic 4a Introduction to Root Finding & Bracketing Methods
/8/18 Couse Instucto D. Raymond C. Rumpf Office: A 337 Phone: (915) 747 6958 E Mail: cumpf@utep.edu Topic 4a Intoduction to Root Finding & Backeting Methods EE 4386/531 Computational Methods in EE Outline
More informationPROBLEM SET #1 SOLUTIONS by Robert A. DiStasio Jr.
POBLM S # SOLUIONS by obet A. DiStasio J. Q. he Bon-Oppenheime appoximation is the standad way of appoximating the gound state of a molecula system. Wite down the conditions that detemine the tonic and
More informationRelated Rates - the Basics
Related Rates - the Basics In this section we exploe the way we can use deivatives to find the velocity at which things ae changing ove time. Up to now we have been finding the deivative to compae the
More informationContact impedance of grounded and capacitive electrodes
Abstact Contact impedance of gounded and capacitive electodes Andeas Hödt Institut fü Geophysik und extateestische Physik, TU Baunschweig The contact impedance of electodes detemines how much cuent can
More informationBayesian Analysis of Topp-Leone Distribution under Different Loss Functions and Different Priors
J. tat. Appl. Po. Lett. 3, No. 3, 9-8 (6) 9 http://dx.doi.og/.8576/jsapl/33 Bayesian Analysis of Topp-Leone Distibution unde Diffeent Loss Functions and Diffeent Pios Hummaa ultan * and. P. Ahmad Depatment
More informationSubstances that are liquids or solids under ordinary conditions may also exist as gases. These are often referred to as vapors.
Chapte 0. Gases Chaacteistics of Gases All substances have thee phases: solid, liquid, and gas. Substances that ae liquids o solids unde odinay conditions may also exist as gases. These ae often efeed
More information10/04/18. P [P(x)] 1 negl(n).
Mastemath, Sping 208 Into to Lattice lgs & Cypto Lectue 0 0/04/8 Lectues: D. Dadush, L. Ducas Scibe: K. de Boe Intoduction In this lectue, we will teat two main pats. Duing the fist pat we continue the
More information763620SS STATISTICAL PHYSICS Solutions 2 Autumn 2012
763620SS STATISTICAL PHYSICS Solutions 2 Autumn 2012 1. Continuous Random Walk Conside a continuous one-dimensional andom walk. Let w(s i ds i be the pobability that the length of the i th displacement
More informationIntroduction to Mathematical Statistics Robert V. Hogg Joeseph McKean Allen T. Craig Seventh Edition
Intoduction to Mathematical Statistics Robet V. Hogg Joeseph McKean Allen T. Caig Seventh Edition Peason Education Limited Edinbugh Gate Halow Essex CM2 2JE England and Associated Companies thoughout the
More informationAuchmuty High School Mathematics Department Advanced Higher Notes Teacher Version
The Binomial Theoem Factoials Auchmuty High School Mathematics Depatment The calculations,, 6 etc. often appea in mathematics. They ae called factoials and have been given the notation n!. e.g. 6! 6!!!!!
More informationClassical Worm algorithms (WA)
Classical Wom algoithms (WA) WA was oiginally intoduced fo quantum statistical models by Pokof ev, Svistunov and Tupitsyn (997), and late genealized to classical models by Pokof ev and Svistunov (200).
More informationInformation Retrieval Advanced IR models. Luca Bondi
Advanced IR models Luca Bondi Advanced IR models 2 (LSI) Pobabilistic Latent Semantic Analysis (plsa) Vecto Space Model 3 Stating point: Vecto Space Model Documents and queies epesented as vectos in the
More informationBoundary Layers and Singular Perturbation Lectures 16 and 17 Boundary Layers and Singular Perturbation. x% 0 Ω0æ + Kx% 1 Ω0æ + ` : 0. (9.
Lectues 16 and 17 Bounday Layes and Singula Petubation A Regula Petubation In some physical poblems, the solution is dependent on a paamete K. When the paamete K is vey small, it is natual to expect that
More informationMEASURES OF BLOCK DESIGN EFFICIENCY RECOVERING INTERBLOCK INFORMATION
MEASURES OF BLOCK DESIGN EFFICIENCY RECOVERING INTERBLOCK INFORMATION Walte T. Fedee 337 Waen Hall, Biometics Unit Conell Univesity Ithaca, NY 4853 and Tey P. Speed Division of Mathematics & Statistics,
More informationarxiv: v1 [cs.si] 4 Jul 2012
A Estimating Node Influenceability in Social Netwoks Rong-Hua Li, The Chinese Univesity of Hong Kong Jeffey Xu Yu, The Chinese Univesity of Hong Kong Zechao Shang, The Chinese Univesity of Hong Kong axiv:1207.0913v1
More informationn 1 Cov(X,Y)= ( X i- X )( Y i-y ). N-1 i=1 * If variable X and variable Y tend to increase together, then c(x,y) > 0
Covaiance and Peason Coelation Vatanian, SW 540 Both covaiance and coelation indicate the elationship between two (o moe) vaiables. Neithe the covaiance o coelation give the slope between the X and Y vaiable,
More informationMotion in One Dimension
Motion in One Dimension Intoduction: In this lab, you will investigate the motion of a olling cat as it tavels in a staight line. Although this setup may seem ovesimplified, you will soon see that a detailed
More informationA Deep Convolutional Neural Network Based on Nested Residue Number System
A Deep Convolutional Neual Netwok Based on Nested Residue Numbe System Hioki Nakahaa Ehime Univesity, Japan Tsutomu Sasao Meiji Univesity, Japan Abstact A pe-tained deep convolutional neual netwok (DCNN)
More informationCentripetal Force OBJECTIVE INTRODUCTION APPARATUS THEORY
Centipetal Foce OBJECTIVE To veify that a mass moving in cicula motion expeiences a foce diected towad the cente of its cicula path. To detemine how the mass, velocity, and adius affect a paticle's centipetal
More informationMEASURING CHINESE RISK AVERSION
MEASURING CHINESE RISK AVERSION --Based on Insuance Data Li Diao (Cental Univesity of Finance and Economics) Hua Chen (Cental Univesity of Finance and Economics) Jingzhen Liu (Cental Univesity of Finance
More informationON INDEPENDENT SETS IN PURELY ATOMIC PROBABILITY SPACES WITH GEOMETRIC DISTRIBUTION. 1. Introduction. 1 r r. r k for every set E A, E \ {0},
ON INDEPENDENT SETS IN PURELY ATOMIC PROBABILITY SPACES WITH GEOMETRIC DISTRIBUTION E. J. IONASCU and A. A. STANCU Abstact. We ae inteested in constucting concete independent events in puely atomic pobability
More informationHopefully Helpful Hints for Gauss s Law
Hopefully Helpful Hints fo Gauss s Law As befoe, thee ae things you need to know about Gauss s Law. In no paticula ode, they ae: a.) In the context of Gauss s Law, at a diffeential level, the electic flux
More informationNewton s Laws, Kepler s Laws, and Planetary Orbits
Newton s Laws, Keple s Laws, and Planetay Obits PROBLEM SET 4 DUE TUESDAY AT START OF LECTURE 28 Septembe 2017 ASTRONOMY 111 FALL 2017 1 Newton s & Keple s laws and planetay obits Unifom cicula motion
More informationPAPER 39 STOCHASTIC NETWORKS
MATHEMATICAL TRIPOS Pat III Tuesday, 2 June, 2015 1:30 pm to 4:30 pm PAPER 39 STOCHASTIC NETWORKS Attempt no moe than FOUR questions. Thee ae FIVE questions in total. The questions cay equal weight. STATIONERY
More informationworking pages for Paul Richards class notes; do not copy or circulate without permission from PGR 2004/11/3 10:50
woking pages fo Paul Richads class notes; do not copy o ciculate without pemission fom PGR 2004/11/3 10:50 CHAPTER7 Solid angle, 3D integals, Gauss s Theoem, and a Delta Function We define the solid angle,
More informationTESTING THE VALIDITY OF THE EXPONENTIAL MODEL BASED ON TYPE II CENSORED DATA USING TRANSFORMED SAMPLE DATA
STATISTICA, anno LXXVI, n. 3, 2016 TESTING THE VALIDITY OF THE EXPONENTIAL MODEL BASED ON TYPE II CENSORED DATA USING TRANSFORMED SAMPLE DATA Hadi Alizadeh Noughabi 1 Depatment of Statistics, Univesity
More informationChapter 5 Force and Motion
Chapte 5 Foce and Motion In Chaptes 2 and 4 we have studied kinematics, i.e., we descibed the motion of objects using paametes such as the position vecto, velocity, and acceleation without any insights
More informationModeling Fermi Level Effects in Atomistic Simulations
Mat. Res. Soc. Symp. Poc. Vol. 717 Mateials Reseach Society Modeling Femi Level Effects in Atomistic Simulations Zudian Qin and Scott T. Dunham Depatment of Electical Engineeing, Univesity of Washington,
More informationyou of a spring. The potential energy for a spring is given by the parabola U( x)
Small oscillations The theoy of small oscillations is an extemely impotant topic in mechanics. Conside a system that has a potential enegy diagam as below: U B C A x Thee ae thee points of stable equilibium,
More information2 x 8 2 x 2 SKILLS Determine whether the given value is a solution of the. equation. (a) x 2 (b) x 4. (a) x 2 (b) x 4 (a) x 4 (b) x 8
5 CHAPTER Fundamentals When solving equations that involve absolute values, we usually take cases. EXAMPLE An Absolute Value Equation Solve the equation 0 x 5 0 3. SOLUTION By the definition of absolute
More informationGradient-based Neural Network for Online Solution of Lyapunov Matrix Equation with Li Activation Function
Intenational Confeence on Infomation echnology and Management Innovation (ICIMI 05) Gadient-based Neual Netwok fo Online Solution of Lyapunov Matix Equation with Li Activation unction Shiheng Wang, Shidong
More information16 Modeling a Language by a Markov Process
K. Pommeening, Language Statistics 80 16 Modeling a Language by a Makov Pocess Fo deiving theoetical esults a common model of language is the intepetation of texts as esults of Makov pocesses. This model
More information