A New Evaluation Measure. J. Joiner and L. Werner. The problems of evaluation and the needed criteria of evaluation
|
|
- Adam Crawford
- 5 years ago
- Views:
Transcription
1 III-l III. A New Evaluatin Measure J. Jiner and L. Werner Abstract The prblems f evaluatin and the needed criteria f evaluatin measures in the SMART system f infrmatin retrieval are reviewed and discussed. Perfrmance characteristics f a gd evaluatin measure are examined. The suggested measure Pr N (P<R/n), (the prbability under the hypergemetric distributin, that the precisin culd be strictly less than that precisin attained, where R = number relevant in the sample drawn, N = ttal number in cllectin and n = size f sample drawn) is intrduced and tested against the varius criteria needed fr a gd evaluatin measure. A statistical test f significance is explained.. Intrductin Amng the principal bstacles t the evaluatin f infrmatin retrieval methds are the fllwing: ) Interplatin between pints f recall results in errrs which are unsatisfactry in ne way r anther, depending upn the type f interplatin used. ) A recall-precisin curve smetimes gyrates wildly and the averaging f many curves ver queries has questinable reliability. L The statement "methd A is better than methd B u ften depends upn the value ne is measuring. A unique value measuring bth recall and precisin wuld be best. 4) Queries with different numbers f relevant dcuments d nt receive different amunts f credit, althugh just by randm
2 III- chance it is easier t get a relevant dcument fr a query with relevant than fr ne with 4- relevant* ) It has nt been determined hw t handle the evaluatin f feedback methds in relatin t the relevant dcuments retrieved befre feedback. This reprt will attempt t discuss and prpse slutins t these specific prblems.. Prblems f Evaluatin One imprtant aspect f infrmatin retrieval is btaining a value fr a given methd which is a true measure f the methds effectiveness ver many queries. On a recall-precisin graph, the pints f recall where ne measures this effectiveness are.,.,...,,9,.-. Hwever, the nly pints available fr a query with n relevant dcuments are /n, /n,..., n-l/n, n/n. Obviusly, fr queries with different numbers f rele- vant dcuments, ne may expect that nne f the query! s pints will cincide with the pints.,.,...,.9,.. But presently, by interplatin cf sme kine, the precisin values are fund fr each query at these pints. Fig. shws ne such methd. There can be n real justificatin fr any methd f interplatin used, fr it is impssible t estimate a discrete functin at a nnexistent pint. Therefre, what is needed t slve this prblem is a new base index fr the graph that wuld invlve n interplatin. An index that wuld, ver many queries with different numbers f relevant dcuments, have nly cmmn pints fr all queries. The averaging f pints f recall-precisin where interplatin must ccur tends further t distrt the measure f effectiveness. But even ver
3 in-; Ranks f Relevant Dcuments m CVJ ^ <fr C J - CVJ Q_ O Ttal N. f Relevant Dcuments <fr CVJ c > Q> (Z CO a) a Query Number CX O" c Ct sz CL *~ CD c if) <D w_ Q_ ILO al O CD (T CD :
4 III-4 pints that cincide with equal recall, different values can be btained by different methds f averaging. Even at these cmmn pints, the values being averaged are smewhat in dubt. N crrelatins are made in the pre- cisin values fr the generality number (jg = number f Relevant/ttal number in cllectin), which reflects hw easy it wuld be, under randm cnditins alne, t select relevant dcuments. shuld cntrl this randmness factr. that when the generality rati A gd perfrmance measure Cntrl shuld be in the sense is decreased in a way which preserves the bserved perfrmance level, the effect f the generality rati n a perfrmance measure culd be bserved. The measure prpsed is knwn t re- flect the generality number under equal perfrmance but a methd f splitting a cllectin int tw cllectins suggested by R. Williamsn has nt been tested.. Criteria fr a Gd Evaluatin Measure A gd perfrmance measure shuld fulfill the fllwing criteria: l) Recall values measure the effectiveness f a methd by cmparing the number f relevant dcuments retrieved t t ttal number f relevant dcuments, while precisin measures this perfrmance by cmparing the number f relevant retrieved dcuments t the ttal number f retrieved. These intuitively seem t be the best measures f perfrmance available. Their biggest drawback is that they are tw unique values nt ne. A gd measure shuld reflect bth. l The generality number, as stated befre, reflects the degree f effect that pure randm chance selectin will have n the methd f retrieving relevant dcuments fr a certain query. With this cntrlled queries can be cm-
5 - pared n a mre cmmn basis. ) In thery Cat the least, the measure shuld appeal t the user and tester and the values btained shuld have a lgical range. A range frm t best suits a measure f perfrmance and effectiveness. Any system which is effective at all shuld have values f the measure clser t than t. 4. The Prbability Measure A very large urn is filled with Q. dcuments. Fr query q there are dcuments that are relevant and that are nt. If, at randm, dcuments are drawn frm that urn withut replacement, the prbability that less than relevant dcuments are chsen cmpletely at randm is P E, <*<*> = P H,Q- CR = lt P^QQ (R = U t P^Q CR =>,^.. rs,ck = C K ^ + l K 9/ t K j,. r ) ( ) l ; ^ l This is equivalent t finding the prbability by randm chance that the precisin is less than / fr F R Q CR<) = P R QQ CR/n</n) = P R Q CP</). The higher this prbability is, the less likely it wuld be that the precisin achieved was btained by chance. This measure culd be evaluated at any pint n (equals the number f dcuments retrieved) that might be wanted fr investigatin. As precisin increases frm m/n t (m + l)/n, this value ges frm P R ^P<m/n;) t? H QQ ( ' P<^m + ^/n) which is e l ual t P H ^<m^ and P 9 n^r m +!) where P H, (R<m) = P H, CR = m " } + P H, CR = m " ) + + P H, CR = )
6 III-6 and ^ O O ^ ^ = P H, CR = m) + ^^QO = m ' } + ' ' + P H, (R " ) " When P ^^^CR<m) is subtracted frm P^ pncr<m+l) the answer is always psitive since ne mre single hypergemetric prbability is added t P CR<m+l). Since P CR<m) < P tr<m+l) is equivalent t stating that P H CR/n<P<m/n = p ) P (P<m+l/n = p ), and p. <p, then as precisin increases the perfrm* -nance measure increases. This same argument hlds fr recall because P H, (r<m) = P H, Cr/R<m/R) = P H, Crecall<m/R). As the recall increases frm m/r t m+l/r mre prbability is added t the measure and it therefre increases. The prbability itself incrprates the generality number and it will be shwn by example hw this generality affects the measure. All three f the criteria which are mst needed by a unique perfrmance measure are therefre cmbined in this value. The theretical range, -, f this measure is als appealing t testing prcedures and analyzing f results. Sme measures fr arbitrarily chsen results are shwn in Table. The use f this measure fr feedback is the same as withut feedback except that when the ranks f the relevant dcuments retrieved in the first pass are frzen the measure adjusts fr this by use f a new generality number. Suppse fr a single query and tw methds number f dcuments = number f relevant dcuments =
7 Ranks f Relevant Dcuments:,,,,, 4,,, 4,, 69,. Number Relevant Number Drawn Measure Q Perfrmance Results fr up t Retrieved Dcuments Table
8 II I- Suppse that in the first dcuments Methd I prduces 4 relevant and Methd II relevant. Then evaluatin starting with this Infrmatin n a feedbeick pass wuld evaluate the measure as Methd I Cnditins Methd II Cnditins n = 9 n = 9 number relevant = number relevant = Perfrmance wuld thereafter reflect exactly the same measures as if cnditins fr Methds I and II were starting cnditins.. Tests One methd f cmparing tw r mre methds ver the same set f queries in the same dcument cllectin wuld be t average the measure ver the number f dcuments retrieved. This prcedure wuld give ne number fr each- methd and the highest such number culd be stated t represent the best rr.ethd. The difficulty with this methd is that there is n way t knw the statistical prperties f this average and therefre slight differences in the average f methd i vs. methd j cannt be prven significant. With a fixed set f queries and a fixed cllectin there is n randmness invlved anyway. Randmness can be intrduced int the prblem by claiming that the queries are a sample drawn frm a set f queries and that the test results shw that at any pint n a ppulatin f queries divides int a multinmial distributin where methd i has prbability This prcedure is discussed in May T s thesis. p. f being the mst successful. Table shws the suggested partitin f queries and methds ver n, the number f dcuments retrieved. Table als shws a fictitius set f results. There is n hpe f being crrect in a decisin if in reality the methds are exactly alike, S D
9 Three Methds M M M Five Queries Q Q Q Q^ Q _L Z O At pint n =, dcument retrieved III-9 Value given t methd which has highest value.. In case f a tie at sme pint, chse ne f the tied methds by chance. Example: M l M M i Q l Q Q % Q Fr each n. = i, i dcuments retrieved, sum ver queries fr each methd Example: \ - N - N = T M M * = N = : Again, sum, ver n. this time, fr ttal fr methds, Ttal: M M, M " " 4 Estimate: p l fr M l 4.4 P P fr fr M M " ".. Sample Calculatin Table
10 - ne can nly state the "prbability" f being crrect in chsing methd in the example given if the rati P /p 9 C=). is actually greater than sme specified by the experimenter. Fr the example given assuming there is a multinmial distributin Cwhich is unlikely) and further that P/P =., then the prbability that the chice f methd is best is ver.9, using Bechhfer l s prcedures. It shuld be stressed that this is nt t claim a valid statistical test but nly t give sme idea f the pssible cnfidence ne culd have in chsing the largest p. as representing the best methd.
11 III-ll Bibligraphy Bechhfer, R. E., Elmaghraby, S., and Mrse, N., M A Single-sample multiple Decisin Prcedure fr Selecting the Multinmial Event which has the Highest Prbability", Annals f Mathematical Statistics^, Vl., N., March 99.. Cper, W. S., "Expected Search Length A Single Measure f Retrieval Effectiveness Based n the Weak Ordering Actin f Retrieval Systems", American Dcumentatin, January 96. Gffman, W., and Newill, y. A., "A Methdlgy fr Test and Evaluatin f Infrmatin Retrieval Systems", Infrmatin Strage and Retrieval, Vl., 966. Hdges, J. L., and Lehmann, E. L., Basic Cncepts f Statistics, HldenDay, San Francisc, Lesk, M. E., "SIG T h e Significance Prgrams fr Testing the Evaluatin Output", Reprt N. ISR- t the Natinal Science Fundatin, Sectin II, Crnell University, Department f Cmputer Science, 96. May,. C, "Evaluatin f Search Methds in an Infrmatin Retrieval System", an unpublished thesis fr Masterls f Arts degree, June 96. Saltn, G., and Lesk, M.E., "Cmputer Evaluatin f Indexing and Text Prcessing", Reprt N. ISR- t the Natinal Science Fundatin, Sectin III, Crnell University, Department f Cmputer Science, 96. Williamsn, R. E., "A Prpsal t Ascertain the Relatinship between the Generality Rati and Perfrmance Measure", unpublished paper.
Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationMath Foundations 20 Work Plan
Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant
More informationCS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007
CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationCONSTRUCTING STATECHART DIAGRAMS
CONSTRUCTING STATECHART DIAGRAMS The fllwing checklist shws the necessary steps fr cnstructing the statechart diagrams f a class. Subsequently, we will explain the individual steps further. Checklist 4.6
More informationChapter 3: Cluster Analysis
Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA
More informationCAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank
CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal
More informationHypothesis Tests for One Population Mean
Hypthesis Tests fr One Ppulatin Mean Chapter 9 Ala Abdelbaki Objective Objective: T estimate the value f ne ppulatin mean Inferential statistics using statistics in rder t estimate parameters We will be
More informationComprehensive Exam Guidelines Department of Chemical and Biomolecular Engineering, Ohio University
Cmprehensive Exam Guidelines Department f Chemical and Bimlecular Engineering, Ohi University Purpse In the Cmprehensive Exam, the student prepares an ral and a written research prpsal. The Cmprehensive
More informationLeast Squares Optimal Filtering with Multirate Observations
Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical
More informationCHAPTER 3 INEQUALITIES. Copyright -The Institute of Chartered Accountants of India
CHAPTER 3 INEQUALITIES Cpyright -The Institute f Chartered Accuntants f India INEQUALITIES LEARNING OBJECTIVES One f the widely used decisin making prblems, nwadays, is t decide n the ptimal mix f scarce
More informationHow do scientists measure trees? What is DBH?
Hw d scientists measure trees? What is DBH? Purpse Students develp an understanding f tree size and hw scientists measure trees. Students bserve and measure tree ckies and explre the relatinship between
More informationWRITING THE REPORT. Organizing the report. Title Page. Table of Contents
WRITING THE REPORT Organizing the reprt Mst reprts shuld be rganized in the fllwing manner. Smetime there is a valid reasn t include extra chapters in within the bdy f the reprt. 1. Title page 2. Executive
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationChapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms
Chapter 5 1 Chapter Summary Mathematical Inductin Strng Inductin Recursive Definitins Structural Inductin Recursive Algrithms Sectin 5.1 3 Sectin Summary Mathematical Inductin Examples f Prf by Mathematical
More informationB. Definition of an exponential
Expnents and Lgarithms Chapter IV - Expnents and Lgarithms A. Intrductin Starting with additin and defining the ntatins fr subtractin, multiplicatin and divisin, we discvered negative numbers and fractins.
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More informationLesson Plan. Recode: They will do a graphic organizer to sequence the steps of scientific method.
Lessn Plan Reach: Ask the students if they ever ppped a bag f micrwave ppcrn and nticed hw many kernels were unppped at the bttm f the bag which made yu wnder if ther brands pp better than the ne yu are
More informationREADING STATECHART DIAGRAMS
READING STATECHART DIAGRAMS Figure 4.48 A Statechart diagram with events The diagram in Figure 4.48 shws all states that the bject plane can be in during the curse f its life. Furthermre, it shws the pssible
More informationUNIV1"'RSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. CUMULATIVE SUM CONTROL CHARTS FOR THE FOLDED NORMAL DISTRIBUTION
UNIV1"'RSITY OF NORTH CAROLINA Department f Statistics Chapel Hill, N. C. CUMULATIVE SUM CONTROL CHARTS FOR THE FOLDED NORMAL DISTRIBUTION by N. L. Jlmsn December 1962 Grant N. AFOSR -62..148 Methds f
More informationName: Block: Date: Science 10: The Great Geyser Experiment A controlled experiment
Science 10: The Great Geyser Experiment A cntrlled experiment Yu will prduce a GEYSER by drpping Ments int a bttle f diet pp Sme questins t think abut are: What are yu ging t test? What are yu ging t measure?
More informationAP Statistics Notes Unit Two: The Normal Distributions
AP Statistics Ntes Unit Tw: The Nrmal Distributins Syllabus Objectives: 1.5 The student will summarize distributins f data measuring the psitin using quartiles, percentiles, and standardized scres (z-scres).
More informationA Few Basic Facts About Isothermal Mass Transfer in a Binary Mixture
Few asic Facts but Isthermal Mass Transfer in a inary Miture David Keffer Department f Chemical Engineering University f Tennessee first begun: pril 22, 2004 last updated: January 13, 2006 dkeffer@utk.edu
More information2004 AP CHEMISTRY FREE-RESPONSE QUESTIONS
2004 AP CHEMISTRY FREE-RESPONSE QUESTIONS 6. An electrchemical cell is cnstructed with an pen switch, as shwn in the diagram abve. A strip f Sn and a strip f an unknwn metal, X, are used as electrdes.
More informationLab #3: Pendulum Period and Proportionalities
Physics 144 Chwdary Hw Things Wrk Spring 2006 Name: Partners Name(s): Intrductin Lab #3: Pendulum Perid and Prprtinalities Smetimes, it is useful t knw the dependence f ne quantity n anther, like hw the
More informationLead/Lag Compensator Frequency Domain Properties and Design Methods
Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin
More informationParticle Size Distributions from SANS Data Using the Maximum Entropy Method. By J. A. POTTON, G. J. DANIELL AND B. D. RAINFORD
3 J. Appl. Cryst. (1988). 21,3-8 Particle Size Distributins frm SANS Data Using the Maximum Entrpy Methd By J. A. PTTN, G. J. DANIELL AND B. D. RAINFRD Physics Department, The University, Suthamptn S9
More informationDetermining the Accuracy of Modal Parameter Estimation Methods
Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationEvaluating enterprise support: state of the art and future challenges. Dirk Czarnitzki KU Leuven, Belgium, and ZEW Mannheim, Germany
Evaluating enterprise supprt: state f the art and future challenges Dirk Czarnitzki KU Leuven, Belgium, and ZEW Mannheim, Germany Intrductin During the last decade, mircecnmetric ecnmetric cunterfactual
More informationCHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came.
MATH 1342 Ch. 24 April 25 and 27, 2013 Page 1 f 5 CHAPTER 24: INFERENCE IN REGRESSION Chapters 4 and 5: Relatinships between tw quantitative variables. Be able t Make a graph (scatterplt) Summarize the
More informationChecking the resolved resonance region in EXFOR database
Checking the reslved resnance regin in EXFOR database Gttfried Bertn Sciété de Calcul Mathématique (SCM) Oscar Cabells OECD/NEA Data Bank JEFF Meetings - Sessin JEFF Experiments Nvember 0-4, 017 Bulgne-Billancurt,
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationEric Klein and Ning Sa
Week 12. Statistical Appraches t Netwrks: p1 and p* Wasserman and Faust Chapter 15: Statistical Analysis f Single Relatinal Netwrks There are fur tasks in psitinal analysis: 1) Define Equivalence 2) Measure
More informationo o IMPORTANT REMINDERS Reports will be graded largely on their ability to clearly communicate results and important conclusions.
BASD High Schl Frmal Lab Reprt GENERAL INFORMATION 12 pt Times New Rman fnt Duble-spaced, if required by yur teacher 1 inch margins n all sides (tp, bttm, left, and right) Always write in third persn (avid
More informationThe Single Pass Clustering Method. S. Rieber and V. P. Marathe. In information retrieval, several complex clustering methods exist
XIV- The Single ass Clustering Methd S. Rieber and V.. Marathe Abstract In infrmatin retrieval, several cmplex clustering methds exist which require extensive prcessing time and cmputer memry. A cheap
More informationAIP Logic Chapter 4 Notes
AIP Lgic Chapter 4 Ntes Sectin 4.1 Sectin 4.2 Sectin 4.3 Sectin 4.4 Sectin 4.5 Sectin 4.6 Sectin 4.7 4.1 The Cmpnents f Categrical Prpsitins There are fur types f categrical prpsitins. Prpsitin Letter
More informationMODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b
. REVIEW OF SOME BASIC ALGEBRA MODULE () Slving Equatins Yu shuld be able t slve fr x: a + b = c a d + e x + c and get x = e(ba +) b(c a) d(ba +) c Cmmn mistakes and strategies:. a b + c a b + a c, but
More informationNAME TEMPERATURE AND HUMIDITY. I. Introduction
NAME TEMPERATURE AND HUMIDITY I. Intrductin Temperature is the single mst imprtant factr in determining atmspheric cnditins because it greatly influences: 1. The amunt f water vapr in the air 2. The pssibility
More informationPerformance Bounds for Detect and Avoid Signal Sensing
Perfrmance unds fr Detect and Avid Signal Sensing Sam Reisenfeld Real-ime Infrmatin etwrks, University f echnlgy, Sydney, radway, SW 007, Australia samr@uts.edu.au Abstract Detect and Avid (DAA) is a Cgnitive
More informationMath Foundations 10 Work Plan
Math Fundatins 10 Wrk Plan Units / Tpics 10.1 Demnstrate understanding f factrs f whle numbers by: Prime factrs Greatest Cmmn Factrs (GCF) Least Cmmn Multiple (LCM) Principal square rt Cube rt Time Frame
More informationDifferentiation Applications 1: Related Rates
Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm
More informationA Regression Solution to the Problem of Criterion Score Comparability
A Regressin Slutin t the Prblem f Criterin Scre Cmparability William M. Pugh Naval Health Research Center When the criterin measure in a study is the accumulatin f respnses r behavirs fr an individual
More informationLifting a Lion: Using Proportions
Overview Students will wrk in cperative grups t slve a real-wrd prblem by using the bk Hw D yu Lift a Lin? Using a ty lin and a lever, students will discver hw much wrk is needed t raise the ty lin. They
More informationPublic Key Cryptography. Tim van der Horst & Kent Seamons
Public Key Cryptgraphy Tim van der Hrst & Kent Seamns Last Updated: Oct 5, 2017 Asymmetric Encryptin Why Public Key Crypt is Cl Has a linear slutin t the key distributin prblem Symmetric crypt has an expnential
More information4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression
4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw
More informationStudy Group Report: Plate-fin Heat Exchangers: AEA Technology
Study Grup Reprt: Plate-fin Heat Exchangers: AEA Technlgy The prblem under study cncerned the apparent discrepancy between a series f experiments using a plate fin heat exchanger and the classical thery
More informationTree Structured Classifier
Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationInternal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.
Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.
More informationNAME: Prof. Ruiz. 1. [5 points] What is the difference between simple random sampling and stratified random sampling?
CS4445 ata Mining and Kwledge iscery in atabases. B Term 2014 Exam 1 Nember 24, 2014 Prf. Carlina Ruiz epartment f Cmputer Science Wrcester Plytechnic Institute NAME: Prf. Ruiz Prblem I: Prblem II: Prblem
More informationBASD HIGH SCHOOL FORMAL LAB REPORT
BASD HIGH SCHOOL FORMAL LAB REPORT *WARNING: After an explanatin f what t include in each sectin, there is an example f hw the sectin might lk using a sample experiment Keep in mind, the sample lab used
More informationLab 1 The Scientific Method
INTRODUCTION The fllwing labratry exercise is designed t give yu, the student, an pprtunity t explre unknwn systems, r universes, and hypthesize pssible rules which may gvern the behavir within them. Scientific
More informationSection 6-2: Simplex Method: Maximization with Problem Constraints of the Form ~
Sectin 6-2: Simplex Methd: Maximizatin with Prblem Cnstraints f the Frm ~ Nte: This methd was develped by Gerge B. Dantzig in 1947 while n assignment t the U.S. Department f the Air Frce. Definitin: Standard
More information3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression
3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets
More informationReinforcement Learning" CMPSCI 383 Nov 29, 2011!
Reinfrcement Learning" CMPSCI 383 Nv 29, 2011! 1 Tdayʼs lecture" Review f Chapter 17: Making Cmple Decisins! Sequential decisin prblems! The mtivatin and advantages f reinfrcement learning.! Passive learning!
More informationSticiGui Chapter 4: Measures of Location and Spread Philip Stark (2013)
SticiGui Chapter 4: Measures f Lcatin and Spread Philip Stark (2013) Summarizing data can help us understand them, especially when the number f data is large. This chapter presents several ways t summarize
More informationLHS Mathematics Department Honors Pre-Calculus Final Exam 2002 Answers
LHS Mathematics Department Hnrs Pre-alculus Final Eam nswers Part Shrt Prblems The table at the right gives the ppulatin f Massachusetts ver the past several decades Using an epnential mdel, predict the
More informationThermodynamics Partial Outline of Topics
Thermdynamics Partial Outline f Tpics I. The secnd law f thermdynamics addresses the issue f spntaneity and invlves a functin called entrpy (S): If a prcess is spntaneus, then Suniverse > 0 (2 nd Law!)
More informationAssessment Primer: Writing Instructional Objectives
Assessment Primer: Writing Instructinal Objectives (Based n Preparing Instructinal Objectives by Mager 1962 and Preparing Instructinal Objectives: A critical tl in the develpment f effective instructin
More informationSemester 2 AP Chemistry Unit 12
Cmmn In Effect and Buffers PwerPint The cmmn in effect The shift in equilibrium caused by the additin f a cmpund having an in in cmmn with the disslved substance The presence f the excess ins frm the disslved
More informationEASTERN ARIZONA COLLEGE Introduction to Statistics
EASTERN ARIZONA COLLEGE Intrductin t Statistics Curse Design 2014-2015 Curse Infrmatin Divisin Scial Sciences Curse Number PSY 220 Title Intrductin t Statistics Credits 3 Develped by Adam Stinchcmbe Lecture/Lab
More informationA mathematical model for complete stress-strain curve prediction of permeable concrete
A mathematical mdel fr cmplete stress-strain curve predictin f permeable cncrete M. K. Hussin Y. Zhuge F. Bullen W. P. Lkuge Faculty f Engineering and Surveying, University f Suthern Queensland, Twmba,
More informationIB Sports, Exercise and Health Science Summer Assignment. Mrs. Christina Doyle Seneca Valley High School
IB Sprts, Exercise and Health Science Summer Assignment Mrs. Christina Dyle Seneca Valley High Schl Welcme t IB Sprts, Exercise and Health Science! This curse incrprates the traditinal disciplines f anatmy
More informationSupport-Vector Machines
Supprt-Vectr Machines Intrductin Supprt vectr machine is a linear machine with sme very nice prperties. Haykin chapter 6. See Alpaydin chapter 13 fr similar cntent. Nte: Part f this lecture drew material
More informationABSORPTION OF GAMMA RAYS
6 Sep 11 Gamma.1 ABSORPTIO OF GAMMA RAYS Gamma rays is the name given t high energy electrmagnetic radiatin riginating frm nuclear energy level transitins. (Typical wavelength, frequency, and energy ranges
More informationSequential Allocation with Minimal Switching
In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University
More informationGeneral Chemistry II, Unit I: Study Guide (part I)
1 General Chemistry II, Unit I: Study Guide (part I) CDS Chapter 14: Physical Prperties f Gases Observatin 1: Pressure- Vlume Measurements n Gases The spring f air is measured as pressure, defined as the
More information5 th grade Common Core Standards
5 th grade Cmmn Cre Standards In Grade 5, instructinal time shuld fcus n three critical areas: (1) develping fluency with additin and subtractin f fractins, and develping understanding f the multiplicatin
More informationResampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017
Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with
More informationINSTRUMENTAL VARIABLES
INSTRUMENTAL VARIABLES Technical Track Sessin IV Sergi Urzua University f Maryland Instrumental Variables and IE Tw main uses f IV in impact evaluatin: 1. Crrect fr difference between assignment f treatment
More informationDetermining Optimum Path in Synthesis of Organic Compounds using Branch and Bound Algorithm
Determining Optimum Path in Synthesis f Organic Cmpunds using Branch and Bund Algrithm Diastuti Utami 13514071 Prgram Studi Teknik Infrmatika Seklah Teknik Elektr dan Infrmatika Institut Teknlgi Bandung,
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More information1b) =.215 1c).080/.215 =.372
Practice Exam 1 - Answers 1. / \.1/ \.9 (D+) (D-) / \ / \.8 / \.2.15/ \.85 (T+) (T-) (T+) (T-).080.020.135.765 1b).080 +.135 =.215 1c).080/.215 =.372 2. The data shwn in the scatter plt is the distance
More informationBiochemistry Summer Packet
Bichemistry Summer Packet Science Basics Metric Cnversins All measurements in chemistry are made using the metric system. In using the metric system yu must be able t cnvert between ne value and anther.
More informationSurface and Contact Stress
Surface and Cntact Stress The cncept f the frce is fundamental t mechanics and many imprtant prblems can be cast in terms f frces nly, fr example the prblems cnsidered in Chapter. Hwever, mre sphisticated
More informationCoalition Formation and Data Envelopment Analysis
Jurnal f CENTRU Cathedra Vlume 4, Issue 2, 20 26-223 JCC Jurnal f CENTRU Cathedra Calitin Frmatin and Data Envelpment Analysis Rlf Färe Oregn State University, Crvallis, OR, USA Shawna Grsspf Oregn State
More informationECEN 4872/5827 Lecture Notes
ECEN 4872/5827 Lecture Ntes Lecture #5 Objectives fr lecture #5: 1. Analysis f precisin current reference 2. Appraches fr evaluating tlerances 3. Temperature Cefficients evaluatin technique 4. Fundamentals
More informationA solution of certain Diophantine problems
A slutin f certain Diphantine prblems Authr L. Euler* E7 Nvi Cmmentarii academiae scientiarum Petrplitanae 0, 1776, pp. 8-58 Opera Omnia: Series 1, Vlume 3, pp. 05-17 Reprinted in Cmmentat. arithm. 1,
More informationPhysics 2010 Motion with Constant Acceleration Experiment 1
. Physics 00 Mtin with Cnstant Acceleratin Experiment In this lab, we will study the mtin f a glider as it accelerates dwnhill n a tilted air track. The glider is supprted ver the air track by a cushin
More informationALE 21. Gibbs Free Energy. At what temperature does the spontaneity of a reaction change?
Name Chem 163 Sectin: Team Number: ALE 21. Gibbs Free Energy (Reference: 20.3 Silberberg 5 th editin) At what temperature des the spntaneity f a reactin change? The Mdel: The Definitin f Free Energy S
More information1 The limitations of Hartree Fock approximation
Chapter: Pst-Hartree Fck Methds - I The limitatins f Hartree Fck apprximatin The n electrn single determinant Hartree Fck wave functin is the variatinal best amng all pssible n electrn single determinants
More informationAdmin. MDP Search Trees. Optimal Quantities. Reinforcement Learning
Admin Reinfrcement Learning Cntent adapted frm Berkeley CS188 MDP Search Trees Each MDP state prjects an expectimax-like search tree Optimal Quantities The value (utility) f a state s: V*(s) = expected
More informationRevisiting the Socrates Example
Sectin 1.6 Sectin Summary Valid Arguments Inference Rules fr Prpsitinal Lgic Using Rules f Inference t Build Arguments Rules f Inference fr Quantified Statements Building Arguments fr Quantified Statements
More informationChapters 29 and 35 Thermochemistry and Chemical Thermodynamics
Chapters 9 and 35 Thermchemistry and Chemical Thermdynamics 1 Cpyright (c) 011 by Michael A. Janusa, PhD. All rights reserved. Thermchemistry Thermchemistry is the study f the energy effects that accmpany
More informationMODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards:
MODULE FOUR This mdule addresses functins SC Academic Standards: EA-3.1 Classify a relatinship as being either a functin r nt a functin when given data as a table, set f rdered pairs, r graph. EA-3.2 Use
More informationAMERICAN PETROLEUM INSTITUTE API RP 581 RISK BASED INSPECTION BASE RESOURCE DOCUMENT BALLOT COVER PAGE
Ballt ID: Title: USING LIFE EXTENSION FACTOR (LEF) TO INCREASE BUNDLE INSPECTION INTERVAL Purpse: 1. Prvides a methd t increase a bundle s inspectin interval t accunt fr LEF. 2. Clarifies Table 8.6.5 Als
More informationCS:4420 Artificial Intelligence
CS:4420 Artificial Intelligence Spring 2017 Learning frm Examples Cesare Tinelli The University f Iwa Cpyright 2004 17, Cesare Tinelli and Stuart Russell a a These ntes were riginally develped by Stuart
More informationBiplots in Practice MICHAEL GREENACRE. Professor of Statistics at the Pompeu Fabra University. Chapter 13 Offprint
Biplts in Practice MICHAEL GREENACRE Prfessr f Statistics at the Pmpeu Fabra University Chapter 13 Offprint CASE STUDY BIOMEDICINE Cmparing Cancer Types Accrding t Gene Epressin Arrays First published:
More informationDEFENSE OCCUPATIONAL AND ENVIRONMENTAL HEALTH READINESS SYSTEM (DOEHRS) ENVIRONMENTAL HEALTH SAMPLING ELECTRONIC DATA DELIVERABLE (EDD) GUIDE
DEFENSE OCCUPATIOL AND ENVIRONMENTAL HEALTH READINESS SYSTEM (DOEHRS) ENVIRONMENTAL HEALTH SAMPLING ELECTRONIC DATA DELIVERABLE (EDD) GUIDE 20 JUNE 2017 V1.0 i TABLE OF CONTENTS 1 INTRODUCTION... 1 2 CONCEPT
More informationIntroduction to Quantitative Genetics II: Resemblance Between Relatives
Intrductin t Quantitative Genetics II: Resemblance Between Relatives Bruce Walsh 8 Nvember 006 EEB 600A The heritability f a trait, a central cncept in quantitative genetics, is the prprtin f variatin
More informationDrought damaged area
ESTIMATE OF THE AMOUNT OF GRAVEL CO~TENT IN THE SOIL BY A I R B O'RN EMS S D A T A Y. GOMI, H. YAMAMOTO, AND S. SATO ASIA AIR SURVEY CO., l d. KANAGAWA,JAPAN S.ISHIGURO HOKKAIDO TOKACHI UBPREFECTRAl OffICE
More informationDead-beat controller design
J. Hetthéssy, A. Barta, R. Bars: Dead beat cntrller design Nvember, 4 Dead-beat cntrller design In sampled data cntrl systems the cntrller is realised by an intelligent device, typically by a PLC (Prgrammable
More informationNUMBERS, MATHEMATICS AND EQUATIONS
AUSTRALIAN CURRICULUM PHYSICS GETTING STARTED WITH PHYSICS NUMBERS, MATHEMATICS AND EQUATIONS An integral part t the understanding f ur physical wrld is the use f mathematical mdels which can be used t
More informationCOMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification
COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationmaking triangle (ie same reference angle) ). This is a standard form that will allow us all to have the X= y=
Intrductin t Vectrs I 21 Intrductin t Vectrs I 22 I. Determine the hrizntal and vertical cmpnents f the resultant vectr by cunting n the grid. X= y= J. Draw a mangle with hrizntal and vertical cmpnents
More informationChapter 8: The Binomial and Geometric Distributions
Sectin 8.1: The Binmial Distributins Chapter 8: The Binmial and Gemetric Distributins A randm variable X is called a BINOMIAL RANDOM VARIABLE if it meets ALL the fllwing cnditins: 1) 2) 3) 4) The MOST
More information22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion
.54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin
More informationCHM112 Lab Graphing with Excel Grading Rubric
Name CHM112 Lab Graphing with Excel Grading Rubric Criteria Pints pssible Pints earned Graphs crrectly pltted and adhere t all guidelines (including descriptive title, prperly frmatted axes, trendline
More information