Non-Linear & Logistic Regression
|
|
- Harold Cobb
- 6 years ago
- Views:
Transcription
1 Non-Liner & Logistic Regression If the sttistics re boring, then you've got the wrong numbers. Edwrd R. Tufte (Sttistics Professor, Yle University)
2 Regression Anlyses When do we use these? PART 1: find reltionship between response vrible (Y) nd predictor vrible (X) (e.g. Y~X) PART 2: use reltionship to predict Y from X Simple liner regression: y = b + m*x y = β 0 + β 1 * x 1 Multiple liner regression: y = β 0 + β 1 *x 1 + β 2 *x 2 + β n *x n Non liner regression: when line just doesn t fit our dt Logistic regression: when our dt is binry (dt is represented s 0 or 1)
3 Non-liner Regression Curviliner reltionship between response nd predictor vribles The right type of non-liner model re usully conceptully determined bsed on biologicl considertions For strting point we cn plot the reltionship between the 2 vribles nd visully check which model might be good option There re obviously MANY curves you cn generte to try nd fit your dt
4 response (y) response (y) response (y) response (y) Exponentil Curve Non-liner regression option #1 Exponentil: y = + bc x Rpid incresing/decresing chnge in Y or X for chnge in the other Ex: bcteri growth/decy, humn popultion growth, infection rtes (humns, trees, etc.) 0 < c < 1 c > 1 +b +b 0 < c < 1 c > 1 -b -b
5 response (y) response (y) response (y) response (y) Logrithmic Curve Non-liner regression option #2 Logrithmic: y = + bx c Rpid incresing/decresing chnge in Y or X for chnge in the other Ex: survivl thresholds, resource optimiztion -c +c -c +b +b +c -b -b
6 response (y) response (y) Hyperbolic Curve Non-liner regression option #3 Hyperbolic: y = + b x + c Rpid incresing/decresing chnge in Y or X for chnge in the other Ex: survivl of function of popultion Similr to exponentil nd logrithmic curve but now we hve 2 symptotes +b -b c c
7 response (y) response (y) Prbolic Curve Non-liner regression option #4 Prbolic: y = + b x c 2 Rpid incresing/decresing chnge in Y or X for chnge in the other followed by the reverse trend Ex: survivl of function of n environmentl vrible Upwrd Prbolic Downwrd Prbolic +b -b c c
8 response (y) Gussin Curve Non-liner regression option #5 Gussin: y = b x c 2 Resembles norml distribution Ex: survivl of function of n environmentl vrible Where 0 < b < 1 b c
9 response (y) Sigmoidl Curve Non-liner regression option #6 Signoidl: y = 1 + b x c + d Stbility in Y followed by rpid increse then stbility gin Ex: restricted growth, lerning response, threshold hs to occur for response effect Where b > 1 nd c > 1 c b d
10 response (y) response (y) Michelis Menten Curve Non-liner regression option #7 Michelis Menten: y = x b + x Rpid incresing/decresing chnge in Y or X for chnge in the other Ex: biologicl process s function of resource vilbility Similr to exponentil nd logrithmic curve but now we hve 2 prmeters this model comes from kinetics/physiology 1 2 -b b
11 Non-Liner Regression Curve Fitting Procedure: 1. Plot your vribles to visulize the reltionship. Wht curve does the pttern resemble? b. Wht might lterntive options be? 2. Decide on the curves you wnt to compre nd run non-liner regression curve fitting. You will hve to estimte your prmeters from your curve to hve strting vlues for your curve fitting function 3. Once you hve prmeters for your curves compre models with AIC 4. Plot the model with the lowest AIC on your point dt to visulize fit Non-liner regression curve fitting in R: instll.pckges("minpck.lm") nlslm(responsey~model, strt=list(strting vlues for model prmeters))
12 Non-Liner Regression Output from R Non-liner model tht we fit Simplified logrithmic with slope=0 Estimtes of model prmeters Residul sum-of-squres for your non-liner model Number of itertions needed to estimte the prmeters
13 Non-Liner Regression Curve Fitting Procedure: 1. Plot your vribles to visulize the reltionship. Wht curve does the pttern resemble? b. Wht might lterntive options be? 2. Decide on the curves you wnt to compre nd run non-liner regression curve fitting. You will hve to estimte your prmeters from your curve to hve strting vlues for your curve fitting function 3. Once you hve prmeters for your curves compre models with AIC 4. Plot the model with the lowest AIC on your point dt to visulize fit Non-liner regression curve fitting in R: instll.pckges("minpck.lm") nlslm(responsey~model, strt=list(strting vlues for model prmeters))
14 Akike s Informtion Criterion (AIC) How do we decide which model is best? In the 1970s he used informtion theory to build numericl equivlent of Occm's rzor Hirotugu Akike, Occm s rzor: All else being equl, the simplest explntion is the best one For model selection, this mens the simplest model is preferred to more complex one Of course, this needs to be weighed ginst the bility of the model to ctully predict nything AIC considers both the fit of the model nd the model complexity Complexity is mesured s number prmeters or the use of higher order polynomils Allows us to blnce over- nd under-fitting in our modelled reltionships We wnt model tht is s simple s possible, but no simpler A resonble mount of explntory power is trded off ginst model complexity AIC mesures the blnce of this for us
15 Akike s Informtion Criterion (AIC) AIC in R AIC is useful becuse it cn be clculted for ny kind of model llowing comprisons cross different modelling pproches nd model fitting techniques Model with the lowest AIC vlue is the model tht fits your dt best (e.g. minimizes your model residuls) Output from R is single AIC vlue Akike s Informtion Criterion in R to determine best model: AIC(nlsLM(responseY~MODEL1, strt=list(strting vlues))) AIC(nlsLM(responseY~MODEL2, strt=list(strting vlues))) AIC(nlsLM(responseY~MODEL3, strt=list(strting vlues)))
16 Non-Liner Regression Curve fitting Use the prmeter estimtes outputted from nlslm() to generte curve for plotting
17 Non-Liner Regression Assumptions NLR mke no ssumptions for normlity, equl vrinces, or outliers However the ssumptions of independence (sptil & temporl) nd design considertions (rndomiztion, sufficient replictes, no pseudorepliction) still pply We don t hve to worry bout sttisticl power here becuse we re fitting reltionships All we cre bout is if or how well we cn model the reltionship between our response nd predictor vribles
18 Non-Liner Regression R 2 for goodness of fit Clculting n R 2 is NOT APPROPIATE for non-liner regression Why? For liner models, the sums of the squred errors lwys dd up in specific mnner: SS Regression + SS Error = SS Totl Therefore R 2 = SS Regression SSTotl which mthemticlly must produce vlue between 0 nd 100% But in nonliner regression SS Regression + SS Error SS Totl Therefore the rtio used to construct R 2 is bis in nonliner regression Best to use AIC vlue nd the mesurement of the residul sum-of-squres to pick best model then plot the curve to visulize the fit
19 Logistic Regression (.k. logit regression) Reltionship between binry response vrible nd predictor vribles Logistic Model: y = eβ 0+β 1 x 1 +β 2 x 2 + +β n x n 1 e β 0 +β 1 x 1 +β 2 x 2 + +β nx n Logit Model Binry response vrible cn be considered clss (1 or 0) Yes or No Present or Absent The liner prt of the logistic regression eqution is used to find the probbility of being in ctegory bsed on the combintion of predictors Predictor vribles re usully (but not necessrily) continuous But it is hrder to mke inferences from regression outputs tht use discrete or ctegoricl vribles
20 Binomil distribution vs Norml distribution Key difference: Vlues re continuous (Norml) vs discrete (Binomil) As smple size increses the binomil distribution ppers to resemble the norml distribution Binomil distribution is fmily of distributions becuse the shpe references both the number of observtions nd the probbility of getting success - vlue of 1 Wht is probbility of x success in n independent nd identiclly distributed Bernoulli trils? Bernoulli tril (or binomil tril) - rndom experiment with exctly two possible outcomes, "success" nd "filure", in which the probbility of success is the sme every time the experiment is conducted
21 Logistic Regression vs Liner Regression Liner Regression - references the Gussin (norml) distribution - uses ordinry lest squres to find best fitting line the estimtes prmeters tht predict the chnge in the dependent vrible for chnge in the independent vrible Logistic regression - references the Binomil distribution - estimtes the probbility (p) of n event occurring (y=1) rther then not occurring (y=0) from knowledge of relevnt independent vribles (our dt) - regression coefficients re estimted using mximum likelihood estimtion (itertive process)
22 Mximum likelihood estimtion How coefficients re estimted for logistic regression Complex itertive process to find coefficient vlues tht mximizes the likelihood function Likelihood function - probbility for the occurrence of observed set of vlues X nd Y given function with defined prmeters Process: 1. Begins with tenttive solution for ech coefficient 2. Revise it slightly to see if the likelihood function cn be improved 3. Repets this revision until improvement is minute, t which point the process is sid to hve converged
23 Logistic Regression vs Liner Regression Liner Regression - references the Gussin (norml) distribution - uses ordinry lest squres to find best fitting line the estimtes prmeters tht predict the chnge in the dependent vrible for chnge in the independent vrible Logistic regression - references the Binomil distribution - estimtes the probbility (p) of n event occurring (y=1) rther then not occurring (y=0) from knowledge of relevnt independent vribles (our dt) - regression coefficients re estimted using mximum likelihood estimtion (itertive process) Simple Logistic Regression in R: lm(response~predictor, fmily="binomil") summry(lm(response~predictor, fmily="binomil")) Multiple Logistic Regression in R: lm(response~predictor1+predictor2+ +predictorn, fmily="binomil") summry(lm(response~predictor1+predictor2+ +predictorn, fmily="binomil"))
24 Logistic Regression (.k. logit regression) Output from R Estimte of model prmeters (intercept nd slope) Stndrd error of estimtes AIC vlue for the model Tests the null hypothesis tht the coefficient is equl to zero (no effect) A predictor tht hs low p-vlue is likely to be meningful ddition to your model becuse chnges in the predictor's vlue re relted to chnges in the response vrible A lrge p-vlue suggests tht chnges in the predictor re not ssocited with chnges in the response
25 Logistic Regression (.k. logit regression) Pseudo R 2 for goodness of fit In liner regression, the reltionship between the dependent nd the independent vribles is liner However this ssumption is not mde in logistic regression so we cnnot use the clcultion R 2 = SS Regression SSTotl - REMEMBER we re not using sum-of-squres to estimte our prmeters we re using mximum likelihood estimtion We cn however clculte pseudo R 2 - Lots of options on how to do this, but the best for logistic regression ppers to be McFdden's clcultion R 2 = 1 lnl M FULL lnl M intercept L = Estimted likelihood Estimting McFdden s pseudo R 2 in R: mod=lm(response~predictor,fmily="binomil") mcf.r2=1-mod$devince/mod$null.devince NOTE: Pseudo R 2 will be MUCH lower thn R 2 vlues!
26 Logistic Regression (.k. logit regression) Assumptions Logistic regression mke no ssumptions for normlity, equl vrinces, or outliers However the ssumptions of independence (sptil & temporl) nd design considertions (rndomiztion, sufficient replictes, no pseudorepliction) still pply Logistic regression ssumes the response vrible is binry (0 & 1) We don t hve to worry bout sttisticl power here becuse we re fitting reltionships All we cre bout is if or how well we cn model the reltionship between our response nd predictor vribles
27 Importnt to Remember A non-liner or logistic reltionship DOES NOT imply custion! AIC or pseudo R 2 implies reltionship rther thn one or multiple fctors cusing nother fctor vlue Be creful of your interprettions!
Tests for the Ratio of Two Poisson Rates
Chpter 437 Tests for the Rtio of Two Poisson Rtes Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson
More informationStudent Activity 3: Single Factor ANOVA
MATH 40 Student Activity 3: Single Fctor ANOVA Some Bsic Concepts In designed experiment, two or more tretments, or combintions of tretments, is pplied to experimentl units The number of tretments, whether
More informationThe steps of the hypothesis test
ttisticl Methods I (EXT 7005) Pge 78 Mosquito species Time of dy A B C Mid morning 0.0088 5.4900 5.5000 Mid Afternoon.3400 0.0300 0.8700 Dusk 0.600 5.400 3.000 The Chi squre test sttistic is the sum of
More informationContinuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht
More informationPredict Global Earth Temperature using Linier Regression
Predict Globl Erth Temperture using Linier Regression Edwin Swndi Sijbt (23516012) Progrm Studi Mgister Informtik Sekolh Teknik Elektro dn Informtik ITB Jl. Gnesh 10 Bndung 40132, Indonesi 23516012@std.stei.itb.c.id
More informationCS 188 Introduction to Artificial Intelligence Fall 2018 Note 7
CS 188 Introduction to Artificil Intelligence Fll 2018 Note 7 These lecture notes re hevily bsed on notes originlly written by Nikhil Shrm. Decision Networks In the third note, we lerned bout gme trees
More informationChapter 5 : Continuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll
More informationLecture 3 Gaussian Probability Distribution
Introduction Lecture 3 Gussin Probbility Distribution Gussin probbility distribution is perhps the most used distribution in ll of science. lso clled bell shped curve or norml distribution Unlike the binomil
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationEstimation of Binomial Distribution in the Light of Future Data
British Journl of Mthemtics & Computer Science 102: 1-7, 2015, Article no.bjmcs.19191 ISSN: 2231-0851 SCIENCEDOMAIN interntionl www.sciencedomin.org Estimtion of Binomil Distribution in the Light of Future
More informationNUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.
NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with
More informationLecture INF4350 October 12008
Biosttistics ti ti Lecture INF4350 October 12008 Anj Bråthen Kristoffersen Biomedicl Reserch Group Deprtment of informtics, UiO Gol Presenttion of dt descriptive tbles nd grphs Sensitivity, specificity,
More informationMORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.)
MORE FUNCTION GRAPHING; OPTIMIZATION FRI, OCT 25, 203 (Lst edited October 28, 203 t :09pm.) Exercise. Let n be n rbitrry positive integer. Give n exmple of function with exctly n verticl symptotes. Give
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationOperations with Polynomials
38 Chpter P Prerequisites P.4 Opertions with Polynomils Wht you should lern: How to identify the leding coefficients nd degrees of polynomils How to dd nd subtrct polynomils How to multiply polynomils
More informationDiscrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 17
EECS 70 Discrete Mthemtics nd Proility Theory Spring 2013 Annt Shi Lecture 17 I.I.D. Rndom Vriles Estimting the is of coin Question: We wnt to estimte the proportion p of Democrts in the US popultion,
More informationSection 11.5 Estimation of difference of two proportions
ection.5 Estimtion of difference of two proportions As seen in estimtion of difference of two mens for nonnorml popultion bsed on lrge smple sizes, one cn use CLT in the pproximtion of the distribution
More informationMonte Carlo method in solving numerical integration and differential equation
Monte Crlo method in solving numericl integrtion nd differentil eqution Ye Jin Chemistry Deprtment Duke University yj66@duke.edu Abstrct: Monte Crlo method is commonly used in rel physics problem. The
More informationChapter 9: Inferences based on Two samples: Confidence intervals and tests of hypotheses
Chpter 9: Inferences bsed on Two smples: Confidence intervls nd tests of hypotheses 9.1 The trget prmeter : difference between two popultion mens : difference between two popultion proportions : rtio of
More informationSUMMER KNOWHOW STUDY AND LEARNING CENTRE
SUMMER KNOWHOW STUDY AND LEARNING CENTRE Indices & Logrithms 2 Contents Indices.2 Frctionl Indices.4 Logrithms 6 Exponentil equtions. Simplifying Surds 13 Opertions on Surds..16 Scientific Nottion..18
More informationGoals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite
Unit #8 : The Integrl Gols: Determine how to clculte the re described by function. Define the definite integrl. Eplore the reltionship between the definite integrl nd re. Eplore wys to estimte the definite
More informationThe First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a).
The Fundmentl Theorems of Clculus Mth 4, Section 0, Spring 009 We now know enough bout definite integrls to give precise formultions of the Fundmentl Theorems of Clculus. We will lso look t some bsic emples
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More information1 Linear Least Squares
Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving
More informationCS667 Lecture 6: Monte Carlo Integration 02/10/05
CS667 Lecture 6: Monte Crlo Integrtion 02/10/05 Venkt Krishnrj Lecturer: Steve Mrschner 1 Ide The min ide of Monte Crlo Integrtion is tht we cn estimte the vlue of n integrl by looking t lrge number of
More informationUNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction
Lesson : Logrithmic Functions s Inverses Prerequisite Skills This lesson requires the use of the following skills: determining the dependent nd independent vribles in n exponentil function bsed on dt from
More information1 Probability Density Functions
Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our
More information20 MATHEMATICS POLYNOMIALS
0 MATHEMATICS POLYNOMIALS.1 Introduction In Clss IX, you hve studied polynomils in one vrible nd their degrees. Recll tht if p(x) is polynomil in x, the highest power of x in p(x) is clled the degree of
More informationData Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading
Dt Assimiltion Aln O Neill Dt Assimiltion Reserch Centre University of Reding Contents Motivtion Univrite sclr dt ssimiltion Multivrite vector dt ssimiltion Optiml Interpoltion BLUE 3d-Vritionl Method
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk bout solving systems of liner equtions. These re problems tht give couple of equtions with couple of unknowns, like: 6 2 3 7 4
More informationf(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral
Improper Integrls Every time tht we hve evluted definite integrl such s f(x) dx, we hve mde two implicit ssumptions bout the integrl:. The intervl [, b] is finite, nd. f(x) is continuous on [, b]. If one
More informationCBE 291b - Computation And Optimization For Engineers
The University of Western Ontrio Fculty of Engineering Science Deprtment of Chemicl nd Biochemicl Engineering CBE 9b - Computtion And Optimiztion For Engineers Mtlb Project Introduction Prof. A. Jutn Jn
More information1 Online Learning and Regret Minimization
2.997 Decision-Mking in Lrge-Scle Systems My 10 MIT, Spring 2004 Hndout #29 Lecture Note 24 1 Online Lerning nd Regret Minimiztion In this lecture, we consider the problem of sequentil decision mking in
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationPre-Session Review. Part 1: Basic Algebra; Linear Functions and Graphs
Pre-Session Review Prt 1: Bsic Algebr; Liner Functions nd Grphs A. Generl Review nd Introduction to Algebr Hierrchy of Arithmetic Opertions Opertions in ny expression re performed in the following order:
More informationReview of basic calculus
Review of bsic clculus This brief review reclls some of the most importnt concepts, definitions, nd theorems from bsic clculus. It is not intended to tech bsic clculus from scrtch. If ny of the items below
More informationfractions Let s Learn to
5 simple lgebric frctions corne lens pupil retin Norml vision light focused on the retin concve lens Shortsightedness (myopi) light focused in front of the retin Corrected myopi light focused on the retin
More informationf(a+h) f(a) x a h 0. This is the rate at which
M408S Concept Inventory smple nswers These questions re open-ended, nd re intended to cover the min topics tht we lerned in M408S. These re not crnk-out-n-nswer problems! (There re plenty of those in the
More informationLECTURE NOTE #12 PROF. ALAN YUILLE
LECTURE NOTE #12 PROF. ALAN YUILLE 1. Clustering, K-mens, nd EM Tsk: set of unlbeled dt D = {x 1,..., x n } Decompose into clsses w 1,..., w M where M is unknown. Lern clss models p(x w)) Discovery of
More informationPrecalculus Spring 2017
Preclculus Spring 2017 Exm 3 Summry (Section 4.1 through 5.2, nd 9.4) Section P.5 Find domins of lgebric expressions Simplify rtionl expressions Add, subtrct, multiply, & divide rtionl expressions Simplify
More informationMATH 144: Business Calculus Final Review
MATH 144: Business Clculus Finl Review 1 Skills 1. Clculte severl limits. 2. Find verticl nd horizontl symptotes for given rtionl function. 3. Clculte derivtive by definition. 4. Clculte severl derivtives
More informationLecture 21: Order statistics
Lecture : Order sttistics Suppose we hve N mesurements of sclr, x i =, N Tke ll mesurements nd sort them into scending order x x x 3 x N Define the mesured running integrl S N (x) = 0 for x < x = i/n for
More informationDuality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below.
Dulity #. Second itertion for HW problem Recll our LP emple problem we hve been working on, in equlity form, is given below.,,,, 8 m F which, when written in slightly different form, is 8 F Recll tht we
More informationARITHMETIC OPERATIONS. The real numbers have the following properties: a b c ab ac
REVIEW OF ALGEBRA Here we review the bsic rules nd procedures of lgebr tht you need to know in order to be successful in clculus. ARITHMETIC OPERATIONS The rel numbers hve the following properties: b b
More informationFor the percentage of full time students at RCC the symbols would be:
Mth 17/171 Chpter 7- ypothesis Testing with One Smple This chpter is s simple s the previous one, except it is more interesting In this chpter we will test clims concerning the sme prmeters tht we worked
More informationapproaches as n becomes larger and larger. Since e > 1, the graph of the natural exponential function is as below
. Eponentil nd rithmic functions.1 Eponentil Functions A function of the form f() =, > 0, 1 is clled n eponentil function. Its domin is the set of ll rel f ( 1) numbers. For n eponentil function f we hve.
More informationMathematics Extension 1
04 Bored of Studies Tril Emintions Mthemtics Etension Written by Crrotsticks & Trebl. Generl Instructions Totl Mrks 70 Reding time 5 minutes. Working time hours. Write using blck or blue pen. Blck pen
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 17
CS 70 Discrete Mthemtics nd Proility Theory Summer 2014 Jmes Cook Note 17 I.I.D. Rndom Vriles Estimting the is of coin Question: We wnt to estimte the proportion p of Democrts in the US popultion, y tking
More informationImproper Integrals. Type I Improper Integrals How do we evaluate an integral such as
Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph
More informationMATH SS124 Sec 39 Concepts summary with examples
This note is mde for students in MTH124 Section 39 to review most(not ll) topics I think we covered in this semester, nd there s exmples fter these concepts, go over this note nd try to solve those exmples
More informationMath 135, Spring 2012: HW 7
Mth 3, Spring : HW 7 Problem (p. 34 #). SOLUTION. Let N the number of risins per cookie. If N is Poisson rndom vrible with prmeter λ, then nd for this to be t lest.99, we need P (N ) P (N ) ep( λ) λ ln(.)
More informationA-Level Mathematics Transition Task (compulsory for all maths students and all further maths student)
A-Level Mthemtics Trnsition Tsk (compulsory for ll mths students nd ll further mths student) Due: st Lesson of the yer. Length: - hours work (depending on prior knowledge) This trnsition tsk provides revision
More information13: Diffusion in 2 Energy Groups
3: Diffusion in Energy Groups B. Rouben McMster University Course EP 4D3/6D3 Nucler Rector Anlysis (Rector Physics) 5 Sept.-Dec. 5 September Contents We study the diffusion eqution in two energy groups
More informationIdentify graphs of linear inequalities on a number line.
COMPETENCY 1.0 KNOWLEDGE OF ALGEBRA SKILL 1.1 Identify grphs of liner inequlities on number line. - When grphing first-degree eqution, solve for the vrible. The grph of this solution will be single point
More informationProperties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives
Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn
More informationdifferent methods (left endpoint, right endpoint, midpoint, trapezoid, Simpson s).
Mth 1A with Professor Stnkov Worksheet, Discussion #41; Wednesdy, 12/6/217 GSI nme: Roy Zho Problems 1. Write the integrl 3 dx s limit of Riemnn sums. Write it using 2 intervls using the 1 x different
More informationComparison Procedures
Comprison Procedures Single Fctor, Between-Subects Cse /8/ Comprison Procedures, One-Fctor ANOVA, Between Subects Two Comprison Strtegies post hoc (fter-the-fct) pproch You re interested in discovering
More informationAP Calculus Multiple Choice: BC Edition Solutions
AP Clculus Multiple Choice: BC Edition Solutions J. Slon Mrch 8, 04 ) 0 dx ( x) is A) B) C) D) E) Divergent This function inside the integrl hs verticl symptotes t x =, nd the integrl bounds contin this
More informationMath& 152 Section Integration by Parts
Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible
More informationOverview of Calculus I
Overview of Clculus I Prof. Jim Swift Northern Arizon University There re three key concepts in clculus: The limit, the derivtive, nd the integrl. You need to understnd the definitions of these three things,
More information2008 Mathematical Methods (CAS) GA 3: Examination 2
Mthemticl Methods (CAS) GA : Exmintion GENERAL COMMENTS There were 406 students who st the Mthemticl Methods (CAS) exmintion in. Mrks rnged from to 79 out of possible score of 80. Student responses showed
More informationCMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature
CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy
More informationScientific notation is a way of expressing really big numbers or really small numbers.
Scientific Nottion (Stndrd form) Scientific nottion is wy of expressing relly big numbers or relly smll numbers. It is most often used in scientific clcultions where the nlysis must be very precise. Scientific
More informationMath 3B Final Review
Mth 3B Finl Review Written by Victori Kl vtkl@mth.ucsb.edu SH 6432u Office Hours: R 9:45-10:45m SH 1607 Mth Lb Hours: TR 1-2pm Lst updted: 12/06/14 This is continution of the midterm review. Prctice problems
More informationRead section 3.3, 3.4 Announcements:
Dte: 3/1/13 Objective: SWBAT pply properties of exponentil functions nd will pply properties of rithms. Bell Ringer: 1. f x = 3x 6, find the inverse, f 1 x., Using your grphing clcultor, Grph 1. f x,f
More informationMath 113 Exam 2 Practice
Mth Em Prctice Februry, 8 Em will cover sections 6.5, 7.-7.5 nd 7.8. This sheet hs three sections. The first section will remind you bout techniques nd formuls tht you should know. The second gives number
More informationMath 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 2-5pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of
More informationFundamentals of Analytical Chemistry
Homework Fundmentls of nlyticl hemistry hpter 9 0, 1, 5, 7, 9 cids, Bses, nd hpter 9(b) Definitions cid Releses H ions in wter (rrhenius) Proton donor (Bronsted( Lowry) Electron-pir cceptor (Lewis) hrcteristic
More informationMA 124 January 18, Derivatives are. Integrals are.
MA 124 Jnury 18, 2018 Prof PB s one-minute introduction to clculus Derivtives re. Integrls re. In Clculus 1, we lern limits, derivtives, some pplictions of derivtives, indefinite integrls, definite integrls,
More informationChapter 0. What is the Lebesgue integral about?
Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous
More informationHow can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function?
Mth 125 Summry Here re some thoughts I ws hving while considering wht to put on the first midterm. The core of your studying should be the ssigned homework problems: mke sure you relly understnd those
More informationTutorial 4. b a. h(f) = a b a ln 1. b a dx = ln(b a) nats = log(b a) bits. = ln λ + 1 nats. = log e λ bits. = ln 1 2 ln λ + 1. nats. = ln 2e. bits.
Tutoril 4 Exercises on Differentil Entropy. Evlute the differentil entropy h(x) f ln f for the following: () The uniform distribution, f(x) b. (b) The exponentil density, f(x) λe λx, x 0. (c) The Lplce
More information4 7x =250; 5 3x =500; Read section 3.3, 3.4 Announcements: Bell Ringer: Use your calculator to solve
Dte: 3/14/13 Objective: SWBAT pply properties of exponentil functions nd will pply properties of rithms. Bell Ringer: Use your clcultor to solve 4 7x =250; 5 3x =500; HW Requests: Properties of Log Equtions
More information( ) where f ( x ) is a. AB/BC Calculus Exam Review Sheet. A. Precalculus Type problems. Find the zeros of f ( x).
AB/ Clculus Exm Review Sheet A. Preclculus Type prolems A1 Find the zeros of f ( x). This is wht you think of doing A2 Find the intersection of f ( x) nd g( x). A3 Show tht f ( x) is even. A4 Show tht
More informationDriving Cycle Construction of City Road for Hybrid Bus Based on Markov Process Deng Pan1, a, Fengchun Sun1,b*, Hongwen He1, c, Jiankun Peng1, d
Interntionl Industril Informtics nd Computer Engineering Conference (IIICEC 15) Driving Cycle Construction of City Rod for Hybrid Bus Bsed on Mrkov Process Deng Pn1,, Fengchun Sun1,b*, Hongwen He1, c,
More informationUniversity of Texas MD Anderson Cancer Center Department of Biostatistics. Inequality Calculator, Version 3.0 November 25, 2013 User s Guide
University of Texs MD Anderson Cncer Center Deprtment of Biosttistics Inequlity Clcultor, Version 3.0 November 5, 013 User s Guide 0. Overview The purpose of the softwre is to clculte the probbility tht
More informationReinforcement learning II
CS 1675 Introduction to Mchine Lerning Lecture 26 Reinforcement lerning II Milos Huskrecht milos@cs.pitt.edu 5329 Sennott Squre Reinforcement lerning Bsics: Input x Lerner Output Reinforcement r Critic
More informationLesson 1.6 Exercises, pages 68 73
Lesson.6 Exercises, pges 68 7 A. Determine whether ech infinite geometric series hs finite sum. How do you know? ) + +.5 + 6.75 +... r is:.5, so the sum is not finite. b) 0.5 0.05 0.005 0.0005... r is:
More information5.7 Improper Integrals
458 pplictions of definite integrls 5.7 Improper Integrls In Section 5.4, we computed the work required to lift pylod of mss m from the surfce of moon of mss nd rdius R to height H bove the surfce of the
More informationDesign and Analysis of Single-Factor Experiments: The Analysis of Variance
13 CHAPTER OUTLINE Design nd Anlysis of Single-Fctor Experiments: The Anlysis of Vrince 13-1 DESIGNING ENGINEERING EXPERIMENTS 13-2 THE COMPLETELY RANDOMIZED SINGLE-FACTOR EXPERIMENT 13-2.1 An Exmple 13-2.2
More informationAB Calculus Review Sheet
AB Clculus Review Sheet Legend: A Preclculus, B Limits, C Differentil Clculus, D Applictions of Differentil Clculus, E Integrl Clculus, F Applictions of Integrl Clculus, G Prticle Motion nd Rtes This is
More informationPART 1 MULTIPLE CHOICE Circle the appropriate response to each of the questions below. Each question has a value of 1 point.
PART MULTIPLE CHOICE Circle the pproprite response to ech of the questions below. Ech question hs vlue of point.. If in sequence the second level difference is constnt, thn the sequence is:. rithmetic
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Physics Department Statistical Physics I Spring Term Solutions to Problem Set #1
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Physics Deprtment 8.044 Sttisticl Physics I Spring Term 03 Problem : Doping Semiconductor Solutions to Problem Set # ) Mentlly integrte the function p(x) given in
More information( ) as a fraction. Determine location of the highest
AB Clculus Exm Review Sheet - Solutions A. Preclculus Type prolems A1 A2 A3 A4 A5 A6 A7 This is wht you think of doing Find the zeros of f ( x). Set function equl to 0. Fctor or use qudrtic eqution if
More informationLecture 1: Introduction to integration theory and bounded variation
Lecture 1: Introduction to integrtion theory nd bounded vrition Wht is this course bout? Integrtion theory. The first question you might hve is why there is nything you need to lern bout integrtion. You
More information( ) where f ( x ) is a. AB Calculus Exam Review Sheet. A. Precalculus Type problems. Find the zeros of f ( x).
AB Clculus Exm Review Sheet A. Preclculus Type prolems A1 Find the zeros of f ( x). This is wht you think of doing A2 A3 Find the intersection of f ( x) nd g( x). Show tht f ( x) is even. A4 Show tht f
More informationAcceptance Sampling by Attributes
Introduction Acceptnce Smpling by Attributes Acceptnce smpling is concerned with inspection nd decision mking regrding products. Three spects of smpling re importnt: o Involves rndom smpling of n entire
More informationA Matrix Algebra Primer
A Mtrix Algebr Primer Mtrices, Vectors nd Sclr Multipliction he mtrix, D, represents dt orgnized into rows nd columns where the rows represent one vrible, e.g. time, nd the columns represent second vrible,
More informationPreparation for A Level Wadebridge School
Preprtion for A Level Mths @ Wdebridge School Bridging the gp between GCSE nd A Level Nme: CONTENTS Chpter Removing brckets pge Chpter Liner equtions Chpter Simultneous equtions 6 Chpter Fctorising 7 Chpter
More informationThe graphs of Rational Functions
Lecture 4 5A: The its of Rtionl Functions s x nd s x + The grphs of Rtionl Functions The grphs of rtionl functions hve severl differences compred to power functions. One of the differences is the behvior
More informationA. Limits - L Hopital s Rule ( ) How to find it: Try and find limits by traditional methods (plugging in). If you get 0 0 or!!, apply C.! 1 6 C.
A. Limits - L Hopitl s Rule Wht you re finding: L Hopitl s Rule is used to find limits of the form f ( x) lim where lim f x x! c g x ( ) = or lim f ( x) = limg( x) = ". ( ) x! c limg( x) = 0 x! c x! c
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationW. We shall do so one by one, starting with I 1, and we shall do it greedily, trying
Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)
More informationHybrid Group Acceptance Sampling Plan Based on Size Biased Lomax Model
Mthemtics nd Sttistics 2(3): 137-141, 2014 DOI: 10.13189/ms.2014.020305 http://www.hrpub.org Hybrid Group Acceptnce Smpling Pln Bsed on Size Bised Lomx Model R. Subb Ro 1,*, A. Ng Durgmmb 2, R.R.L. Kntm
More informationA-level Mathematics. Paper 3 Mark scheme. Practice paper Set 1. Version 1.0
A-level Mthemtics Pper 3 Mrk scheme Prctice pper Set 1 Version 1.0 Mrk schemes re prepred by the Led Assessment Writer nd considered, together with the relevnt questions, by pnel of subject techers. This
More informationLesson 25: Adding and Subtracting Rational Expressions
Lesson 2: Adding nd Subtrcting Rtionl Expressions Student Outcomes Students perform ddition nd subtrction of rtionl expressions. Lesson Notes This lesson reviews ddition nd subtrction of frctions using
More informationCS 188: Artificial Intelligence Spring 2007
CS 188: Artificil Intelligence Spring 2007 Lecture 3: Queue-Bsed Serch 1/23/2007 Srini Nrynn UC Berkeley Mny slides over the course dpted from Dn Klein, Sturt Russell or Andrew Moore Announcements Assignment
More informationMath 426: Probability Final Exam Practice
Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by
More information