Hard Core Predicates: How to encrypt? Recap
|
|
- Harry Berry
- 5 years ago
- Views:
Transcription
1 Hard Core Predcates: How to ecrypt? Debdeep Mukhopadhyay IIT Kharagpur Recap A ecrypto scheme s secured f for every probablstc adversary A carryg out some specfed kd of attack ad for every polyomal p(.), there exsts a teger N s.t. the probablty that A succeeds ths attack s less tha /p() for every >N
2 If f :{0,} Hard Core Predcates {0,}, ad bjectve, a poly() computable B:{0,} {0,} s ( t, ε ) hp for f f for every A wth rug tme t(), Pr X [A(f(X))=B(X)] + () Oe-way fuctos ad Trapdoors They are class of fuctos whch are easy to compute oe drecto (poyomal tme), but hard to vert (caot be verted polyomal tme) But ca be easly verted wth a secret formato, called the trap-door formato.
3 Example wth RSA y=x e mod(pq) [Easy to compute] Gve y, e ad N=pq, we do ot kow effcet techques to compute x. But f we have a trap-door d=e - mod(p-)(q-) t becomes easy to compute x ad hece vert the fucto. Hard Core Predcate of trapdoor permutatos ( GFI,, ) s a famly of trapdoor permutatos, G chooses (k, t ) F(., k) s bjectve I(., t, k) s verse of F(., k) k k st, G,F,I ca be doe poly() tme ad vertg F wthout t s hard. k 3
4 HP for trap-door permutatos If ( G, F, I) s a famly of trapdoor permutatos, the polyomal tme oe bt output BXk (, ) s a hard-core predcate f for every A rug tme t(), Pr ( kt, ) ( )[A(F(X,k),k)=B(X,k)] + () k G ε Goldrech-Lev Theorem If there s a famly of trapdoor permutatos, the there s a famly wth a hard core predcate. 4
5 Ecryptg a bt b Gve (G,F,I),t k ad a hardcore predcate B Key Geerato: G Retur (k,t k ) Ecrypto: E(b,t k ) Pck radom X Є {0,} Retur F( X, k), b B( X, k) Decrypto: D((z,c),k,t k ) X=I(z,t k ) Retur c B( X, k) ( kt, k ) G( ) X {0,} b {0,} The Ecrypto s MI secure Pr [ A( F( X, k), b B( X, k), k) = b] + ε ( ) Proof: Suppose ths ecrypto s ot ( t, ε ) MI secure. Pr [ A( F( X, k), b B( X, k), k) = b] > + ε ( ) ( kt, k ) G( ) X {0,} b {0,} Cosder algorthm A'(y,k) Pck radom c {0,} Retur c A(y,c,k) Thus, Pr [ A'( F( X, k), k) = B( X, k)] X {0,} = Pr [ AF ( ( X, k), ck, ) = BX (, k) c] ( kt, k ) G ( ) X {0,} c {0,} = Pr [ A( F( X, k), b B( X, k), k) = b] > + ε ( ) ( kt, k ) G ( ) X {0,} b {0,} 5
6 Example for RSA B(X,(N,e))=X mod s a hp for RSA that s gve (N,e), X e mod N t s hard to guess X mod wth a o-eglgbly large probablty tha ½ Ecrypt bє{0,} wth RSA Pck X Є{0,} Compute, X e mod N, XOR(b,Xmod ) How to ecrypt loger strgs? Gve (G,F,I),t k ad a hardcore predcate B Key Geerato: G Retur (k,t k ) Ecrypto: E GM (m,k), mє{0,} for = to Pck radom X Є {0,} Retur F( X, k), m[ ] B( X, k) Decrypto: D((z,c),k,t k ) X=I(z,t k ) for = to Retur d [] BX (, k) 6
7 Proof of MI secured For every m, m' for every A rug tme t() Pr[ AE ( ( mk, ), k) = ] Pr[ AE ( ( m', k), k) = ] ε GM If we cotradct ths supposto, we have Amm,, 's.t. Pr[ AE ( ( mk, ), k) = ] Pr[ AE ( ( m', k), k) = ] > ε GM GM GM Cotd. Cosder the followg hybrd costructo: Pr[A(E(m[])E(m[])...E(m[]))=]=p Pr[A(E(m'[])E(m[])...E(m[]))=]=p... Pr[A(E(m'[])E(m'[])...m'[]m[+]...E(m[]))=]=p Pr[A(E(m'[])E(m'[])...m'[] m'[+]...e(m[]))=]=p+... Pr[A(E(m'[])E(m[])...E(m'[-])E(m[]))=]=p Pr[A(E(m[])E(m[])...E(m'[-]E(m'[]))=]=p 0-7
8 Cotd. So, from our cotradcto we have: p p > ε 0 or, ( p p ) > ε = 0 + ε or, :( p p+ ) > e, Pr[A(E(m'[])E(m'[])...m'[]m[+]...E(m[]))=] ε -Pr[A(E(m'[])E(m'[])...m'[]m'[+]...E(m[]))=] > Cotd. Cosder algorthm A'(c,k) Compute, c = E( m'[0])... c = E( m'[ ]) c + = E( m[ + ])... c = E( m[ ]) Retur Ac (,..., c, cc,, +..., c ) 8
9 cotd. Pr[ A'( c, k) = ] Pr[ A'( c, k) = ] = Pr[ Ac (,..., c, cc,,..., c)] Pr[ Ac (,..., c, cc,,..., c)] + + ε > Ths cotradcts the fact that oe bt ecrypto was MI secure. A Hard Core Predcate for ay oeway fucto Let (G,F,I) be a famly of trap-door permutatos. Cosder (G,F',I'), whch s also a famly of trap-door permutatos. I'(( z, r), tk) = I( z, tk), r ad F'(( x, r), k) =< F( x, k), r > The Bxr (, ) = xr. mod s a hard core predcate for (G',F',I'). 9
10 Proof Let us drop the varables k ad t k for smplcty. The proof s uchaged wth them. Assume that there s a polyomal tme algorthm A, that always correctly computes B(x,r) gve F (x)=(f(x),r) we shall show that easy to compute x from f(x). Ths cotradcts our assumpto that F s oe-way. Detals Let A be a PPT algorthm whch computes the value of B(x,r) from F (x,r)=f(x),r Pr [ ( ( ), ) (, )] AF x r = Bxr = x,r {0,} Now we shall frame a expermet A, whch vokes A for =,,,. The argumets beg passed to A are x ad e e deotes a strg wth the th bt ad rest 0. Sce, A computes the term B(x,e )=x wth probablty, the etre x s retreved by A by executg A umber of tmes. Note that the ru tme of A s also polyomal ad also has a probablty of. 0
11 But that s ot all! The G-L Theorem says that the probablty of computg B(x,r) from F (X,r)=(F(x),r) should be greater tha ½ by a eglgble quatty So, assumg a probablty of s a weak case. Slghtly more volved case (ad more closer to the proof) wll be f the probablty s sgfcatly greater tha ¾. Why the prevous proofs does ot work? It may be that A ever succeeds computg B(x,r) correctly whe r=e The algorthm A has o meas of uderstadg that A has succeeded or ot? So, what does A do ths case to crease hs chace? (repeat the expermet of A)
12 Two mportat observatos B( xr, ) Bxr (, e) = Bxe (, ) = x ote that A s voked wth radom puts. There s o way to uderstad whe A gves a correct aswer. So, ru A multple tmes ad take the majorty. A prelmary step would be to prove that for may x s, the probablty that A aswers both the predcate queres correctly s very hgh. Clam 3 If, Pr [ AF ( ( x), r) = Bxr (, )] + ε ( ). xr, {0,} 4 The there exsts a set S {0,} of sze at least ε ( ), where for every x S : 3 ε ( ) Pr [ AF ( ( x), r) = Bxr (, )] + r {0,} 4
13 xr, Proof Defe, sx ( ) = Pr [ AFx ( ( ), r) = Bxr (, )] r {0,} ε ( ) We have to show that S Pr [ AF ( ( x), r) = Bxr (, )] = Pr [ AF ( ( x), r) = Bxr (, ) x S]Pr [ x S] xr, x + Pr [ AF ( ( x), r) = Bxr (, ) x S]Pr [ x S] xr, x Pr [ x S ] + Pr [ A( F( x), r) = B( xr, ) x S] x x, r Pr [ x S ] Pr [ A( F( x), r) = B( x, r)] x x, r Pr [ AF ( ( x), r) = Bxr (, ) x S] xr, 3 3 () ().e. P r x[ x S] + ()-( + )= 4 4 () Thus, S must be of sze at least x s uformly dstrbuted { 0,} ) (because r {0,} Clam 3 If, Pr [ AF ( ( x), r) = Bxr (, )] + ε ( ). xr, {0,} 4 The there exsts a set S {0,} of sze at least ε ( ), where for every x S ad every t holds that: Pr [ A( F( x), r) = B( x, r) A( F( x), r e) = B( x, r e) ] +ε ( ) 3
14 Proof We kow for x S : ε ( ) Pr [ AF ( ( x), r) Bxr (, )] < r {0,} 4 Fxg ay, f r s uformly dstrbuted so, s r e. So, ε ( ) Pr [ AF ( ( x), r) Bxr (, e)] r {0,} < 4 We wsh to upper-boud the probablty that at least oe of the two predcates are wrogly computed. From the theory of probablty, ths s atmost: ε( ) ε( ) ( ) + ( ) = ε ( ) 4 4 So, A s correct o both the queres wth probablty at least + ε ( ). The strategy of A For =,...,. Choose a radom r {0,} ad guess that the value x = A( y, r) A( y, r e).. Repeat ths procedure for a large umber of cases, (oly the umber of trals has to be polyomal ) ad retur the majorty as the correct guess. 4
15 Ca ths proof be exteded to the geeral case? Sce t volves two computatos of B(), the error probablty s doubled. for the actual proof (ad eve whe the error probablty s exactly ¼ ths wll ot help vertg F wth a sgfcat prob) Istead, we guess oe B ad compute the other. m=poly() ad set l=log (m+) Ca ths proof be exteded to the geeral case? Choose l strgs uformly ad depedetly {0,} ad deote them by s,,s l. The guess B(x,s ),,B(x,s l ) ad call them σ,,σ l. Probablty that all of them are correct s / l =/poly() j Fx as a subset of {,,l} ad defe r = j s It may be show that the r s are parwse depedet ad uformly dstrbuted {0,} 5
16 Ca ths proof be exteded to the geeral case? Note that: j j B( xr, ) = Bx (, s) = Bxs (, ) j j So, our guess for B(x,r ) s ρ = j j σ A s expermet: The Actual Proof. Geerate ad depedetly set l l s,..., s {0,} ad σ,..., σ {0,}. For every o-empty subset of, {,...,l} computes a strg, r = s ad a bt ρ = σ j j j j 3. For every {,..,} ad every o-empty subset of, {,...,l} computes, z = ρ A( y, r + e) 4. For every {,..,} t sets z to be the majorty of the 5. It outputs z = z... z z values. 6
17 Aalyss Next, we show that f for all jє{,,l}, σ j s are equal to B(x,s j ), the: z = Bxr (, ) AFx ( ( ), r e) has a majorty equal to x for all Є{,,} Clam For every x S ad every, l Pr[ { : B( x, r ) A( F( X), r e ) = x} > ( )] >- 7
18 Proof For every defe a 0- r.v M whch equals, ff Bxr (, ) AFX ( ( ), r e) = Bxe (, ) = x M = ff A( F( X), r e ) = B( x, r e ) Thus, M = wth probablty at least ε ( ) +,as x S. Note that Bxr (, ) AFX ( ( ), r ff M = for majorty of j's, j. Thus, Pr[ M ] =? m e ) = x Chebyshev s Iequalty Let X be a r.v ad δ > 0 Var( X ) Pr[ X E( X) δ ] δ 8
19 Pr[ M ] Pr[ ( ) ] Note, E( M )=( ) Var ( M ) ( )( ) Pr[ M ] Pr[ ( ) ] m ε ( ) ε ( ) M + m m ε ( ) + m ε( ) ε( ) m = m + < 4 m ε( ) ε( ) M + m m m/4 = ( ε( )/) ε( ) m m Let, m =, we have: ε ( ) m Pr[ M ] m Pr[ M > ] Ths completes the proof of the clam. Thus the probablty that A' s wrog for a partcular value of s at most (t occurs whe M m). Thus, the probablty that A' returs a wrog result for at least oe value of s atmost =. Thus the probablty that t s correct for all the values s at least. Remder, ths was uder the assumpto that the l guesses were -l all correct probablty of whch s. Hece f x S, A' verts F(x) wth a probablty of -l. = = m + + ε ( ) ε ( ) Also, we kow Pr x[ x S]= Thus, the probablty that A' s able to vert F(x) ε ( ) s at least = p( ) + p( ) ε ( ) whch s a cotradcto to the assumpto that F(x) s a oe-way fucto. 9
Pseudo-random Functions
Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom
More informationPseudo-random Functions. PRG vs PRF
Pseudo-radom Fuctos Debdeep Muhopadhyay IIT Kharagpur PRG vs PRF We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More informationPTAS for Bin-Packing
CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More information18.413: Error Correcting Codes Lab March 2, Lecture 8
18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More information8.1 Hashing Algorithms
CS787: Advaced Algorthms Scrbe: Mayak Maheshwar, Chrs Hrchs Lecturer: Shuch Chawla Topc: Hashg ad NP-Completeess Date: September 21 2007 Prevously we looked at applcatos of radomzed algorthms, ad bega
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationCIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights
CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:
More informationLecture 4 Sep 9, 2015
CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector
More informationAlgorithms Design & Analysis. Hash Tables
Algorthms Desg & Aalyss Hash Tables Recap Lower boud Order statstcs 2 Today s topcs Drect-accessble table Hash tables Hash fuctos Uversal hashg Perfect Hashg Ope addressg 3 Symbol-table problem Symbol
More informationAlgorithms Theory, Solution for Assignment 2
Juor-Prof. Dr. Robert Elsässer, Marco Muñz, Phllp Hedegger WS 2009/200 Algorthms Theory, Soluto for Assgmet 2 http://lak.formatk.u-freburg.de/lak_teachg/ws09_0/algo090.php Exercse 2. - Fast Fourer Trasform
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationHomework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015
Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts
More informationMedian as a Weighted Arithmetic Mean of All Sample Observations
Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of
More informationLecture 02: Bounding tail distributions of a random variable
CSCI-B609: A Theorst s Toolkt, Fall 206 Aug 25 Lecture 02: Boudg tal dstrbutos of a radom varable Lecturer: Yua Zhou Scrbe: Yua Xe & Yua Zhou Let us cosder the ubased co flps aga. I.e. let the outcome
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationThe Occupancy and Coupon Collector problems
Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where
More informationNP!= P. By Liu Ran. Table of Contents. The P vs. NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Strategy 3. Prelmary theorem 4. Proof 5. Expla 6. Cocluso. Itroduce The P vs. NP problem s a major usolved problem computer scece. Iformally, t asks whether
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationRandom Variables and Probability Distributions
Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x
More informationNP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Prelmary theorem 3. Proof 4. Expla 5. Cocluso. Itroduce The P versus NP problem s a major usolved problem computer scece. Iformally, t asks whether a computer
More informationDimensionality Reduction and Learning
CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that
More informationFeature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)
CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More information1 Onto functions and bijections Applications to Counting
1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of
More informationPolynomial Encryption Using The Subset Problem Based On Elgamal. Raipur, Chhattisgarh , India. Raipur, Chhattisgarh , India.
Polyomal Ecrypto Usg The Subset Problem Based O Elgamal Khushboo Thakur 1, B. P. Trpath 2 1 School of Studes Mathematcs Pt. Ravshakar Shukla Uversty Rapur, Chhattsgarh 92001, Ida. 2 Departmet of Mathematcs,
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More information1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.
Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please
More informationNon-uniform Turán-type problems
Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationIntroduction to Probability
Itroducto to Probablty Nader H Bshouty Departmet of Computer Scece Techo 32000 Israel e-mal: bshouty@cstechoacl 1 Combatorcs 11 Smple Rules I Combatorcs The rule of sum says that the umber of ways to choose
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationSampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION
Samplg Theor MODULE V LECTUE - 4 ATIO AND PODUCT METHODS OF ESTIMATION D. SHALABH DEPATMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPU A mportat objectve a statstcal estmato procedure
More informationA tighter lower bound on the circuit size of the hardest Boolean functions
Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More information1. A real number x is represented approximately by , and we are told that the relative error is 0.1 %. What is x? Note: There are two answers.
PROBLEMS A real umber s represeted appromately by 63, ad we are told that the relatve error s % What s? Note: There are two aswers Ht : Recall that % relatve error s What s the relatve error volved roudg
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More information1 Solution to Problem 6.40
1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we
More informationLattices. Mathematical background
Lattces Mathematcal backgroud Lattces : -dmesoal Eucldea space. That s, { T x } x x = (,, ) :,. T T If x= ( x,, x), y = ( y,, y), the xy, = xy (er product of xad y) x = /2 xx, (Eucldea legth or orm of
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationThe Selection Problem - Variable Size Decrease/Conquer (Practice with algorithm analysis)
We have covered: Selecto, Iserto, Mergesort, Bubblesort, Heapsort Next: Selecto the Qucksort The Selecto Problem - Varable Sze Decrease/Coquer (Practce wth algorthm aalyss) Cosder the problem of fdg the
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More information1. BLAST (Karlin Altschul) Statistics
Parwse seuece algmet global ad local Multple seuece algmet Substtuto matrces Database searchg global local BLAST Seuece statstcs Evolutoary tree recostructo Gee Fdg Prote structure predcto RNA structure
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationRandom Variate Generation ENM 307 SIMULATION. Anadolu Üniversitesi, Endüstri Mühendisliği Bölümü. Yrd. Doç. Dr. Gürkan ÖZTÜRK.
adom Varate Geerato ENM 307 SIMULATION Aadolu Üverstes, Edüstr Mühedslğ Bölümü Yrd. Doç. Dr. Gürka ÖZTÜK 0 adom Varate Geerato adom varate geerato s about procedures for samplg from a varety of wdely-used
More informationRecall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I
Chapter 8 Heterosedastcty Recall MLR 5 Homsedastcty error u has the same varace gve ay values of the eplaatory varables Varu,..., = or EUU = I Suppose other GM assumptos hold but have heterosedastcty.
More informationStatistics Descriptive and Inferential Statistics. Instructor: Daisuke Nagakura
Statstcs Descrptve ad Iferetal Statstcs Istructor: Dasuke Nagakura (agakura@z7.keo.jp) 1 Today s topc Today, I talk about two categores of statstcal aalyses, descrptve statstcs ad feretal statstcs, ad
More informationChain Rules for Entropy
Cha Rules for Etroy The etroy of a collecto of radom varables s the sum of codtoal etroes. Theorem: Let be radom varables havg the mass robablty x x.x. The...... The roof s obtaed by reeatg the alcato
More informationIdea is to sample from a different distribution that picks points in important regions of the sample space. Want ( ) ( ) ( ) E f X = f x g x dx
Importace Samplg Used for a umber of purposes: Varace reducto Allows for dffcult dstrbutos to be sampled from. Sestvty aalyss Reusg samples to reduce computatoal burde. Idea s to sample from a dfferet
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationMA 524 Homework 6 Solutions
MA 524 Homework 6 Solutos. Sce S(, s the umber of ways to partto [] to k oempty blocks, ad c(, s the umber of ways to partto to k oempty blocks ad also the arrage each block to a cycle, we must have S(,
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationLECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR
amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after
More information= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n
.. Soluto of Problem. M s obvously cotuous o ], [ ad ], [. Observe that M x,..., x ) M x,..., x ) )..) We ext show that M s odecreasg o ], [. Of course.) mles that M s odecreasg o ], [ as well. To show
More informationLecture 2 - What are component and system reliability and how it can be improved?
Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected
More information3. Basic Concepts: Consequences and Properties
: 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8
More information1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.
CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy
More informationå 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018
Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationThe expected value of a sum of random variables,, is the sum of the expected values:
Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationLaw of Large Numbers
Toss a co tmes. Law of Large Numbers Suppose 0 f f th th toss came up H toss came up T s are Beroull radom varables wth p ½ ad E( ) ½. The proporto of heads s. Itutvely approaches ½ as. week 2 Markov s
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad
More informationLinear Approximating to Integer Addition
Lear Approxmatg to Iteger Addto L A-Pg Bejg 00085, P.R. Cha apl000@a.com Abtract The teger addto ofte appled cpher a a cryptographc mea. I th paper we wll preet ome reult about the lear approxmatg for
More informationD KL (P Q) := p i ln p i q i
Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL
More informationFor combinatorial problems we might need to generate all permutations, combinations, or subsets of a set.
Addtoal Decrease ad Coquer Algorthms For combatoral problems we mght eed to geerate all permutatos, combatos, or subsets of a set. Geeratg Permutatos If we have a set f elemets: { a 1, a 2, a 3, a } the
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationReview of Elementary Cryptography. For more material, see my notes of CSE 5351, available on my webpage
Review of Elemetary Cryptography For more material, see my otes of CSE 5351, available o my webpage Outlie Security (CPA, CCA, sematic security, idistiguishability) RSA ElGamal Homomorphic ecryptio 2 Two
More informationDependence In Network Reliability
Depedece I Network Relablty Nozer D. Sgpurwalla George Washgto Uversty Washgto, DC, U.S.A. ozer@reasearch.crc.gwu.edu Abstract It s farly easy to calculate the relablty of a etwork wth depedet odes va
More informationIntroduction Cryptography and Security Fall 2009 Steve Lai
Itroducto 788.11 Cryptography ad Securty Fall 2009 Steve La Outle Bascs of ecrypto Homomorphc ecrypto Bascs of Ecrypto For more formato, see my CSE 651 or 794Q otes Summary Symmetrc ecrypto Stream cpher
More informationMu Sequences/Series Solutions National Convention 2014
Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed
More informationLecture 16: Backpropogation Algorithm Neural Networks with smooth activation functions
CO-511: Learg Theory prg 2017 Lecturer: Ro Lv Lecture 16: Bacpropogato Algorthm Dsclamer: These otes have ot bee subected to the usual scruty reserved for formal publcatos. They may be dstrbuted outsde
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More information