Hauptman and Karle Joint and Conditional Probability Distributions. Robert H. Blessing, HWI/UB Structural Biology Department, January 2003 ( )

Similar documents
Expectation and Variance of a random variable

Lecture 7: Properties of Random Samples

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

Exponential Families and Bayesian Inference

Topic 9: Sampling Distributions of Estimators

Monte Carlo Integration

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

1 Introduction to reducing variance in Monte Carlo simulations

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

STAT Homework 1 - Solutions

Estimation for Complete Data

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Stat 421-SP2012 Interval Estimation Section

THE KALMAN FILTER RAUL ROJAS

Chapter 6 Principles of Data Reduction

EE 4TM4: Digital Communications II Probability Theory

NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

CS284A: Representations and Algorithms in Molecular Biology

Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables

The Poisson Process *

Exercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1).

Lecture 11 and 12: Basic estimation theory

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula Derived from the Gamma Function

HOMEWORK I: PREREQUISITES FROM MATH 727

Topic 9: Sampling Distributions of Estimators

Kernel density estimator

Exercises and Problems

7.1 Convergence of sequences of random variables

Topic 9: Sampling Distributions of Estimators

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

Best bounds for dispersion of ratio block sequences for certain subsets of integers

ON STATISTICAL CONVERGENCE AND STATISTICAL MONOTONICITY

Properties and Hypothesis Testing

Chapter 1. Complex Numbers. Dr. Pulak Sahoo

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

The time evolution of the state of a quantum system is described by the time-dependent Schrödinger equation (TDSE): ( ) ( ) 2m "2 + V ( r,t) (1.

Microscopic Theory of Transport (Fall 2003) Lecture 6 (9/19/03) Static and Short Time Properties of Time Correlation Functions

This section is optional.

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

o <Xln <X2n <... <X n < o (1.1)

Expected Number of Level Crossings of Legendre Polynomials

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

7.1 Convergence of sequences of random variables

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].

6. Sufficient, Complete, and Ancillary Statistics

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Chapter 2 The Monte Carlo Method

Notes 5 : More on the a.s. convergence of sums

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

radians A function f ( x ) is called periodic if it is defined for all real x and if there is some positive number P such that:

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Fundamental Concepts: Surfaces and Curves

Statistical Inference Based on Extremum Estimators

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object

Detailed proofs of Propositions 3.1 and 3.2

Section 13.3 Area and the Definite Integral

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Machine Learning Brett Bernstein

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

Law of the sum of Bernoulli random variables

6 Sample Size Calculations

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

Singular Continuous Measures by Michael Pejic 5/14/10

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

Lecture 18: Sampling distributions

Element sampling: Part 2

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

Assignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Random Variables, Sampling and Estimation

1 Review of Probability & Statistics

Maximum Likelihood Estimation and Complexity Regularization

AMS570 Lecture Notes #2

Section 14. Simple linear regression.

Problem Set 4 Due Oct, 12

Math 21B-B - Homework Set 2

Bayesian Methods: Introduction to Multi-parameter Models

PAPER : IIT-JAM 2010

Solutions to Final Exam Review Problems

Distribution of Random Samples & Limit theorems

ON POINTWISE BINOMIAL APPROXIMATION

Subject: Differential Equations & Mathematical Modeling-III

1 Approximating Integrals using Taylor Polynomials

Lecture 3. Properties of Summary Statistics: Sampling Distribution

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018

AP Calculus Chapter 9: Infinite Series

Glivenko-Cantelli Classes

Numerical Conformal Mapping via a Fredholm Integral Equation using Fourier Method ABSTRACT INTRODUCTION

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

8. Applications To Linear Differential Equations

Transcription:

Hauptma ad Karle Joit ad Coditioal Probability Distributios Robert H Blessig HWI/UB Structural Biology Departmet Jauary 00 ormalized crystal structure factors are defied by E h = F h F h = f a hexp ihi h f a h It follows that E h h = sice the squared ormalizatio factor F h = E h exp i* h = h f a h is the expectatio value Wilso 949 for the itesity of the Bragg reflectio labled h fo structure of atoms per uit cell with the atoms distributed idepedetly ad uiformly at positio vectors The factors h are symmetry degeeracy factors with kow values Iwasaki ad Ito 977 that accout for multiple ehacemet of certai classes of reflectio itesity averages due to space group symmetry: I space groups P ad P h = foll reflectios; i space groups of higher symmetry if the lattice is primitive h = for geeral reflectios ad h > for some sets of zoal oxial special reflectios due to atomic overlap i projectio; if the lattice is cetered h > foll the allowed reflectios due to extictio of the forbidde reflectios Hauptma ad Karle 958 ad Karle ad Hauptma 958 applied probability theory to derive joit ad coditioal probability distributios for structure factor triplets E h E h E h i order to estimate the three-phase structure ivariats h + h + h with h + h + h = 0 I outlie the basic priciples of joit ad coditioal probability distributios are: b P a < x < b a < x < b b = p J x x dx dx p J - C u u / x x = a a b b exp i u j x j * C u u du du a a j= ++ ++ = exp +i u j x j + + = exp i u j x j * j= j= x x = p J x x m a m+ a * p J x x dx dx p C x x m a m+ a p M a m+ a - ++ ++ p M x m+ x = p J x x m x m+ x m dx dx + + m /

where the fuctio C u = C u u is called the characteristic fuctio of the joit x = p J x x ; the fuctio p C x x m a m+ a is probability desity fuctio p J the coditioal probability desity fuctio fo subset of m of the radom variables give particular values a m+ a for the other m variables; ad the fuctio p M x m+ x is the margial probability desity fuctio for the subset of m of the radom variables irrespective of the values of the other m variables The joit probability desity fuctio ad the characteristic fuctio are related by ad uiquely defie oe aother by Fourier trasformatio Thus Fˆ C u = ˆ C u p J x F ˆ p J x = F ˆ C u For the joit distributio of three structure factors that correspod to a uiform radom distributio of atomic positios fo = atoms per uit cell Hauptma ad Karle showed that the joit probability desity fuctio p J x is p J R R R = + F p J x + d 6 d d d d d R R R 0 0 0 * exp i + j= + R j j cos j j - / C where R R R ad deote respectively the radom variable amplitudes E h E h E h ad phases h h h of the three structure factors ad the = ˆ = ˆ characteristic fuctio C u C is F p J x F p J R R R = dr dr dr d d d R R R 0 0 0 exp +i - j= ++ *+ ++ *+ ++ *+ R j j cos j * j / p J R R R = R R R exp +i- R j j cos j * j / j= I space group P the characteristic fuctio becomes = exp-i C / j= f a h j R R R f a h j j cos *h j i + j 0

ad if we itroduce the simplifyig otatios we have C = C ad The usig the elemetary relatioships exp x + y we obtai C = exp i c a j j= = exp i c a j j= ad usig the series expasio f a h j f a h j C = exp i c a j j= = exp x exp y l xy = l x + l y = exp l x = x l exp x x + y = x + y x + iy = r exp i l x + iy r = = l r exp i = exp i c a j j= = c a j cos *h i r + j j a j y x + y = ta x ad = lr + i = exp l + exp i c a j j= * + - = exp i c a j r a r j= = exp i c a j r j= a a exp ix = + ix + i x + i x + the complex expoetial factors i the cotiued product C = exp i c a j r a ca be expressed as sums of averages of cosie products exp i c a j r a = + i c + i c ak ak c al j= k = j= k = l = Usig the elemerary relatioship cos xcos y = cos x + y + i c ak c al c am + ra k = l = m= + cos x y

the averages of cosie products ca be show to be expressible i terms of averages of cosie ad squared-cosie fuctios The by the hypothesis of a uiform radom distributio of atomic positios the cosie argumets spa the whole iterval [0 π ad the averages cos x = 0 ad cos x = < 0 x mod allow simplificatio ad termwise sixfold itegratio over the dummy variables to obtai the fial result for the joit distributio fuctio p J R R R = * exp R + R + + R - + R R R * + f a h f a h f a h / - 0 * + - f a h f a h f a h R R R cos + + f a h f a h f a h / 0 Specifyig give values R = E h R = E h R = E h for the amplitudes ad expadig the cosie expoetial fuctio i modified Bessel fuctios of the secod kid + = I x exp xcos exp i = I x = + exp xcos cos d leads from the joit distributio fuctio to the coditioal distributio fuctio p C + + R R R = I 0 A where f a h f a h exp A cos + + f a h A = E h E h E h + f a h f a h f a h * - The coditioal distributio has the form of a vo Mises or circular ormal distributio I crystallography it is kow as the Cochra distributio because Cochra 955 discovered that it was the distributio fuctio for the origi-idepedet triplet or three-phase structure ivariats h + h + h with h + h + h = 0 / 0 4

Coditioal Distributio for the Triplet Ivariats I customary otatio the coditioal distributio fuctio for the three-phase structure ivariat hk h + k + hk is writte as where I 0 p C hk = I 0 exp A cos hk hk x deotes the zeroth order modified Bessel fuctio ad the amplitudes factor f a k f a h k f a h = E h E k E hk f a h f a k f a h k * + - is a iverse measure of the variace or spread of the distributio I the limit of large the coditioal distributio approaches the ormal distributio I other words the vo Mises circular ormal distributio has the property exp cos µ p µ = lim p µ I 0 * µ + + = Sice atomic scatterig factor curves all have approximately the same shape f a h Z a f h Z the amplitudes factor ca be approximated as = Z a f h Z f k Z f h k Z f h Z f k Z f h k Z Z a Z a E h E k E hk = E h E k E hk Z a which uder the approximatio of equal poit-atoms at rest or with equal mea-square atomic displacemets simplifies to E h E k E hk The latter expressio makes it clear that the spread or flatess of the coditioal distributio icreases ad hece its predictive or estimatio power decreases with icreasig strucure size ad decreasig structure factors magitudes 5

Coditioal Expectatio Values from the Triplet Distributio The coditioal distributio of the three-phase structure ivariat gives expectatio values y = + p x dx y x = y hk hk = 0 si hk = 0 cos hk = I I 0 + d hk p C hk var y = y y = y y var hk = hk var si hk = si hk = I I 0 = cos hk cos hk = si hk cos hk var cos hk = I I 0 I A hk I 0 * + 6

The Taget Formula The coditioal distributio of the three-phase or triplet structure ivariats also leads to the taget formula Give a set of coditioal probability distributios for pairs of kow phases with fixed h p C hki A hki for { ki hki i = } the combied distributio is give by the product of the distributios P = K = K = K p i p C hki A hki I 0 i + exp - i cos h + ki + *h*ki - where K is a ormalizatio costat At the most probable value of h ad sice we obtai or P = 0 A hki si h + ki + hki h si h i cos ki + hki = 0 si x + y = si xcos y + cos xsi y + cos A h hki ta h = si h cos h = ta h = si ki + hki i si ki + hki i cos ki + hki E k E hk si k + hk k E k E hk cos k + hk k 0 / 0 = 0 7

Refereces Cochra W 955 Relatios betwee the Phases of Structure Factors Acta Cryst A8 47-477 Hauptma HA ad Karle J 958 Phase Determiatio from ew Joit Probability Distributios: Space Group P Acta Cryst 49-57 Iwasaki H ad Ito T 977 Values of ε for obtaiig ormalized structure factors Acta Cryst A 7-9 Karle J ad Hauptma HA 956 A theory of phase determiatio for the four types of o-cetrosymmetric space groups P P P P Acta Cryst 9 65-65 8

Karle J ad Hauptma HA 958 Phase Determiatio from ew Joit Probability Distributios: Space Group P Acta Cryst 64-7 9

Modified Bessel fuctios i polyomial approximatio t = x 75 I x = + exp xcos cos d I 0 + 56t + 090t 4 + 07t 6 + 0660t 8 + 00607t 0 + 000458t 75 x +75 x = e x x 0989 + 009t + 0005t 000576t + 00096t 4 00058t 5 + 0066t 6 00648t 7 +00094t 8 + 75 x < I x = x + 08789t + 0550t 4 + 0508t 6 +00659t 8 + 00005t 0 + 00004t 75 x +75 e x x 0989 00988t 00060t + 00068t 0000t 4 + 008t 5 00895t 6 + 00787t 7 +00040t 8 + 75 x < Ratios of modified Bessel fuctios x / 0 < x < ; I x I 0 x 05658 x 004 x + 0006 x 0 < x < 6 ; x > 6 I x I x I 0 x = x I 0 x 0