UNCLASSIFIED AD 402 663 DEFENSE DOCUMENTATION CENTER FOR SCIENTIFIC AND TECHNICAL INFORMATION CAMERON SIATION, ALEXANDRIA. VIRGINIA UNCLASSIFIED
NOTICE: When government or other drawings, specifications or other data are used for any purpose other than in connection with a definitely related government procurement operation, the U. S. Government thereby incurs no responsibility, nor any obligation whatsoever; and the fact that the Government may have fomulated, furnished, or in any way supplied the said drawings, specifications, or other data is not to be regarded by implication or otherwise as in any manner licensing the holder or any other person or corporation, or conveying any rights or permission to manufacture, use or sell any patented invention that may in any way be related thereto.
The views, conclusions, or recommendations expressed in this document do not neces- TM saily reflect the official views or policies of agencies of the United States Government. T 9)t,?53 This document was produced by SInC in performance of contract U. S. G)oern.nwt ConttraCtW 11 Url E]. Clark S TICIVNCAL :lliun Karush (lacule ibatum UCU a working paper C. West Churchman 0 System Development Corporation/ 2500 Colorado Ave./Santa Menlo, C-f1fa11 I 1 3/18/61 PMK I OF 402 663.' j., :.?,, A, 'LTN; D13TOflTIOfS, FR.0LIMIIUARY REPORT A SE"pP1J, PRO_,_UR_ FOR S CCF,3SLY This paper is written in-the language of mathematical statistics. Expositions for practition,- rs in Monte Carlo will appe;r elsewhere. *-~- Let -' i)y;:n and~ be iudelpenlnt vo,riabl!s (tbhe discussion applies if these Is ' are random vectors, and in applications we are interested in vectors, but for ease of exposition we shall sp,.!ak of r-nanoim variables). We consider the real function of n+l real varinble& (2) Y,- 1,.,Xn**). We are interested in ()E(y), the expected value of y an a function on tth probability space of the Is. Uet AST IA A.2450 10/62
18 March 1.963 2,4-9i0253 be rondom variubleu such'that for every menaurable set A, the probability that is in A is zero ir and only if the probability that is in A is also zero. Thus with probability 1, a seample value from either of ti and t! could have arisen as a sample value from the other. We shall define weight functions such that where El denotes expected value under the probability measure of qlo'""x1 X If 11 and p are -the probability measures for the unprimed and primed random variables, respectively, we take (6)i Let us now indicate what we are trying, to do. We are given (1) and (2). We wish to estinvite (3). This estimate could be made by Monte Carlo analysis, that is, by means of simple random sampling from the joint distribution of the random variables (1). gowever in the light of (5), we would like to define random variables (4) such that the variance of yfly! over the probability space of the primed random variables is less than that of y over the apace of the unprimed variables. We shall speak of the ri as the distorted variables and the as the undistorted variablea. Thus, in estivvatinru E(y) we distort distributions of random variables to achieve greater efficiency.
18 Mnarch 1.963 3 TM-94253 LeL us indicate further the motivation of the analysis to b% developed below. Suppose that the probability density of c i is X exl)(-xx), with x nonnegative. Suppose that y is practically zero tuless x Is very large. Then in undistorted acmpling, one woultl require a large Samrple because only sample values in the tail of the diotribution o0 e1. give much infornntion. This suggests that one ait introdiuce with probability density x' exp(-l'x) with ).' swiller than X; in this vay one wokuld get nore snasple vadues located in the tall of the distribution of r B.ut the choice of X' is not easy. Let us assume that a value of X' was selected and a scaple drawn from the distorted distributions, and that this selection and this sampling were done prior to the discussion of the present memorandum. Our objective below is to use the sample data to determdne a new X', say V" which will yield greater efficiency than X1. Let us write (still digressir) r) X" =- X + (14-) (X'-X). We shall seek a good value to use for 0. We note that (6) with the subscript i deleted specializes to (8) V'" and that there is a similar expression with prims in place of the double-primes. For purposes to come to light below we calcuilate using (7) and (8) that wit expfxp U-X~) x] W" exp [(l+0) (x'-]) X1 1+(1+0,) =
18 March 1.963; ~-94253 V. if' V -X~ :L.; riulf1ciontly t-ipll, (see (8) with priu'es in place of the daiible primos) The simgificance of' this relation to thc, followin:z. The difference AI-X ra,;.v.rures the avounl of diotor-tion in the use of V' in place of X.. If the amount ov the diatortion is nreo by a small a~mount o(w-q), thbe weig,,ht function is raised to the power 1&O approxivr~taly. This same approximate power lav holds "Ior dintrtou dfohreunny mzed distributiorw. Let ua now return to the serious3 development of the paper. We assume that corrmspotidinf, -to Qach act ((-y.. 'a n,) of real nurabers near (0,...,0) there Is a set of random varimbles siuch that. for 0 O hil,..,, the- double-primed variablea -raduce to the.%.jn1d such that tile 1o1sodng'~i~t fnc~tionc Satisf'y (9) w" -. (Nil where, au Fv.bove, the wj are the weiý,jt Puyictionti for the We ahll-l estilautc, 4 Ta.1ingcl into-account, (5), we write
18 March 1963 5 TM- 9 )1253 whlere 11" iz t¾e plprobabil.ity i:neývure Cor (" From (6) and the similar relation with priuw.s re.laced by double-priiikvu, we obtain wldi w" d~.i" which tos,,her with (9) ;,ives.he above integral for E(y) reduces to NOy = IY y,"w) which with further use of (9) b'ecomes E(y) Y Hyl W, PuuL this is nothiug but (5). Vh:at we are interested in is the variance of t y w, which by calculations like those just completed is obtained. from (we introduce notation used below) 1Vf T " c' E'[(Y Hi w) y f wf (wi) i daij (0)0 f Yfl(w)I) i dp, Since the expected wvlue of t is constant with respect to the Cri' our objective will be to nilninltze E`"(tg. The utility of the last xupreosion results from the fact thavt it. lnvolver4 the wei.fth'jt and mnnirpes of random vrriables which
18 March 1963 6 7M-94253 (Last page) have already been sampled. Thus using the sample from the we shall be able to pick out a good values of the Qi to be used in further sampling. In practice the relation (9) is only unable when the a are seall. Hence the same is true of (10). We shall calculate the derivatives of (10) with respect to the ai at ai 0, i21,...,n, and use a quadratic approximation for (10). Differentiation under the integral sign leads to the following derivatives which have been evaluated at a =O. Let T denote E"(t ). ý 2r c- 3 j y log l3vh 2 WI, ci. - P. fy (log wll 2 (-,1) 2 cd, 2 Cik fy2 log,log w f, (v') 2 d41 We have T T (,...,). (o,...,o) + Z C a+ j cjk The m-inimum oif T occurs at -the solution of C 1 + C L, % 0, j
System Development Corporation, Santa Monica, California A SQUENTIAL PROCEDUE FOR SUCCESSIVELY IMPROVING SAMPLING DISTORTION, PRELIMINARY EEP(CT. Scientific rept., TJ-94253, by C. z. Clark. 18 march 1963, 6p. Unclassified report UNCLASSIFIED DESCRIPTORS: (mathematles). Monte Carlo Method UNCLASSIFIED