Collection of problems in probability theory

Transcription

1 Collection of problems in probability theory

2 L. D. MESHALKIN Moscow State University Collection of problems in probability theory Translated from the Russian and edited by LEO F. BORON University of Idaho and BRYAN A. HAWORTH University of Idaho and California State College, Bakersfield NOORDHOFF INTERNATIONAL PUBLISHING, LEYDEN

3 1973 Noordhoff International Publishing, Leyden, The Netherlands Softcover reprint of the hardcover 1st edition 1973 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior permission of the copyright owner. ISBN -13: : / e-isbn -13: Library of Congress Catalog Card Number: Original title "Sbornik zadach po teorii veroyatnostey" published in 1963 in Moscow

4 Contents Editor's foreword Foreword to the Russian edition 1 Fundamental concepts viii ix 1.1 Field of events Interrelationships among cardinalities of sets Definition of probability Classical definition of probability. Combinatorics Simplest problems on arrangements Geometric probability Metrization and ordering of sets 15 2 Application of the basic formu]as Conditional probability. Independence Discrete distributions: binomial, multinomial, geometric, hypergeometric Continuous distributions Application of the formula for total probability The probability of the sum of events Setting up equations with the aid of the formula for total probability 32 3 Random variables and their properties Calculation of mathematical expectations and dispersion 39 v

5 Contents 3.2 Distribution functions 3.3 Correlation coefficient 3.4 Chebyshev's inequality 3.5 Distribution functions of random variables 3.6 Entropy and information Basic limit theorems The de Moivre-Laplace and Poisson theorems Law of Large Numbers and convergence in probability Central Limit Theorem 66 5 Characteristic and generating functions Calculation of characteristic and generating functions 5.2 Connection with properties of a distribution 5.3 Use of the c.f. and g.f. to prove the limit theorems 5.4 Properties of c.f.'s and g.f.'s 5.5 Solution of problems with the aid of c.f.'s and g.f.'s Application of measure theory Measurability Various concepts of convergence Series of independent random variables Strong law of large numbers and the iterated logarithm law Conditional probabilities and conditional mathematical expectations 93 vi

6 7 Infinitely divisible distributions. Normal law. Multidimensional distributions Contents Infinitely divisible distributions 7.2 The normal distribution 7.3 Multidimensional distributions Markov chains Definition and examples. Transition probability matrix Classification of states. Ergodicity The distribution of random variables defined on a Markov chain 115 Appendix 117 Answers 125 Suggested reading 145 Index 147 vii

7 Editor's foreword The Russian version of A collection of problems in probability theory contains a chapter devoted to statistics. That chapter has been omitted in this translation because, in the opinion of the editor, its content deviates somewhat from that which is suggested by the title: problems in probability theory. The original Russian version contains some errors; an attempt was made to correct all errors found, but perhaps a few stiii remain. An index has been added for the convenience of the reader who may be searching for a definition, a classical problem, or whatever. The index lists pages as well as problems where the indexed words appear. The book has been translated and edited with the hope of leaving as much "Russian flavor" in the text and problems as possible. Any peculiarities present are most likely a result of this intention. August, 1972 Bryan A. Haworth viii

8 Foreword to the Russian edition This Collection of problems in probability theory is primarily intended for university students in physics and mathematics departments. Its goal is to help the student of probability theory to master the theory more profoundly and to acquaint him with the application of probability theory methods to the solution of practical problems. This collection is geared basically to the third edition of the GNEDENKO textbook Course in probability theory, Fizmatgiz, Moscow (1961), Probability theory, Chelsea (1965). It contains 500 problems, some suggested by monograph and journal article material, and some adapted from existing problem books and textbooks. The problems are combined in nine chapters which are equipped with short introductions and subdivided in turn into individual sections. The problems of Chapters 1-4 and part of 5,8 and 9 correspond to the semester course Probability theory given in the mechanics and mathematics department of MSU. The problems of Chapters 5-8 correspond to the semester course Supplementary topics in probability theory. Difficult problems are marked with an asterisk and are provided with hints. Several tables are adjoined to the collection. Answers are given only to odd numbered problems. This is done to train the student to evaluate independently the correctness of a solution, and also so that the material of the collection could be used for supervised work. To supplement the collection, the teacher can make use of the following three problem books which contain well chosen material on statistics and the theory of stochastic processes: 1. VOLODIN, B. G., M. P. GANIN, I. YA. DINER, L. B. KOMAROV, A. A. SVESHNIKOV, and K. B. STAROBIN. Textbook on problem solving ix

9 in probability theory for engineers. Sudpromgiz, Leningrad (1962). 2. LAJOS TAKAcS. Stochastic processes. Problems and solutions. Wiley (1970) (in the series Methuen's monographs on applied probability and statistics). 3. DAVID, F. N. and E. S. PEARSON. Elementary statistical exercises. Cambridge University Press (1961). My co-workers and degree candidates of the MSU Department of Probability Theory were of enormous help in choosing and formulating these exercises. I am deeply indebted to them for this. In particular I wish to thank M. Arato, B. V. Gnedenko, R. L. Dobrushin and Ya. G. Sinai. July 9, 1963 L. D. Meshalkin x