Output Analysis for a Single Model

Transcription

1 Output Analysis for a Single Model

2 Output Analysis for a Single Model Output analysis is the examination of data generated by a simulation. Its purpose is to predict the performance of a system or to compare the performance of two or more alternative system designs. This lecture deals with the analysis of a single system, while next lecture deals with the comparison of two or more systems.

3 Type of Simulation with respect to Output Analysis When analyzing simulation output data, a distinction is made between terminating or transient simulation and steady-state simulation. A terminating simulation is one that runs for some duration of time TE, where E is a specified event (or set of events) which stops the simulation. Example 11.1: Shady Grove Bank operates 8:30 16:30, then TE = 480min. Example 11.3: A communication system consists of several components. Consider the system over a period of time, TE, until the system fails. E = {A fails, or D fails, or (B and C both fail)} 3

4 Terminating Simulation When simulating a terminating system, the initial conditions of the system at time 0 must be specified, and the stopping time TE, or alternatively, the stopping event E, must be well defined. Whether a simulation is considered to be terminating or not depends on both the objectives of the simulation study and the nature of the system. Examples 11.1 and 11.3 are considered the terminating systems because: Ex. 11.1: the objective of interest is one day s operation; Ex. 11.3: short-run behavior, from time 0 until the first system failure. 4

5 Steady-state Simulation A nonterminating system is a system that runs continuously, or at least over a very long period of time. For example, assembly lines which shut down infrequently, continuous production systems of many different types, telephone systems and other communications systems such as the Internet, hospital emergency rooms, fire departments, etc. A steady-state simulation is a simulation whose objective is to study long-run, or steady-state, behavior of a nonterminating system. The stopping time, TE, is determined not by the nature of the problem but rather by the simulation analyst, either arbitrarily or with a certain statistical precision in mind. 5

6 Stochastic Nature of Output Data Consider one run of a simulation model over a period of time [ 0, T ]. Since the model is an input-output transformation, and since some of the model input variables are random variable, it follows that the model output variables are random variables. The stochastic (or probability) nature of output variables will be observed. Example. (Able-Baker carhop problem) Input: randomness of arrival time and service time Output: randomness of utilization and time spent in the system per customer. 6

7 Output Analysis for Terminating Simulations Consider the estimation of a performance parameter, (or ), of a simulated system. The simulation output data is of the form {Y1, Y,, Yn} (discrete-time data) for estimating. E.g. the delay of customer i, total cost in week i. The simulation output data is of the form {Y(t), 0 t TE} (continuous-time data) for estimating. E.g. the queue length at time t, the number of backlogged orders at time t. Point Estimation: ˆ 1 n n i1 Y i 1 ˆ T E 0 T E Y( t) dt 7

8 Output Analysis for Terminating Simulations (cont ) By the Central Limited Theorem (CLT), for n 30, ˆ ˆ n t ( Yi ˆ) ˆ( ˆ) S( ˆ) / n where i1 S ( ˆ) n 1 Interval Estimation: An approximate 100(1 - )% confidence interval for is given by: ˆ t /, n1 S( ˆ) n ˆ t /, n1 S( ˆ) n 8

9 Output Analysis for Terminating Simulations (Example) Example (Able Baker Carhop Problem) ˆ Run, r Utilization, Average System Time, r ŵr ˆ ˆ ( ˆ) ˆ t ,3 ( ) ˆ( ˆ) (3.18)(0.036) ( ) 3(4) (0.036) 9

10 10 Number of Replications PRECISION LEVEL Suppose that an error criterion is specified; in other words, it is desired to estimate by to within with high probability, say at least 1. ˆ / 1, / 1, / ˆ) ( ˆ) ( ˆ) ( S z S t R R S t R R

11 Number of Replications (Example) Example 11.1 (Able Baker Carhop Problem) Suppose that it is desired to estimate Able s utilization in Example 11.7 to within 0.04 with probability An initial sample size R0=4 is taken. Step 1: z. 05 S (1.96) ( ) (0.04) Step : t R t0.05, R , R1 S R = 15 Additional replications: R R0 = 15 4 = 11 11