ON THE STRUCTURE OF OPTIMAL ORDERING POLICIES FOR STOCHASTIC INVENTORY SYSTEMS WITH MINIMUM ORDER QUANTITY

Similar documents
Coordinating Inventory Control and Pricing Strategies with Random Demand and Fixed Ordering Cost: The Finite Horizon Case

Keywords: inventory control; finite horizon, infinite horizon; optimal policy, (s, S) policy.

Inventory Control with Convex Costs

(s, S) Optimality in Joint Inventory-Pricing Control: An Alternate Approach*

(s, S) Optimality in Joint Inventory-Pricing Control: An Alternate Approach

A Decomposition Approach for a Class of Capacitated Serial Systems 1

A Single-Unit Decomposition Approach to Multiechelon Inventory Systems

Optimality Results in Inventory-Pricing Control: An Alternate Approach

On the Convergence of Optimal Actions for Markov Decision Processes and the Optimality of (s, S) Inventory Policies

Structure of optimal policies to periodic-review inventory models with convex costs and backorders for all values of discount factors

Constrained Inventory Allocation

A New Algorithm and a New Heuristic for Serial Supply Systems.

Single-stage Approximations for Optimal Policies in Serial Inventory Systems with Non-stationary Demand

Optimal Control of an Inventory System with Joint Production and Pricing Decisions

Ordering Policies for Periodic-Review Inventory Systems with Quantity-Dependent Fixed Costs

Optimal Control of Parallel Make-To-Stock Queues in an Assembly System

Inventory control with partial batch ordering

Optimal and Heuristic Echelon ( r, nq, T ) Policies in Serial Inventory Systems with Fixed Costs

On the Convergence of Optimal Actions for Markov Decision Processes and the Optimality of (s, S) Inventory Policies

Single-stage Approximations for Optimal Policies in Serial Inventory Systems with Non-stationary Demand

A Customer-Item Decomposition Approach to Stochastic Inventory Systems with Correlation

Coordinated Replenishments at a Single Stocking Point

2001, Dennis Bricker Dept of Industrial Engineering The University of Iowa. DP: Producing 2 items page 1

On the Convexity of Discrete (r, Q) and (s, T ) Inventory Systems

Serial Inventory Systems with Markov-Modulated Demand: Solution Bounds, Asymptotic Analysis, and Insights

Serial Inventory Systems with Markov-Modulated Demand: Derivative Bounds, Asymptotic Analysis, and Insights

Optimal ordering policies for periodic-review systems with replenishment cycles

A Duality-Based Relaxation and Decomposition Approach for Inventory Distribution Systems

1 Positive Ordering Costs

Full terms and conditions of use:

Optimality Inequalities for Average Cost MDPs and their Inventory Control Applications

7.1 INTRODUCTION. In this era of extreme competition, each subsystem in different

New Markov Decision Process Formulations and Optimal Policy Structure for Assemble-to-Order and New Product Development Problems

Serial Supply Chains with Economies of Scale: Bounds and Approximations

Total Expected Discounted Reward MDPs: Existence of Optimal Policies

Expected Time Delay in Multi-Item Inventory Systems with Correlated Demands

Purchase Contract Management with Demand Forecast Updates

No-Holdback Allocation Rules for Continuous-Time Assemble-to-Order Systems

Optimal Backlogging Over an Infinite Horizon Under Time Varying Convex Production and Inventory Costs

Improving Supply Chain Performance: Real-Time Demand Information and Flexible Deliveries

Asymptotically Optimal Inventory Control For Assemble-to-Order Systems

Are Base-stock Policies Optimal in Inventory Problems with Multiple Delivery Modes?

Performance Analysis and Evaluation of Assemble-to-Order Systems with Stochastic Sequential Lead Times

A Hierarchy of Suboptimal Policies for the Multi-period, Multi-echelon, Robust Inventory Problem

On the static assignment to parallel servers

Research Article A Partial Backlogging Inventory Model for Deteriorating Items with Fluctuating Selling Price and Purchasing Cost

A Proof of the EOQ Formula Using Quasi-Variational. Inequalities. March 19, Abstract

The Stochastic Economic Lot Sizing Problem for Continuous Multi-Grade Production

On Optimization of the Total Present Value of Profits under Semi Markov Conditions

Stochastic Analysis of Bidding in Sequential Auctions and Related Problems.

Optimal Control of a Production-Inventory System with both Backorders and Lost Sales

We consider the classic N -stage serial supply systems with linear costs and stationary

Technical Memorandum Number 758. The Multiple-Family ELSP with Safety Stocks. Serge M. Karalli and A. Dale Flowers

Scheduling Linear Deteriorating Jobs with an Availability Constraint on a Single Machine 1

This paper studies a periodic-review, serial supply chain in which materials are ordered and shipped according

Markov Decision Processes and Dynamic Programming

Interchanging fill rate constraints and backorder costs in inventory models

PROBABILISTIC SERVICE LEVEL GUARANTEES IN MAKE-TO-STOCK MANUFACTURING SYSTEMS

Reducing the Cost of Demand Uncertainty through Accurate Response to Early Sales

Dynamic Inventory Models and Stochastic Programming*

A Non-Parametric Approach to Stochastic Inventory Planning with Lost Sales and Censored Demand

A Shadow Simplex Method for Infinite Linear Programs

Extreme Point Solutions for Infinite Network Flow Problems

OPTIMALITY OF RANDOMIZED TRUNK RESERVATION FOR A PROBLEM WITH MULTIPLE CONSTRAINTS

An Asymptotic Analysis of Inventory Planning with Censored Demand

Inventory optimization of distribution networks with discrete-event processes by vendor-managed policies

STOCK RATIONING IN A MULTI-CLASS MAKE-TO-STOCK QUEUE WITH INFORMATION ON THE PRODUCTION STATUS. August 2006

Information Relaxation Bounds for Infinite Horizon Markov Decision Processes

A polynomial time algorithm to solve the single-item capacitated lot sizing problem with minimum order quantities and concave costs

Designing the Distribution Network for an Integrated Supply Chain

The Economic Lot Sizing Problem for Continuous Multi-grade Production with Stochastic demands

Using Markov Chains To Model Human Migration in a Network Equilibrium Framework

Preservation of Structural Properties in Optimization with Decisions Truncated by Random Variables and Its Applications

Operations Research Letters. Joint pricing and inventory management with deterministic demand and costly price adjustment

OPTIMAL CONTROL OF A FLEXIBLE SERVER

Stochastic Dynamic Programming. Jesus Fernandez-Villaverde University of Pennsylvania

Optimality Inequalities for Average Cost Markov Decision Processes and the Optimality of (s, S) Policies

Online Appendices: Inventory Control in a Spare Parts Distribution System with Emergency Stocks and Pipeline Information

Inventory management with advance capacity information

Optimal on-line algorithms for single-machine scheduling

Mixture inventory model in fuzzy demand with controllable lead time

Chapter 2 Discrete-Time Inventory Problems with Lead-Time and Order-Time Constraint

Complexity analysis of job-shop scheduling with deteriorating jobs

Multimodularity and Its Applications in Three Stochastic Dynamic Inventory Problems

Mathematical models in economy. Short descriptions

STOCHASTIC LEADTIMES IN A ONE-WAREHOUSE, N-RETAILER INVENTORY SYSTEM WITH THE WAREHOUSE CARRYING STOCK

Influence of product return lead-time on inventory control

Multi level inventory management decisions with transportation cost consideration in fuzzy environment. W. Ritha, S.

Optimal Control of Stochastic Inventory System with Multiple Types of Reverse Flows. Xiuli Chao University of Michigan Ann Arbor, MI 48109

The Single and Multi-Item Transshipment Problem with Fixed Transshipment Costs

A Non-Parametric Asymptotic Analysis of Inventory Planning with Censored Demand

Electronic Companion to Optimal Policies for a Dual-Sourcing Inventory Problem with Endogenous Stochastic Lead Times

We address multi-item inventory systems with random and seasonally fluctuating, and

Scheduling jobs with agreeable processing times and due dates on a single batch processing machine

Optimal Policies for a Dual-Sourcing Inventory Problem with Endogenous Stochastic Lead Times

COMPUTING OPTIMAL SEQUENTIAL ALLOCATION RULES IN CLINICAL TRIALS* Michael N. Katehakis. State University of New York at Stony Brook. and.

Robustness of policies in Constrained Markov Decision Processes

Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions

On the optimality equation for average cost Markov decision processes and its validity for inventory control

Approximate Dynamic Programming Methods for an Inventory Allocation Problem under Uncertainty

Transcription:

Probability in the Engineering and Informational Sciences, 20, 2006, 257 270+ Printed in the U+S+A+ ON THE STRUCTURE OF OPTIMAL ORDERING POLICIES FOR STOCHASTIC INVENTORY SYSTEMS WITH MINIMUM ORDER QUANTITY YAO ZHAO AND MICHAEL N. KATEHAKIS Department of Management Science and Information Systems Rutgers University, The State University of New Jersey Newark, NJ 07102-1895 E-mail: yaozhao@andromeda.rutgers.edu; mnk@andromeda.rutgers.edu We study a single-product periodic-review inventory model in which the ordering quantity is either zero or at least a minimum order size+ The ordering cost is a linear function of the ordering quantity, and the demand in different time periods are independent random variables+ The objective is to characterize the inventory policies that minimize the total discounted ordering, holding, and backorder penalty costs over a finite time horizon+ We introduce the concept of an M-increasing function+ These functions allow us to characterize the optimal inventory policies everywhere in the state space outside of an interval for each time period+ Furthermore, we identify easily computable upper bounds and asymptotic lower bounds for these intervals+ Finally, examples are given to demonstrate the complex structure of the optimal inventory policies+ 1. INTRODUCTION Minimum Order Quantity ~MOQ! is widely used in many industries ~e+g+, apparel, pharmaceutical, and consumer packaged products!+ In these industries, customers ~e+g+, distributors or retailers! typically have two choices, either not to order from their suppliers or to order at least a minimum quantity, namely the MOQ+ This MOQ provides a way for the suppliers to achieve economies of scale in production and transportation+ A well-known example of MOQ is the fashion sport ski-wear distributor Sport Obermeyer @7#+ Sport Obermeyer outsources almost all of its production to Hong 2006 Cambridge University Press 0269-9648006 $16+00 257

258 Y. Zhao and M. N. Katehakis Kong and China to reduce production variable cost+ Due to the economy of scale in mass production, the manufacturing facilities require a minimum ordering quantity of 600 garments in Hong Kong and 1200 garments in China per order+ The MOQ constraints apply to a particular item or a group of items, such as all colors of a particular style+ MOQ is not only required in fashion industries where products are subject to obsolescence ~thus distributors and retailers only place orders for a few items!, it also applies to many repeatedly ordered items+ For instance, Home Depot and Wal-Mart have to honor the MOQs specified by the suppliers for many nonseasonal items they carry+ When the suppliers require MOQ, they typically do not charge a fixed ordering cost ~which is accounted by the MOQ!, but charge the same unit price per item+ Therefore, the customers ordering cost is a linear function of the ordering quantity+ Minimum order quantity stands as a substantial challenge to managing supply chains efficiently+ As illustrated by the numerical examples of Fisher and Raman @7#, MOQ requires the distributors or retailers ~hereafter we use retailer and distributor interchangeably! to order either none or many+ Thus, it reduces the retailers flexibility of responding to demand and eventually increases the retailers inventory costs or reduces their service levels+ To provide tools and guidance for companies to effectively manage inventory when they face MOQs from their suppliers, we model, in this article, this type of problem as stochastic dynamic programs and investigate the structure of the optimal policy for the single-product, periodic-review inventory system with MOQ in a finite time horizon+ There is a large body of literature in the general areas of production and inventory management incorporating the impact of the economy of scale+ However, most efforts have been devoted to models with fixed ordering costs and fixed batch sizes; little attention has been paid to MOQs+ Scarf @16# proved that an ~s, S! policy is optimal for periodic-review, single-product inventory systems with fixed ordering cost and general demand distributions+ An alternative proof is provided by Veinott @20# under a different set of assumptions+ An excellent review of stochastic inventory systems with fixed ordering cost can be found in Heyman and Sobel @9#+ For systems with fixed batch sizes, Veinott @19# first proved that a reorder point0batchtransfer policy is optimal+ In this policy, if the inventory level drops below the reorder point, orders are placed in batches to raise the inventory level to the smallest value above the reorder point; if the inventory level is above the reorder point, no order is placed+ Chen @4# proved that the policy is optimal for multiechelon inventory systems under some regularity conditions+ Karlin @10# analyzed a single-period stochastic inventory system in which a fixed amount is added to stock whenever a decision to increase stock is made+ This model has applications in production systems in which the difference between the cost of producing up to the capacity and the cost of producing any number of units less than the capacity is negligible+ Karlin @10# specified the conditions under which the optimal inventory policy can be characterized by a single critical number+ Chan and Muckstadt @3# studied a stochastic production-inventory system in which the production quantity is constrained by a minimum and a maximum level

STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 259 in each time period, namely, the production smoothing problem+ They characterized the optimal production policy in finite and infinite time horizons under the discounted cost criterion+ This production smoothing problem is different from the model studied here because in the former, the action of zero production is absent and, hence, the action sets are connected and compact+ In the model studied here, the order quantity is either zero or at least the MOQ; therefore, the action sets are disjoint and unbounded+ As we will see later, these disjoint action sets significantly complicate the structure of the optimal policies+ Other related work in this general area includes that of Axsater @1#, De Bodt and Graves @5#, Federgruen and Katalan @6#, Gallego and Wolf @8#, Karmarkar @11#, Lee and Moinzadeh @13#, Porteus @14#, Sethi and Cheng @17#, Zheng and Federgruen @22#, Zipkin @23#, and Song and Yao @18#+ The work of Fisher and Raman @7# is perhaps the first article explicitly considering MOQ in stochastic inventory systems+ They considered a distributor managing multiple products in two time periods+ If the distributor decides to order, the order sizes must be larger than or equal to the MOQs for each time period and less than the supplier s production capacity+ They solved the optimal order quantity problem using stochastic programming, and they quantified the impact of MOQ on the distributor s inventory costs for the case of two time periods+ Katehakis and Bradford @12# considered a related single-period, multilocation distribution system with both minimum and maximum order quantity constraints+ To the best of our knowledge, there are almost no studies on the multiperiod inventory systems with MOQs+ Indeed, the structure of the optimal inventory policy is not known even for the simplest type of such systems with a single product and unlimited production capacity+ This article is organized as follows: In Section 2 the model and notation are presented+ In Section 3 we establish, in Theorem 3+10, the form of the optimal policy outside of an interval for each time period+ In Lemma 3+9, Lemma 3+12, and Theorem 3+13 we provide the upper bound and asymptotic lower bound for this interval in each time period+ Examples are given to demonstrate the complex structure of the optimal policy+ Section 4 concludes the article by pointing out future research directions+ 2. THE MODEL AND FORMULATION We consider a single retailer managing a single product and reviewing its inventory periodically+ External demand is stochastic and a minimum order quantity, M, is required from the supplier+ The sequence of events is as follows+ At the beginning of a time period, the retailer reviews the inventory and makes order decisions+ If he orders, the order size must be at least M units and it is immediately filled+ At the end of the time period, demand is realized and the retailer fills the demand from on-hand stock+ Any excessive demand is backlogged+ Our analysis can be easily extended to systems with constant replenishment lead times following the standard argument in Heyman and Sobel @9#+

260 Y. Zhao and M. N. Katehakis Let N be an integer that represents the number of time periods in the planning horizon+ We index time periods n 1,2,+++,N, where N is the first time period in the planning horizon and 1 is the last+ Let c, b~0 b 1!, h, and p be the unit ordering cost, the time discounted factor for each time period, the unit inventory holding cost per time period, and the unit backorder penalty per time period, respectively+ We use D n to denote the external demand in time period n, and it is assumed that the D n s are independent with finite means E~D n!+ Throughout this article, we assume p c+ Following Markov Decision Process ~MDP! notations, let S be the continuous state space for inventory position x, at the beginning of a time period, and y x be the amount ordered in that time period+ y A x, where A x $x% @x M,`! is the set of feasible actions+ Let j~x, y, D! y D be the transition function, where D is the demand+ It is easy to verify that the expected inventory and ordering cost in one time period given that the period starts with an inventory position x and orders in that period y x items can be written as follows: c~ y x! E~L~ y, D!!, where E~{! is the expectation with respect to D and L~ y, D! h~ y D! p~d y! + Let U n ~x! be the minimum total inventory and ordering costs from the beginning of nth time period until the end of the planning horizon, given an nth period initial inventory position x+ Clearly, U 1 ~x! inf ya x $c~ y x! E~L~ y, D 1!!%, U n ~x! inf ya x $c~ y x! E~L~ y, D n!! be~u n1 ~ y D n!!%, n 2,+++,N+ The salvage value of the unsold products at the end of the planning horizon is zero ~i+e+, U 0 ~x![0!+ Observe that if M 0, Eq+ ~1! reduces to the well-known inventory model of zero fixed ordering cost @15#+ Define V n ~x! U n ~x! cx, n; we can simplify Eq+ ~1! as follows: V 1 ~x! inf ya x $cy E~L~ y, D 1!!%, V n ~x! inf ya x $c~1 b!y E~L~ y, D n!! be~v n1 ~ y D n!!% bce~d n!, (1) n 2,+++,N+ (2)

For simplicity, we define g n ~ y! c~1 b!y E~L~ y, D n!! for n 2 and g 1 ~ y! cy E~L~ y, D 1!!; we let H n ~ y! g n ~ y! be~v n1 ~ y D n!!, n 2, and H 1 ~ y! g 1 ~ y!+ We can rewrite Eq+ ~2! as V 1 ~x! inf$h 1 ~x!; H 1 ~ y! : y x M %, V n ~x! inf$h n ~x!; H n ~ y! : y x M % bce~d n!, n 2,+++,N+ (3) We can prove the following proposition by induction+ Proposition 2.1: If M M ' while everything else is identical, then U n ~x! U n ' ~x!, x, where U ~U '! corresponds to M ~M ', respectively). The proof is based on the observation that A x A x ', where A ~A '! corresponds to M ~M ', respectively!+ We omit the details of the proof+ 3. STRUCTURE OF THE OPTIMAL POLICY We first focus on the last time period in the planning horizon+ Definition 3.1: Consider two continuous functions, f~y! and c~y!, where y ~`,`!. If there exists a positive e, S d, N and a v @a, b# where a and b are finite constants, so that f~y! c~y!, y @a, b#, and ~f~a e! c~a e!! ~f~b d! c~b d!! 0 for any 0 e es and 0 d d, N then we define a to be a junction. Intuitively, a junction is the minimum point of an interval in which f~y! c~y! 0 and beyond which, f~y! c~y! changes sign+ Lemma 3.2: Given any convex function f~y!, y ~`,`!, that satisfies f~y! r ` as 6 y6 r `, define y * to be the smallest value at which f~y! reaches the global minimum. Proof: STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 261 1. There exists a unique and finite junction y 0 between f~y! and f~y M!. 2. 3. y * M y 0 y *. f~x! f~x M '!, x y 0, M ' M, f~x! f~x M!, x y 0 + 1+ Observe that f~x! is continuous ~due to convexity!, that there exists a y 1 ` so that f~y 1! f~y 1 M!, and that there exists a y 2 ` so that f~y 2! f~y 2 M!+ It follows from the Intermediate Value Theorem of continuous functions that there must exist a junction between f~y! and f~y M!, and all junctions between f~y! and f~y M! must be finite+

262 Y. Zhao and M. N. Katehakis To show the uniqueness of the junction, we prove that if f~y 1! f~y 1 M! and f~y 2! f~y 2 M! for two points y 1 y 2, then f~y! f~y M!, y ~ y 1, y 2!+ For any y ~ y 1, y 2!, the convexity of f~y! implies that and Thus, f~y! f~y 1! y y 1 f~y M! f~y 1 M! y y 1 f~y 2! f~y! y 2 y f~y 2 M! f~y M! + y 2 y f~y 1 M! f~y 1! f~y M! f~y! f~y 2 M! f~y 2!+ Since f~y 1 M! f~y 1! f~y 2 M! f~y 2! 0, the proof of part 1 is complete+ 2+ Consider x y 0 + Due to the convexity of f~x!, we have f~x! f~y 0! f~x M! f~y 0 M! + x y 0 x y 0 Thus, f~y 0! f~y 0 M! implies f~x! f~x M!+ The convexity of f~x! further implies that f~x M! f~x! f~x M '! f~x!, M ' M; M M ' hence, f~x! f~x M '!+ Consider x y 0 + Due to the convexity of f~x!, we have f~y 0! f~x! f~y 0 M! f~x M! + y 0 x y 0 x Thus, f~y 0! f~y 0 M! implies f~x! f~x M!+ 3+ First, there must exist a point y, y * M y y * so that f~y! f~y M!+ This is true because f~y! is continuous and f~y! ~f~y M!! reaches the global minimum at y * ~ y * M, respectively!+ Hence, the uniqueness of the junction y 0 implies that y 0 y * + Second, because f~y * M! f~y *!~due to the fact that y * is the smallest global minimum of f~y!!, the uniqueness of the junction y 0 implies that y 0 y * M+ Clearly, H 1 ~ y! is convex, and since p c, H 1 ~ y! tends to infinity as 6 y6 r `+ Thus, Lemma 3+2 holds for H 1 ~ y!+ Define the smallest global minimum of H 1 ~ y! to be y 1 * and the junction between H 1 ~ y! and H 1 ~ ym! to be y 1 + The following theorem characterizes the optimal policy for the single-period inventory systems with MOQ+

Theorem 3.3: In the single-period problem, the optimal policy, given the initial inventory position x, is to order y1 * x, x y * 1 M M, y * 1 M x y 1 0, otherwise+ Proof: For x y * 1 M, the global minimum y * 1 is a feasible order-up-to level; thus, it is optimal to order y * 1 x+ For x y 1, since H 1 ~x M '! H 1 ~x!, M ' M ~Lemma 3+2!, the optimal policy is to order nothing+ For x that satisfies y * 1 M x y 1, first notice that H 1 ~x M! H 1 ~x! ~Lemma 3+2!, which implies that we should order at least M; second, notice that H 1 ~x M '! H 1 ~x M!, M ' M, because x M y * 1 and H 1 ~ y! is convex+ Thus, only ordering M is the optimal policy+ The optimal policy is illustrated in Figure 1+ We point out that the single-period optimal policy for the model with MOQ has a different structure than the ~s, S! policy that is optimal for the model of fixed ordering cost and than the reorder point0batch-transfer policy that is optimal for the model of fixed batch sizes+ Now consider any time period n,1 n N+ We first show that the following properties hold for H n ~ y!+ Proposition 3.4: H n ~ y!, n 1 has the following properties: Proof: STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 263 1. H n ~ y! is continuous. 2. H n ~ y! 0 and H n ~ y! r ` as 6 y6 r `. 1+ The proof is by induction+ Assume that H n1 ~ y! is continuous; then it is easily seen that inf$h n1 ~ y! : y x M % is continuous because Figure 1. The cost function of a single-period inventory system with MOQ+

264 Y. Zhao and M. N. Katehakis the boundary x M is a continuous function of x+ Thus, V n1 ~x! inf$h n1 ~x!;inf$h n1 ~ y! : y x M %% is continuous because the infinmum of continuous functions is continuous+ Hence, H n ~ y! g n ~ y! be~v n1 ~ y D n!! is continuous+ Finally, the continuity of H 1 ~ y! implies the result+ 2+ Notice that for n 1, H n ~ y! g n ~ y! be~v n1 ~ y D n!! c~1 b!y E~L~ y, D n!! be~u n1 ~ y D n! c~ y D n!! cy E~L~ y, D n!! be~u n1 ~ y D n!! bce~d n! E~~h c!~y D n! ~p c!~d n y!! be~u n1 ~ y D n!!+ (4) Since E~~h c!~y D n! ~p c!~d n y!! is nonnegative and tends to positive infinity as 6 y6 r ` ~due to p c!, the fact that U n1 ~{! 0 implies the result+ Definition 3.5: f~x! is an M-increasing function if f~x! f~x M '!, x and M ' M. Note that the regular nondecreasing functions are special cases of the M- increasing function for which M 0+ The definition of the M-increasing functions directly implies the following proposition+ Proposition 3.6: If f~x! and c~x! are M-increasing functions, then the following hold: 1. af~x! bc~x! is M-increasing for nonnegative a and b. 2. E~f~x D!! is M-increasing, where E~{! is the expectation with respect to D. 3. f~x! is M ' -increasing with M ' M. Lemma 3.7: V n ~x! is an M-increasing function for all n 1. Proof: The result holds because V n ~x! inf yax $H n ~ y!% bce~d n! and A xm ' A x, M ' M+ To characterize the optimal policy for time period n 1, define the smallest global minimum of H n ~ y! to be y n * ~it is finite due to Proposition 3+4!+ Since the single-period cost functions g n ~ y! are convex and g n ~ y! r ` as 6 y6 r ` because p c, we can define y n,g to be the unique junction between g n ~ y! and g n ~ y M!~Lemma 3+2!+ Observe that if the demand is identically distributed, y n,g is a constant for all n 1; therefore, we let y G y 2,G for simplicity+ Following the same logic as in the proof of Lemma 3+2, we can show that H n ~ y! and H n ~ y M! must have at least one junction in ~ y n * M, y n * # because H n ~ y! is continuous, and H n ~ y! ~H n ~ y M!! reaches the global minimum at y n * ~ y n * M,

respectively!+ Let ry n be the smallest junction between H n ~ y! and H n ~ y M! in ~ y * n M, y * n # and let yt n ~M '! be the largest junction between H n ~ y! and H n ~ y M '! for M ' M+ We define yi n max M ' M $ yt n ~M '!%+ For the ease of exposition, we simplify the notation yt n ~M! to yt n + Given these definitions, we can make the following observations+ Observation 3.8: STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 265 ~a! g n ~ y! is M-increasing for y y n,g ~i+e+, g n ~ y! g n ~ y M '!, M ' M, y y n,g!~lemma 3+2!+ ~b! For all y @ y * n M, ry n!, H n ~ y M! H n ~ y!+ ~c! Due to the asymptotic behavior of H n ~ y! ~Proposition 3+4!, for all y yi n we have H n ~ y! H n ~ y M '!, M ' M ~M-increasing!+ The following relationships hold+ Lemma 3.9: y * n M ry n yi n y n,g. Proof: The first and second inequalities follow by the definitions of ry n and yi n + To show the third inequality, we use contradiction+ Suppose y n,g yi n ; first observe that for all y y n,g, H n ~ y! g n ~ y! be~v n1 ~ y D n!! is M-increasing+ This is true because g n ~ y! is M-increasing, y y n,g ~Observation 3+8~a!!, and V n1 ~ y! is M-increasing for all y, Proposition 3+6 implies the result+ Thus, for any y ~ y n,g, yi n!, we must have H n ~ y! H n ~ y M '!, M ' M+ However, by the definition of yi n, there must exist a M ' M and a y ~ y n,g, yi n! such that H n ~ y M '! H n ~ y!+ This completes the proof+ Now we are ready to show the optimal policy in certain regions of the state space+ Theorem 3.10: In the multiple-period problem, the optimal policy at time period n 1, given the initial inventory position x, is to order yn * x, x y * n M z * n ~x! x, y * n M x ry n 0, x yi n, where z n * ~x! is a nondecreasing function of x and z n * ~x! x M. Proof: For x y * n M, the optimal policy is obviously to order up to y * n since the global minimum y * n is feasible for x+ For y * n M x ry n, it is optimal to order up to level z * n ~x! x M because H n ~ y M! H n ~ y! for all y ~ y * n M, ry n!~observation 3+8~b!!+ To show that z * n ~x! is a nondecreasing function, consider x, x ' ~ y * n M, ry n # and assume x x ' ; then arg min y@xm,`! H n ~ y! arg min y@x ' M,`! H n ~ y!+ For x yi n, H n ~ y! g n ~ y! be~v n1 ~ y D n!! is M-increasing ~Observation 3+8~c!!; thus, the optimal policy is to order nothing+

266 Y. Zhao and M. N. Katehakis Figure 2. Example 1+ The example in Figure 2 shows that z * n ~x! might not always be equal to x M for x ~ y * n M, ry n #+ The example has two time periods with a deterministic demand seven units realized in the first period and a deterministic demand five units realized in the second period ~the same observation can be made when the demand in the second period is also seven!, and M 10, p 10, h 1, and c 0+ See Figure 2 for the definition of y ' and Y ' + It is obvious from Figure 2 that if y * 2 M x y ', z * 2 ~x! x M; however, if y ' x Y ', z * 2 ~x! Y ' M; and, finally, if Y ' x ry n, z * 2 ~x! x M+ We have examples ~not reported here! with stochastic demand in which there exist multiple y s and Y s+ These examples show that the optimal policies of the multiperiod systems generally have different structures than those of the single-period systems ~Theorem 3+3!+ Together with the single-period optimal policy, these examples demonstrate that neither the optimal policy in terms of the ordering quantity nor the optimal policy in terms of the order-up-to level is monotone+ Theorem 3+10 characterizes the optimal policy in the state space except for the interval V n ~ ry n, yi n #+ We have numerical examples ~not reported here! to show that H n ~ y! has multiple junctions with H n ~ y M!; thus, V n can be nonempty+ To characterize the optimal policy in this interval, we need to answer the following question: Does there exist a unique point y 0 n V n so that we should order at least M for x y 0 n and order nothing for x y 0 n? If there exists such a point, then y 0 n yi n because we should not order for x yi n ~Theorem 3+10!, and there must exist a e 0 so that for x ~ yi n e, yi n!, we should order ~due to the definition of junction and the continuity of H n ~ y!!+ However, when H n ~ y! and

STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 267 Figure 3. Example 2+ H n ~ y M! have multiple junctions, such a point might not exist+ For instance, Figure 3 illustrates a case in which H n ~ y! has three junctions with H n ~ y M!, with ry n ~ yt n! being the smallest ~largest, respectively! junction+ If x ry n, we should order; if x ~ ry n, y ' n!~see Fig+ 3 for the definition of y ' n!, we should not order; if x ~ y ' n, yt n!, we should again order; and if x yt n we should again not order+ It is still not clear under what conditions such a case might exist+ Thus, the existence of such a point y 0 n is an open question+ We next provide bounds for $ y * n % as n r ` in the case of stationary demands+ Observe that Lemma 3+9 specifies upper bounds for y * n, n; therefore, we focus on lower bounds+ We define y L to be the junction between E~L~ y, D!! and E~L~ y M, D!!+ A simple heuristic policy works as follows: Order up to y @ y L, y L M # if x y L ; otherwise, do not order+ It is easily seen that if the initial inventory position of a time period x @ y L, y L M #, the expected cost in this period is no more than c~m E~D!! E~L~ y L, D!!+ Thus, the infinite horizon long-run average cost and the total discounted cost of this heuristic policy are bounded from above for an initial state x @ y L, y L M #+ Proposition 3.11: For stationary demand, the smallest global minimum of H n ~{!, y n *, is uniformly bounded from below for all n. Proof: The proof is by contradiction+ If there exists a subsequence n k so that y * nk r ` as n k r `, H nk ~ y * nk! r ` ~by Eq+ ~4! and part 2 of Proposition 3+4!+ Since V nk 1~x! H nk ~ y * nk! bce~d nk 1!, x, V nk 1~x! r `, x @ y L, y L M # as n k r `+ This creates a contradiction because the discounted cost U nk 1~x! V nk 1~x! cx is bounded by the total discounted cost of the heuristic policy+ It follows from Lemma 3+9 and Proposition 3+11 that there exists a compact set V so that y n * V, n+ To obtain a lower bound for the limit points of $ y n * %, we assume without loss of generality that c 0 @21#; then y L y G, V n ~x! U n ~x!, and U n ~x! inf ya x $E~L~ y, D!! be~u n1 ~ y D!!%+ (5)

268 Y. Zhao and M. N. Katehakis Since the single-period cost function is nonnegative, Bertsekas @2# showed that U n ~x! U n1 ~x!, x, n, and there exists a function U~x! such that U~x! inf ya x $E~L~ y, D!! be~u~ y D!!%+ (6) In addition, for all x, l R, and all n 1,2,+++, the sets B n ~x, l! $ y A x 6E~L~ y, D!! be~u n ~ y D!! l% are compact ~Proposition 3+4 and Eq+ ~14!!+ Thus, using Proposition ~1+7! of Bertsekas @2, p+ 148#, it follows that U n ~x! r U~x! pointwisely as n r `+ Thus, H n ~ y! r E~L~ y, D!! be~u~ y D!! pointwisely ~by the monotone convergence theorem!+ Define H~ y! E~L~ y, D!! be~u~ y D!!+ H~ y! satisfies Proposition 3+4 because H n ~ y! r H~ y! pointwisely as n r ` and U n ~{! 0, n+ Finally, in V, H n ~ y! converges uniformly to H~ y! because V is compact+ Lemma 3.12: Let y * be the smallest global minimum of H~ y!; then y * y G. Proof: For all x S, U~x! H~ y *! E~L~ y *, D!! be~u~ y * D!! E~L~ y *, D!! be~l~ y *, D!! {{{ E~L~ y *, D!! + 1 b Since the heuristic policy has a long-run average cost less than or equal to E~L~ y G, D!!, for a x @ y G, y G M #, E~L~ y *, D!! 1 b U~x! E~L~ y G, D!! + (7) 1 b To show that y * y G, we observe that if y * y G, then E~L~ y *, D!! E~L~ y G, D!! from the definition of y *, the convexity and asymptotic behavior of E~L~ y, D!!+ Thus, ~7! is violated+ Now we are ready to provide a lower bound for the limit points of $ y n * %+ Theorem 3.13: lim nr` y n * y *. Proof: The proof is by contradiction+ Consider a limit point y[ of $ y * n %; that is, there exists a subsequence n k so that as n k r `, y * nk r y+ [ Suppose y[ y * + Because y * is the smallest global minimum of H~{!, we must have H~ y! [ H~ y *!+ (8)

On the other hand, the definition of y * nk, n k, implies that Let n k r `; first we have H nk ~ y * nk! H nk ~ y *!+ (9) H nk ~ y *! r H~ y *!, (10) due to the pointwise convergence of H n ~{!+ Second, we observe that 6H~ y! [ H nk ~ y * nk!6 6H~ y! [ H~ y * nk!6 6H~ y * nk! H nk ~ y * nk!6+ As n k r `, the first term on the right-hand side converges to zero because H~{! is continuous; the second term on the right-hand side also converges to zero because H nk ~{! uniformly converges to H~{! in V+ Thus, we must have H nk ~ y * nk! r H~ y!+ [ (11) Inequality ~9! and relations ~10! and ~11! imply H~ y! [ H~ y *!+ This completes the proof by contradiction+ In the case of stationary demand, it follows from Theorem 3+13 and Lemmas 3+9 and 3+12 that the interval @ ry n, yi n # is asymptotically bounded by @ y G M, y G #, where y G can be easily determined from the known single-period cost function+ Furthermore, yi n is asymptotically bounded from above by y * n + Therefore, Theorem 3+10 implies that asymptotically it is optimal to stop ordering above a certain point smaller than or equal to y * n + 4. CONCLUSION In this article, we partially characterized the optimal inventory policy for the singleproduct, periodic-review inventory systems in which the ordering cost is linear but the order size must be either zero or larger than or equal to a minimum order quantity+ There are many interesting research topics left unexplored for the stochastic inventory systems with minimum order quantity+ For instance, we still do not know whether there exists a unique boundary between the ordering region and the nonordering region; nor do we know the existence of a stationary optimal control policy in the infinite time horizon under the average cost criterion; finally, given the complex structure of the optimal policy, easily implementable and effective heuristic policies need to be developed for the inventory systems with either a single product or multiple products sharing the minimum order quantity+ Acknowledgment STOCHASTIC INVENTORY SYSTEMS AND ORDERING POLICIES 269 This research was supported in part by a Faculty Research Grant from Rutgers Business School Newark and New Brunswick+

270 Y. Zhao and M. N. Katehakis References 1+ Axsater, S+ ~1993!+ Continuous review policies for multi-level inventory systems with stochastic demand+ In S+ Graves, A+ Rinnooy Kan, &P+ Zipkin ~eds+!, Logistics of production and inventory+ Amsterdam: Elsevier ~North-Holland!+ 2+ Bertsekas, D+P+ ~1995!+ Dynamic programming and optimal control, Vol+ 2+ Belmont, MA: Athena Scientific+ 3+ Chan, E+W+ & Muckstadt, J+A+ ~1999!+ The effects of load smoothing on inventory levels in a capacitated production inventory system+ Technical Report, School of Operations Research and Industrial Engineering+ Cornell University, Ithaca, NY+ 4+ Chen, F+ ~2000!+ Optimal policies for multi-echelon inventory problems with batch ordering+ Operations Research 48: 376 389+ 5+ De Bodt, M+A+ & Graves, S+C+ ~1985!+ Continuous-review policies for a multi-echelon inventory problem with stochastic demand+ Management Science 31: 1286 1299+ 6+ Federgruen, A+ & Katalan, Z+ ~1996!+ The stochastic economic lot scheduling problem: Cyclical base-stock policies with idle times+ Management Science 42: 783 796+ 7+ Fisher, M+ & Raman, A+ ~1996!+ Reducing the cost of demand uncertainty through accurate response to early sales+ Operations Research 44: 87 99+ 8+ Gallego, G+ & Wolf, A+S+ ~2000!+ Capacitated inventory problems with fixed order costs: Some optimal policy structure+ European Journal of Operational Research 126: 603 613+ 9+ Heyman, D+ & Sobel, M+ ~1984!+ Stochastic models in operations research+ Vol+ 2+ New York: McGraw-Hill+ 10+ Karlin, S+ ~1958!+ Optimal inventory policy for the Arrow Harris Marschak dynamic model+ In K+J+ Arrow, S+ Karlin, and H+ Scarf ~eds+!, Studies in the Mathematical Theory of Inventory and Production+ Stanford, CA: Stanford University Press+ 11+ Karmarkar, U+ ~1987!+ Lot sizes, lead-times and in-process inventories+ Management Science 33: 409 419+ 12+ Katehakis, M+ & Bradford, P+ ~2002!+ Contract constrained resource allocation+ In INFORMS Annual Meeting, San Jose, CA+ 13+ Lee, H+L+ & Moinzadeh, K+ ~1987!+ Two-parameter approximations for multi-echelon repairable inventory models with batch ordering policy+ IIE Transaction 19: 140 149+ 14+ Porteus, E+L+ ~1971!+ On the optimality of generalized ~s,s! policies+ Management Science 17: 411 427+ 15+ Ross, S+M+ ~1970!+ Applied probability models with optimization applications+ New York: Dover+ 16+ Scarf, H+ ~1960!+ The optimality of ~s,s! policies in dynamic inventory problems+ In K+ Arrow, S+ Karlin, &P+ Suppes ~eds+!, Mathematical models in the social sciences+ Stanford, CA: Stanford University Press+ 17+ Sethi, S+P+ & Cheng, F+ ~1997!+ Optimality of ~s,s! policies in inventory models with Markovian demand+ Operations Research 45: 931 939+ 18+ Song, J+S+ &Yao, D+D+ ~2001!+ Supply chain structures: Coordination, information and optimization+ Boston: Kluwer Academic+ 19+ Veinott, A+F+ ~1965!+ The optimal inventory policy for batch ordering+ Operations Research 13: 424 432+ 20+ Veinott, A+F+ ~1966!+ On the optimality of ~s,s! inventory policies: New conditions and a new proof+ SIAM Journal of Applied Mathematics 14: 525 552+ 21+ Veinott, A+F+ & Wagner, H+ ~1965!+ Computing optimal ~s,s! inventory policies+ Management Science 11: 525 552+ 22+ Zheng, Y+S+ & Federgruen, A+ ~1991!+ Finding optimal ~s,s! policies is about as simple as evaluating a single policy+ Operations Research 39: 654 665+ 23+ Zipkin, P+ ~2000!+ Foundations of inventory management+ Boston: McGraw-Hill+