Optimization of Containers Inspection at Port-of-Entry

Similar documents
Data Quality Assurance System. Hong Kong, China

Umans Complexity Theory Lectures

Problem Set 2. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 30

Statistical Pattern Recognition

A GA Mechanism for Optimizing the Design of attribute-double-sampling-plan

Machine Learning, Midterm Exam: Spring 2009 SOLUTION

Final Exam December 12, 2017

Introductory Econometrics. Review of statistics (Part II: Inference)

BBM402-Lecture 11: The Class NP

Final Exam December 12, 2017

ORIE 4741 Final Exam

Final Exam, Machine Learning, Spring 2009

ECE521 Lecture7. Logistic Regression

Definition: A "system" of equations is a set or collection of equations that you deal with all together at once.

Biometrics: Introduction and Examples. Raymond Veldhuis

Simplex tableau CE 377K. April 2, 2015

Machine Learning Practice Page 2 of 2 10/28/13

Quality Control & Statistical Process Control (SPC)

Energy Flow in Electrical Grids

Numerical Solution for Multivariable Idle Speed Control of a Lean Burn Natural Gas Engine

The exam is closed book, closed calculator, and closed notes except your one-page crib sheet.

Introduction to Machine Learning

6-1. Canonical Correlation Analysis

Algorithmisches Lernen/Machine Learning

Chapter 8 Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2013 John Wiley & Sons, Inc.

Announcements. Unit 3: Foundations for inference Lecture 3: Decision errors, significance levels, sample size, and power.

Anomaly Detection. Jing Gao. SUNY Buffalo

CSL302/612 Artificial Intelligence End-Semester Exam 120 Minutes

Multi-Attribute Bayesian Optimization under Utility Uncertainty

ISyE 6644 Fall 2014 Test 3 Solutions

Multi Objective Optimization

Simultaneous and sequential detection of multiple interacting change points

Lecture 1: Introduction to Sublinear Algorithms

Monotonicity Analysis, Evolutionary Multi-Objective Optimization, and Discovery of Design Principles

Lab 5: 16 th April Exercises on Neural Networks

Exact Max 2-SAT: Easier and Faster. Martin Fürer Shiva Prasad Kasiviswanathan Pennsylvania State University, U.S.A

Final Exam, Fall 2002

Linear Classification. CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington

CS5371 Theory of Computation. Lecture 19: Complexity IV (More on NP, NP-Complete)

L5 Support Vector Classification

Automatic Determination of Uncertainty versus Data Density

Performance Evaluation and Comparison

Data Mining: Concepts and Techniques. (3 rd ed.) Chapter 8. Chapter 8. Classification: Basic Concepts

Midterm: CS 6375 Spring 2015 Solutions

NP-Completeness. Until now we have been designing algorithms for specific problems

Power Grid State Estimation after a Cyber-Physical Attack under the AC Power Flow Model

Least Squares Classification

Chapter 1: Introduction

REVISION SHEET DECISION MATHS 2 DECISION ANALYSIS

9. Decision-making in Complex Engineering Design. School of Mechanical Engineering Associate Professor Choi, Hae-Jin

Natural Language Processing. Classification. Features. Some Definitions. Classification. Feature Vectors. Classification I. Dan Klein UC Berkeley

Statistical quality control (SQC)

Trade Of Analysis For Helical Gear Reduction Units

CSC501 Operating Systems Principles. Deadlock

1 [15 points] Frequent Itemsets Generation With Map-Reduce

Mathematics (MEI) Advanced Subsidiary GCE Core 1 (4751) May 2010

CSE 546 Final Exam, Autumn 2013

Unsupervised Anomaly Detection for High Dimensional Data

D1 Discrete Mathematics The Travelling Salesperson problem. The Nearest Neighbour Algorithm The Lower Bound Algorithm The Tour Improvement Algorithm

Alpha-Beta Pruning: Algorithm and Analysis

CS151 Complexity Theory. Lecture 1 April 3, 2017

Technical Report. Results from 200 billion iris cross-comparisons. John Daugman. Number 635. June Computer Laboratory

Classifier Selection. Nicholas Ver Hoeve Craig Martek Ben Gardner

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014

In the Name of God. Lecture 11: Single Layer Perceptrons

Safety analysis and standards Analyse de sécurité et normes Sicherheitsanalyse und Normen

EVACUATION PLANNING IN EARTHQUAKE DISASTERS, USING RS & GIS

Lecture 14 : Online Learning, Stochastic Gradient Descent, Perceptron

CS246 Final Exam, Winter 2011

Chapter 7 Comparison of two independent samples

Alpha-Beta Pruning: Algorithm and Analysis

Review Questions REVIEW QUESTIONS 71

Solar Flux Case Study

Jeff Howbert Introduction to Machine Learning Winter

Evaluation. Andrea Passerini Machine Learning. Evaluation

Midterm Exam Solutions, Spring 2007

Support Vector Machines. CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington

Classification CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2012

Adaptive Binary Integration CFAR Processing for Secondary Surveillance Radar *

Markov Decision Processes

Evaluation requires to define performance measures to be optimized

University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout 2:. The Multivariate Gaussian & Decision Boundaries

The Behavior of a Multichannel Queueing System under Three Queue Disciplines

Ma 530 Power Series II

Mathematics (MEI) Advanced Subsidiary GCE Core 1 (4751) June 2010

The University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.

An optimization model for designing acceptance sampling plan based on cumulative count of conforming run length using minimum angle method

Final Examination CS 540-2: Introduction to Artificial Intelligence

CS 170, Fall 1997 Second Midterm Professor Papadimitriou

CSE-4412(M) Midterm. There are five major questions, each worth 10 points, for a total of 50 points. Points for each sub-question are as indicated.

Numerical algorithms for one and two target optimal controls

hypothesis a claim about the value of some parameter (like p)

CHAPTER 2: QUADRATIC PROGRAMMING

Alpha-Beta Pruning: Algorithm and Analysis

Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms

CPSC 340 Assignment 4 (due November 17 ATE)

Continuous Ordinal Clustering: A Mystery Story 1

Computationally Expensive Multi-objective Optimization. Juliane Müller

Artificial Neural Networks Examination, March 2004

SVM optimization and Kernel methods

Transcription:

Optimization of Containers Inspection at Port-of-Entry E. A. Elsayed, Christina Young, Yada Zhu Department of Industrial and Systems Engineering Mingyu Li, Minge Xie Department of Statistics Rutgers University

Introduction Containers arrive at a port-of-entry for inspection n attributes tested independently Sensors used to classify attributes of a container as safe (d=0) or suspicious (d=1) based on selected threshold values (T i for station i) Overall accept/reject decision based on specified Boolean function of station decisions 2

Simple Container Inspection Procedure Containers arriving at port 95~97% Segregation 3~5% to be inspected Station 1: Image Analysis Fail Result Storage area: Containers to Pass be picked up by receivers Station 2: Physical & Visual Check Pass Result Station 3: PRD & RIID Fail CES Central Examination Site Result Fail Pass 3

Inspection Problem Description Threshold levels affect the decisions and probabilities of misclassification at each station Sequence of inspection stations affects the expected cost and time of inspection per container Inspection policy specifies sequence (S) and T i values Objective Minimize expected cost of inspection, cost of container misclassifications, and expected inspection time Decision Variables Sensor threshold values and sequence of stations

Modeling Approach Assume the unit s true state (x) is 0 or 1 A container attribute value comes from a mixture of two normal distributions, depending on the unit s true state Let r represent the sensor reading returned from a unit, assumed equal to the attribute value 2 r x = 0 Norm( μ0, σ0 ) 2 r x = 1 Norm( μ, σ ) 1 1 For some value T i at station i If measurement r i > threshold level (T i ), then decision for station i, d i =1 5 If r i T i, d i =0

Modeling Approach Assume prior distribution of suspicious containers is known: π = P x = 1 = 1 P x = 0 ( ) ( ) Subscript i is used to indicate association with station i Assume parameters of the two normal distributions are known: μ, μ, σ, σ 0i 1i 0i 1i 6

Probabilities of Error ( i = 0 x = 1) P( r T x 1) P d = = i Ti μ 1i =Φ σ1 i i ( i = 1 x = 0) P( r T x 0) P d = > = i T i 0i = 1 Φ i μ σ 0i 7

Cost of Misclassification The individual results of stations are combined according to defined system Boolean function to reach an overall inspection decision to accept or reject a container This system decision D may or may not agree with the container s true status Probability of false accept, PFA = P ( D = 0 x = 1) Probability of false reject, PFR = P ( D = 1 x = 0) Two sources of container misclassification cost: c FA = cost of false acceptance (undesired cargo) c FR = cost of false rejection (manual unpack) Total cost: = π + ( 1 π) C PFA c PFR c F FA FR 8

Cost of Inspection c i = cost of using i th sensor Expected cost of inspection depends on probability of passing (or failing) sensor i : ( ) ( )( ) ( ) pi = P di = 0 = P di = 0 x= 0 1 π + P di = 0 x= 1 T ( ) i μ 0i Ti μ 1i = 1 π Φ + πφ σ0i σ1 i π q = 1 p = P( d = 1 x = 0)( 1 π ) + P( d = 1 x = 1) i i i i T ( ) i μ 0i Ti μ 1i = 1 π 1 Φ + π 1 Φ σ0i σ1 i π 9

Optimum Inspection Sequence The sequence in which stations are visited affects the expected cost of inspection A sequence which minimizes this cost is known as an optimum sequence Theorem 1: For a series Boolean decision function, inspecting attributes i, i = 1,2, K, n in sequential order is optimum (minimizes expected inspection cost) if and only if:. c / q c / q Kc / q 1 1 2 2 n n A container is suspicious if decision for any station i is 1. In other words: F( d, d, K, d ) = d d... d ( ) 1 2 n 1 2 n 10

Optimum Inspection Sequence Theorem 2: For a parallel Boolean decision function, inspecting attributes i, i = 1,2, K, n in sequential order is optimum (minimizes expected inspection cost) if and only if: c / p c / p Kc / p 1 1 2 2 In other words: Fd (, d, K, d) = d d... d n n ( ) 1 2 n 1 2 n 11

Total Expected Cost Example: parallel Boolean decision function Cost of misclassifications: C F = (False acceptance cost) + (False rejection cost) n n Ti μ 1i Ti μ 0i = πcfa 1 1 Φ + ( 1 π) c FR 1 Φ i= 1 σ1 i i= 1 σ0i 12

Total Expected Cost Example: parallel Boolean decision function Cost of inspection: n i 1 CI = c1 + qj ci i = 2 j = 1 n i 1 Tj μ 0j Tj μ 1j = c1 + c i ( 1 π) 1 Φ + π 1 Φ i = 2 j = 1 σ 0j σ 1j Total expected cost: c = C + C total I F 13

Inspection Time Time for a container to complete inspection at station i denoted t i Optimum sequence with regard to total expected inspection time can be found with similar method to cost Optimum Cost Sequence Similar Methods Optimum Time Sequence 14

Inspection Time t i could be a function of threshold T i, approximated from data Higher Threshold More Pass Decisions Fast Inspection 15

Objectives Multi-Objective Problem min { c, t } Sequence, Threshold Minimize the total expected cost including inspection cost and misclassification cost, c = C + C Minimize the total expected inspection time Some trade-off between objectives Goal: find solutions located along Pareto front Find min of weighted objective function fw for various 1, w ( ST, ) = w 2 1ctotal + w2ttotal, w2 = 1-w1 weights Each solution is a Pareto optimal point for multiobjective problem Take advantage of optimal sequence theorem to improve efficiency of algorithms total total total I F t total 16

Optimum Sequence for Weighted Objective Given fixed weights, optimum sequence theorem can be adapted Change objective from c i to w 1 c i +w 2 t i For parallel Boolean, minimum sequence condition: wc 1 1+ wt 2 1 wc 1 2+ wt 2 2 wc 1 n + wt 2 n... p p p 1 2 Condition for series Boolean: wc 1 1+ wt 2 1 wc 1 2+ wt 2 2 wc 1 n + wt 2 n... q q q 1 2 n n 17

Modified Weighted Sum Algorithm Computationally expensive to solve minimization of weighted objective function Easier if sequence is known Apply optimum sequence given thresholds to compute fw1, w( T) = minf 2 w1, w( ST, ) S 2 Solve min fw 1, w( T ) T 2 Avoiding consideration of all potential sequences improves the efficiency of the algorithm 18

Solution Methods Three methods developed and implemented to compare optimality of results Grid search- complete enumeration of discrete threshold values Two methods involve repetitions with various weights to solve min fw, w( T ) and generate 1 2 Pareto-optimal solutions Matlab fmincon function Genetic algorithm Output graphed (Pareto frontier) Time vs. cost expectations T 19

Numerical Example Three station system using parallel Boolean decision function Cost fixed for each station, c i = 1 Prior π = 0.0002 Distribution parameters µ 0 = [0 0 0] µ 1 = [1 1 1] σ 0 = [0.16 0.2 0.22] σ 1 = [0.3 0.2 0.26] Cost parameters c FA = 100000 c FR = 500 Time related a = [20 20 20] b = [-3-3 -3]

Comparison of Three Solution Methods 12 Grid Search Genetic Algorithm Parallel - Grid Search Parallel - Genetic Algorithm fmincon Parallel - fmincon TIV-set1 TIV-set2 12 11 11 10 10 9 9 C o s t 8 7 6 5 8 7 6 5 4 4 3 3 2 2 1 0 1 2 3 4 5 6 0 1 2 3 4 5 6 Time 0 1 2 3 4 5 6 1

Pareto-Optimal Solutions Output: Graph of time vs. cost trade-off curve Optimal sequence of sensors Threshold level for each sensor Examples of solutions T 1 T 2 T 3 Sequence Cost Time 0.2 0.75 0.35 2-3-1 9.03 1.16

Conclusions Port-of-entry container inspection problem was formulated to determine optimum threshold levels of sensors by minimizing total expected cost and time Estimate threshold-dependent probabilities of false accept and false reject to calculate expected cost of false classification Sequence of inspection affects expected cost and time of inspection but not probabilities of error Compare three approaches to multi-objective problem GA provides dependable set of Pareto solutions 23

Acknowledgment and Website This research is conducted with partial support from ONR grant numbers N00014-05-1-0237, N00014-07- 1-029 and NSF grant number NSFSES 05-18543 to Rutgers University For further information and related papers, please visit the DIMACS website http://dimacs.rutgers.edu/workshops/portofentry 24