Uncertainty Quantification in Performance Evaluation of Manufacturing Processes

Transcription

1 Uncertainty Quantification in Performance Evaluation of Manufacturing Processes Manufacturing Systems October 27, 2014 Saideep Nannapaneni, Sankaran Mahadevan Vanderbilt University, Nashville, TN Acknowledgement Funding support: NIST (Cooperative Agreement NANB14H036, Monitor: Sudarsan Rachuri) Technical help: Seung-Jun Shin, Senthilkumaran Kumaraguru, Anantha Narayanan, Sudarsan Rachuri

2 Why Uncertainty Quantification? Uncertainty Sources Data Sources Process variability Operational data Reliability data Material uncertainty Evaluation Uncertainty Model uncertainty Legacy system data Information Fusion Test data Sensor uncertainty Simulation data Mathematical models Expert Opinion Performance evaluation affected by available data and uncertainty Uncertainty sources linear or non-linear combination, occur at different stages Information sources heterogeneous A systematic approach is necessary for information fusion and uncertainty quantification. 2

3 Aleatory vs. epistemic uncertainty Four types of quantities 1. Deterministic known value (fixed constant) 2. Stochastic random variability Distribution statistics are known Aleatory, irreducible uncertainty 3. Quantity is deterministic, but unknown Epistemic, reducible uncertainty True value 4. Quantity is stochastic, but distribution characteristics are unknown Has both aleatory and epistemic uncertainty Unknown distribution type Unknown distribution parameters 3

4 Bayesian network a b d e g a, b,.. component nodes (variables) g system-level output c f U - set of all nodes { a, b,, g } Joint PDF of all variables π(u) = π(a) π(b a) π(c a) π(d c) π(e b, d) π(f ) π(g e, f ) PDF of node g π(g) = π(u) da db df Data m b e With new observed data m π(u, m) = π(u) π(m b) a c d f g 4

5 Methodology for UQ (1/2) Construction of Bayesian Network Physics-based Models Use available models based on process physics (domain knowledge) Eg: Differential equations Construction of Bayesian Network Data-driven approach Build surrogate models using data e.g., Regression, Polynomial models, Gaussian Process Structure Learning algorithms Constraint-based and Score-based algorithms Hybrid approach Combination of physics-based and data-driven approaches Partial structure of the BN using domain knowledge Learn other parts of network using data Bayesian Model Calibration/Updating Uncertainty Propagation Bartram & Mahadevan, SCHM,

6 Methodology for UQ (2/2) Bayesian Model Calibration/Updating Estimate unknown (epistemic) parameters using data in a probabilistic manner Bayes theorem Likelihood Prior Pr Pr Pr Pr, Posterior Evidence Sampling from Posterior: Markov Chain Monte Carlo (MCMC) Uncertainty Propagation Obtain updated posterior distribution of the Quantity of Interest (QoI) Monte Carlo Sampling - samples from posterior distribution Samples are propagated through the network Construction of Bayesian Network Bayesian Model Calibration, Updating Uncertainty Propagation Posterior distribution of QoI (Performance Metric) 6

7 Scalability Dimension Reduction Size of Production Network increases Increase in Epistemic Parameters Goal: Obtain a reduced set of variables such that there is no significant change in statistics of QoI Increase in Computational effort Obtain prior sensitivity indices by performing sensitivity analysis using prior distributions Assume a threshold value for sensitivity index. If sensitivity index < threshold value, assume that variable to be deterministic at the nominal value. Approach: Global Sensitivity Analysis Assess the variance contribution of each of the variables to the variance of the QoI., 1 7

8 Sensitivity Analysis under Epistemic Uncertainty Global Sensitivity Analysis Applicable to Y = G(X) where G is deterministic One value of X One value of Y Define auxiliary variables Can include both aleatory & epistemic sources Data uncertainty Model uncertainty P Transfer Function Distribution X G(X) Y Introduce auxiliary variable U represent variability U (0, 1) X U f ( x P) dx X F -1 (U, P) U, P X Sankararaman & Mahadevan, RESS,

9 Handling Big Data HDFS : Hadoop Distributed File System To store large amounts of data in databases MapReduce A parallel processing framework for large-scale data processing. Model Building using all data computationally unaffordable Data Reduction and Feature Selection techniques required Clustering Selection of Data using Design of Experiments (DoE) Apache Mahout : Machine learning library for Hadoop The reduced dataset can be used for Bayesian Network construction 9

10 Summary Methodology Construction of Bayesian Network Data Reduction, Dimension Reduction Construction of Bayesian Network Bayesian Model Calibration, Updating Bayesian Model Calibration, Updating Uncertainty Propagation Without Dimension/Data Reduction Uncertainty Propagation With Data/ Dimension Reduction 10

11 Demonstration Problem Metal Part GTAW Arc Welding Metallic Module OR OR Plastic Grains Plastic Part GMAW Product Module Injection Molding Process Metal Powder Machine1 Metal Part Threaded Fastening e.g. Power Train Die Casting Machine2 Machine3 Turning 11

12 Injection Molding Goal: UQ in Energy Consumption of an Injection Molding Process Three stages Melting of polymer Injection of polymer into the mold Cooling of polymer to form product Source: 12

13 Melting Process Power used for melting the dye Volume of shot Energy consumed for melting 1 Flow rate and Average flow rate Δ 100 Legend = specific gravity of polymer = heat capacity of polymer = Injection temperature = polymer temperature = polymer heat of fusion = Volume of mold = shrinkage Δ = buffer = total volume injected 13

14 Injection Process Injection time 2 1Δ 1000 Energy consumed in injection process Legend = number of cavities 14

15 Cooling Process Cooling Time ln 4 Energy consumed in cooling process Legend = maximum wall thickness of mold = thermal diffusivity = Injection temperature = mold temperature = ejection temperature COP = coefficient of performance of cooling equipment 15

16 Total Energy Consumption Energy consumed in making a part Δ Total Electricity Cost Reset Energy Total Cycle Time Reset time t Legend = maximum wall thickness of mold = Energy consumed for resetting = Power required for basic energy consuming units, when machine is in stand by mode = dry cycle time = maximum clamp stroke in the mold = unit cost in USA = Total cycle time,,,, = Efficiencies of injection, reset, cooling, heating, machine power = depth of the part = output per day = number of days 16

17 Injection Molding Bayesian Network Constants Calibration Parameters (Epistemic) Deterministic Observations Aleatory 17

18 Injection Molding Materials Several types of materials used in injection molding Metals Glass Elastomers Thermoplastic polymers Thermosetting polymers Polyethylene properties (assumed) Specific gravity = 960 kg/m 3 Heat capacity = 2250 J/kg-K Thermal diffusivity = 2.27 x 10-7 m 2 /s Shrinkage = Heat of fusion = 240 kj/kg Nylon Polyethylene Polypropylene Polyvinyl chloride Polystyrene Acrylic Teflon 18

19 Injection Molding Process Parameters Synthetic Dataset Parameter Value Injection temperature 210 ( o C) Mold temperature 35 ( o C) Ejection temperature 50 ( o C) Injection pressure Flow rate 90 MPa 1.67e-5 / Coefficient of performance 0.7 All efficiency coefficients 0.7 Number of cavities 1 Fraction Δ Thickness m Volume of part m 3 Unit Cost 10 cents/kwh Parts per day 10,000 Number of days 28 19

20 Injection Molding Process - Synthetic dataset Error in temperature measurements ( o C) ~0,3 Error in cycle time measurements (s) ~0,2 Error in injection pressure measurements (MPa) ~ 0,4 Initial temperature of polymer ( o C) 30,2 Density of polymer (kg/m 3 ) 960,10 Heat Capacity (J/kg-K) 2250,20 Flow Rate (m 3 /s) ~0,1.5 6 Parameter Prior Distribution ( o C) Uniform (205,220) ( o C) Uniform (45,60) ( o C) Uniform (30,45) (MPa) Uniform (88,95) (m 3 /s) Uniform (1.6e-5,1.75e-5). 100 data points are generated and used in calibration process 20

21 Results Prior Sensitivity Analysis Variable Type of Uncertainty Prior Individual effect Prior - Total effect Remarks Epistemic Significant Aleatory Significant Epistemic Significant Aleatory Significant Epistemic Insignificant Aleatory Insignificant Aleatory Significant Sensitivity index < 0.01 (Threshold value) Insignificant Variables retained for Calibration : Injection Temperature, Ejection Temperature 21

22 Results - Prior and Posterior Plots (Epistemic variables) Injection Temperature Energy consumed per part Ejection Temperature 22

23 Results Prior and Posterior Sensitivity Analysis Variable Type of Uncertainty Prior Individual effect Prior - Total effect Remarks Posterior Individual effect Posterior Total effect Remarks Epistemic Significant Insignificant Aleatory Significant Significant Epistemic Significant Insignificant Aleatory Significant Significant Epistemic Insignificant Insignificant Aleatory Insignificant Significant Aleatory Significant Significant Uncertainty in and greatly reduced after calibration process (Effects Significant to Insignificant) 23

24 Illustrative Example Welding Process Energy Consumption (1/2) Goal: UQ in Energy Consumption of a Welding Process Volume of the Weld Theoretical Minimum Energy (filler and metal are the same) Input Energy (Laser) Efficiency of welding process Legend L = Length of weld = density of material = Heat capacity of material = Final Temperature = Initial Temperature = Latent Heat = Voltage = Current = Welding Speed 24

25 Energy Consumption in Welding Process (2/2) Total Power Total Electricity Cost Legend = Total weld time = Number of days in service = Unit cost for electricity in USA 25

26 Welding Process Bayesian Network Constants Calibration Parameters (Epistemic) Deterministic Observations Aleatory 26

27 Synthetic Dataset (1/2) Parameter Initial Temperature ( ) (K) Final Temperature ( ) (K) Heat Capacity ( ) (J/kgK) Density () (kg/m 3 ) Latent Heat () (kj/kg) Weld Zone parameters (mm) Length of weld () (mm) Value 303, ,10 500,5 8238,10 270,3 8.5, ,0.5 2,0.1 15,0.5 11,1 500,10 Voltage () (V) 20 Current () (A) 250 Weld Speed () (mm/min) cents/kwh 27

28 Synthetic Dataset(2/2) Error in length measurement (mm), ~ 0,0.01 Error in current measurement (A), ~ 0,2 Observation Data 8.5,0.5 0, ,0.5 0, ,1 0, ,2 Parameter Prior Distributions Prior Distributions Uniform (8.3,8.6) Uniform (0.2,0.7) Uniform (2.5,2.8) Uniform (0.3,0.6) Uniform (10,13) Uniform (0.8,1.3) Uniform (235,260) Uniform (1.7,2.5) - Standard deviation in measurement error of current 28

29 Results Prior Sensitivity Analysis Parameter Type of uncertainty Prior Individual effect Prior Total effect Remarks Aleatory Significant Epistemic Insignificant Epistemic 6.44 x x 10-3 Insignificant Aleatory Significant Epistemic Insignificant Epistemic x Insignificant Aleatory Significant Epistemic Significant Epistemic x Insignificant Aleatory Significant Aleatory Significant Aleatory Insignificant Aleatory Insignificant Aleatory Insignificant Aleatory x x 10-6 Insignificant Aleatory Insignificant Aleatory Significant Threshold value 0.01 Significant Epistemic variables - 29

30 Results Prior and Posterior Plots (Epistemic Variables) Weld parameter e Theoretical energy consumption per weld Prior and Posterior no major change, most of the uncertain variables are aleatory (uncertainty can not be reduced) 30

31 Results Prior and Posterior Sensitivity Analysis Parameter Type of uncertainty Prior Individual effect Prior Total effect Remarks Posterior Individual effect Posterior Total effect Remarks Aleatory Significant Significant Epistemic Insignificant Insignificant Epistemic 6.44 x x 10-3 Insignificant x x 10-5 Insignificant Aleatory Significant Significant Epistemic Insignificant Insignificant Epistemic x Insignificant x Insignificant Aleatory Significant Significant Epistemic Significant Insignificant Epistemic x Insignificant x Insignificant Aleatory Significant Significant Aleatory Significant Insignificant Aleatory Insignificant Insignificant Aleatory Insignificant Insignificant Aleatory Insignificant Insignificant Aleatory x x 10-6 Insignificant x x 10-6 Insignificant Aleatory Insignificant Insignificant Aleatory Significant Significant Uncertainty in greatly reduced after calibration process (Significant to Insignificant) 31

32 Comprehensive framework for uncertainty integration and management Bayesian network j Include all available models and data Include calibration, verification and validation results at multiple levels e d Heterogeneous data of varying precision g and cost c Models of varying complexity, accuracy, s cost Data on different but related systems Bayesian Network o n r Facilitates Forward problem: UQ in overall system-level prediction Integrate all available sources of information and results of modeling/testing/monitoring Inverse problem: Resource allocation at various stages of system life cycle Model development, data collection, system design, manufacturing, operations, health monitoring, risk management 32

33 Summary of Analyses Information Retrieval retrieve required information from database Dimension Reduction Select a subset of features/parameters Data Reduction Reduce amount of data through clustering Model Building Build a Bayesian Network Uncertainty Propagation Monte Carlo simulation Sensitivity Analysis (Aleatory vs. Epistemic) Variance decomposition Performance Prediction Monte Carlo simulation Temporal variation -- Dynamic Bayesian Network Diagnosis, Prognosis Classification, Particle filtering Decision-Making, Resource allocation 33

34 Future Work Derive Bayesian network from process and model libraries Include text and image data, along with numerical data in UQ Apply to production network with multiple processes Analysis over time with streaming data (Dynamic Bayesian Network) Explore various problems in manufacturing Process Monitoring (Dynamic Tracking) For diagnosis Stochastic Process Optimization Adjust parameters to meet the requirements Risk Management Reduce performance variability to be within desired limits Resource Allocation maximize information maximize reduction in uncertainty 34