Everybody uses modeling and simulation, even without being aware of doing it!

Size: px
Start display at page:

Download "Everybody uses modeling and simulation, even without being aware of doing it!"

Transcription

1 Everybody uses modeling and simulation, even without being aware of doing it!

2 What is this course about? Modeling as a general tool to solve complex scientific / engineering problems, not just a mathematical equation Computational modeling & simulation to solve complex problems & to reduce experimental costs A better exploration of the information content of experimental data Answer questions such as What is a mathematical model? What types of models do exist? Which model is appropriate for a particular problem? How does one set up a mathematical model? What is simulation, parameter estimation, validation?

3 Course Content Mechanistic Models Differential equations Variational Principle Solution to ODEs Classical ODE systems Cellular automata Others: inverse problems, difference equation, etc Phenomenological Models Regression Neural networks Others: power law, networks, etc

4 Course Assignment & Evaluation I hope it to help your research, now or in the future Course project (term project throughout the course): 60% Select a problem in your area of interest Progress report (5%) Midterm report + presentation (20%) Final report + presentation (35%) Critical paper review (20%) Homework (10%) Participation (10%)

5 C1 Principles of Mathematical Modeling : Computational Modeling and Simulation Instructor: Linwei Wang

6 A Complex World Needs Models Engineers/scientists try to understand, develop, or optimize complex systems System: the object of interest. Plant cell, an atom, a organ, an electric circuit, a galaxy, To break the complexity of a system, simplified descriptions of the system (i.e., models) are needed to make the problem tractable Examples: a car that refuses to start

7 A Complex World Needs Models Problem: a car that refuses to start What is the system? What is the model (assuming we know to check the fuel & battery from experience)? Tank Ba.ery Car as a system Car as a model

8 What is a Model? To an observer B, an object A* is a model of an object A to the extent that B can use A* to answer questions that interest him about A Goal driven What is a good model? The best model is the simplest model that still serves its purpose, that is, which is still complex enough to help us understand a system and to solve problems. Seen in terms of a simple model, the complexity of a complex system will no longer obstruct our view, and we will virtually be able to look through the complexity of the system at the heart of things

9 Modeling and Simulation Scheme Definitions Of a problem to be solved or a question to be answered Of a system, i.e., a part of reality that pertains to the problem or question Systems Analysis (literature; experimental design) Identify parts of the system that are relevant for the problem or question Modeling Develop a model of the system based on the systems analysis Simulation Apply the model to the problem or question Derive a strategy to solve the problem or answer the question Validation (model-data fit does not guarantee this) Does the strategy derived solve the problem or answer the question?

10 What is Simulation & System? Simulation The application of a model with the objective to derive strategies that help solve a problem or answer a question pertaining to the system Simulare: to pretend (The model pretends to be the system) System Any kind of object to which we have a question that can be answered mathematically

11 Mathematics as a Natural Modeling Input-output systems Language Must be observable Transform input parameters to output parameters Can be naturally seen as a mathematical function y=f(x) A simplified representation of the real system in mathematical terms The mapping of the internal mechanics of real systems into mathematical operations Proved to be extremely fruitful to the understanding, optimization, or development of systems

12 What is a Mathematical Model? A mathematical model is an abstract, simplified, mathematical construct related to a part of reality and created for a particular purpose A triplet (S, Q, M) S: system Q: question relating to S M: a set of mathematical statement can be used to answer Q Importance of Q Example: mechanical system S Q: behavior of S at moderate velocity: M = {Newtonian mechanics} Q: behavior of S at velocity close to the speed of light: M = {relativistic mechanics}

13 A Very Simple Example We want to minimize the material consumption to build a cylindrical tin having a volume of 1 L S: the cylindrical tin Q: minimize the material consumption M: {!r 2 h =1, min(2!r 2 + 2!rh) } r,h

14 State Variables and System Parameters Reduced system S r The description of S in terms of the mathematical model The cylindrical tin example, Sr = {r, h} Neglecting other factors such as the thickness, material, color, roughness, etc, of the metal sheets State variables Describe the state of S in terms of M and are required to answer Q: describe the system properties we are interested in Tin example: s = A System parameters Mathematical quantities that describe the properties of S in terms of M, and are needed to compute the state variables: describe the system properties needed to obtain the state variables mathematically Tin example: p = {r, h}

15 Another Simple Example To predict the time evolution of the overall biomass of a plant System: plant Model: m = e r (r: growth rate) Reduced system: S r = {r} Justify your Sr The details of S r depend on the question Q to be answered. Ideally it will consist of no more than exactly those properties of the original system that are important to answer the Q being investigated Model guides the experiments: Typically parameters of Sr are those that need experimental characterization

16 Mathematical Models as Door Opener Translating originally non-mathematical problems into the language of mathematics, where powerful mathematical methods become applicable System S Ques5on Q Mathema5cal Model (S, Q, M) Answer A Real world Mathema5cal Problem M Answer A* Mathema.cs

17 How to Set Up Simple Models Define the unknowns Translate the problem into mathematical formulations Start with the simplest models!

18 What Types of Models Exist? Phenomenological models vs. Mechanistic models Phenomenal model Constructed based on experimental data only, using no a priori information about S Treat S as a black box AKA Empirical models, statistical models, data-driven models, blackbox model, etc Mechanistic model Some of the statements in M are based on a priori information about S Treat S as a white box or, often times, a grey box

19 Another Simple Example System 1 with input x (N) and output y (cm) x System 1 y X (N) y(cm) Black- box system Input- output data Phenomenological model Data fitting: y = ax + b a = 0.33, b = -0.5

20 The Same Simple Example Now if we assume that the internal mechanics of system a looks like this: y = kx, estimate k from the data

21 Phenomenological vs. Mechanistic Models Mechanistic models: Allow better predictions of system behavior Phenomenological models are expected to be valid only close to the range of the data Allow better predictions of modified system behaviors Consider replacing the previous system by one that has 2 springs Physically interpretable parameters Particularly important when we want to optimize system performance Phenomenological models: Universally applicable Mechanistic models require a priori knowledge of the system Might be more efficient when dealing with a very complex system Basically explains the popularity of neural network methods No risk of wrong prior knowledge

22 More Classification of Models Stationary vs. instationary models Whether at least one of the system parameters or state variables depends on time Distributed vs. lumped models Whether at least one of the system parameters or state variables depends on space variables Direct vs. inverse models

23 From Black to White Box Models Electrical circuits Mechanical Chemical Biological Economic Social Psychological Design Control Analysis Predic5on Specula5on White box Black box

24 Don ts of Mathematical Modeling Don t believe that the model is the reality Don t extrapolate beyond the region of fit Don t distort reality to fit the model Don t retain a discredited model Don t fall in love with your model Golomb S. W., Mathematical models uses and limitations. Simulation 4 (14), , 1970

25 Summary Definitions Validation System analysis (Hypothesis & abstract) Simulation Modeling

26 Course Outline Mechanistic Models Differential equations Variational Principle Solution to ODEs Classical ODE systems Cellular automata Others: inverse problems, difference equation, etc Phenomenological Models Regression Neural networks Others: power law, networks, etc

Mathematical Modeling and Simulation

Mathematical Modeling and Simulation Kai Velten Mathematical Modeling and Simulation Introduction for Scientists ar d Engineers WILLYNCH Verlag (irribli & Co. l

More information

Modelling environmental systems

Modelling environmental systems Modelling environmental systems Some words on modelling the hitchhiker s guide to modelling Problem perception Definition of the scope of the model Clearly define your objectives Allow for incremental

More information

Mathematical Modeling of Chemical Processes. Aisha Osman Mohamed Ahmed Department of Chemical Engineering Faculty of Engineering, Red Sea University

Mathematical Modeling of Chemical Processes. Aisha Osman Mohamed Ahmed Department of Chemical Engineering Faculty of Engineering, Red Sea University Mathematical Modeling of Chemical Processes Aisha Osman Mohamed Ahmed Department of Chemical Engineering Faculty of Engineering, Red Sea University Chapter Objectives End of this chapter, you should be

More information

DS-GA 1003: Machine Learning and Computational Statistics Homework 6: Generalized Hinge Loss and Multiclass SVM

DS-GA 1003: Machine Learning and Computational Statistics Homework 6: Generalized Hinge Loss and Multiclass SVM DS-GA 1003: Machine Learning and Computational Statistics Homework 6: Generalized Hinge Loss and Multiclass SVM Due: Monday, April 11, 2016, at 6pm (Submit via NYU Classes) Instructions: Your answers to

More information

Lab #2: Newton s Second Law

Lab #2: Newton s Second Law Physics 144 Chowdary How Things Work Spring 2006 Name: Partners Name(s): Lab #2: Newton s Second Law Introduction In today s exploration, we will investigate the consequences of what is one of the single

More information

11. Further Issues in Using OLS with TS Data

11. Further Issues in Using OLS with TS Data 11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,

More information

Linear Models in Econometrics

Linear Models in Econometrics Linear Models in Econometrics Nicky Grant At the most fundamental level econometrics is the development of statistical techniques suited primarily to answering economic questions and testing economic theories.

More information

A Summary of Economic Methodology

A Summary of Economic Methodology A Summary of Economic Methodology I. The Methodology of Theoretical Economics All economic analysis begins with theory, based in part on intuitive insights that naturally spring from certain stylized facts,

More information

Least Mean Squares Regression

Least Mean Squares Regression Least Mean Squares Regression Machine Learning Spring 2018 The slides are mainly from Vivek Srikumar 1 Lecture Overview Linear classifiers What functions do linear classifiers express? Least Squares Method

More information

Introduction to Control (034040) lecture no. 2

Introduction to Control (034040) lecture no. 2 Introduction to Control (034040) lecture no. 2 Leonid Mirkin Faculty of Mechanical Engineering Technion IIT Setup: Abstract control problem to begin with y P(s) u where P is a plant u is a control signal

More information

IFT Lecture 7 Elements of statistical learning theory

IFT Lecture 7 Elements of statistical learning theory IFT 6085 - Lecture 7 Elements of statistical learning theory This version of the notes has not yet been thoroughly checked. Please report any bugs to the scribes or instructor. Scribe(s): Brady Neal and

More information

You have 3 hours to complete the exam. Some questions are harder than others, so don t spend too long on any one question.

You have 3 hours to complete the exam. Some questions are harder than others, so don t spend too long on any one question. Data 8 Fall 2017 Foundations of Data Science Final INSTRUCTIONS You have 3 hours to complete the exam. Some questions are harder than others, so don t spend too long on any one question. The exam is closed

More information

Definition of differential equations and their classification. Methods of solution of first-order differential equations

Definition of differential equations and their classification. Methods of solution of first-order differential equations Introduction to differential equations: overview Definition of differential equations and their classification Solutions of differential equations Initial value problems Existence and uniqueness Mathematical

More information

CS168: The Modern Algorithmic Toolbox Lecture #6: Regularization

CS168: The Modern Algorithmic Toolbox Lecture #6: Regularization CS168: The Modern Algorithmic Toolbox Lecture #6: Regularization Tim Roughgarden & Gregory Valiant April 18, 2018 1 The Context and Intuition behind Regularization Given a dataset, and some class of models

More information

Classification. The goal: map from input X to a label Y. Y has a discrete set of possible values. We focused on binary Y (values 0 or 1).

Classification. The goal: map from input X to a label Y. Y has a discrete set of possible values. We focused on binary Y (values 0 or 1). Regression and PCA Classification The goal: map from input X to a label Y. Y has a discrete set of possible values We focused on binary Y (values 0 or 1). But we also discussed larger number of classes

More information

Math 112 Group Activity: The Vertical Speed of a Shell

Math 112 Group Activity: The Vertical Speed of a Shell Name: Section: Math 112 Group Activity: The Vertical Speed of a Shell A shell is fired straight up by a mortar. The graph below shows its altitude as a function of time. 400 300 altitude (in feet) 200

More information

High-dimensional probability and statistics for the data sciences

High-dimensional probability and statistics for the data sciences High-dimensional probability and statistics for the data sciences Larry Goldstein and Mahdi Soltanolkotabi Motivation August 21, 2017 Motivation August 21, 2017 Please ask questions! Traditionally mathematics

More information

Acceleration Due to Gravity in my Country

Acceleration Due to Gravity in my Country Acceleration Due to Gravity in my Country http://blossoms.mit.edu/video/lahlouh.html Hello my friends! I believe that you have discussed with your teacher the influences of gravity on our lives, and we

More information

Introduction To Mathematical Modeling

Introduction To Mathematical Modeling CHAPTER 1 Introduction To Mathematical Modeling In his book The Possible and the Actual, published by the University of Washington Press as a part of the Jessie and John Danz Lectures, Françis Jacob 1920-2013),

More information

Least Mean Squares Regression. Machine Learning Fall 2017

Least Mean Squares Regression. Machine Learning Fall 2017 Least Mean Squares Regression Machine Learning Fall 2017 1 Lecture Overview Linear classifiers What func?ons do linear classifiers express? Least Squares Method for Regression 2 Where are we? Linear classifiers

More information

September 16, 2004 The NEURON Book: Chapter 2

September 16, 2004 The NEURON Book: Chapter 2 Chapter 2 The ing perspective This and the following chapter deal with concepts that are not NEURON-specific but instead pertain equally well to any tools used for neural ing. Why? In order to achieve

More information

Discrete Mathematics and Probability Theory Summer 2015 Chung-Wei Lin Midterm 1

Discrete Mathematics and Probability Theory Summer 2015 Chung-Wei Lin Midterm 1 CS 70 Discrete Mathematics and Probability Theory Summer 2015 Chung-Wei Lin Midterm 1 PRINT Your Name:, last) first) SIGN Your Name: PRINT Your Student ID: CIRCLE your exam room: 2050 VLSB 10 EVANS OTHER

More information

Lecture 13.1 :! Electromagnetic Induction Continued

Lecture 13.1 :! Electromagnetic Induction Continued Lecture 13.1 :! Electromagnetic Induction Continued Lecture Outline:! Faraday s Law! Induced Fields! Applications! Textbook Reading:! Ch. 33.5-33.7 April 7, 2015 1 Announcements! Homework #10 due on Tuesday,

More information

Using regression to study economic relationships is called econometrics. econo = of or pertaining to the economy. metrics = measurement

Using regression to study economic relationships is called econometrics. econo = of or pertaining to the economy. metrics = measurement EconS 450 Forecasting part 3 Forecasting with Regression Using regression to study economic relationships is called econometrics econo = of or pertaining to the economy metrics = measurement Econometrics

More information

In this chapter, you will study the normal distribution, the standard normal, and applications associated with them.

In this chapter, you will study the normal distribution, the standard normal, and applications associated with them. The Normal Distribution The normal distribution is the most important of all the distributions. It is widely used and even more widely abused. Its graph is bell-shaped. You see the bell curve in almost

More information

First Order Rate Laws and the Kinetics Mechanism Simulation Program

First Order Rate Laws and the Kinetics Mechanism Simulation Program First Order Rate Laws and the Kinetics Mechanism Simulation Program The Kinetics Mechanism Simulation program (kine.html) is useful for building models in a wide variety of areas, including population

More information

CSE446: non-parametric methods Spring 2017

CSE446: non-parametric methods Spring 2017 CSE446: non-parametric methods Spring 2017 Ali Farhadi Slides adapted from Carlos Guestrin and Luke Zettlemoyer Linear Regression: What can go wrong? What do we do if the bias is too strong? Might want

More information

Topic 1: 1D Motion PHYSICS 231

Topic 1: 1D Motion PHYSICS 231 Topic 1: 1D Motion PHYSICS 231 Current Assignments Reading Chapter 1.5 and 3 due Tuesday, Jan 18, beginning of class Homework Set 1 already open (covers this week) due Thursday, Jan 20, 11 pm Recommended

More information

Introduction to Scientific Modeling Stephanie Forrest Dept. of Computer Science Univ. of New Mexico Albuquerque, NM

Introduction to Scientific Modeling Stephanie Forrest Dept. of Computer Science Univ. of New Mexico Albuquerque, NM Introduction to Scientific Modeling Stephanie Forrest Dept. of Computer Science Univ. of New Mexico Albuquerque, NM August, 20112 http://cs.unm.edu/~forrest forrest@cs.unm.edu " Introduction" The three

More information

12 Statistical Justifications; the Bias-Variance Decomposition

12 Statistical Justifications; the Bias-Variance Decomposition Statistical Justifications; the Bias-Variance Decomposition 65 12 Statistical Justifications; the Bias-Variance Decomposition STATISTICAL JUSTIFICATIONS FOR REGRESSION [So far, I ve talked about regression

More information

Sociology 593 Exam 2 Answer Key March 28, 2002

Sociology 593 Exam 2 Answer Key March 28, 2002 Sociology 59 Exam Answer Key March 8, 00 I. True-False. (0 points) Indicate whether the following statements are true or false. If false, briefly explain why.. A variable is called CATHOLIC. This probably

More information

Department of Computer and Information Science and Engineering. CAP4770/CAP5771 Fall Midterm Exam. Instructor: Prof.

Department of Computer and Information Science and Engineering. CAP4770/CAP5771 Fall Midterm Exam. Instructor: Prof. Department of Computer and Information Science and Engineering UNIVERSITY OF FLORIDA CAP4770/CAP5771 Fall 2016 Midterm Exam Instructor: Prof. Daisy Zhe Wang This is a in-class, closed-book exam. This exam

More information

About this class. Maximizing the Margin. Maximum margin classifiers. Picture of large and small margin hyperplanes

About this class. Maximizing the Margin. Maximum margin classifiers. Picture of large and small margin hyperplanes About this class Maximum margin classifiers SVMs: geometric derivation of the primal problem Statement of the dual problem The kernel trick SVMs as the solution to a regularization problem Maximizing the

More information

Energy in Animals Classwork. 3) Complete the following chart to show what Energy is used for in animals: Use of Energy Description (slides )

Energy in Animals Classwork. 3) Complete the following chart to show what Energy is used for in animals: Use of Energy Description (slides ) Energy in Animals Classwork 5 th Grade PSI 1) Define Energy. Give an example. 2) Why do animals need to eat? 3) Complete the following chart to show what Energy is used for in animals: Use of Energy Description

More information

What is the computational cost of automating brilliance or serendipity? (Computational complexity & P vs NP) COS 116, Spring 2010 Adam Finkelstein

What is the computational cost of automating brilliance or serendipity? (Computational complexity & P vs NP) COS 116, Spring 2010 Adam Finkelstein What is the computational cost of automating brilliance or serendipity? (Computational complexity & P vs NP) COS 116, Spring 2010 Adam Finkelstein Combination lock Why is it secure? (Assume it cannot be

More information

The Kernel Trick, Gram Matrices, and Feature Extraction. CS6787 Lecture 4 Fall 2017

The Kernel Trick, Gram Matrices, and Feature Extraction. CS6787 Lecture 4 Fall 2017 The Kernel Trick, Gram Matrices, and Feature Extraction CS6787 Lecture 4 Fall 2017 Momentum for Principle Component Analysis CS6787 Lecture 3.1 Fall 2017 Principle Component Analysis Setting: find the

More information

1 Distributional problems

1 Distributional problems CSCI 5170: Computational Complexity Lecture 6 The Chinese University of Hong Kong, Spring 2016 23 February 2016 The theory of NP-completeness has been applied to explain why brute-force search is essentially

More information

Formal Definition of Computation. August 28, 2013

Formal Definition of Computation. August 28, 2013 August 28, 2013 Computation model The model of computation considered so far is the work performed by a finite automaton Finite automata were described informally, using state diagrams, and formally, as

More information

13 : Variational Inference: Loopy Belief Propagation and Mean Field

13 : Variational Inference: Loopy Belief Propagation and Mean Field 10-708: Probabilistic Graphical Models 10-708, Spring 2012 13 : Variational Inference: Loopy Belief Propagation and Mean Field Lecturer: Eric P. Xing Scribes: Peter Schulam and William Wang 1 Introduction

More information

Astronomy 301G: Revolutionary Ideas in Science. Getting Started. What is Science? Richard Feynman ( CE) The Uncertainty of Science

Astronomy 301G: Revolutionary Ideas in Science. Getting Started. What is Science? Richard Feynman ( CE) The Uncertainty of Science Astronomy 301G: Revolutionary Ideas in Science Getting Started What is Science? Reading Assignment: What s the Matter? Readings in Physics Foreword & Introduction Richard Feynman (1918-1988 CE) The Uncertainty

More information

2 Approaches To Developing Design Ground Motions

2 Approaches To Developing Design Ground Motions 2 Approaches To Developing Design Ground Motions There are two basic approaches to developing design ground motions that are commonly used in practice: deterministic and probabilistic. While both approaches

More information

Course 16:198:520: Introduction To Artificial Intelligence Lecture 13. Decision Making. Abdeslam Boularias. Wednesday, December 7, 2016

Course 16:198:520: Introduction To Artificial Intelligence Lecture 13. Decision Making. Abdeslam Boularias. Wednesday, December 7, 2016 Course 16:198:520: Introduction To Artificial Intelligence Lecture 13 Decision Making Abdeslam Boularias Wednesday, December 7, 2016 1 / 45 Overview We consider probabilistic temporal models where the

More information

Theory and Methods for the Analysis of Social Networks

Theory and Methods for the Analysis of Social Networks Theory and Methods for the Analysis of Social Networks Alexander Volfovsky Department of Statistical Science, Duke University Lecture 1: January 16, 2018 1 / 35 Outline Jan 11 : Brief intro and Guest lecture

More information

Outline. Nature of the Problem. Nature of the Problem. Basic Econometrics in Transportation. Autocorrelation

Outline. Nature of the Problem. Nature of the Problem. Basic Econometrics in Transportation. Autocorrelation 1/30 Outline Basic Econometrics in Transportation Autocorrelation Amir Samimi What is the nature of autocorrelation? What are the theoretical and practical consequences of autocorrelation? Since the assumption

More information

Modelling biological oscillations

Modelling biological oscillations Modelling biological oscillations Shan He School for Computational Science University of Birmingham Module 06-23836: Computational Modelling with MATLAB Outline Outline of Topics Van der Pol equation Van

More information

Midterm 2 - Solutions

Midterm 2 - Solutions Ecn 102 - Analysis of Economic Data University of California - Davis February 24, 2010 Instructor: John Parman Midterm 2 - Solutions You have until 10:20am to complete this exam. Please remember to put

More information

System Modeling. Lecture-2. Emam Fathy Department of Electrical and Control Engineering

System Modeling. Lecture-2. Emam Fathy Department of Electrical and Control Engineering System Modeling Lecture-2 Emam Fathy Department of Electrical and Control Engineering email: emfmz@yahoo.com 1 Types of Systems Static System: If a system does not change with time, it is called a static

More information

Math 115 Spring 11 Written Homework 10 Solutions

Math 115 Spring 11 Written Homework 10 Solutions Math 5 Spring Written Homework 0 Solutions. For following its, state what indeterminate form the its are in and evaluate the its. (a) 3x 4x 4 x x 8 Solution: This is in indeterminate form 0. Algebraically,

More information

Where we ended last time:

Where we ended last time: Review Where we ended last time: A nuclear power plant generates 10 million Watts of power nonstop for a day. How much less do the fuel rods weigh at the end of the day? (Careful with units!) A. around

More information

CSE 20 DISCRETE MATH. Fall

CSE 20 DISCRETE MATH. Fall CSE 20 DISCRETE MATH Fall 2017 http://cseweb.ucsd.edu/classes/fa17/cse20-ab/ Today's learning goals Distinguish between a theorem, an axiom, lemma, a corollary, and a conjecture. Recognize direct proofs

More information

Math 241 Final Exam, Spring 2013

Math 241 Final Exam, Spring 2013 Math 241 Final Exam, Spring 2013 Name: Section number: Instructor: Read all of the following information before starting the exam. Question Points Score 1 5 2 5 3 12 4 10 5 17 6 15 7 6 8 12 9 12 10 14

More information

6.080 / Great Ideas in Theoretical Computer Science Spring 2008

6.080 / Great Ideas in Theoretical Computer Science Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 6.080 / 6.089 Great Ideas in Theoretical Computer Science Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

AP Statistics. Chapter 9 Re-Expressing data: Get it Straight

AP Statistics. Chapter 9 Re-Expressing data: Get it Straight AP Statistics Chapter 9 Re-Expressing data: Get it Straight Objectives: Re-expression of data Ladder of powers Straight to the Point We cannot use a linear model unless the relationship between the two

More information

TESTING FOR CO-INTEGRATION

TESTING FOR CO-INTEGRATION Bo Sjö 2010-12-05 TESTING FOR CO-INTEGRATION To be used in combination with Sjö (2008) Testing for Unit Roots and Cointegration A Guide. Instructions: Use the Johansen method to test for Purchasing Power

More information

Prentice Hall Conceptual Physics (Hewitt) 2006 Correlated to: Michigan Curriculum Framework Science Benchmarks (Grade 9-12)

Prentice Hall Conceptual Physics (Hewitt) 2006 Correlated to: Michigan Curriculum Framework Science Benchmarks (Grade 9-12) 1. Ask questions that can be investigated empirically. 2. Design and conduct scientific investigations. CONSTRUCTING NEW SCIENTIFIC KNOWLEDGE (C) I.1 All students will ask questions that help them learn

More information

Lecture 1: Review of Probability

Lecture 1: Review of Probability EAS31136/B9036: Statistics in Earth & Atmospheric Sciences Lecture 1: Review of Probability Instructor: Prof. Johnny Luo www.sci.ccny.cuny.edu/~luo Dates Topic Reading (Based on the 2 nd Edition of Wilks

More information

CHAPTER 9: HYPOTHESIS TESTING

CHAPTER 9: HYPOTHESIS TESTING CHAPTER 9: HYPOTHESIS TESTING THE SECOND LAST EXAMPLE CLEARLY ILLUSTRATES THAT THERE IS ONE IMPORTANT ISSUE WE NEED TO EXPLORE: IS THERE (IN OUR TWO SAMPLES) SUFFICIENT STATISTICAL EVIDENCE TO CONCLUDE

More information

NEW RELATIVITY GAMMA

NEW RELATIVITY GAMMA NEW RELATIVITY GAMMA James A. Putnam 2003 What is the meaning of gamma? In relativity theory there appears the mathematical expression: It originated from the Lorentz transforms. The question I will answer

More information

Least Mean Squares Regression. Machine Learning Fall 2018

Least Mean Squares Regression. Machine Learning Fall 2018 Least Mean Squares Regression Machine Learning Fall 2018 1 Where are we? Least Squares Method for regression Examples The LMS objective Gradient descent Incremental/stochastic gradient descent Exercises

More information

Material presented. Direct Models for Classification. Agenda. Classification. Classification (2) Classification by machines 6/16/2010.

Material presented. Direct Models for Classification. Agenda. Classification. Classification (2) Classification by machines 6/16/2010. Material presented Direct Models for Classification SCARF JHU Summer School June 18, 2010 Patrick Nguyen (panguyen@microsoft.com) What is classification? What is a linear classifier? What are Direct Models?

More information

Performance Evaluation

Performance Evaluation Performance Evaluation David S. Rosenberg Bloomberg ML EDU October 26, 2017 David S. Rosenberg (Bloomberg ML EDU) October 26, 2017 1 / 36 Baseline Models David S. Rosenberg (Bloomberg ML EDU) October 26,

More information

Support Vector Machines (SVM) in bioinformatics. Day 1: Introduction to SVM

Support Vector Machines (SVM) in bioinformatics. Day 1: Introduction to SVM 1 Support Vector Machines (SVM) in bioinformatics Day 1: Introduction to SVM Jean-Philippe Vert Bioinformatics Center, Kyoto University, Japan Jean-Philippe.Vert@mines.org Human Genome Center, University

More information

Note on Chebyshev Regression

Note on Chebyshev Regression 1 Introduction Note on Chebyshev Regression Makoto Nakajima, UIUC January 006 The family of Chebyshev polynomials is by far the most popular choice for the base functions for weighted residuals method.

More information

Discriminative Models

Discriminative Models No.5 Discriminative Models Hui Jiang Department of Electrical Engineering and Computer Science Lassonde School of Engineering York University, Toronto, Canada Outline Generative vs. Discriminative models

More information

Response Selection Using Neural Phase Oscillators

Response Selection Using Neural Phase Oscillators Response Selection Using Neural Phase Oscillators J. Acacio de Barros 1 A symposium on the occasion of Patrick Suppes 90th birthday March 10, 2012 1 With Pat Suppes and Gary Oas (Suppes et al., 2012).

More information

AP STATISTICS Name: Period: Review Unit IV Scatterplots & Regressions

AP STATISTICS Name: Period: Review Unit IV Scatterplots & Regressions AP STATISTICS Name: Period: Review Unit IV Scatterplots & Regressions Know the definitions of the following words: bivariate data, regression analysis, scatter diagram, correlation coefficient, independent

More information

Computational Tasks and Models

Computational Tasks and Models 1 Computational Tasks and Models Overview: We assume that the reader is familiar with computing devices but may associate the notion of computation with specific incarnations of it. Our first goal is to

More information

Dr. Trent L. Silbaugh, Instructor Chemical Reaction Engineering Final Exam Study Guide

Dr. Trent L. Silbaugh, Instructor Chemical Reaction Engineering Final Exam Study Guide Chapter 1 Mole balances: Know the definitions of the rate of reaction, rate of disappearance and rate of appearance Know what a rate law is Be able to write a general mole balance and know what each term

More information

Absolute motion versus relative motion in Special Relativity is not dealt with properly

Absolute motion versus relative motion in Special Relativity is not dealt with properly Absolute motion versus relative motion in Special Relativity is not dealt with properly Roger J Anderton R.J.Anderton@btinternet.com A great deal has been written about the twin paradox. In this article

More information

Model predictive control of industrial processes. Vitali Vansovitš

Model predictive control of industrial processes. Vitali Vansovitš Model predictive control of industrial processes Vitali Vansovitš Contents Industrial process (Iru Power Plant) Neural networ identification Process identification linear model Model predictive controller

More information

Stat 412/512 REVIEW OF SIMPLE LINEAR REGRESSION. Jan Charlotte Wickham. stat512.cwick.co.nz

Stat 412/512 REVIEW OF SIMPLE LINEAR REGRESSION. Jan Charlotte Wickham. stat512.cwick.co.nz Stat 412/512 REVIEW OF SIMPLE LINEAR REGRESSION Jan 7 2015 Charlotte Wickham stat512.cwick.co.nz Announcements TA's Katie 2pm lab Ben 5pm lab Joe noon & 1pm lab TA office hours Kidder M111 Katie Tues 2-3pm

More information

Solving Word Problems Using Systems Of Linear Equations Algebra 1 Homework

Solving Word Problems Using Systems Of Linear Equations Algebra 1 Homework Solving Word Problems Using Systems Of Linear Equations Algebra 1 Homework Ad: Mathway solves algebra homework problems with step-by-step help! Tutors Answer Your Questions about Linear Equations And Systems

More information

Principles and Problems. Chapter 1: A Physics Toolkit

Principles and Problems. Chapter 1: A Physics Toolkit PHYSICS Principles and Problems Chapter 1: A Physics Toolkit CHAPTER 1 A Physics Toolkit BIG IDEA Physicists use scientific methods to investigate energy and matter. CHAPTER 1 Table Of Contents Section

More information

Child sexual abuse is a serious crime that is why you must listen while the Touching Rules are being explained.

Child sexual abuse is a serious crime that is why you must listen while the Touching Rules are being explained. Child sexual abuse is a serious crime that is why you must listen while the Touching Rules are being explained. Touching Rule 1: It is never all right for someone older or more powerful than you to touch

More information

CSE 20 DISCRETE MATH. Winter

CSE 20 DISCRETE MATH. Winter CSE 20 DISCRETE MATH Winter 2017 http://cseweb.ucsd.edu/classes/wi17/cse20-ab/ Today's learning goals Distinguish between a theorem, an axiom, lemma, a corollary, and a conjecture. Recognize direct proofs

More information

Introduction to Regression Analysis

Introduction to Regression Analysis Introduction to Regression Analysis Modeling a Response A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors,

More information

Most people said that they understand force and acceleration. GOOD!

Most people said that they understand force and acceleration. GOOD! Questions and Answers on Dynamics 3/17/98 Thanks to the students who submitted questions and comments! I have grouped them by topic and shortened some of the long questions/comments. Please feel free to

More information

Clustering. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 8, / 26

Clustering. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 8, / 26 Clustering Professor Ameet Talwalkar Professor Ameet Talwalkar CS26 Machine Learning Algorithms March 8, 217 1 / 26 Outline 1 Administration 2 Review of last lecture 3 Clustering Professor Ameet Talwalkar

More information

An Introduction to Statistical Theory of Learning. Nakul Verma Janelia, HHMI

An Introduction to Statistical Theory of Learning. Nakul Verma Janelia, HHMI An Introduction to Statistical Theory of Learning Nakul Verma Janelia, HHMI Towards formalizing learning What does it mean to learn a concept? Gain knowledge or experience of the concept. The basic process

More information

ECON 497 Midterm Spring

ECON 497 Midterm Spring ECON 497 Midterm Spring 2009 1 ECON 497: Economic Research and Forecasting Name: Spring 2009 Bellas Midterm You have three hours and twenty minutes to complete this exam. Answer all questions and explain

More information

Testing for a break in persistence under long-range dependencies and mean shifts

Testing for a break in persistence under long-range dependencies and mean shifts Testing for a break in persistence under long-range dependencies and mean shifts Philipp Sibbertsen and Juliane Willert Institute of Statistics, Faculty of Economics and Management Leibniz Universität

More information

Name Date. Answers 1.

Name Date. Answers 1. Name Date Honors Algebra 2 Summer Work Due at Meet the Teacher Night Show all work. You will be graded on accuracy and completion. Partial credit will be given on problems where work is not shown. 1. Plot

More information

Special Relativity Lecture

Special Relativity Lecture Special Relativity Lecture Prateek Puri August 24, 200 The Lorentz Transformation So far, we have proved length contraction and time dilation only for very specific situations involving light clocks; however,

More information

Modeling and Analysis of Dynamic Systems

Modeling and Analysis of Dynamic Systems Modeling and Analysis of Dynamic Systems by Dr. Guillaume Ducard Fall 2016 Institute for Dynamic Systems and Control ETH Zurich, Switzerland based on script from: Prof. Dr. Lino Guzzella 1/33 Outline 1

More information

Dynamic Modeling. For the mechanical translational system shown in Figure 1, determine a set of first order

Dynamic Modeling. For the mechanical translational system shown in Figure 1, determine a set of first order QUESTION 1 For the mechanical translational system shown in, determine a set of first order differential equations describing the system dynamics. Identify the state variables and inputs. y(t) x(t) k m

More information

CH 23 PRODUCING WIDGETS

CH 23 PRODUCING WIDGETS CH 23 PRODUCING WIDGETS 215 Introduction S uppose we have 10 apples and 13 bananas, which of course means that we have 23 pieces of fruit in total. This can be written with the simple equation: 10 + 13

More information

18.9 SUPPORT VECTOR MACHINES

18.9 SUPPORT VECTOR MACHINES 744 Chapter 8. Learning from Examples is the fact that each regression problem will be easier to solve, because it involves only the examples with nonzero weight the examples whose kernels overlap the

More information

Math 251 Midterm II Information Spring 2018

Math 251 Midterm II Information Spring 2018 Math 251 Midterm II Information Spring 2018 WHEN: Thursday, April 12 (in class). You will have the entire period (125 minutes) to work on the exam. RULES: No books or notes. You may bring a non-graphing

More information

BASIC SCIENCE [BSC410S]

BASIC SCIENCE [BSC410S] FEEDBACK TUTORIAL LETTER ASSIGNMENT 1 SECOND SEMESTER 2017 BASIC SCIENCE [BSC410S] 1 Dear Student Assignment one has been marked and this serves as feedback on the assignment. Individual feedback is already

More information

8. Solving Problems in Science: understanding the scientific method. describe the scientific method

8. Solving Problems in Science: understanding the scientific method. describe the scientific method EUSO non ha ancora uno specifico sillabo di riferimento. Il seguente sillabo è adottato nella competizione International Junior Science Olympiad rivolta a studenti di meno di 16 anni. Adapted from International

More information

A Course on Advanced Econometrics

A Course on Advanced Econometrics A Course on Advanced Econometrics Yongmiao Hong The Ernest S. Liu Professor of Economics & International Studies Cornell University Course Introduction: Modern economies are full of uncertainties and risk.

More information

Midterm 3 Review. Terms. Formulas and Rules to Use. Math 1010, Fall 2011 Instructor: Marina Gresham. Odd Root ( n x where n is odd) Exponent

Midterm 3 Review. Terms. Formulas and Rules to Use. Math 1010, Fall 2011 Instructor: Marina Gresham. Odd Root ( n x where n is odd) Exponent Math 1010, Fall 2011 Instructor: Marina Gresham Terms Midterm 3 Review Exponent Polynomial - Monomial - Binomial - Trinomial - Standard Form - Degree - Leading Coefficient - Constant Term Difference of

More information

HOOKE S LAW FORCE AND STRETCH OF A SPRING

HOOKE S LAW FORCE AND STRETCH OF A SPRING HOOKE S LAW FORCE AND STRETCH OF A SPRING NAME DATE PERIOD Hooke's Law Lab Report 1 of 5 PURPOSE: The purpose of this experiment was to determine the relationship between the stretch of a spring and the

More information

Revealing inductive biases through iterated learning

Revealing inductive biases through iterated learning Revealing inductive biases through iterated learning Tom Griffiths Department of Psychology Cognitive Science Program UC Berkeley with Mike Kalish, Brian Christian, Simon Kirby, Mike Dowman, Stephan Lewandowsky

More information

Basis Expansion and Nonlinear SVM. Kai Yu

Basis Expansion and Nonlinear SVM. Kai Yu Basis Expansion and Nonlinear SVM Kai Yu Linear Classifiers f(x) =w > x + b z(x) = sign(f(x)) Help to learn more general cases, e.g., nonlinear models 8/7/12 2 Nonlinear Classifiers via Basis Expansion

More information

1. CHEMISTRY OF LIFE. Tutorial Outline

1. CHEMISTRY OF LIFE. Tutorial Outline Tutorial Outline North Carolina Tutorials are designed specifically for the Common Core State Standards for English language arts, the North Carolina Standard Course of Study for Math, and the North Carolina

More information

Naïve Bayes Introduction to Machine Learning. Matt Gormley Lecture 18 Oct. 31, 2018

Naïve Bayes Introduction to Machine Learning. Matt Gormley Lecture 18 Oct. 31, 2018 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Naïve Bayes Matt Gormley Lecture 18 Oct. 31, 2018 1 Reminders Homework 6: PAC Learning

More information

The Myth of Dirac supposedly combining Special Relativity with Quantum Mechanics Roger J. Anderton

The Myth of Dirac supposedly combining Special Relativity with Quantum Mechanics Roger J. Anderton The Myth of Dirac supposedly combining Special Relativity with Quantum Mechanics Roger J. Anderton R.J.Anderton@btinternet.com Many popular texts state that Dirac - combined Special Relativity (SR) with

More information

Unit 7 Graphs and Graphing Utilities - Classwork

Unit 7 Graphs and Graphing Utilities - Classwork A. Graphing Equations Unit 7 Graphs and Graphing Utilities - Classwork Our first job is being able to graph equations. We have done some graphing in trigonometry but now need a general method of seeing

More information

5: Capacitors July 8, 2008

5: Capacitors July 8, 2008 5: Capacitors July 8, 2008 5.1 Definition A capacitor is a structure which has a certain capacity to hold an electric charge. It is essentially the simplest possible battery. The typical example of a capacitor,

More information