Predicting investment fluxes from implicit lead-lag investor networks

Size: px
Start display at page:

Download "Predicting investment fluxes from implicit lead-lag investor networks"

Transcription

1 Predicting investment fluxes from implicit lead-lag investor networks D. Challet 1,2 M. Lallouache 1 R. Chicheportiche 3,4 1 CentraleSupélec 2 Encelade Capital SA 3 CFM 4 previously at Swissquote Bank SA September 8, 2015

2 Broker internal order matching versus

3 Internal order matching...?

4 Broker s gain G T = T I t r t = t=1 T t=1 (I t 1 + δi t )r t Classic optimization problem 1 Fix T (1 day) 2 Assume random δi t and r t 3 Constraints 4 Minimize cost function

5 Broker s gain G T = T I t r t = t=1 T t=1 (I t 1 + δi t )r t Prediction problem 1 predict flux 2 predict price return 3 PROFIT!

6 Prediction problem= Science + Engineering Science: flux 1 cluster clients 2 lead-lag networks 3 machine learning 4 ENJOY! Engineering 1 Predict price returns 2 Inventory constraints 3 PROFIT!

7 Investor classification Supervised Individual vs institutional (Odean, Barber, etc.)... Unsupervised Similarity measure categories

8 Supervised classification

9 Real networks D. Challet, M. Lallouache, R. Chicheportiche Predicting investment fluxes from implicit lead-lag investor networks

10 Unsupervised learning

11 Unsupervised learning

12 FX traders cumsum(strat) cumsum(strat) yday yday cumsum(strat) cumsum(strat) yday yday

13 Unsupervised classification I Spanish brokers Lillo et al. (2008) Daily inventory change V i (t) Correlation matrix C E(V i V j ) Principal Component Analysis + Random Matrix theory

14 Unsupervised classification I Equities, Spanish brokers Lillo et al. (2008)

15 Unsupervised classification II Equities, Chinese investors Zhou et al. (2012)

16 Unsupervised classification III: FX, individual investors, daily p(λ) Data Shuffled RMT C SR log(n) λ

17 Unsupervised classification IV: FX, individual investors, hourly λ p(λ) Data Shuffled RMT log(n) C SR

18 Unsupervised classification Statistically validated networks (SVNs) Tumminello et al. (2011a) 1 Agent i, state i (t) {1,,S} s i (t) = sign Agents i and j: measure frequency Compute p-values Buy(t) Sell(t) { 1,0,1,2 = /0} Buy(t) + Sell(t) s i (t) = s && s j (t) = s O(N 2 ) pairs multiple hypothesis correction NETWORK

19 Origin of trade synchronicity 1 Explicit communication 2 Implicit communication 1 same news 2 same strategy: MA(CD) 3 same parameters 4 Master in Finance

20 Trader-trader communication: explicit

21 Trader-trader communication: explicit

22 Trader-trader communication: explicit

23 Do traders look at prices?

24 Implicit AND explicit communication

25 Implicit communication: same price analysis

26 Implicit communication: same price analysis

27 Implicit communication: same price analysis

28 Example: MACD (1970) Parameters 12, 26, and 9 days Trading week then: 6 days Now: 5 days

29 Investor SVNs group=disconnected subgraphs Tumminello et al. (2011b): daily Finish investment fluxes

30 Datasets 1 Swissquote (SQ): individual traders 2 Large Bank: institutional traders P>(N) 10-2 P>(N) N N Number of transactions

31 Step 1: Implicit network + community, daily Challet et al. (2015) EUR.USD SQ Links

32 Implicit network + community, hourly Challet et al. (2015) EUR.USD SQ Links

33 Implicit network + community detection, LB, hourly Challet et al. (2015) GBP.USD EUR.USD Links Links

34 Cluster stability 1_1 2_1 1_2 1_3 1_15 1_24 1_16 1_17 1_26 1_29 2_37 1_4 2_2 2_3 1_31 1_7 2_8 1_10 2_9 1_8 2_5 2_21 2_10 1_21 1_23 2_27 1_11 2_12 1_22 2_26 2_19 2_36 2_22 2_25 1_20 1_27 2_32 1_30 2_34 2_24 2_28 1_28 2_33 2_29 2_31 1_0 2_17 2_18 2_20 2_23 2_0 3_1 3_2 3_3 3_5 3_7 3_13 3_29 3_10 3_20 3_30 3_14 3_34 3_21 3_27 3_39 3_15 3_19 3_40 3_31 3_37 3_16 3_42 3_32 3_38 3_26 3_28 3_35 3_12 3_25 3_24 3_22 3_36 4_1 4_3 4_2 4_6 4_9 4_13 4_22 4_15 4_25 4_7 4_34 4_14 4_23 4_24 4_30 4_19 4_28 4_33 4_37 4_27 4_11 4_32 4_35 4_36 4_31 4_17 4_21 4_26 4_0 5_1 5_2 5_3 5_7 5_16 5_11 5_30 5_8 5_34 5_10 5_36 5_32 5_29 5_14 5_42 5_47 5_21 5_40 5_31 5_26 5_27 5_22 5_24 5_44 5_48 5_35 5_28 5_37 5_15 5_18 5_45 5_12 5_19 5_49 5_38 5_50 5_46 5_39 5_41 5_20 5_0 6_1 6_2 6_3 6_15 6_18 6_32 6_6 6_30 6_28 6_39 6_33 6_36 6_34 6_13 6_7 6_10 6_16 6_47 6_29 6_45 6_37 6_41 6_19 6_35 6_43 6_38 6_27 6_44 6_31 6_21 6_8 6_42 6_25 6_14 6_23 6_46 6_26 6_20 6_0 7_1 7_2 7_3 7_11 7_4 7_10 7_31 7_27 7_14 7_16 7_36 7_20 7_29 7_32 7_33 7_6 7_17 7_21 7_38 7_37 7_42 7_41 7_35 7_28 7_19 7_30 7_25 7_40 7_24 7_26 7_39 7_23 7_22 7_0 8_1 8_14 8_2 8_5 8_7 8_20 8_15 8_24 8_6 8_12 8_25 8_9 8_27 8_23 8_30 8_21 8_28 8_19 8_31 8_29 8_33 8_32 8_26 8_10 8_22 8_0 9_1 9_6 9_8 9_38 9_37 9_22 9_14 9_23 9_15 9_25 9_10 9_12 9_21 9_19 9_30 9_33 9_27 9_34 9_26 9_28 9_40 9_31 9_35 9_36 9_29 9_24 9_5 9_41 9_39 9_32 9_16 9_18 9_0 10_1 10_9 10_7 10_11 10_5 10_21 10_20 10_16 10_4 10_23 10_22 10_15 10_26 10_30 10_24 10_25 10_29 10_31 10_27 10_32 10_34 10_10 10_18 10_28 10_35 10_33 10_0 11_1 11_4 11_6 11_12 11_10 11_16 11_30 11_25 11_27 11_11 11_17 11_7 11_33 11_32 11_29 11_28 11_18 11_39 11_36 11_34 11_26 11_37 11_38 11_20 11_14 11_35 11_31 11_19 11_2 11_21 11_0 12_1 12_2 12_21 12_3 12_13 12_6 12_12 12_8 12_26 12_9 12_15 12_17 12_24 12_23 12_28 12_22 12_30 12_25 12_20 12_29 12_27 12_14 13_1 13_2 13_4 13_8 13_3 13_13 13_27 13_21 13_5 13_19 13_22 13_24 13_23 13_9 13_17 13_36 13_30 13_34 13_26 13_32 13_28 13_31 13_14 13_18 13_33 13_29 13_35 14_1 14_2 14_4 14_3 14_5 14_8 14_30 14_11 14_18 14_21 14_10 14_22 14_27 14_23 14_19 14_24 14_28 14_25 14_29 14_26 14_0 movie GBP.USD 2014 movie EUR.USD 2014

35 Step 2: lead-lag SVNs determine groups group lead-lag? SNVs: p-values of s g (t) s g (t + 1)

36 Intertemporal interaction networks (FX LB) Compute p-value of {s g (t),s g (t + 1)} 4 [ 1 > 1 ] [ 1 > 1 ] [ 2 > 1 ] 5 [ 1 > 1 ] [ 1 > 1 ] 4 [ 0 > 0 ] [ 1 > 1 ] 27 [ 0 > 1 ] 25 [ 1 > 1 ] 23 [ 2 > 1 ] [ 1 > 0 ] [ 0 > 0 ] [ 1 > 0 ] [ 1 > 1 ] 12 [ 0 > 1 ] [ 1 > 1 ] [ 2 > 1 ] [ 1 > 2 ] 24 [ 1 > 2 ] [ 2 > 2 ]

37 EUR.USD (LB) [ 1 > 1 ] [ 0 > 1 ] [ 1 > 1 ] [ 2 > 1 ] [ 1 > 0 ] [ 0 > 0 ] [ 1 > 0 ] 37 27

38 Origin of lead-lag 1 Explicit communication 2 Delayed reaction 1 faster news 2 same strategy, faster parameters MA(CD) 12, 26, 5 10, 25, 4: 3 Master in Finance +...

39 Lead-lag: number of links vs time 20 #Links #Links SQ LB EUR.USD

40 Lead-lag between groups: inter-temporal networks Goal: predict global flux sign (B S) out of sample 1 Sliding in-out sample periods 2 Determine groups in-sample 3 Calibrate machine learning in-sample 4 Predict next SIGN

41 Predictors+predictee F 1,t F 2,t F 1,t 1 F 2,t 1 hour 3-2 NA 0 1 NA NA NA NA 3 sign (B S) +1-1????

42 Machine learning: random forest Random forest = collection of random trees Classification tree: P predictors, T data points each Each tree: bootstrap of data points Each node: cut according to criterion e.g. predictor i > 2

43 Prediction results 12 weeks in-sample 24 hours out-of-sample Predict sign of flux Predictors: group actions {-1,0,1,NA} Random Forests

44 Prediction results 12 weeks in-sample 24 hours out-of-sample Predict sign of flux Predictors: group actions {-1,0,1,NA} Random Forests

45 Prediction results: SQ 12 weeks in-sample 24 hours out-of-sample Predict sign of flux Predictors: group actions {-1,0,1,NA} Random Forests cumsum(s t φ t ) in billions obliquerf RF H 0 2 H Time (hours)

46 Out-of-sample performance by hour

47 Origins of performance peaks

48 Summary Method Clustering communities lead-lag machine learning prediction Todo Find algorithmic strategy of groups Other fields fund ownership recommendations systems...

Monecor (London) Ltd.

Monecor (London) Ltd. Monecor (London) Ltd. Account: 7000669 Name: Gabriel Gaertner Currency: EUR 2017 December 1, 11:07 Closed Transactions: Ticket Open Time Type Size Item Price S / L T / P Close Time Price Commission Taxes

More information

Q-Learning and SARSA: Machine learningbased stochastic control approaches for financial trading

Q-Learning and SARSA: Machine learningbased stochastic control approaches for financial trading Q-Learning and SARSA: Machine learningbased stochastic control approaches for financial trading Marco CORAZZA (corazza@unive.it) Department of Economics Ca' Foscari University of Venice CONFERENCE ON COMPUTATIONAL

More information

Advanced Techniques for Mining Structured Data: Process Mining

Advanced Techniques for Mining Structured Data: Process Mining Advanced Techniques for Mining Structured Data: Process Mining Frequent Pattern Discovery /Event Forecasting Dr A. Appice Scuola di Dottorato in Informatica e Matematica XXXII Problem definition 1. Given

More information

Variance Reduction and Ensemble Methods

Variance Reduction and Ensemble Methods Variance Reduction and Ensemble Methods Nicholas Ruozzi University of Texas at Dallas Based on the slides of Vibhav Gogate and David Sontag Last Time PAC learning Bias/variance tradeoff small hypothesis

More information

Tutorial on Machine Learning for Advanced Electronics

Tutorial on Machine Learning for Advanced Electronics Tutorial on Machine Learning for Advanced Electronics Maxim Raginsky March 2017 Part I (Some) Theory and Principles Machine Learning: estimation of dependencies from empirical data (V. Vapnik) enabling

More information

Probabilities & Statistics Revision

Probabilities & Statistics Revision Probabilities & Statistics Revision Christopher Ting Christopher Ting http://www.mysmu.edu/faculty/christophert/ : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 January 6, 2017 Christopher Ting QF

More information

Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets

Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets Nan Zhou, Wen Cheng, Ph.D. Associate, Quantitative Research, J.P. Morgan nan.zhou@jpmorgan.com The 4th Annual

More information

PARTICIPATING ORGANISATIONS CIRCULAR

PARTICIPATING ORGANISATIONS CIRCULAR PARTICIPATING ORGANISATIONS CIRCULAR Date : 24 November 2011 R/R No. : 10 of 2011 DIRECTIVES ON SUBMISSION BY PARTICIPATING ORGANISATIONS OF PERIODIC REPORTS BY ELECTRONIC TRANSMISSION TO BURSA MALAYSIA

More information

Sparkasse Bank Malta plc

Sparkasse Bank Malta plc Sparkasse Bank Malta plc April 2018 Professional Clients Structured Finance Instrument Baader Bank AG - 529900JFOPPEDUR61H13 ICF Bank AG - 529900E89HA1I45HB613 BondPartners SA - 391200DMGAI5C0MDYA1 2 Fintech

More information

From statistics to data science. BAE 815 (Fall 2017) Dr. Zifei Liu

From statistics to data science. BAE 815 (Fall 2017) Dr. Zifei Liu From statistics to data science BAE 815 (Fall 2017) Dr. Zifei Liu Zifeiliu@ksu.edu Why? How? What? How much? How many? Individual facts (quantities, characters, or symbols) The Data-Information-Knowledge-Wisdom

More information

TECHNICAL P-SYSTEMS: OPERATING IN THE STOCK MARKETS WITH TRANSITION P-SYSTEMS. Alberto Arteta, Angel Luis Castellanos, Nuria Gómez Blas

TECHNICAL P-SYSTEMS: OPERATING IN THE STOCK MARKETS WITH TRANSITION P-SYSTEMS. Alberto Arteta, Angel Luis Castellanos, Nuria Gómez Blas 236 TECHNICAL P-SYSTEMS: OPERATING IN THE STOCK MARKETS WITH TRANSITION P-SYSTEMS Alberto Arteta, Angel Luis Castellanos, Nuria Gómez Blas Abstract: During last 50 years, the markets have been object of

More information

Decision Models Lecture 5 1. Lecture 5. Foreign-Currency Trading Integer Programming Plant-location example Summary and Preparation for next class

Decision Models Lecture 5 1. Lecture 5. Foreign-Currency Trading Integer Programming Plant-location example Summary and Preparation for next class Decision Models Lecture 5 1 Lecture 5 Foreign-Currency Trading Integer Programming Plant-location example Summary and Preparation for next class Foreign Exchange (FX) Markets Decision Models Lecture 5

More information

Wavelet based sample entropy analysis: A new method to test weak form market efficiency

Wavelet based sample entropy analysis: A new method to test weak form market efficiency Theoretical and Applied Economics Volume XXI (2014), No. 8(597), pp. 19-26 Fet al Wavelet based sample entropy analysis: A new method to test weak form market efficiency Anoop S. KUMAR University of Hyderabad,

More information

CPSC 340: Machine Learning and Data Mining. Linear Least Squares Fall 2016

CPSC 340: Machine Learning and Data Mining. Linear Least Squares Fall 2016 CPSC 340: Machine Learning and Data Mining Linear Least Squares Fall 2016 Assignment 2 is due Friday: Admin You should already be started! 1 late day to hand it in on Wednesday, 2 for Friday, 3 for next

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning CS4731 Dr. Mihail Fall 2017 Slide content based on books by Bishop and Barber. https://www.microsoft.com/en-us/research/people/cmbishop/ http://web4.cs.ucl.ac.uk/staff/d.barber/pmwiki/pmwiki.php?n=brml.homepage

More information

Learning with multiple models. Boosting.

Learning with multiple models. Boosting. CS 2750 Machine Learning Lecture 21 Learning with multiple models. Boosting. Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Learning with multiple models: Approach 2 Approach 2: use multiple models

More information

CS 6375 Machine Learning

CS 6375 Machine Learning CS 6375 Machine Learning Nicholas Ruozzi University of Texas at Dallas Slides adapted from David Sontag and Vibhav Gogate Course Info. Instructor: Nicholas Ruozzi Office: ECSS 3.409 Office hours: Tues.

More information

On the Directional Predictability of Eurostoxx 50

On the Directional Predictability of Eurostoxx 50 On the Directional Predictability of Eurostoxx 50 Democritus University of Thrace Department of Economics Pragidis I., Plakandaras, V., Karapistoli E. Motivation Eurostoxx is an under-investigated index/concept

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression Christopher Ting Christopher Ting : christophert@smu.edu.sg : 688 0364 : LKCSB 5036 January 7, 017 Web Site: http://www.mysmu.edu/faculty/christophert/ Christopher Ting QF 30 Week

More information

Lecture 11 Linear regression

Lecture 11 Linear regression Advanced Algorithms Floriano Zini Free University of Bozen-Bolzano Faculty of Computer Science Academic Year 2013-2014 Lecture 11 Linear regression These slides are taken from Andrew Ng, Machine Learning

More information

day month year documentname/initials 1

day month year documentname/initials 1 ECE471-571 Pattern Recognition Lecture 13 Decision Tree Hairong Qi, Gonzalez Family Professor Electrical Engineering and Computer Science University of Tennessee, Knoxville http://www.eecs.utk.edu/faculty/qi

More information

Financial Risk and Returns Prediction with Modular Networked Learning

Financial Risk and Returns Prediction with Modular Networked Learning arxiv:1806.05876v1 [cs.lg] 15 Jun 2018 Financial Risk and Returns Prediction with Modular Networked Learning Carlos Pedro Gonçalves June 18, 2018 University of Lisbon, Instituto Superior de Ciências Sociais

More information

-Monthly Market Review

-Monthly Market Review -ly Market Review May 2018 Global Regulatory Scanner Federal Reserve releases paper on Collateral Runs : Broker-dealers are unique because they transform liquidity on both sides of their balance sheet.

More information

Paul A. O Gorman 1, John G. Dwyer 1 * Contents of this file. 1. Figures S1 to S13

Paul A. O Gorman 1, John G. Dwyer 1 * Contents of this file. 1. Figures S1 to S13 JAMES Supporting Information for Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events Paul A. O Gorman, John G. Dwyer * Contents

More information

IE598 Big Data Optimization Introduction

IE598 Big Data Optimization Introduction IE598 Big Data Optimization Introduction Instructor: Niao He Jan 17, 2018 1 A little about me Assistant Professor, ISE & CSL UIUC, 2016 Ph.D. in Operations Research, M.S. in Computational Sci. & Eng. Georgia

More information

ABC random forest for parameter estimation. Jean-Michel Marin

ABC random forest for parameter estimation. Jean-Michel Marin ABC random forest for parameter estimation Jean-Michel Marin Université de Montpellier Institut Montpelliérain Alexander Grothendieck (IMAG) Institut de Biologie Computationnelle (IBC) Labex Numev! joint

More information

Land Cover Project ESA Climate Change Initiative. Processing chain for land cover maps dedicated to climate modellers.

Land Cover Project ESA Climate Change Initiative. Processing chain for land cover maps dedicated to climate modellers. Land Cover Project ESA Climate Change Initiative Processing chain for land cover maps dedicated to climate modellers land_cover_cci S. Bontemps 1, P. Defourny 1, V. Kalogirou 2, F.M. Seifert 2 and O. Arino

More information

Introduction to Machine Learning and Cross-Validation

Introduction to Machine Learning and Cross-Validation Introduction to Machine Learning and Cross-Validation Jonathan Hersh 1 February 27, 2019 J.Hersh (Chapman ) Intro & CV February 27, 2019 1 / 29 Plan 1 Introduction 2 Preliminary Terminology 3 Bias-Variance

More information

Statistical Machine Learning from Data

Statistical Machine Learning from Data Samy Bengio Statistical Machine Learning from Data 1 Statistical Machine Learning from Data Ensembles Samy Bengio IDIAP Research Institute, Martigny, Switzerland, and Ecole Polytechnique Fédérale de Lausanne

More information

Anomaly Detection for the CERN Large Hadron Collider injection magnets

Anomaly Detection for the CERN Large Hadron Collider injection magnets Anomaly Detection for the CERN Large Hadron Collider injection magnets Armin Halilovic KU Leuven - Department of Computer Science In cooperation with CERN 2018-07-27 0 Outline 1 Context 2 Data 3 Preprocessing

More information

Overview of Statistical Tools. Statistical Inference. Bayesian Framework. Modeling. Very simple case. Things are usually more complicated

Overview of Statistical Tools. Statistical Inference. Bayesian Framework. Modeling. Very simple case. Things are usually more complicated Fall 3 Computer Vision Overview of Statistical Tools Statistical Inference Haibin Ling Observation inference Decision Prior knowledge http://www.dabi.temple.edu/~hbling/teaching/3f_5543/index.html Bayesian

More information

Real Estate Price Prediction with Regression and Classification CS 229 Autumn 2016 Project Final Report

Real Estate Price Prediction with Regression and Classification CS 229 Autumn 2016 Project Final Report Real Estate Price Prediction with Regression and Classification CS 229 Autumn 2016 Project Final Report Hujia Yu, Jiafu Wu [hujiay, jiafuwu]@stanford.edu 1. Introduction Housing prices are an important

More information

Integrated Electricity Demand and Price Forecasting

Integrated Electricity Demand and Price Forecasting Integrated Electricity Demand and Price Forecasting Create and Evaluate Forecasting Models The many interrelated factors which influence demand for electricity cannot be directly modeled by closed-form

More information

A Sparse Linear Model and Significance Test. for Individual Consumption Prediction

A Sparse Linear Model and Significance Test. for Individual Consumption Prediction A Sparse Linear Model and Significance Test 1 for Individual Consumption Prediction Pan Li, Baosen Zhang, Yang Weng, and Ram Rajagopal arxiv:1511.01853v3 [stat.ml] 21 Feb 2017 Abstract Accurate prediction

More information

Machine Learning and Deep Learning! Vincent Lepetit!

Machine Learning and Deep Learning! Vincent Lepetit! Machine Learning and Deep Learning!! Vincent Lepetit! 1! What is Machine Learning?! 2! Hand-Written Digit Recognition! 2 9 3! Hand-Written Digit Recognition! Formalization! 0 1 x = @ A Images are 28x28

More information

Gradient Boosting (Continued)

Gradient Boosting (Continued) Gradient Boosting (Continued) David Rosenberg New York University April 4, 2016 David Rosenberg (New York University) DS-GA 1003 April 4, 2016 1 / 31 Boosting Fits an Additive Model Boosting Fits an Additive

More information

Classification using stochastic ensembles

Classification using stochastic ensembles July 31, 2014 Topics Introduction Topics Classification Application and classfication Classification and Regression Trees Stochastic ensemble methods Our application: USAID Poverty Assessment Tools Topics

More information

Data Informatics. Seon Ho Kim, Ph.D.

Data Informatics. Seon Ho Kim, Ph.D. Data Informatics Seon Ho Kim, Ph.D. seonkim@usc.edu What is Machine Learning? Overview slides by ETHEM ALPAYDIN Why Learn? Learn: programming computers to optimize a performance criterion using example

More information

Filtering bond and credit default swap markets

Filtering bond and credit default swap markets Filtering bond and credit default swap markets Peter Cotton May 20, 2017 Overview Disclaimer Filtering credit markets A visual introduction A unified state space for bond and CDS markets Kalman filtering

More information

Machine Learning on temporal data

Machine Learning on temporal data Machine Learning on temporal data Learning Dissimilarities on Time Series Ahlame Douzal (Ahlame.Douzal@imag.fr) AMA, LIG, Université Joseph Fourier Master 2R - MOSIG (2011) Plan Time series structure and

More information

WP6 Early estimates of economic indicators. WP6 coordinator: Tomaž Špeh, SURS ESSNet Big data: BDES 2018 Sofia 14.,

WP6 Early estimates of economic indicators. WP6 coordinator: Tomaž Špeh, SURS ESSNet Big data: BDES 2018 Sofia 14., WP6 Early estimates of economic indicators WP6 coordinator: Tomaž Špeh, SURS ESSNet Big data: BDES 2018 Sofia 14.,15.5.2018 WP6 objectives Outline Summary of activities carried out and results achieved

More information

Module 2.1 Monitoring activity data for forests using remote sensing

Module 2.1 Monitoring activity data for forests using remote sensing Module 2.1 Monitoring activity data for forests using remote sensing Module developers: Frédéric Achard, European Commission (EC) Joint Research Centre (JRC) Jukka Miettinen, EC JRC Brice Mora, Wageningen

More information

Course in Data Science

Course in Data Science Course in Data Science About the Course: In this course you will get an introduction to the main tools and ideas which are required for Data Scientist/Business Analyst/Data Analyst. The course gives an

More information

Will it rain tomorrow?

Will it rain tomorrow? Will it rain tomorrow? Bilal Ahmed - 561539 Department of Computing and Information Systems, The University of Melbourne, Victoria, Australia bahmad@student.unimelb.edu.au Abstract With the availability

More information

CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning

CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS Learning Neural Networks Classifier Short Presentation INPUT: classification data, i.e. it contains an classification (class) attribute.

More information

From Argentina to Zimbabwe: Where Should I Sell my Widgets?

From Argentina to Zimbabwe: Where Should I Sell my Widgets? From Argentina to Zimbabwe: Department of Statistics Texas A&M University 15 Feb 2010 Acknowledgments This is joint work with my coauthors Bani Mallick (Texas A&M University) Debu Talukdar (SUNY - Buffalo)

More information

Machine Learning (CS 567) Lecture 2

Machine Learning (CS 567) Lecture 2 Machine Learning (CS 567) Lecture 2 Time: T-Th 5:00pm - 6:20pm Location: GFS118 Instructor: Sofus A. Macskassy (macskass@usc.edu) Office: SAL 216 Office hours: by appointment Teaching assistant: Cheol

More information

Statistical Machine Learning Hilary Term 2018

Statistical Machine Learning Hilary Term 2018 Statistical Machine Learning Hilary Term 2018 Pier Francesco Palamara Department of Statistics University of Oxford Slide credits and other course material can be found at: http://www.stats.ox.ac.uk/~palamara/sml18.html

More information

Exponential and Logarithmic Functions

Exponential and Logarithmic Functions Graduate T.A. Department of Mathematics Dynamical Systems and Chaos San Diego State University April 9, 11 Definition (Exponential Function) An exponential function with base a is a function of the form

More information

An Optimal Strategy Model for Purchasing Initial Public Offerings in China

An Optimal Strategy Model for Purchasing Initial Public Offerings in China Appl. Math. Inf. Sci. 7, No. 3, 1013-100 (013) 1013 Applied Mathematics & Information Sciences An International Journal An Optimal Strategy Model for Purchasing Initial Public Offerings in China Dong Huang

More information

Project Name: Income Generation Project 4 Pouk District, Siem Reap Province Implementing Partner: Farmer Livelihood Development (FLD)

Project Name: Income Generation Project 4 Pouk District, Siem Reap Province Implementing Partner: Farmer Livelihood Development (FLD) Grant Category: Micro Finance Project Name: Income Generation Project 4 Pouk District, Siem Reap Province Implementing Partner: Farmer Livelihood Development (FLD) Status: Ongoing Start Date: 1 April 2012

More information

Data analysis strategies for high dimensional social science data M3 Conference May 2013

Data analysis strategies for high dimensional social science data M3 Conference May 2013 Data analysis strategies for high dimensional social science data M3 Conference May 2013 W. Holmes Finch, Maria Hernández Finch, David E. McIntosh, & Lauren E. Moss Ball State University High dimensional

More information

Analysis of Spectral Kernel Design based Semi-supervised Learning

Analysis of Spectral Kernel Design based Semi-supervised Learning Analysis of Spectral Kernel Design based Semi-supervised Learning Tong Zhang IBM T. J. Watson Research Center Yorktown Heights, NY 10598 Rie Kubota Ando IBM T. J. Watson Research Center Yorktown Heights,

More information

Topic 4 Forecasting Exchange Rate

Topic 4 Forecasting Exchange Rate Topic 4 Forecasting Exchange Rate Why Firms Forecast Exchange Rates MNCs need exchange rate forecasts for their: hedging decisions, short-term financing decisions, short-term investment decisions, capital

More information

Multi-Layer Boosting for Pattern Recognition

Multi-Layer Boosting for Pattern Recognition Multi-Layer Boosting for Pattern Recognition François Fleuret IDIAP Research Institute, Centre du Parc, P.O. Box 592 1920 Martigny, Switzerland fleuret@idiap.ch Abstract We extend the standard boosting

More information

Warm up: risk prediction with logistic regression

Warm up: risk prediction with logistic regression Warm up: risk prediction with logistic regression Boss gives you a bunch of data on loans defaulting or not: {(x i,y i )} n i= x i 2 R d, y i 2 {, } You model the data as: P (Y = y x, w) = + exp( yw T

More information

9/26/17. Ridge regression. What our model needs to do. Ridge Regression: L2 penalty. Ridge coefficients. Ridge coefficients

9/26/17. Ridge regression. What our model needs to do. Ridge Regression: L2 penalty. Ridge coefficients. Ridge coefficients What our model needs to do regression Usually, we are not just trying to explain observed data We want to uncover meaningful trends And predict future observations Our questions then are Is β" a good estimate

More information

UPDATING THE MINNESOTA NATIONAL WETLAND INVENTORY

UPDATING THE MINNESOTA NATIONAL WETLAND INVENTORY UPDATING THE MINNESOTA NATIONAL WETLAND INVENTORY An Integrated Approach Using Object-Oriented Image Analysis, Human Air-Photo Interpretation and Machine Learning AARON SMITH EQUINOX ANALYTICS INC. FUNDING

More information

Simple linear regression

Simple linear regression Simple linear regression Business Statistics 41000 Fall 2015 1 Topics 1. conditional distributions, squared error, means and variances 2. linear prediction 3. signal + noise and R 2 goodness of fit 4.

More information

Gradient Boosting, Continued

Gradient Boosting, Continued Gradient Boosting, Continued David Rosenberg New York University December 26, 2016 David Rosenberg (New York University) DS-GA 1003 December 26, 2016 1 / 16 Review: Gradient Boosting Review: Gradient Boosting

More information

A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE

A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE Li Sheng Institute of intelligent information engineering Zheiang University Hangzhou, 3007, P. R. China ABSTRACT In this paper, a neural network-driven

More information

Marks. bonus points. } Assignment 1: Should be out this weekend. } Mid-term: Before the last lecture. } Mid-term deferred exam:

Marks. bonus points. } Assignment 1: Should be out this weekend. } Mid-term: Before the last lecture. } Mid-term deferred exam: Marks } Assignment 1: Should be out this weekend } All are marked, I m trying to tally them and perhaps add bonus points } Mid-term: Before the last lecture } Mid-term deferred exam: } This Saturday, 9am-10.30am,

More information

= observed volume on day l for bin j = base volume in jth bin, and = residual error, assumed independent with mean zero.

= observed volume on day l for bin j = base volume in jth bin, and = residual error, assumed independent with mean zero. QB research September 4, 06 Page -Minute Bin Volume Forecast Model Overview In response to strong client demand, Quantitative Brokers (QB) has developed a new algorithm called Closer that specifically

More information

Prof. Dr. Ann Nowé. Artificial Intelligence Lab ai.vub.ac.be

Prof. Dr. Ann Nowé. Artificial Intelligence Lab ai.vub.ac.be REINFORCEMENT LEARNING AN INTRODUCTION Prof. Dr. Ann Nowé Artificial Intelligence Lab ai.vub.ac.be REINFORCEMENT LEARNING WHAT IS IT? What is it? Learning from interaction Learning about, from, and while

More information

Information Percolation, Momentum, and Reversal

Information Percolation, Momentum, and Reversal Reversal Daniel Andrei Julien Cujean a b c Banque de France, Mars 2014 Reversal 0 / 14 Time-Series Momentum and Reversal: Evidence T-Statistic T-Statistic by Month, All Asset Classes 6 5 4 3 2 1 0-1 -2-3

More information

Ensemble Methods and Random Forests

Ensemble Methods and Random Forests Ensemble Methods and Random Forests Vaishnavi S May 2017 1 Introduction We have seen various analysis for classification and regression in the course. One of the common methods to reduce the generalization

More information

10-810: Advanced Algorithms and Models for Computational Biology. Optimal leaf ordering and classification

10-810: Advanced Algorithms and Models for Computational Biology. Optimal leaf ordering and classification 10-810: Advanced Algorithms and Models for Computational Biology Optimal leaf ordering and classification Hierarchical clustering As we mentioned, its one of the most popular methods for clustering gene

More information

Ensembles. Léon Bottou COS 424 4/8/2010

Ensembles. Léon Bottou COS 424 4/8/2010 Ensembles Léon Bottou COS 424 4/8/2010 Readings T. G. Dietterich (2000) Ensemble Methods in Machine Learning. R. E. Schapire (2003): The Boosting Approach to Machine Learning. Sections 1,2,3,4,6. Léon

More information

brainlinksystem.com $25+ / hr AI Decision Tree Learning Part I Outline Learning 11/9/2010 Carnegie Mellon

brainlinksystem.com $25+ / hr AI Decision Tree Learning Part I Outline Learning 11/9/2010 Carnegie Mellon I Decision Tree Learning Part I brainlinksystem.com $25+ / hr Illah Nourbakhsh s version Chapter 8, Russell and Norvig Thanks to all past instructors Carnegie Mellon Outline Learning and philosophy Induction

More information

Reinforcement learning an introduction

Reinforcement learning an introduction Reinforcement learning an introduction Prof. Dr. Ann Nowé Computational Modeling Group AIlab ai.vub.ac.be November 2013 Reinforcement Learning What is it? Learning from interaction Learning about, from,

More information

Linear Regression. Machine Learning CSE546 Kevin Jamieson University of Washington. Oct 5, Kevin Jamieson 1

Linear Regression. Machine Learning CSE546 Kevin Jamieson University of Washington. Oct 5, Kevin Jamieson 1 Linear Regression Machine Learning CSE546 Kevin Jamieson University of Washington Oct 5, 2017 1 The regression problem Given past sales data on zillow.com, predict: y = House sale price from x = {# sq.

More information

As a % of total no. of partly paid-up shares. As a % of total no. of outstanding convertible securities.

As a % of total no. of partly paid-up shares. As a % of total no. of outstanding convertible securities. (1)(a) STATEMENT SHOWING SHAREHOLDING PATTERN IN CLAUSE-35 NAME OF THE COMPANY:WIPRO LIMITED SCRIP CODE: 507685 Name of the Scrip: Wipro Limited Class of Security: Equity QUARTER ENDED: March 31, 2015

More information

Chart Group indicator

Chart Group indicator Chart Group indicator 1. Overview... 2 2. Using the... 3 2.1 Adding the indicator to a chart... 3 2.2 Choosing whether to link the timeframe or the symbol... 3 2.3 Assigning charts to groups... 3 2.3.1

More information

The GARCH Analysis of YU EBAO Annual Yields Weiwei Guo1,a

The GARCH Analysis of YU EBAO Annual Yields Weiwei Guo1,a 2nd Workshop on Advanced Research and Technology in Industry Applications (WARTIA 2016) The GARCH Analysis of YU EBAO Annual Yields Weiwei Guo1,a 1 Longdong University,Qingyang,Gansu province,745000 a

More information

Bayesian Learning Extension

Bayesian Learning Extension Bayesian Learning Extension This document will go over one of the most useful forms of statistical inference known as Baye s Rule several of the concepts that extend from it. Named after Thomas Bayes this

More information

Generative Learning. INFO-4604, Applied Machine Learning University of Colorado Boulder. November 29, 2018 Prof. Michael Paul

Generative Learning. INFO-4604, Applied Machine Learning University of Colorado Boulder. November 29, 2018 Prof. Michael Paul Generative Learning INFO-4604, Applied Machine Learning University of Colorado Boulder November 29, 2018 Prof. Michael Paul Generative vs Discriminative The classification algorithms we have seen so far

More information

Argo Mortgages 2 S.r.l

Argo Mortgages 2 S.r.l External Parties Arrangers WestLB AG Natixis S.A. UBS Investment Bank Servicer CDC IXIS Table of Contents Page 1. The Notes 2 2. Issuer Available Funds 3 3. Expenses 4 4. Amortisation Amounts 5 5. Pre-Enforcement

More information

SF2930 Regression Analysis

SF2930 Regression Analysis SF2930 Regression Analysis Alexandre Chotard Tree-based regression and classication 20 February 2017 1 / 30 Idag Overview Regression trees Pruning Bagging, random forests 2 / 30 Today Overview Regression

More information

PRICE OVERREACTIONS IN THE CRYPTOCURRENCY MARKET. Guglielmo Maria Caporale * Brunel University, London, CESifo and DIW Berlin

PRICE OVERREACTIONS IN THE CRYPTOCURRENCY MARKET. Guglielmo Maria Caporale * Brunel University, London, CESifo and DIW Berlin PRICE OVERREACTIONS IN THE CRYPTOCURRENCY MARKET Guglielmo Maria Caporale * Brunel University, London, CESifo and DIW Berlin Alex Plastun** Sumy State University November 2018 Abstract This paper examines

More information

Models, Data, Learning Problems

Models, Data, Learning Problems Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Models, Data, Learning Problems Tobias Scheffer Overview Types of learning problems: Supervised Learning (Classification, Regression,

More information

QualiMET 2.0. The new Quality Control System of Deutscher Wetterdienst

QualiMET 2.0. The new Quality Control System of Deutscher Wetterdienst QualiMET 2.0 The new Quality Control System of Deutscher Wetterdienst Reinhard Spengler Deutscher Wetterdienst Department Observing Networks and Data Quality Assurance of Meteorological Data Michendorfer

More information

Correlation Preserving Unsupervised Discretization. Outline

Correlation Preserving Unsupervised Discretization. Outline Correlation Preserving Unsupervised Discretization Jee Vang Outline Paper References What is discretization? Motivation Principal Component Analysis (PCA) Association Mining Correlation Preserving Discretization

More information

Introduction to Reinforcement Learning. CMPT 882 Mar. 18

Introduction to Reinforcement Learning. CMPT 882 Mar. 18 Introduction to Reinforcement Learning CMPT 882 Mar. 18 Outline for the week Basic ideas in RL Value functions and value iteration Policy evaluation and policy improvement Model-free RL Monte-Carlo and

More information

Econ 423 Lecture Notes: Additional Topics in Time Series 1

Econ 423 Lecture Notes: Additional Topics in Time Series 1 Econ 423 Lecture Notes: Additional Topics in Time Series 1 John C. Chao April 25, 2017 1 These notes are based in large part on Chapter 16 of Stock and Watson (2011). They are for instructional purposes

More information

Nonlinear Bivariate Comovements of Asset Prices: Theory and Tests

Nonlinear Bivariate Comovements of Asset Prices: Theory and Tests Nonlinear Bivariate Comovements of Asset Prices: Theory and Tests M. Corazza, A.G. Malliaris, E. Scalco Department of Applied Mathematics University Ca Foscari of Venice (Italy) Department of Economics

More information

RS Metrics CME Group Copper Futures Price Predictive Analysis Explained

RS Metrics CME Group Copper Futures Price Predictive Analysis Explained RS Metrics CME Group Copper Futures Price Predictive Analysis Explained Disclaimer ALL DATA REFERENCED IN THIS WHITE PAPER IS PROVIDED AS IS, AND RS METRICS DOES NOT MAKE AND HEREBY EXPRESSLY DISCLAIMS,

More information

SGA-2: WP6- Early estimates. SURS: Boro Nikić, Tomaž Špeh ESSnet Big Data Project Brussels 26.,

SGA-2: WP6- Early estimates. SURS: Boro Nikić, Tomaž Špeh ESSnet Big Data Project Brussels 26., SGA-2: WP6- Early estimates SURS: Boro Nikić, Tomaž Špeh ESSnet Big Data Project Brussels 26.,27.10. 2017 Outline WP6 state of affairs WP6 pilot: Early estimates of economic indicators Methods Data sources

More information

BOSELE NATIONAL PROVIDENT FUND JM BUSHA BONDPLUS

BOSELE NATIONAL PROVIDENT FUND JM BUSHA BONDPLUS JM BUSHA BONDPLUS INVESTMENT PORTFOLIO REPORT JM BUSHA Asset Managers Pty Ltd TABLE OF CONTENTS Contents Page 1 Balance Sheet Page 2 Income Statement Page 3 Portfolio Statements Fixed Interest Portfolio

More information

HOW TO USE THE SBDC FINANCIAL TEMPLATE

HOW TO USE THE SBDC FINANCIAL TEMPLATE HOW TO USE THE SBDC FINANCIAL TEMPLATE It is strongly suggested that, if you are not well acquainted with Financial Statements and their interrelationships, that you seek the assistance of the Small Business

More information

Introduction to machine learning. Concept learning. Design of a learning system. Designing a learning system

Introduction to machine learning. Concept learning. Design of a learning system. Designing a learning system Introduction to machine learning Concept learning Maria Simi, 2011/2012 Machine Learning, Tom Mitchell Mc Graw-Hill International Editions, 1997 (Cap 1, 2). Introduction to machine learning When appropriate

More information

: Mei Wu Zhou (2005),, : (1)

: Mei Wu Zhou (2005),, : (1) : 3 ( 100871) : Mei Wu Zhou (2005),, : (1),,; (2) 0,, ; (3),, ; (4),;;,, ; (5), :,,,,,,,,,,,,,,,,,,,,,,, Hart (1977), Hart (1977),Hart Kreps(1986),Vila (1989),Allen Gale (1992),Bagnoli Lipman (1996), Gerard

More information

Probabilistic photometric redshifts in the era of Petascale Astronomy

Probabilistic photometric redshifts in the era of Petascale Astronomy Probabilistic photometric redshifts in the era of Petascale Astronomy Matías Carrasco Kind NCSA/Department of Astronomy University of Illinois at Urbana-Champaign Tools for Astronomical Big Data March

More information

Big Data Analytics. Special Topics for Computer Science CSE CSE Feb 24

Big Data Analytics. Special Topics for Computer Science CSE CSE Feb 24 Big Data Analytics Special Topics for Computer Science CSE 4095-001 CSE 5095-005 Feb 24 Fei Wang Associate Professor Department of Computer Science and Engineering fei_wang@uconn.edu Prediction III Goal

More information

ECE 5424: Introduction to Machine Learning

ECE 5424: Introduction to Machine Learning ECE 5424: Introduction to Machine Learning Topics: Ensemble Methods: Bagging, Boosting PAC Learning Readings: Murphy 16.4;; Hastie 16 Stefan Lee Virginia Tech Fighting the bias-variance tradeoff Simple

More information

Introduction to Supervised Learning. Performance Evaluation

Introduction to Supervised Learning. Performance Evaluation Introduction to Supervised Learning Performance Evaluation Marcelo S. Lauretto Escola de Artes, Ciências e Humanidades, Universidade de São Paulo marcelolauretto@usp.br Lima - Peru Performance Evaluation

More information

Price Overreactions in the Cryptocurrency Market

Price Overreactions in the Cryptocurrency Market 1718 Discussion Papers Deutsches Institut für Wirtschaftsforschung 2018 Price Overreactions in the Cryptocurrency Market Guglielmo Maria Caporale and Alex Plastun Opinions expressed in this paper are those

More information

CS 570: Machine Learning Seminar. Fall 2016

CS 570: Machine Learning Seminar. Fall 2016 CS 570: Machine Learning Seminar Fall 2016 Class Information Class web page: http://web.cecs.pdx.edu/~mm/mlseminar2016-2017/fall2016/ Class mailing list: cs570@cs.pdx.edu My office hours: T,Th, 2-3pm or

More information

22/04/2014. Economic Research

22/04/2014. Economic Research 22/04/2014 Economic Research Forecasting Models for Exchange Rate Tuesday, April 22, 2014 The science of prognostics has been going through a rapid and fruitful development in the past decades, with various

More information

Lecture 2. (1) Aggregation (2) Permanent Income Hypothesis. Erick Sager. September 14, 2015

Lecture 2. (1) Aggregation (2) Permanent Income Hypothesis. Erick Sager. September 14, 2015 Lecture 2 (1) Aggregation (2) Permanent Income Hypothesis Erick Sager September 14, 2015 Econ 605: Adv. Topics in Macroeconomics Johns Hopkins University, Fall 2015 Erick Sager Lecture 2 (9/14/15) 1 /

More information

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000

More information