Automatic Melody Composition Using Path Constraints of Nonchord Tone Rules

Size: px
Start display at page:

Download "Automatic Melody Composition Using Path Constraints of Nonchord Tone Rules"

Transcription

1 Automatic Melody Composition Using Path Constraints of Nonchord Tone Rules Satoru FUKAYAMA, 1 Tauya NISHIMOTO, 1 Nobutaa ONO 1 and Shigei SAGAYAMA 1 In this paper, we discuss a model that can generate a melody which satisfies non-chord tone rules given by the classical methods of composition. Since non-chord tones are important when musicians analyze the relationship between the melody and the chord, rules of non-chord tones are relatively well-organized in music theories. However there were some difficulties in appling those rules to automatic composition because of the variety and complexity of non-chord tone usages. We show that non-chord tone rules can be represented as local constratins on the melody path and the melodies can be automatically generated by finding the optimal melody paths using dynamic programming under constraints of those local constraints. 1 Graduate School of Information Science and Technology, the University of Toyo 1. 1) 2) 3) 4) 5) 8) 12)13) c 2009 Information Processing Society of Japan

2 2 neighbor tone) : 1 passing tone) : : 3 : 1 I i,iii,v) ii ii i 1 ii iii i passing tone) 4 : neighbor tone) 3 appoggiatura) suspension) escape tone) anticipation) 4 9) 1 2 c 2009 Information Processing Society of Japan

3 )13) 5 : 10) X 5): X = argmax PX) 3) X 8 i i δ i, ) : PX) = b x0 a x0 x 1 b x1 a x1 x 2 a xn 1 x n b xn 1) n = b x0 a xi 1 x i b xi 2) i=1 b, a j j PX) δ i, ) = max P X, x i = ) 4) X ={x 0,,x i 1 } X = {x 0, x 1,, x n} PX) = max max P X, x i 1 = j ) a j b 5) j X ={x 0,,x i 2 } = max δ i 1, j) a j b 6) j 1 δ i 1, j) 11) X = {x 0, x 1,, x n} 3 c 2009 Information Processing Society of Japan

4 X Step.1 j = 0,, M δ 0, j) = b j 0) ψ 0, j) = 0 Step.2 i = 1,, n = 0,, M δ i, ) = max δ i 1, j) a j i) b i) j ψ i, ) = argmax δ i 1, j) a j i) j Step.3 ˆP = max δ n, ) x n = argmax δ n, ) Step.4 i = n, n 1,,1 X = {x 0,, x n} 6 : δ i, ) = max P x 0,, x i 3) P x i 2, x i 1, x i = ) 7) X ={x 0,,x i 1 } 1 = max δ i 3, x i 3) a xi s x i ) b xi ) 8) x i 3,x i 2,x i 1) x i 1 = ψ i, x i ) K a j 6) b m 3.3 n n m 8) 2 3 4) s=3 K x i 3, x i 2, x i 1) 6) 1 3 l 4 c 2009 Information Processing Society of Japan

5 Step.2 8 i = 1,, n = 0,, M 7 l ) ) 1 l) 0 = 0, l) 1, l) 2, l) 3 8 l = 1) δ i, ) = max δ i n l), + l) a l = { l) 0, l) 1, l) 2, l) 3 } xi 3 = + l n l) l) + b s + l) l) l) 3, xi 2 = + l) 2, xi 1 = l) 1 s=n l) + 8) δ i, ) = max + l) 3,+ l) 2,+ l) 1 ) δ i 3, + l) 3 ) 1 s=3 a l) + b s + l) l) + 9) Step.3 ) 1 ˆP = max δ i 3, + l) = max δ n, ) 3 a l) l + b s + l) l) + 10) s=3 x n = argmax δ n, ) ) δ i 3, + l) 3 Step.4 l) = { l) 0,, l) n } i = n i = 0 n l n l) X = {x 0,, x n} ) 1 δ i, ) = max δ i n l), + l) ˆl = φi, x 11) i ) l n l) a l) + s + l) s=n l) b + l) δ i, ) l δ i n l), + l) i := i n ˆl) n l) ) X Step.1 j = 0,, M δ 0, j) = b j 0) φ0, j) = 0 φi, ) = argmax δ i, ) l i n l) 0 x i 1 = x i + ˆl) 1, x i 2 = x i + ˆl) 2 x i n ˆl) = x i + ˆl) n ˆl) 5 c 2009 Information Processing Society of Japan

6 CREST 9 : 1) L. Hiller, L. Isaacson: Musical Composition with a High-Speed Digital Computer, in Machines Models of Music, M. Schwanauer, and D. Levitt Eds, MIT Press pp , Reprint of original article in Journal of Audio Engineering Society, ) W. Shottstaedt: Automatic counterpoint, In M. Mathews and J. R. Pierce, Current 4.1 Directions in Computer Music Research, pp , Cambridge, Massachusetts, The MIT Press, ) R. Ramirez, J. Peralta: A constraint-based melody harmonizer, ECAI 98 Worshop on Constraints and Artistic Applications, Brighton, ) M. Allan, C. Williams: Harmonizing Chorales by Probabilistic Inference, Proceedings of Advances in Neural Information Processing Systems, 17, ) D. Levitt: A melody description system for jazz improvisation, M. S. Thesis, Artificial Intelligence Laboratory, Chambridge, Massachusetts, ) F. Pachet, P. Roy: Musical harmonization with constraints: A survey, Constraints 4.3 Journal, 61):7-19, ) M. Baroni, R. Brunetti, L. Callegari, and C. Jacobini: A grammar for melody: relationships between melody and harmony, In M. Baroni and L. Callegari, eds. Musical Grammars and Computer Analysis, Florence: L. Olshi, pp , ),, :,, 2008-MUS-74, pp.77 82, ) :, pp.8 9, pp.18 20, pp.37 39,, ) :, pp.68 89,, ) Bellman, R. E.: Dynamic Programming, Princeton University Press, Princeton, New Jersey, ),,, :,, pp , ),,,,,, : Orpheus,, 2008-MUS-76, pp , c 2009 Information Processing Society of Japan

GENERATING MUSICAL ACCOMPANIMENT USING FINITE STATE TRANSDUCERS

GENERATING MUSICAL ACCOMPANIMENT USING FINITE STATE TRANSDUCERS GENERATING MUSICAL ACCOMPANIMENT USING FINITE STATE TRANSDUCERS Jonathan P. Forsyth, Juan P. Bello Music and Audio Research Lab (MARL) New York University New York, NY USA {jpf211,jpbello}@nyu.edu ABSTRACT

More information

Phase Diagram Study on Variational Bayes Learning of Bernoulli Mixture

Phase Diagram Study on Variational Bayes Learning of Bernoulli Mixture 009 Technical Report on Information-Based Induction Sciences 009 (IBIS009) Phase Diagram Study on Variational Bayes Learning of Bernoulli Mixture Daisue Kaji Sumio Watanabe Abstract: Variational Bayes

More information

Scott Wendholt on You and the Night and the Music

Scott Wendholt on You and the Night and the Music Scott Wendholt on You and the Night and the Music Transcription and Analysis by eff McGregor www.smallslive.com www.jeffmcgregormusic.com 2 Dmin w. Emin ( b 5) A Scott Wendholt on "You and the Night and

More information

Intelligent Systems I

Intelligent Systems I Intelligent Systems I 00 INTRODUCTION Stefan Harmeling & Philipp Hennig 24. October 2013 Max Planck Institute for Intelligent Systems Dptmt. of Empirical Inference Which Card? Opening Experiment Which

More information

Computational Creativity via Human-Level Concept Learning

Computational Creativity via Human-Level Concept Learning Computational Creativity via Human-Level Concept Learning Paul Bodily, Benjamin Bay, and Dan Ventura Computer Science Department Brigham Young University Provo, UT 84602 USA paulmbodily@gmail.com, benjamin.bay@gmail.com,

More information

McGill University > Schulich School of Music > MUMT 611 > Presentation III. Neural Networks. artificial. jason a. hockman

McGill University > Schulich School of Music > MUMT 611 > Presentation III. Neural Networks. artificial. jason a. hockman jason a. hockman Overvie hat is a neural netork? basics and architecture learning applications in music History 1940s: William McCulloch defines neuron 1960s: Perceptron 1970s: limitations presented (Minsky)

More information

PreFEst: A Predominant-F0 Estimation Method for Polyphonic Musical Audio Signals

PreFEst: A Predominant-F0 Estimation Method for Polyphonic Musical Audio Signals PreFEst: A Predominant-F0 Estimation Method for Polyphonic Musical Audio Signals Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST). IT, AIST, 1-1-1 Umezono, Tsukuba,

More information

Learning Gaussian Process Models from Uncertain Data

Learning Gaussian Process Models from Uncertain Data Learning Gaussian Process Models from Uncertain Data Patrick Dallaire, Camille Besse, and Brahim Chaib-draa DAMAS Laboratory, Computer Science & Software Engineering Department, Laval University, Canada

More information

Gaussian Harmony Search Algorithm: A Novel Method for Loney s Solenoid Problem

Gaussian Harmony Search Algorithm: A Novel Method for Loney s Solenoid Problem IEEE TRANSACTIONS ON MAGNETICS, VOL. 50, NO., MARCH 2014 7026405 Gaussian Harmony Search Algorithm: A Novel Method for Loney s Solenoid Problem Haibin Duan and Junnan Li State Key Laboratory of Virtual

More information

Classification & Information Theory Lecture #8

Classification & Information Theory Lecture #8 Classification & Information Theory Lecture #8 Introduction to Natural Language Processing CMPSCI 585, Fall 2007 University of Massachusetts Amherst Andrew McCallum Today s Main Points Automatically categorizing

More information

Nonnegative Matrix Factorization with Markov-Chained Bases for Modeling Time-Varying Patterns in Music Spectrograms

Nonnegative Matrix Factorization with Markov-Chained Bases for Modeling Time-Varying Patterns in Music Spectrograms Nonnegative Matrix Factorization with Markov-Chained Bases for Modeling Time-Varying Patterns in Music Spectrograms Masahiro Nakano 1, Jonathan Le Roux 2, Hirokazu Kameoka 2,YuKitano 1, Nobutaka Ono 1,

More information

arxiv: v3 [cs.ai] 2 Mar 2018

arxiv: v3 [cs.ai] 2 Mar 2018 Generative Statistical Models with Self-Emergent Grammar of Chord Sequences Hiroaki Tsushima 1, Eita Nakamura 1, Katsutoshi Itoyama 1, and Kazuyoshi Yoshii 1,2 1 Graduate School of Informatics, Kyoto University,

More information

Musical Genre Classication

Musical Genre Classication Musical Genre Classication Jan Müllers RWTH Aachen, 2015 Jan Müllers Finding Disjoint Paths 1 / 15 Musical Genres The Problem Musical Genres History Automatic Speech Regocnition categorical labels created

More information

Finite-Length Markov Processes with Constraints

Finite-Length Markov Processes with Constraints Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Finite-Length Markov Processes with Constraints François Pachet, Pierre Roy, Gabriele Barbieri Sony CSL Paris

More information

Bayesian networks: approximate inference

Bayesian networks: approximate inference Bayesian networks: approximate inference Machine Intelligence Thomas D. Nielsen September 2008 Approximative inference September 2008 1 / 25 Motivation Because of the (worst-case) intractability of exact

More information

Pattern Recognition Applied to Music Signals

Pattern Recognition Applied to Music Signals JHU CLSP Summer School Pattern Recognition Applied to Music Signals 2 3 4 5 Music Content Analysis Classification and Features Statistical Pattern Recognition Gaussian Mixtures and Neural Nets Singing

More information

Session 1: Pattern Recognition

Session 1: Pattern Recognition Proc. Digital del Continguts Musicals Session 1: Pattern Recognition 1 2 3 4 5 Music Content Analysis Pattern Classification The Statistical Approach Distribution Models Singing Detection Dan Ellis

More information

MULTI-RESOLUTION SIGNAL DECOMPOSITION WITH TIME-DOMAIN SPECTROGRAM FACTORIZATION. Hirokazu Kameoka

MULTI-RESOLUTION SIGNAL DECOMPOSITION WITH TIME-DOMAIN SPECTROGRAM FACTORIZATION. Hirokazu Kameoka MULTI-RESOLUTION SIGNAL DECOMPOSITION WITH TIME-DOMAIN SPECTROGRAM FACTORIZATION Hiroazu Kameoa The University of Toyo / Nippon Telegraph and Telephone Corporation ABSTRACT This paper proposes a novel

More information

Using Expectation-Maximization for Reinforcement Learning

Using Expectation-Maximization for Reinforcement Learning NOTE Communicated by Andrew Barto and Michael Jordan Using Expectation-Maximization for Reinforcement Learning Peter Dayan Department of Brain and Cognitive Sciences, Center for Biological and Computational

More information

Knowledge Extraction from DBNs for Images

Knowledge Extraction from DBNs for Images Knowledge Extraction from DBNs for Images Son N. Tran and Artur d Avila Garcez Department of Computer Science City University London Contents 1 Introduction 2 Knowledge Extraction from DBNs 3 Experimental

More information

Probabilistic Sequential Patterns for Singing Transcription

Probabilistic Sequential Patterns for Singing Transcription Probabilistic Sequential Patterns for Singing Transcription Eita Nakamura, Ryo Nishikimi, Simon Dixon and Kazuyoshi Yoshii Kyoto University, Kyoto, Japan E-mail: [enakamura,nishikimi,yoshii]@sap.ist.i.kyoto-u.ac.p

More information

A Priori and A Posteriori Machine Learning and Nonlinear Artificial Neural Networks

A Priori and A Posteriori Machine Learning and Nonlinear Artificial Neural Networks A Priori and A Posteriori Machine Learning and Nonlinear Artificial Neural Networks Jan Zelinka, Jan Romportl, and Luděk Müller The Department of Cybernetics, University of West Bohemia, Czech Republic

More information

Bayesian Machine Learning

Bayesian Machine Learning Bayesian Machine Learning Andrew Gordon Wilson ORIE 6741 Lecture 2: Bayesian Basics https://people.orie.cornell.edu/andrew/orie6741 Cornell University August 25, 2016 1 / 17 Canonical Machine Learning

More information

11 The Max-Product Algorithm

11 The Max-Product Algorithm Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms for Inference Fall 2014 11 The Max-Product Algorithm In the previous lecture, we introduced

More information

Intelligent Systems:

Intelligent Systems: Intelligent Systems: Undirected Graphical models (Factor Graphs) (2 lectures) Carsten Rother 15/01/2015 Intelligent Systems: Probabilistic Inference in DGM and UGM Roadmap for next two lectures Definition

More information

Determining Feature Relevance in Subject Responses to Musical Stimuli

Determining Feature Relevance in Subject Responses to Musical Stimuli Determining Feature Relevance in Subject Responses to Musical Stimuli Morwaread M. Farbood 1 and Bernd Schoner 2 1 New York University, New York, NY 10012, USA 2 ThingMagic Inc., Cambridge, MA 02142, USA

More information

QUERY-BY-EXAMPLE MUSIC RETRIEVAL APPROACH BASED ON MUSICAL GENRE SHIFT BY CHANGING INSTRUMENT VOLUME

QUERY-BY-EXAMPLE MUSIC RETRIEVAL APPROACH BASED ON MUSICAL GENRE SHIFT BY CHANGING INSTRUMENT VOLUME Proc of the 12 th Int Conference on Digital Audio Effects (DAFx-09 Como Italy September 1-4 2009 QUERY-BY-EXAMPLE MUSIC RETRIEVAL APPROACH BASED ON MUSICAL GENRE SHIFT BY CHANGING INSTRUMENT VOLUME Katsutoshi

More information

9 Forward-backward algorithm, sum-product on factor graphs

9 Forward-backward algorithm, sum-product on factor graphs Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms For Inference Fall 2014 9 Forward-backward algorithm, sum-product on factor graphs The previous

More information

Deep Learning & Artificial Intelligence WS 2018/2019

Deep Learning & Artificial Intelligence WS 2018/2019 Deep Learning & Artificial Intelligence WS 2018/2019 Linear Regression Model Model Error Function: Squared Error Has no special meaning except it makes gradients look nicer Prediction Ground truth / target

More information

The geometry of Gaussian processes and Bayesian optimization. Contal CMLA, ENS Cachan

The geometry of Gaussian processes and Bayesian optimization. Contal CMLA, ENS Cachan The geometry of Gaussian processes and Bayesian optimization. Contal CMLA, ENS Cachan Background: Global Optimization and Gaussian Processes The Geometry of Gaussian Processes and the Chaining Trick Algorithm

More information

Stochastic Gradient Estimate Variance in Contrastive Divergence and Persistent Contrastive Divergence

Stochastic Gradient Estimate Variance in Contrastive Divergence and Persistent Contrastive Divergence ESANN 0 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges (Belgium), 7-9 April 0, idoc.com publ., ISBN 97-7707-. Stochastic Gradient

More information

Bias-Variance Trade-Off in Hierarchical Probabilistic Models Using Higher-Order Feature Interactions

Bias-Variance Trade-Off in Hierarchical Probabilistic Models Using Higher-Order Feature Interactions - Trade-Off in Hierarchical Probabilistic Models Using Higher-Order Feature Interactions Simon Luo The University of Sydney Data61, CSIRO simon.luo@data61.csiro.au Mahito Sugiyama National Institute of

More information

Bayesian Modelling of Temporal Structure in Musical Audio

Bayesian Modelling of Temporal Structure in Musical Audio Bayesian Modelling of Temporal Structure in Musical Audio Nic Whiteley, A.Taylan Cemgil and Simon Godsill Signal Processing Group, University of Cambridge Department of Engineering, Trumpington Street,

More information

Chorale Warm-ups for Young Band

Chorale Warm-ups for Young Band Tenor Saxophone YCB41 No. 1 & b 4. p Chorale Warm-ups for Young Band In the Bleak Midwinter (Chorale) œ w. œ œ. J œ œ œ GUSTAV HOLST (1874 1934) Arranged by Sandy Feldstein & Larry Clark. œ rit. j œ w

More information

Machine Recognition of Sounds in Mixtures

Machine Recognition of Sounds in Mixtures Machine Recognition of Sounds in Mixtures Outline 1 2 3 4 Computational Auditory Scene Analysis Speech Recognition as Source Formation Sound Fragment Decoding Results & Conclusions Dan Ellis

More information

BACKPROPAGATION THROUGH THE VOID

BACKPROPAGATION THROUGH THE VOID BACKPROPAGATION THROUGH THE VOID Optimizing Control Variates for Black-Box Gradient Estimation 27 Nov 2017, University of Cambridge Speaker: Geoffrey Roeder, University of Toronto OPTIMIZING EXPECTATIONS

More information

Computing lp. proportionality constants and (automatic) transforms. Daniel Lee May 22, Stan Meetup.

Computing lp. proportionality constants and (automatic) transforms. Daniel Lee May 22, Stan Meetup. Computing lp proportionality constants and (automatic) transforms Daniel Lee daniel@generable.com May 22, 2018. Stan Meetup. Who am I? Stan developer since 2011 CTO of Generable Tools in pharma for analysis

More information

arxiv: v1 [stat.me] 24 May 2010

arxiv: v1 [stat.me] 24 May 2010 The role of the nugget term in the Gaussian process method Andrey Pepelyshev arxiv:1005.4385v1 [stat.me] 24 May 2010 Abstract The maximum likelihood estimate of the correlation parameter of a Gaussian

More information

Generalization to a zero-data task: an empirical study

Generalization to a zero-data task: an empirical study Generalization to a zero-data task: an empirical study Université de Montréal 20/03/2007 Introduction Introduction and motivation What is a zero-data task? task for which no training data are available

More information

Musical Style Modification as an Optimization Problem

Musical Style Modification as an Optimization Problem Musical Style Modification as an Optimization Problem Frank Zalkow AudioLabs frank.zalkow@audiolabs-erlangen.de Stephan Brand SAP SE stephan.brand@sap.com Benjamin Graf SAP SE benjamin.graf@sap.com International

More information

The Longest Common Subsequence Problem

The Longest Common Subsequence Problem Advanced Studies in Biology, Vol. 4, 2012, no. 8, 373-380 The Longest Common Subsequence Problem Anna Gorbenko Department of Intelligent Systems and Robotics Ural Federal University 620083 Ekaterinburg,

More information

Efficient Information Planning in Graphical Models

Efficient Information Planning in Graphical Models Efficient Information Planning in Graphical Models computational complexity considerations John Fisher & Giorgos Papachristoudis, MIT VITALITE Annual Review 2013 September 9, 2013 J. Fisher (VITALITE Annual

More information

Lecture : Probabilistic Machine Learning

Lecture : Probabilistic Machine Learning Lecture : Probabilistic Machine Learning Riashat Islam Reasoning and Learning Lab McGill University September 11, 2018 ML : Many Methods with Many Links Modelling Views of Machine Learning Machine Learning

More information

Evolving Complex Sounds with Cellular Automata: an Approach to Granular Synthesis

Evolving Complex Sounds with Cellular Automata: an Approach to Granular Synthesis Evolving Complex Sounds with Cellular Automata: an Approach to Granular Synthesis Eduardo Reck Miranda Sony Computer Science Laboratory - Paris 6 rue Amyot 75005 Paris - France miranda@csl.sony.fr Abstract

More information

Prequential Analysis

Prequential Analysis Prequential Analysis Philip Dawid University of Cambridge NIPS 2008 Tutorial Forecasting 2 Context and purpose...................................................... 3 One-step Forecasts.......................................................

More information

Neutron inverse kinetics via Gaussian Processes

Neutron inverse kinetics via Gaussian Processes Neutron inverse kinetics via Gaussian Processes P. Picca Politecnico di Torino, Torino, Italy R. Furfaro University of Arizona, Tucson, Arizona Outline Introduction Review of inverse kinetics techniques

More information

Chorale Warm-ups for Young Band. œ œ œ œ œ œ œ œ

Chorale Warm-ups for Young Band. œ œ œ œ œ œ œ œ Baritone Saxophone YCB41 No. 1 & 4. p Chorale Warm-ups for Young Band In the Bleak Midwinter (Chorale) œ œ œ. œ œ. J œ œ œ œ œ GUSTAV HOLST (1874 1934) Arranged by Sandy Feldstein & Larry Clark w U rit.

More information

Automated Musical Part Writing

Automated Musical Part Writing Automated Musical Part Writing Kevin Deisz 03/26/2009 Abstract This program writes music. Simply put, that is actually a relatively accurate summary of what this program does. Through a series of pseudorandomly

More information

MULTIPLE PITCH TRANSCRIPTION USING DBN-BASED MUSICOLOGICAL MODELS

MULTIPLE PITCH TRANSCRIPTION USING DBN-BASED MUSICOLOGICAL MODELS 11th International ociety for Music Information Retrieval onference (IMIR 2010) MULIPLE PIH RARIPIO UIG DB-BAED MUIOLOGIAL MODEL tanisław A. Raczyński * raczynski@ Emmanuel Vincent+ emmanuel.vincent@ Frédéric

More information

Chapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang

Chapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang Chapter 4 Dynamic Bayesian Networks 2016 Fall Jin Gu, Michael Zhang Reviews: BN Representation Basic steps for BN representations Define variables Define the preliminary relations between variables Check

More information

Worst-Case Analysis of the Perceptron and Exponentiated Update Algorithms

Worst-Case Analysis of the Perceptron and Exponentiated Update Algorithms Worst-Case Analysis of the Perceptron and Exponentiated Update Algorithms Tom Bylander Division of Computer Science The University of Texas at San Antonio San Antonio, Texas 7849 bylander@cs.utsa.edu April

More information

Models for Inexact Reasoning. Fuzzy Logic Lesson 8 Fuzzy Controllers. Master in Computational Logic Department of Artificial Intelligence

Models for Inexact Reasoning. Fuzzy Logic Lesson 8 Fuzzy Controllers. Master in Computational Logic Department of Artificial Intelligence Models for Inexact Reasoning Fuzzy Logic Lesson 8 Fuzzy Controllers Master in Computational Logic Department of Artificial Intelligence Fuzzy Controllers Fuzzy Controllers are special expert systems KB

More information

Incorporating features of distribution and progression for automatic makam classification

Incorporating features of distribution and progression for automatic makam classification Incorporating features of distribution and progression for automatic makam classification Erdem Ünal Barış Bozkurt M. Kemal Karaosmanoğlu Tübitak-Bilgem, Bahçeşehir University, Yıldız Teknik University,

More information

EM-based Reinforcement Learning

EM-based Reinforcement Learning EM-based Reinforcement Learning Gerhard Neumann 1 1 TU Darmstadt, Intelligent Autonomous Systems December 21, 2011 Outline Expectation Maximization (EM)-based Reinforcement Learning Recap : Modelling data

More information

Sequences and Information

Sequences and Information Sequences and Information Rahul Siddharthan The Institute of Mathematical Sciences, Chennai, India http://www.imsc.res.in/ rsidd/ Facets 16, 04/07/2016 This box says something By looking at the symbols

More information

Exact Inference Algorithms Bucket-elimination

Exact Inference Algorithms Bucket-elimination Exact Inference Algorithms Bucket-elimination COMPSCI 276, Spring 2013 Class 5: Rina Dechter (Reading: class notes chapter 4, Darwiche chapter 6) 1 Belief Updating Smoking lung Cancer Bronchitis X-ray

More information

An Empirical-Bayes Score for Discrete Bayesian Networks

An Empirical-Bayes Score for Discrete Bayesian Networks An Empirical-Bayes Score for Discrete Bayesian Networks scutari@stats.ox.ac.uk Department of Statistics September 8, 2016 Bayesian Network Structure Learning Learning a BN B = (G, Θ) from a data set D

More information

Exact Inference Algorithms Bucket-elimination

Exact Inference Algorithms Bucket-elimination Exact Inference Algorithms Bucket-elimination COMPSCI 276, Spring 2011 Class 5: Rina Dechter (Reading: class notes chapter 4, Darwiche chapter 6) 1 Belief Updating Smoking lung Cancer Bronchitis X-ray

More information

MACHINE LEARNING 2 UGM,HMMS Lecture 7

MACHINE LEARNING 2 UGM,HMMS Lecture 7 LOREM I P S U M Royal Institute of Technology MACHINE LEARNING 2 UGM,HMMS Lecture 7 THIS LECTURE DGM semantics UGM De-noising HMMs Applications (interesting probabilities) DP for generation probability

More information

ECE 6504: Advanced Topics in Machine Learning Probabilistic Graphical Models and Large-Scale Learning

ECE 6504: Advanced Topics in Machine Learning Probabilistic Graphical Models and Large-Scale Learning ECE 6504: Advanced Topics in Machine Learning Probabilistic Graphical Models and Large-Scale Learning Topics Summary of Class Advanced Topics Dhruv Batra Virginia Tech HW1 Grades Mean: 28.5/38 ~= 74.9%

More information

University of Colorado at Boulder ECEN 4/5532. Lab 2 Lab report due on February 16, 2015

University of Colorado at Boulder ECEN 4/5532. Lab 2 Lab report due on February 16, 2015 University of Colorado at Boulder ECEN 4/5532 Lab 2 Lab report due on February 16, 2015 This is a MATLAB only lab, and therefore each student needs to turn in her/his own lab report and own programs. 1

More information

Non-Negative Matrix Factorization And Its Application to Audio. Tuomas Virtanen Tampere University of Technology

Non-Negative Matrix Factorization And Its Application to Audio. Tuomas Virtanen Tampere University of Technology Non-Negative Matrix Factorization And Its Application to Audio Tuomas Virtanen Tampere University of Technology tuomas.virtanen@tut.fi 2 Contents Introduction to audio signals Spectrogram representation

More information

How Miraculous Things Happen

How Miraculous Things Happen for keyboard sampler and soundfile by Kyle Gann 997 Kyle Gann More than a year before I wrote this piece my then elevenyearold son Bernard began to insist repeatedly that I write a piece called. I don't

More information

A Necessary Condition for Learning from Positive Examples

A Necessary Condition for Learning from Positive Examples Machine Learning, 5, 101-113 (1990) 1990 Kluwer Academic Publishers. Manufactured in The Netherlands. A Necessary Condition for Learning from Positive Examples HAIM SHVAYTSER* (HAIM%SARNOFF@PRINCETON.EDU)

More information

Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation

Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation Jason K. Johnson, Dmitry M. Malioutov and Alan S. Willsky Department of Electrical Engineering and Computer Science Massachusetts Institute

More information

Optimal rejection regions for testing multiple binary endpoints in small samples

Optimal rejection regions for testing multiple binary endpoints in small samples Optimal rejection regions for testing multiple binary endpoints in small samples Robin Ristl and Martin Posch Section for Medical Statistics, Center of Medical Statistics, Informatics and Intelligent Systems,

More information

Structured Prediction Models via the Matrix-Tree Theorem

Structured Prediction Models via the Matrix-Tree Theorem Structured Prediction Models via the Matrix-Tree Theorem Terry Koo Amir Globerson Xavier Carreras Michael Collins maestro@csail.mit.edu gamir@csail.mit.edu carreras@csail.mit.edu mcollins@csail.mit.edu

More information

Inference in Explicit Duration Hidden Markov Models

Inference in Explicit Duration Hidden Markov Models Inference in Explicit Duration Hidden Markov Models Frank Wood Joint work with Chris Wiggins, Mike Dewar Columbia University November, 2011 Wood (Columbia University) EDHMM Inference November, 2011 1 /

More information

Information, Utility & Bounded Rationality

Information, Utility & Bounded Rationality Information, Utility & Bounded Rationality Pedro A. Ortega and Daniel A. Braun Department of Engineering, University of Cambridge Trumpington Street, Cambridge, CB2 PZ, UK {dab54,pao32}@cam.ac.uk Abstract.

More information

Bayesian Learning. Examples. Conditional Probability. Two Roles for Bayesian Methods. Prior Probability and Random Variables. The Chain Rule P (B)

Bayesian Learning. Examples. Conditional Probability. Two Roles for Bayesian Methods. Prior Probability and Random Variables. The Chain Rule P (B) Examples My mood can take 2 possible values: happy, sad. The weather can take 3 possible vales: sunny, rainy, cloudy My friends know me pretty well and say that: P(Mood=happy Weather=rainy) = 0.25 P(Mood=happy

More information

AUDIO CHORD RECOGNITION WITH RECURRENT NEURAL NETWORKS

AUDIO CHORD RECOGNITION WITH RECURRENT NEURAL NETWORKS AUDIO CHORD RECOGNITION WITH RECURRENT NEURAL NETWORKS Nicolas Boulanger-Lewandowski, Yoshua Bengio and Pascal Vincent Dept. IRO, Université de Montréal Montréal, Québec, Canada H3C 3J7 {boulanni, bengioy,

More information

Keywords: Unsupervised Learning, Interactive Computer Music Systems, Music Improvisation, Real-time, Stochastic Processes

Keywords: Unsupervised Learning, Interactive Computer Music Systems, Music Improvisation, Real-time, Stochastic Processes BoB: An Improvisational Music Companion Belinda Thom July 2001 CMU-CS-01-18 School of Computer Science Computer Science Department Carnegie Mellon University Pittsburgh, PA Submitted in partial fulfillment

More information

Robust Multipitch Analyzer against Initialization based on Latent Harmonic Allocation using Overtone Corpus

Robust Multipitch Analyzer against Initialization based on Latent Harmonic Allocation using Overtone Corpus [DOI: 10.2197/ipsjjip.21.246] Regular Paper Robust Multipitch Analyzer against Initialization based on Latent Harmonic Allocation using Overtone Corpus Daichi Saaue 1,a) Katsutoshi Itoyama 1 Tetsuya Ogata

More information

Reliability-Informed Beat Tracking of Musical Signals

Reliability-Informed Beat Tracking of Musical Signals 1 Reliability-Informed Beat Tracking of Musical Signals Norberto Degara, Student Member, IEEE, Enrique Argones Rúa, Member, IEEE, Antonio Pena, Member, IEEE, Soledad Torres-Guijarro, Matthew E. P. Davies,

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Algorithms For Inference Fall 2014

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Algorithms For Inference Fall 2014 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms For Inference Fall 2014 Problem Set 3 Issued: Thursday, September 25, 2014 Due: Thursday,

More information

Computational Systems Biology

Computational Systems Biology Computational Systems Biology Vasant Honavar Artificial Intelligence Research Laboratory Bioinformatics and Computational Biology Graduate Program Center for Computational Intelligence, Learning, & Discovery

More information

Learning Causal Bayesian Networks from Observations and Experiments: A Decision Theoretic Approach

Learning Causal Bayesian Networks from Observations and Experiments: A Decision Theoretic Approach Learning Causal Bayesian Networks from Observations and Experiments: A Decision Theoretic Approach Stijn Meganck 1, Philippe Leray 2, and Bernard Manderick 1 1 Vrije Universiteit Brussel, Pleinlaan 2,

More information

Naïve Bayes classification

Naïve Bayes classification Naïve Bayes classification 1 Probability theory Random variable: a variable whose possible values are numerical outcomes of a random phenomenon. Examples: A person s height, the outcome of a coin toss

More information

Undirected graphical models

Undirected graphical models Undirected graphical models Semantics of probabilistic models over undirected graphs Parameters of undirected models Example applications COMP-652 and ECSE-608, February 16, 2017 1 Undirected graphical

More information

CS 188: Artificial Intelligence Fall 2011

CS 188: Artificial Intelligence Fall 2011 CS 188: Artificial Intelligence Fall 2011 Lecture 20: HMMs / Speech / ML 11/8/2011 Dan Klein UC Berkeley Today HMMs Demo bonanza! Most likely explanation queries Speech recognition A massive HMM! Details

More information

A Bayesian Local Linear Wavelet Neural Network

A Bayesian Local Linear Wavelet Neural Network A Bayesian Local Linear Wavelet Neural Network Kunikazu Kobayashi, Masanao Obayashi, and Takashi Kuremoto Yamaguchi University, 2-16-1, Tokiwadai, Ube, Yamaguchi 755-8611, Japan {koba, m.obayas, wu}@yamaguchi-u.ac.jp

More information

Chaos, Complexity, and Inference (36-462)

Chaos, Complexity, and Inference (36-462) Chaos, Complexity, and Inference (36-462) Lecture 5: Symbolic Dynamics; Making Discrete Stochastic Processes from Continuous Deterministic Dynamics Cosma Shalizi 27 January 2009 Symbolic dynamics Reducing

More information

Dynamic Time-Alignment Kernel in Support Vector Machine

Dynamic Time-Alignment Kernel in Support Vector Machine Dynamic Time-Alignment Kernel in Support Vector Machine Hiroshi Shimodaira School of Information Science, Japan Advanced Institute of Science and Technology sim@jaist.ac.jp Mitsuru Nakai School of Information

More information

An Introduction to Statistical and Probabilistic Linear Models

An Introduction to Statistical and Probabilistic Linear Models An Introduction to Statistical and Probabilistic Linear Models Maximilian Mozes Proseminar Data Mining Fakultät für Informatik Technische Universität München June 07, 2017 Introduction In statistical learning

More information

State Space Abstractions for Reinforcement Learning

State Space Abstractions for Reinforcement Learning State Space Abstractions for Reinforcement Learning Rowan McAllister and Thang Bui MLG RCC 6 November 24 / 24 Outline Introduction Markov Decision Process Reinforcement Learning State Abstraction 2 Abstraction

More information

Chapter 05: Hidden Markov Models

Chapter 05: Hidden Markov Models LEARNING AND INFERENCE IN GRAPHICAL MODELS Chapter 05: Hidden Markov Models Dr. Martin Lauer University of Freiburg Machine Learning Lab Karlsruhe Institute of Technology Institute of Measurement and Control

More information

Lecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016

Lecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016 Lecture 15: MCMC Sanjeev Arora Elad Hazan COS 402 Machine Learning and Artificial Intelligence Fall 2016 Course progress Learning from examples Definition + fundamental theorem of statistical learning,

More information

REALTIME alignment of audio signals to symbolic music. A coupled duration-focused architecture for realtime music to score alignment

REALTIME alignment of audio signals to symbolic music. A coupled duration-focused architecture for realtime music to score alignment Author manuscript, published in IEEE Transaction on Pattern Analysis and Machine Intelligence 32 (21) 974-987 DOI : 1.119/TPAMI.29.16 A coupled duration-focused architecture for realtime music to score

More information

Realtime Tempo Tracking using Kalman Filtering

Realtime Tempo Tracking using Kalman Filtering Realtime Tempo Tracking using Kalman Filtering Tim van Kasteren Supervisors: Dr. A. Taylan Cemgil Dr. ir. B.J.A. Kröse March 2006 University of Amsterdam Tim van Kasteren Realtime Tempo Tracking using

More information

Parallel Tempering is Efficient for Learning Restricted Boltzmann Machines

Parallel Tempering is Efficient for Learning Restricted Boltzmann Machines Parallel Tempering is Efficient for Learning Restricted Boltzmann Machines KyungHyun Cho, Tapani Raiko, Alexander Ilin Abstract A new interest towards restricted Boltzmann machines (RBMs) has risen due

More information

PROBABILISTIC EXTRACTION OF BEAT POSITIONS FROM A BEAT ACTIVATION FUNCTION

PROBABILISTIC EXTRACTION OF BEAT POSITIONS FROM A BEAT ACTIVATION FUNCTION PROBABILISTIC EXTRACTION OF BEAT POSITIONS FROM A BEAT ACTIVATION FUNCTION Filip Korzeniowski, Sebastian Böck, and Gerhard Widmer Department of Computational Perception Johannes Kepler University, Linz,

More information

CS379H Undergraduate Thesis

CS379H Undergraduate Thesis CS379H Undergraduate Thesis Polyphonic Guitar Transcription by Bayesian Methods Mark Kedzierski University of Texas at Austin, Department of Computer Sciences 2005 2 CS379 Honors Thesis - Mark Kedzierski

More information

Know your major scales

Know your major scales page 8 Know your major scales Major and minor scales use every note name (A B C D E F G), but start on different notes. The notes of a scale move stepwise by intervals of a tone or semitone. The pattern

More information

A reinforcement learning scheme for a multi-agent card game with Monte Carlo state estimation

A reinforcement learning scheme for a multi-agent card game with Monte Carlo state estimation A reinforcement learning scheme for a multi-agent card game with Monte Carlo state estimation Hajime Fujita and Shin Ishii, Nara Institute of Science and Technology 8916 5 Takayama, Ikoma, 630 0192 JAPAN

More information

Musimathics The Mathematical Foundations of Music Volume 2. Gareth Loy. Foreword by John Chowning

Musimathics The Mathematical Foundations of Music Volume 2. Gareth Loy. Foreword by John Chowning Musimathics The Mathematical Foundations of Music Volume 2 Gareth Loy Foreword by John Chowning The MIT Press Cambridge, Massachusetts London, England ..2.3.4.5.6.7.8.9.0..2.3.4 2 2. 2.2 2.3 2.4 2.5 2.6

More information

An Adaptive Clustering Method for Model-free Reinforcement Learning

An Adaptive Clustering Method for Model-free Reinforcement Learning An Adaptive Clustering Method for Model-free Reinforcement Learning Andreas Matt and Georg Regensburger Institute of Mathematics University of Innsbruck, Austria {andreas.matt, georg.regensburger}@uibk.ac.at

More information

Semi-Supervised Learning through Principal Directions Estimation

Semi-Supervised Learning through Principal Directions Estimation Semi-Supervised Learning through Principal Directions Estimation Olivier Chapelle, Bernhard Schölkopf, Jason Weston Max Planck Institute for Biological Cybernetics, 72076 Tübingen, Germany {first.last}@tuebingen.mpg.de

More information

Control of Dynamic Systems Using Bayesian Networks?

Control of Dynamic Systems Using Bayesian Networks? Control of Dynamic Systems Using Bayesian Networks? RAINER DEVENTER, JOACHIM DENZLER, HEINRICH NIEMANN Chair for pattern recognition Martensstr. 3 D 9158 Erlangen Telephone: +49 ()9131 85-785 fdeventer,

More information

Beyond Uniform Priors in Bayesian Network Structure Learning

Beyond Uniform Priors in Bayesian Network Structure Learning Beyond Uniform Priors in Bayesian Network Structure Learning (for Discrete Bayesian Networks) scutari@stats.ox.ac.uk Department of Statistics April 5, 2017 Bayesian Network Structure Learning Learning

More information

A Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement

A Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement A Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement Simon Leglaive 1 Laurent Girin 1,2 Radu Horaud 1 1: Inria Grenoble Rhône-Alpes 2: Univ. Grenoble Alpes, Grenoble INP,

More information