Monitoring System Of Phytoplankton Blooms By Using Unsupervised Classifier And Time Modelling

Size: px
Start display at page:

Download "Monitoring System Of Phytoplankton Blooms By Using Unsupervised Classifier And Time Modelling"

Transcription

1 Monitoring System Of Phytoplankton Blooms By Using Unsupervised Classifier And Time Modelling Kevin Rousseeuw, IFREMER/LISIC Emilie Caillault, LISIC Alain Lefebvre, IFREMER Denis Hamad, LISIC

2 Summary Marel-Carnot Station General scheme Hybrid K-means / Hidden Markov Model Unsupervised Classification Building HMM Representation Results Conclusion

3 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

4 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

5 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

6 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

7 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

8 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

9 Marel-Carnot Station Located in the harbor of Boulogne-sur-Mer, France It is a strong area of fishing, coastal strip, pressures from «La Liane», common toxic species, But where is Boulogne-sur-Mer?

10 Marel-Carnot Station 19 data signals 16 physics characteristics every 20 minutes (Fluorescence, Turbidity, Corrected Dissolved Oxygen, Temperature, ) 3 nutrients levels every 12h (Nitrate, Phosphate, Silicate) Representation of 6 mains parameters

11 Marel-Carnot Station The Fluorescence is us indicator of bloom. The bloom are not cyclical and the level is different by years. Representation of the Fluorescence

12 Marel-Carnot Station Year Percent Percent age of age of data data with at with at Number least least of data one five paramet paramet er ers missing missing 105, ,

13 General Scheme

14 Hybrid K-mean / Hidden Markov Model

15 Unsupervised Classification Using the fast K-means algorithm (Hartigan-Wong 1979) Algorithm: if number of data > 20,000 points select randomly 20,000 points K-means Using centers in the 2nd K-means

16 Building HMM Representation The HMM is noted λ=(k, K2, π, A, B) K the number of classes (first K-means) K2 the number of symbols in the codebook (second K-means) π of size K, defines the initial probability distribution A of size n*n, defines the transition matrix B of size n*k2, defines the emissions matrix

17 Results Time period: Parameters used: Nutrients (Nitrate, Phosphate, Silicate) Turbidity Corrected Dissolved Oxygen The Fluorescence is used for the visual validation

18 Results of classification (K=2) Detection productive and non-productive periods Distribution of data in each class Temporal change of the fluorescence for the year 2008

19 Results of classification (K=5) Ideally, the environmental states would be: prebloom, bloom, post-bloom, no productive and rare events It is possible to label 2 environmental states within a given bloom (colors green and cyan)

20 Results of classification (K=5) The representation of the Principal Component of the class «green» and «cyan» The structural parameters are: Fluorescence, Oxygen, Salinity, Conductivity and the Wind Class green Class blue

21 Result of prediction (K=5) Each new data is labelling on the codebook (knn). This labelling and the HMM are using with the Viterbi algorithm. Percentage of same labelling by the clustering method and the time modelling for each year is the following: Year Recogn ition Rate

22 Result of prediction (K=5) This figure illustrates the state labelling on the fluorescence signal for year 2009 A unique bloom is detected, so the system is able to detect if one species is dominant

23 Conclusion The monitoring system allows to: Understand the environmental state (parameter release, event precedent release) of a bloom of phytoplankton species or group Predict a possible harmful bloom Refine the measurement campaigns in critical period

24 Thank you Do you have any questions?

Hybrid hidden Markov model for marine environment monitoring

Hybrid hidden Markov model for marine environment monitoring 1 Ieee Journal Of Selected Topics In Applied Earth Observations And Remote Sensing January 2015, Volume 8 Issue 1 Pages 204-213 http://dx.doi.org/10.1109/jstars.2014.2341219 http://archimer.ifremer.fr/doc/00255/36643/

More information

Using Hidden Markov Models as a Statistical Process Control Technique: An Example from a ML 5 Organization

Using Hidden Markov Models as a Statistical Process Control Technique: An Example from a ML 5 Organization Using Hidden Markov Models as a Statistical Process Control Technique: An Example from a ML 5 Organization Bob Moore, Senior Principal Process Engineer, Business, Inc. (BTI) Ray Luke, Engineer, Raytheon

More information

Lecture 7: Pitch and Chord (2) HMM, pitch detection functions. Li Su 2016/03/31

Lecture 7: Pitch and Chord (2) HMM, pitch detection functions. Li Su 2016/03/31 Lecture 7: Pitch and Chord (2) HMM, pitch detection functions Li Su 2016/03/31 Chord progressions Chord progressions are not arbitrary Example 1: I-IV-I-V-I (C-F-C-G-C) Example 2: I-V-VI-III-IV-I-II-V

More information

Existing modelling studies on shellfish

Existing modelling studies on shellfish Existing modelling studies on shellfish Laboratoire Ressources Halieutiques IFREMER Port-en-Bessin, France Worldwide production of cultured shellfish GENIMPACT February 2007 Main species and producers

More information

QUESTIONNAIRE. Harmful Algal Bloom and Microbial Contamination Bulletin in France

QUESTIONNAIRE. Harmful Algal Bloom and Microbial Contamination Bulletin in France QUESTIONNAIRE Harmful Algal Bloom and Microbial Contamination Bulletin in France This short questionnaire aims to gather opinions from shellfish and fin-fish producers to help to tailor the PRIMROSE Harmful

More information

Correlation Preserving Unsupervised Discretization. Outline

Correlation Preserving Unsupervised Discretization. Outline Correlation Preserving Unsupervised Discretization Jee Vang Outline Paper References What is discretization? Motivation Principal Component Analysis (PCA) Association Mining Correlation Preserving Discretization

More information

Human Mobility Pattern Prediction Algorithm using Mobile Device Location and Time Data

Human Mobility Pattern Prediction Algorithm using Mobile Device Location and Time Data Human Mobility Pattern Prediction Algorithm using Mobile Device Location and Time Data 0. Notations Myungjun Choi, Yonghyun Ro, Han Lee N = number of states in the model T = length of observation sequence

More information

Hidden Markov Models. Representing sequence data. Markov Models. A dice-y example 4/5/2017. CISC 5800 Professor Daniel Leeds Π A = 0.3, Π B = 0.

Hidden Markov Models. Representing sequence data. Markov Models. A dice-y example 4/5/2017. CISC 5800 Professor Daniel Leeds Π A = 0.3, Π B = 0. Representing sequence data Hidden Markov Models CISC 5800 Professor Daniel Leeds Spoken language DNA sequences Daily stock values Example: spoken language F?r plu? fi?e is nine Between F and r expect a

More information

Hidden Markov Models Part 2: Algorithms

Hidden Markov Models Part 2: Algorithms Hidden Markov Models Part 2: Algorithms CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 Hidden Markov Model An HMM consists of:

More information

Hidden Markov Models. Representing sequence data. Markov Models. A dice-y example 4/26/2018. CISC 5800 Professor Daniel Leeds Π A = 0.3, Π B = 0.

Hidden Markov Models. Representing sequence data. Markov Models. A dice-y example 4/26/2018. CISC 5800 Professor Daniel Leeds Π A = 0.3, Π B = 0. Representing sequence data Hidden Markov Models CISC 5800 Professor Daniel Leeds Spoken language DNA sequences Daily stock values Example: spoken language F?r plu? fi?e is nine Between F and r expect a

More information

10. Hidden Markov Models (HMM) for Speech Processing. (some slides taken from Glass and Zue course)

10. Hidden Markov Models (HMM) for Speech Processing. (some slides taken from Glass and Zue course) 10. Hidden Markov Models (HMM) for Speech Processing (some slides taken from Glass and Zue course) Definition of an HMM The HMM are powerful statistical methods to characterize the observed samples of

More information

15-381: Artificial Intelligence. Hidden Markov Models (HMMs)

15-381: Artificial Intelligence. Hidden Markov Models (HMMs) 15-381: Artificial Intelligence Hidden Markov Models (HMMs) What s wrong with Bayesian networks Bayesian networks are very useful for modeling joint distributions But they have their limitations: - Cannot

More information

Inferring the Chlorophyll-A vertical distribution in the ocean from satellite data by using Hidden Markov Models and Self Organizing Maps.

Inferring the Chlorophyll-A vertical distribution in the ocean from satellite data by using Hidden Markov Models and Self Organizing Maps. Inferring the Chlorophyll-A vertical distribution in the ocean from satellite data by using Hidden Markov Models and Self Organizing Maps. AMS 2012 NEW ORLEANS 23/01/2012 A.A.Charantonis S.Thiria, C.Moulin

More information

Computational Genomics and Molecular Biology, Fall

Computational Genomics and Molecular Biology, Fall Computational Genomics and Molecular Biology, Fall 2011 1 HMM Lecture Notes Dannie Durand and Rose Hoberman October 11th 1 Hidden Markov Models In the last few lectures, we have focussed on three problems

More information

A.I. in health informatics lecture 8 structured learning. kevin small & byron wallace

A.I. in health informatics lecture 8 structured learning. kevin small & byron wallace A.I. in health informatics lecture 8 structured learning kevin small & byron wallace today models for structured learning: HMMs and CRFs structured learning is particularly useful in biomedical applications:

More information

Time-series observations in the Northern Indian Ocean V.V.S.S. Sarma National Institute of Oceanography Visakhapatnam, India

Time-series observations in the Northern Indian Ocean V.V.S.S. Sarma National Institute of Oceanography Visakhapatnam, India The Second GEOSS Asia-Pacific Symposium, Tokyo, 14-16 th April 28 Time-series observations in the Northern Indian Ocean V.V.S.S. Sarma National Institute of Oceanography Visakhapatnam, India Seasonal variations

More information

p(d θ ) l(θ ) 1.2 x x x

p(d θ ) l(θ ) 1.2 x x x p(d θ ).2 x 0-7 0.8 x 0-7 0.4 x 0-7 l(θ ) -20-40 -60-80 -00 2 3 4 5 6 7 θ ˆ 2 3 4 5 6 7 θ ˆ 2 3 4 5 6 7 θ θ x FIGURE 3.. The top graph shows several training points in one dimension, known or assumed to

More information

Modeling Complex Temporal Composition of Actionlets for Activity Prediction

Modeling Complex Temporal Composition of Actionlets for Activity Prediction Modeling Complex Temporal Composition of Actionlets for Activity Prediction ECCV 2012 Activity Recognition Reading Group Framework of activity prediction What is an Actionlet To segment a long sequence

More information

HAB Forecaster. For info on HABs in the Pacific Northwest see:

HAB Forecaster. For info on HABs in the Pacific Northwest see: HAB Forecaster BACKGROUND In this activity, students can take on the role as a resource manager or scientist, tasked with deciding if razor clam harvesters should go out onto the beach to harvest razor

More information

Life on Earth

Life on Earth Life on Earth By feeding, i.e. source of energy a) Autotrophs, self-feeding, e.g. plants (phyto-) b) Heterotrophs, eat others, e.g. animals (zoo-) By feeding, i.e. source of energy a) Autotrophs b)

More information

Sequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015

Sequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015 Sequence Modelling with Features: Linear-Chain Conditional Random Fields COMP-599 Oct 6, 2015 Announcement A2 is out. Due Oct 20 at 1pm. 2 Outline Hidden Markov models: shortcomings Generative vs. discriminative

More information

Math 350: An exploration of HMMs through doodles.

Math 350: An exploration of HMMs through doodles. Math 350: An exploration of HMMs through doodles. Joshua Little (407673) 19 December 2012 1 Background 1.1 Hidden Markov models. Markov chains (MCs) work well for modelling discrete-time processes, or

More information

L23: hidden Markov models

L23: hidden Markov models L23: hidden Markov models Discrete Markov processes Hidden Markov models Forward and Backward procedures The Viterbi algorithm This lecture is based on [Rabiner and Juang, 1993] Introduction to Speech

More information

RESEARCH EDGE SPECTRAL REMOTE SENSING OF THE COAST. Karl Heinz Szekielda

RESEARCH EDGE SPECTRAL REMOTE SENSING OF THE COAST. Karl Heinz Szekielda Research Edge Working Paper Series, no. 8 p. 1 RESEARCH EDGE SPECTRAL REMOTE SENSING OF THE COAST Karl Heinz Szekielda City University of New York Fulbright Scholar at, Nassau, The Bahamas Email: karl.szekielda@gmail.com

More information

6.047 / Computational Biology: Genomes, Networks, Evolution Fall 2008

6.047 / Computational Biology: Genomes, Networks, Evolution Fall 2008 MIT OpenCourseWare http://ocw.mit.edu 6.047 / 6.878 Computational Biology: Genomes, Networks, Evolution Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

91 PERCENTAGE COMPOSITION

91 PERCENTAGE COMPOSITION 91 PERCENTAGE COMPOSITION - sometimes called "percent composition" or "percent composition by mass" - the percentage of each element in a compound, expressed in terms of mass Example: Find the percentage

More information

When Dictionary Learning Meets Classification

When Dictionary Learning Meets Classification When Dictionary Learning Meets Classification Bufford, Teresa 1 Chen, Yuxin 2 Horning, Mitchell 3 Shee, Liberty 1 Mentor: Professor Yohann Tendero 1 UCLA 2 Dalhousie University 3 Harvey Mudd College August

More information

More on HMMs and other sequence models. Intro to NLP - ETHZ - 18/03/2013

More on HMMs and other sequence models. Intro to NLP - ETHZ - 18/03/2013 More on HMMs and other sequence models Intro to NLP - ETHZ - 18/03/2013 Summary Parts of speech tagging HMMs: Unsupervised parameter estimation Forward Backward algorithm Bayesian variants Discriminative

More information

CS 7180: Behavioral Modeling and Decision- making in AI

CS 7180: Behavioral Modeling and Decision- making in AI CS 7180: Behavioral Modeling and Decision- making in AI Hidden Markov Models Prof. Amy Sliva October 26, 2012 Par?ally observable temporal domains POMDPs represented uncertainty about the state Belief

More information

Biology 644: Bioinformatics

Biology 644: Bioinformatics A stochastic (probabilistic) model that assumes the Markov property Markov property is satisfied when the conditional probability distribution of future states of the process (conditional on both past

More information

Chemistry. Essential Standards Chemistry

Chemistry. Essential Standards Chemistry Essential Standards Chemistry Chemistry Matter: Properties & Change 1.1 Students will analyze the structure of atoms and ions. 1.2 Student will understand the bonding that occurs in simple compounds in

More information

Automatic Detection of RWIS Sensor Malfunctions (Phase II)

Automatic Detection of RWIS Sensor Malfunctions (Phase II) Automatic Detection of RWIS Sensor Malfunctions (Phase II) Final Report Prepared by: Carolyn J. Crouch Donald B. Crouch Richard M. Maclin Aditya Polumetla Department of Computer Science University of Minnesota

More information

Machine Learning for natural language processing

Machine Learning for natural language processing Machine Learning for natural language processing Hidden Markov Models Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Summer 2016 1 / 33 Introduction So far, we have classified texts/observations

More information

Sequence Labeling: HMMs & Structured Perceptron

Sequence Labeling: HMMs & Structured Perceptron Sequence Labeling: HMMs & Structured Perceptron CMSC 723 / LING 723 / INST 725 MARINE CARPUAT marine@cs.umd.edu HMM: Formal Specification Q: a finite set of N states Q = {q 0, q 1, q 2, q 3, } N N Transition

More information

Overview of Statistical Tools. Statistical Inference. Bayesian Framework. Modeling. Very simple case. Things are usually more complicated

Overview of Statistical Tools. Statistical Inference. Bayesian Framework. Modeling. Very simple case. Things are usually more complicated Fall 3 Computer Vision Overview of Statistical Tools Statistical Inference Haibin Ling Observation inference Decision Prior knowledge http://www.dabi.temple.edu/~hbling/teaching/3f_5543/index.html Bayesian

More information

Phytoplankton. Zooplankton. Nutrients

Phytoplankton. Zooplankton. Nutrients Phytoplankton Zooplankton Nutrients Patterns of Productivity There is a large Spring Bloom in the North Atlantic (temperate latitudes remember the Gulf Stream!) What is a bloom? Analogy to terrestrial

More information

BMI/CS 576 Fall 2016 Final Exam

BMI/CS 576 Fall 2016 Final Exam BMI/CS 576 all 2016 inal Exam Prof. Colin Dewey Saturday, December 17th, 2016 10:05am-12:05pm Name: KEY Write your answers on these pages and show your work. You may use the back sides of pages as necessary.

More information

Clustering and Prediction of Solar Radiation Daily Patterns

Clustering and Prediction of Solar Radiation Daily Patterns Int'l Conf. Data Mining DMIN'16 3 Clustering and Prediction of Solar Radiation Daily Patterns G. Nunnari 1, and S. Nunnari 1 1 Dipartimento di Ingegneria Elettrica, Elettronica e Informatica, Universitá

More information

2001 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Newfoundland Region

2001 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Newfoundland Region Stock Status Report G2-2 (2) 1 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Background The Altantic Zone Monitoring Program (AZMP) was implemented in 1998 with the aim of

More information

CISC 889 Bioinformatics (Spring 2004) Hidden Markov Models (II)

CISC 889 Bioinformatics (Spring 2004) Hidden Markov Models (II) CISC 889 Bioinformatics (Spring 24) Hidden Markov Models (II) a. Likelihood: forward algorithm b. Decoding: Viterbi algorithm c. Model building: Baum-Welch algorithm Viterbi training Hidden Markov models

More information

STA 414/2104: Machine Learning

STA 414/2104: Machine Learning STA 414/2104: Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistics! rsalakhu@cs.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 9 Sequential Data So far

More information

Shankar Shivappa University of California, San Diego April 26, CSE 254 Seminar in learning algorithms

Shankar Shivappa University of California, San Diego April 26, CSE 254 Seminar in learning algorithms Recognition of Visual Speech Elements Using Adaptively Boosted Hidden Markov Models. Say Wei Foo, Yong Lian, Liang Dong. IEEE Transactions on Circuits and Systems for Video Technology, May 2004. Shankar

More information

Statistical NLP: Hidden Markov Models. Updated 12/15

Statistical NLP: Hidden Markov Models. Updated 12/15 Statistical NLP: Hidden Markov Models Updated 12/15 Markov Models Markov models are statistical tools that are useful for NLP because they can be used for part-of-speech-tagging applications Their first

More information

Fluorometry Project Chlorophyll Temperature Time Series

Fluorometry Project Chlorophyll Temperature Time Series Fluorometry Project Ocean Institute + Scripps Institution of Oceanography Chlorophyll Temperature Time Series The California Current Long Term Ecological Research (CCE LTER) Phytoplankton Phytoplankton

More information

ECE 521. Lecture 11 (not on midterm material) 13 February K-means clustering, Dimensionality reduction

ECE 521. Lecture 11 (not on midterm material) 13 February K-means clustering, Dimensionality reduction ECE 521 Lecture 11 (not on midterm material) 13 February 2017 K-means clustering, Dimensionality reduction With thanks to Ruslan Salakhutdinov for an earlier version of the slides Overview K-means clustering

More information

USEPA National Watershed Protection Program NY/NJ Harbor Estuary Program USEPA Region 2 New York, New York. USEPA Contract EP-C

USEPA National Watershed Protection Program NY/NJ Harbor Estuary Program USEPA Region 2 New York, New York. USEPA Contract EP-C USEPA National Watershed Protection Program NY/NJ Harbor Estuary Program USEPA Region 2, EVALUATION OF AMMONIA TOXICITY IN THE NY/NJ HARBOR WITHIN THE CONTEXT OF NITROGEN AND CARBON TMDL PLANNING FOR ATTAINMENT

More information

A Comparative Evaluation of Anomaly Detection Techniques for Sequence Data. Technical Report

A Comparative Evaluation of Anomaly Detection Techniques for Sequence Data. Technical Report A Comparative Evaluation of Anomaly Detection Techniques for Sequence Data Technical Report Department of Computer Science and Engineering University of Minnesota 4-192 EECS Building 200 Union Street SE

More information

Hidden Markov Models NIKOLAY YAKOVETS

Hidden Markov Models NIKOLAY YAKOVETS Hidden Markov Models NIKOLAY YAKOVETS A Markov System N states s 1,..,s N S 2 S 1 S 3 A Markov System N states s 1,..,s N S 2 S 1 S 3 modeling weather A Markov System state changes over time.. S 1 S 2

More information

Physiography Ocean Provinces p. 1 Dimensions p. 1 Physiographic Provinces p. 2 Continental Margin Province p. 2 Deep-Ocean Basin Province p.

Physiography Ocean Provinces p. 1 Dimensions p. 1 Physiographic Provinces p. 2 Continental Margin Province p. 2 Deep-Ocean Basin Province p. Physiography Ocean Provinces p. 1 Dimensions p. 1 Physiographic Provinces p. 2 Continental Margin Province p. 2 Deep-Ocean Basin Province p. 2 Mid-Ocean Ridge Province p. 3 Benthic and Pelagic Provinces

More information

Probabilistic Models for Sequence Labeling

Probabilistic Models for Sequence Labeling Probabilistic Models for Sequence Labeling Besnik Fetahu June 9, 2011 Besnik Fetahu () Probabilistic Models for Sequence Labeling June 9, 2011 1 / 26 Background & Motivation Problem introduction Generative

More information

Hidden Markov Models Part 1: Introduction

Hidden Markov Models Part 1: Introduction Hidden Markov Models Part 1: Introduction CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 Modeling Sequential Data Suppose that

More information

Hidden Markov Models. Hosein Mohimani GHC7717

Hidden Markov Models. Hosein Mohimani GHC7717 Hidden Markov Models Hosein Mohimani GHC7717 hoseinm@andrew.cmu.edu Fair et Casino Problem Dealer flips a coin and player bets on outcome Dealer use either a fair coin (head and tail equally likely) or

More information

Probabilistic Graphical Models Homework 2: Due February 24, 2014 at 4 pm

Probabilistic Graphical Models Homework 2: Due February 24, 2014 at 4 pm Probabilistic Graphical Models 10-708 Homework 2: Due February 24, 2014 at 4 pm Directions. This homework assignment covers the material presented in Lectures 4-8. You must complete all four problems to

More information

OCEANOGRAPHIC DATA MANAGEMENT

OCEANOGRAPHIC DATA MANAGEMENT OCEANOGRAPHIC DATA MANAGEMENT Presented to: Environmental Disaster Data Management Meeting Russ Beard Director, National Coastal Data Development Center Interim Science Coordinator, Gulf Restoration Council

More information

9693 MARINE SCIENCE. Mark schemes should be read in conjunction with the question paper and the Principal Examiner Report for Teachers.

9693 MARINE SCIENCE. Mark schemes should be read in conjunction with the question paper and the Principal Examiner Report for Teachers. CAMBRIDGE INTERNATIONAL EXAMINATIONS GCE Advanced Subsidiary Level and GCE Advanced Level MARK SCHEME for the May/June 2013 series 9693 MARINE SCIENCE 9693/02 Paper 2 (AS Data-Handling and Free-Response),

More information

Hidden Markov Models

Hidden Markov Models CS769 Spring 2010 Advanced Natural Language Processing Hidden Markov Models Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu 1 Part-of-Speech Tagging The goal of Part-of-Speech (POS) tagging is to label each

More information

Seasonal and mesoscale variability of phytoplankton in the Arabian Sea. from satellite observations to models

Seasonal and mesoscale variability of phytoplankton in the Arabian Sea. from satellite observations to models Seasonal and mesoscale variability of phytoplankton in the Arabian Sea from satellite observations to models Marina Lévy NIO Winter school, Feb 2015 LOCEAN-IPSL, France 1 Introduction Arabian Sea Chlorophyll

More information

8: Hidden Markov Models

8: Hidden Markov Models 8: Hidden Markov Models Machine Learning and Real-world Data Simone Teufel and Ann Copestake Computer Laboratory University of Cambridge Lent 2017 Last session: catchup 1 Research ideas from sentiment

More information

Machine learning for biological trajectory classification applications

Machine learning for biological trajectory classification applications Center for Turbulence Research Proceedings of the Summer Program 22 35 Machine learning for biological trajectory classification applications By Ivo F. Sbalzarini, Julie Theriot AND Petros Koumoutsakos

More information

Physical Geography Lab Activity #15

Physical Geography Lab Activity #15 Physical Geography Lab Activity #15 Due date Name Choropleth Maps COR Objective 1 & 7, SLOs 1 & 3 15.1. Introduction Up until this point we have used maps to find locations on the Earth. While they are

More information

STRATOGEM The Strait of Georgia Ecosystem Project

STRATOGEM The Strait of Georgia Ecosystem Project STRATOGEM The Strait of Georgia Ecosystem Project R. Pawlowicz 1 S. Allen 1, J. Dower 2, R. Lee 1, S. Harris 1, M. Halverson 1, O. Riche 1 and T. Bird 2 1 Deptartment of Earth and Ocean Sciences, University

More information

Prokaryotes Vs. Eukaryotes

Prokaryotes Vs. Eukaryotes The Microbial World Prokaryotes Vs. Eukaryotes Mircrobes of the Ocean Primary Producers Are the organisms that produce bio-mass from inorganic compounds (autotrophs). -Photosynthetic autotrophs Phytoplankton

More information

These numbers are the masses of each element in a mole of the compound!

These numbers are the masses of each element in a mole of the compound! 91 PERCENTAGE COMPOSITION - sometimes called "percent composition" or "percent composition by mass" - the percentage of each element in a compound, expressed in terms of mass Example: Find the percentage

More information

CSCI 5832 Natural Language Processing. Today 2/19. Statistical Sequence Classification. Lecture 9

CSCI 5832 Natural Language Processing. Today 2/19. Statistical Sequence Classification. Lecture 9 CSCI 5832 Natural Language Processing Jim Martin Lecture 9 1 Today 2/19 Review HMMs for POS tagging Entropy intuition Statistical Sequence classifiers HMMs MaxEnt MEMMs 2 Statistical Sequence Classification

More information

Data-Intensive Computing with MapReduce

Data-Intensive Computing with MapReduce Data-Intensive Computing with MapReduce Session 8: Sequence Labeling Jimmy Lin University of Maryland Thursday, March 14, 2013 This work is licensed under a Creative Commons Attribution-Noncommercial-Share

More information

Ms. A. Mormando's Class *

Ms. A. Mormando's Class * 8 th Grade Science Essential Standard: 8.E.1.1 Explain the structure of the hydrosphere including: Water distribution on Earth; Local river basin and water availability Stream - A stream is a body of water

More information

Algorithmisches Lernen/Machine Learning

Algorithmisches Lernen/Machine Learning Algorithmisches Lernen/Machine Learning Part 1: Stefan Wermter Introduction Connectionist Learning (e.g. Neural Networks) Decision-Trees, Genetic Algorithms Part 2: Norman Hendrich Support-Vector Machines

More information

Background Field program information Examples of measurements Wind validation for synthetic modeling effort

Background Field program information Examples of measurements Wind validation for synthetic modeling effort Background Field program information Examples of measurements Wind validation for synthetic modeling effort How do complex fine-scale structure and processes in coastal waters dominated by pulsed-river

More information

Basic math for biology

Basic math for biology Basic math for biology Lei Li Florida State University, Feb 6, 2002 The EM algorithm: setup Parametric models: {P θ }. Data: full data (Y, X); partial data Y. Missing data: X. Likelihood and maximum likelihood

More information

Hidden Markov Models. Main source: Durbin et al., Biological Sequence Alignment (Cambridge, 98)

Hidden Markov Models. Main source: Durbin et al., Biological Sequence Alignment (Cambridge, 98) Hidden Markov Models Main source: Durbin et al., Biological Sequence Alignment (Cambridge, 98) 1 The occasionally dishonest casino A P A (1) = P A (2) = = 1/6 P A->B = P B->A = 1/10 B P B (1)=0.1... P

More information

A gentle introduction to Hidden Markov Models

A gentle introduction to Hidden Markov Models A gentle introduction to Hidden Markov Models Mark Johnson Brown University November 2009 1 / 27 Outline What is sequence labeling? Markov models Hidden Markov models Finding the most likely state sequence

More information

Long-term Water Quality Monitoring in Estero Bay

Long-term Water Quality Monitoring in Estero Bay Long-term Water Quality Monitoring in Estero Bay Keith Kibbey Laboratory Director Lee County Environmental Laboratory Division of Natural Resource Management Estero Bay Monitoring Programs Three significant

More information

STATS 306B: Unsupervised Learning Spring Lecture 5 April 14

STATS 306B: Unsupervised Learning Spring Lecture 5 April 14 STATS 306B: Unsupervised Learning Spring 2014 Lecture 5 April 14 Lecturer: Lester Mackey Scribe: Brian Do and Robin Jia 5.1 Discrete Hidden Markov Models 5.1.1 Recap In the last lecture, we introduced

More information

COMP90051 Statistical Machine Learning

COMP90051 Statistical Machine Learning COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Trevor Cohn 24. Hidden Markov Models & message passing Looking back Representation of joint distributions Conditional/marginal independence

More information

CHEMICAL CALCULATIONS - RELATING MASS AND ATOMS

CHEMICAL CALCULATIONS - RELATING MASS AND ATOMS CHEMICAL CALCULATIONS - RELATING MASS AND ATOMS Chemical equations are written and balanced in terms of ATOMS and MOLECULES - While chemical equations are written in terms of ATOMS and MOLECULES, that's

More information

2. What is a phytoplankton bloom and when does it generally occur in the North Atlantic?

2. What is a phytoplankton bloom and when does it generally occur in the North Atlantic? Name: Date: Guiding Question: Seasonal Cycles: the North Atlantic Phytoplankton Bloom What are the factors that control the patterns/cycles of phytoplankton growth in the North Atlantic Ocean? Introduction

More information

HIDDEN MARKOV MODELS IN SPEECH RECOGNITION

HIDDEN MARKOV MODELS IN SPEECH RECOGNITION HIDDEN MARKOV MODELS IN SPEECH RECOGNITION Wayne Ward Carnegie Mellon University Pittsburgh, PA 1 Acknowledgements Much of this talk is derived from the paper "An Introduction to Hidden Markov Models",

More information

Statistical Methods for NLP

Statistical Methods for NLP Statistical Methods for NLP Sequence Models Joakim Nivre Uppsala University Department of Linguistics and Philology joakim.nivre@lingfil.uu.se Statistical Methods for NLP 1(21) Introduction Structured

More information

Hidden Markov Models. Dr. Naomi Harte

Hidden Markov Models. Dr. Naomi Harte Hidden Markov Models Dr. Naomi Harte The Talk Hidden Markov Models What are they? Why are they useful? The maths part Probability calculations Training optimising parameters Viterbi unseen sequences Real

More information

University of Cambridge. MPhil in Computer Speech Text & Internet Technology. Module: Speech Processing II. Lecture 2: Hidden Markov Models I

University of Cambridge. MPhil in Computer Speech Text & Internet Technology. Module: Speech Processing II. Lecture 2: Hidden Markov Models I University of Cambridge MPhil in Computer Speech Text & Internet Technology Module: Speech Processing II Lecture 2: Hidden Markov Models I o o o o o 1 2 3 4 T 1 b 2 () a 12 2 a 3 a 4 5 34 a 23 b () b ()

More information

Deep Learning for Natural Language Processing. Sidharth Mudgal April 4, 2017

Deep Learning for Natural Language Processing. Sidharth Mudgal April 4, 2017 Deep Learning for Natural Language Processing Sidharth Mudgal April 4, 2017 Table of contents 1. Intro 2. Word Vectors 3. Word2Vec 4. Char Level Word Embeddings 5. Application: Entity Matching 6. Conclusion

More information

Genome 373: Hidden Markov Models II. Doug Fowler

Genome 373: Hidden Markov Models II. Doug Fowler Genome 373: Hidden Markov Models II Doug Fowler Review From Hidden Markov Models I What does a Markov model describe? Review From Hidden Markov Models I A T A Markov model describes a random process of

More information

Hidden Markov Models. Terminology, Representation and Basic Problems

Hidden Markov Models. Terminology, Representation and Basic Problems Hidden Markov Models Terminology, Representation and Basic Problems Data analysis? Machine learning? In bioinformatics, we analyze a lot of (sequential) data (biological sequences) to learn unknown parameters

More information

CS711008Z Algorithm Design and Analysis

CS711008Z Algorithm Design and Analysis .. Lecture 6. Hidden Markov model and Viterbi s decoding algorithm Institute of Computing Technology Chinese Academy of Sciences, Beijing, China . Outline The occasionally dishonest casino: an example

More information

Hidden Markov Models. based on chapters from the book Durbin, Eddy, Krogh and Mitchison Biological Sequence Analysis via Shamir s lecture notes

Hidden Markov Models. based on chapters from the book Durbin, Eddy, Krogh and Mitchison Biological Sequence Analysis via Shamir s lecture notes Hidden Markov Models based on chapters from the book Durbin, Eddy, Krogh and Mitchison Biological Sequence Analysis via Shamir s lecture notes music recognition deal with variations in - actual sound -

More information

Hidden Markov Models The three basic HMM problems (note: change in notation) Mitch Marcus CSE 391

Hidden Markov Models The three basic HMM problems (note: change in notation) Mitch Marcus CSE 391 Hidden Markov Models The three basic HMM problems (note: change in notation) Mitch Marcus CSE 391 Parameters of an HMM States: A set of states S=s 1, s n Transition probabilities: A= a 1,1, a 1,2,, a n,n

More information

9/12/17. Types of learning. Modeling data. Supervised learning: Classification. Supervised learning: Regression. Unsupervised learning: Clustering

9/12/17. Types of learning. Modeling data. Supervised learning: Classification. Supervised learning: Regression. Unsupervised learning: Clustering Types of learning Modeling data Supervised: we know input and targets Goal is to learn a model that, given input data, accurately predicts target data Unsupervised: we know the input only and want to make

More information

CSE 446 Dimensionality Reduction, Sequences

CSE 446 Dimensionality Reduction, Sequences CSE 446 Dimensionality Reduction, Sequences Administrative Final review this week Practice exam questions will come out Wed Final exam next week Wed 8:30 am Today Dimensionality reduction examples Sequence

More information

CS838-1 Advanced NLP: Hidden Markov Models

CS838-1 Advanced NLP: Hidden Markov Models CS838-1 Advanced NLP: Hidden Markov Models Xiaojin Zhu 2007 Send comments to jerryzhu@cs.wisc.edu 1 Part of Speech Tagging Tag each word in a sentence with its part-of-speech, e.g., The/AT representative/nn

More information

Brief Introduction of Machine Learning Techniques for Content Analysis

Brief Introduction of Machine Learning Techniques for Content Analysis 1 Brief Introduction of Machine Learning Techniques for Content Analysis Wei-Ta Chu 2008/11/20 Outline 2 Overview Gaussian Mixture Model (GMM) Hidden Markov Model (HMM) Support Vector Machine (SVM) Overview

More information

AP Chemistry Unit 2 Test (Chapters 3 and 4)

AP Chemistry Unit 2 Test (Chapters 3 and 4) AP Chemistry Unit 2 Test (Chapters 3 and 4) NAME: 1. A student is assigned the task of determining the mass percent of silver in an alloy of copper and silver by dissolving a sample of the alloy in excess

More information

Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ

Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ-13-2-0013 Second Quarterly Report - 2017 Submitted by Sergio Bernardes

More information

Chemistry Final Review Worksheet

Chemistry Final Review Worksheet Chemistry Final Review Worksheet 1. Balance this equation and then write it in words. Al + F 2 ---> AlF 3 N P 2. What does it mean for a molecule to be polar? What are polar molecules able to do? Use the

More information

The Noisy Channel Model. Statistical NLP Spring Mel Freq. Cepstral Coefficients. Frame Extraction ... Lecture 9: Acoustic Models

The Noisy Channel Model. Statistical NLP Spring Mel Freq. Cepstral Coefficients. Frame Extraction ... Lecture 9: Acoustic Models Statistical NLP Spring 2010 The Noisy Channel Model Lecture 9: Acoustic Models Dan Klein UC Berkeley Acoustic model: HMMs over word positions with mixtures of Gaussians as emissions Language model: Distributions

More information

Part of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch. COMP-599 Oct 1, 2015

Part of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch. COMP-599 Oct 1, 2015 Part of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch COMP-599 Oct 1, 2015 Announcements Research skills workshop today 3pm-4:30pm Schulich Library room 313 Start thinking about

More information

9693 MARINE SCIENCE. Mark schemes should be read in conjunction with the question paper and the Principal Examiner Report for Teachers.

9693 MARINE SCIENCE. Mark schemes should be read in conjunction with the question paper and the Principal Examiner Report for Teachers. CAMBRIDGE INTERNATIONAL EXAMINATIONS GCE Advanced Subsidiary Level and GCE Advanced Level www.xtremepapers.com MARK SCHEME for the May/June 01 series 969 MARINE SCIENCE 969/01 Paper 1 (AS Structured Questions),

More information

Hidden Markov Models. Ivan Gesteira Costa Filho IZKF Research Group Bioinformatics RWTH Aachen Adapted from:

Hidden Markov Models. Ivan Gesteira Costa Filho IZKF Research Group Bioinformatics RWTH Aachen Adapted from: Hidden Markov Models Ivan Gesteira Costa Filho IZKF Research Group Bioinformatics RWTH Aachen Adapted from: www.ioalgorithms.info Outline CG-islands The Fair Bet Casino Hidden Markov Model Decoding Algorithm

More information

Ocean Boundary Currents Guiding Question: How do western boundary currents influence climate and ocean productivity?

Ocean Boundary Currents Guiding Question: How do western boundary currents influence climate and ocean productivity? Name: Date: TEACHER VERSION: Suggested Student Responses Included Ocean Boundary Currents Guiding Question: How do western boundary currents influence climate and ocean productivity? Introduction The circulation

More information

Chapter 1. Matter and Measurements. Our main concern is the understanding of the principles that govern chemical reactions.

Chapter 1. Matter and Measurements. Our main concern is the understanding of the principles that govern chemical reactions. Chapter 1 Matter and Measurements Our main concern is the understanding of the principles that govern chemical reactions. 1. Types of matter- pure vs mixture, element vs compound 2. Measurements uncertainties,

More information

Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ

Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ Evaluating Physical, Chemical, and Biological Impacts from the Savannah Harbor Expansion Project Cooperative Agreement Number W912HZ-13-2-0013 Annual Report FY 2017 Submitted by Sergio Bernardes and Marguerite

More information