Blind Equalization via Particle Filtering

Similar documents
L09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms

RANDOM DISCRETE MEASURE OF THE PHASE POSTERIOR PDF IN TURBO SYNCHRONIZATION

Particle Filters. Outline

Sensor Fusion: Particle Filter

A FEASIBILITY STUDY OF PARTICLE FILTERS FOR MOBILE STATION RECEIVERS. Michael Lunglmayr, Martin Krueger, Mario Huemer

Particle Filter for Joint Blind Carrier Frequency Offset Estimation and Data Detection

An introduction to Sequential Monte Carlo

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

Human Pose Tracking I: Basics. David Fleet University of Toronto

Learning Static Parameters in Stochastic Processes

27 : Distributed Monte Carlo Markov Chain. 1 Recap of MCMC and Naive Parallel Gibbs Sampling

Expectation propagation for signal detection in flat-fading channels

Sequential Monte Carlo Methods for Bayesian Computation

2D Image Processing (Extended) Kalman and particle filter

Lecture 8: Bayesian Estimation of Parameters in State Space Models

Introduction to Particle Filters for Data Assimilation

CSC 2541: Bayesian Methods for Machine Learning

Computer Intensive Methods in Mathematical Statistics

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization

Package RcppSMC. March 18, 2018

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

Content.

Markov Chain Monte Carlo Methods

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Robert Collins CSE586, PSU Intro to Sampling Methods

Robert Collins CSE586, PSU Intro to Sampling Methods

SEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS. A Thesis SIRISH BODDIKURAPATI

AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France.

Particle Filtering for Data-Driven Simulation and Optimization

Pattern Recognition and Machine Learning

Bayesian statistics. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda

An efficient stochastic approximation EM algorithm using conditional particle filters

Advanced Statistical Computing

Sequential Monte Carlo and Particle Filtering. Frank Wood Gatsby, November 2007

MCMC for big data. Geir Storvik. BigInsight lunch - May Geir Storvik MCMC for big data BigInsight lunch - May / 17

Bayesian room-acoustic modal analysis

Bayesian Methods / G.D. Hager S. Leonard

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER

Introduction to Machine Learning

Markov chain Monte Carlo methods for visual tracking

Computer Intensive Methods in Mathematical Statistics

Dynamic Multipath Estimation by Sequential Monte Carlo Methods

An introduction to particle filters

Robert Collins CSE586, PSU Intro to Sampling Methods

Bayesian Regression Linear and Logistic Regression

Markov Chain Monte Carlo, Numerical Integration

Machine Learning for OR & FE

Inferring biological dynamics Iterated filtering (IF)

STA 4273H: Sta-s-cal Machine Learning

Notes on a posteriori probability (APP) metrics for LDPC

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Monte Carlo Approximation of Monte Carlo Filters

Reducing The Computational Cost of Bayesian Indoor Positioning Systems

Strong Lens Modeling (II): Statistical Methods

1 / 31 Identification of nonlinear dynamic systems (guest lectures) Brussels, Belgium, June 8, 2015.

SEQUENTIAL MAP EQUALIZATION OF MIMO CHANNELS WITH UNKNOWN ORDER

The Kalman Filter ImPr Talk

Density Propagation for Continuous Temporal Chains Generative and Discriminative Models

POMP inference via iterated filtering

Lecture 2: From Linear Regression to Kalman Filter and Beyond

STA 4273H: Statistical Machine Learning

1 / 32 Summer school on Foundations and advances in stochastic filtering (FASF) Barcelona, Spain, June 22, 2015.

MCMC and Gibbs Sampling. Kayhan Batmanghelich

Sampling Methods (11/30/04)

Approximate Bayesian Computation and Particle Filters

Mobile Robot Localization

Condensed Table of Contents for Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control by J. C.

MCMC: Markov Chain Monte Carlo

Mobile Robot Localization

STA 414/2104: Machine Learning

The Hierarchical Particle Filter

State Estimation using Moving Horizon Estimation and Particle Filtering

Chapter 4: Continuous channel and its capacity

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels

Part 1: Expectation Propagation

Parameter Estimation

Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems

Particle Filtering a brief introductory tutorial. Frank Wood Gatsby, August 2007

Lecture Particle Filters. Magnus Wiktorsson

Methods and tools to optimize the trade-off performance versus complexity of error control codes architectures.

Bayesian Estimation of Input Output Tables for Russia

Kernel Sequential Monte Carlo

Computer Practical: Metropolis-Hastings-based MCMC

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Sequential Monte Carlo Methods (for DSGE Models)

IN the mobile communication systems, the channel parameters

Variable Resolution Particle Filter

Pattern Recognition and Machine Learning. Bishop Chapter 11: Sampling Methods

Learning the hyper-parameters. Luca Martino

Kernel adaptive Sequential Monte Carlo

AUTOMOTIVE ENVIRONMENT SENSORS

Markov Chain Monte Carlo Methods for Stochastic Optimization

CPSC 540: Machine Learning

Particle Filtering Approaches for Dynamic Stochastic Optimization

Numerical Analysis for Statisticians

Computational statistics

Implementation of Particle Filter-based Target Tracking

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS

Transcription:

Blind Equalization via Particle Filtering Yuki Yoshida, Kazunori Hayashi, Hideaki Sakai Department of System Science, Graduate School of Informatics, Kyoto University

Historical Remarks A sequential Monte Carlo methodology Monte-Carlo Filter (Kitagawa, 1993) Bootstrap Filter (Gordon, 1993) Poor man s Monte Carlo (Hammersley, 1954) Condensation (Isard and Blake, 1998) Significant development of computers makes it possible to realize Bayesian approach in Simple way

Historical Remarks (Cont d) The basic ideas are the Bayesian formulation and sequential importance sampling method (SIS) The capability of coping with difficult nonlinear and/or non-gaussian problems Linear Gaussian State-space Model Non-linear Non-Gaussian State-space Model Generalized State-space Model Chain Structure Graphical Model

Applications in Wireless Communications Communication Applications Single-User System Detection in Flat Fading OFDM Equalization Multiple Access System Synchronization Time-invariant Channels CDMA Space-Time Coding Time-variant Channels ( Particle Filtering, Signal Processing Magazine, 2003)

Blind Equalization via PF Examples of Blind Equalization method via PF for Time-Invariant channels - J. Míguez and P. M. Djuruć, Blind Equalization by sequential importance sampling, 2002 for Time-variant channels - A. Doucet, S. J. Godsill, and C. Andrieu, On sequential Monte Carlo sampling methods for Baysian filtering, 2000 for OFDM systems - Z. Yang and X. Wang, A sequential Mote Carlo blind receiver for OFDM in frequency-selective fading channels, 2002

Signal Model Channel FIR Filter AWGN : Binary signal ht: Channel coefficients L: Length of the channel

Signal Model (Cont d) The state-space model: State equation: Observation equation: ex)

Recursive Computation of the Posterior Probability The MAP estimation of the transmitted sequence at time T : (Maximum A Posteriori) Due to computational complexity, It is desirable to solve the posterior distribution recursively Obtaining from as is observed

Recursive Computation of the Posterior Probability (Cont d) Let us consider the following decomposition... Posterior at time t Likelihood Posterior at time t-1 This provides the sequential computation of the posterior, while the likelihood can be analytically derived

Recursive Computation of the Posterior Probability (Cont d) The Likelihood Function: Recalling... Observation equation:

Recursive Computation of the Posterior Probability (Cont d) The Likelihood Function: If we assume Gaussian prior for h: The posterior channel densities are also Gaussian

Recursive Computation of the Posterior Probability (Cont d) The Likelihood Function: Gaussian Channel Update: The MAP estimation of the channel at time t!

Recursive Computation of the Posterior Probability (Cont d) The Likelihood Function: Gaussian Rao-Blackwellization Channel Update: The MAP estimation of the channel at time t!

On Implementation Our goal is... Now, we can compute this part recursively! How to implement the computation? Application of Sequential Importance Sampling algorithm (SIS) Let us begin with an Importance Sampling method (IS)

Description of Conditional pdf True distribution Linear spline Monte Carlo (Particles) Gaussian sum Particles + Weights Monte-Carlo approximation with samples drawn from importance function and their importance weights

IS Algorithm To obtain Monte-Carlo approximation of the real pdf with M samples drawn from importance function and their importance weights Draw M samples: Importance function Importance weights:

SIS Algorithm The modified IS method where it becomes possible to build the MC estimate sequentially as new observations arrive. Employing the importance function that can be factorized as Likelihood

SIS Algorithm (Cont d) Likelihood At time T...

SIS Algorithm (Cont d) Optimal importance function: Likelihood Recalling, Correspondingly,

Simulation Results Mod./ Demod. QPSK (differential coding) Observation: T=200 Channel: 3-path rayleigh fading channels # of Particle M=200 ( Particle Filtering, Signal Processing Magazine, 2003)

vs Average BER # of Particles # of Particles BER

On Further Applications in Wireless Communications DS P Non-Gaussian Noise Time-variant Channels Suitable for wireless communications? An alo g Fr on t-e nd

Other Bayesian Approaches Is the Particle Filtering the best solution? From the view point of Learning Theory... Functional approximation MCMC (Markov chain Monte Carlo) Gaussian Approximation (Laplace s Approximation) Gibbs Sampling, M-H Sampling Variational Bayesian Learning (EM Algorithm) Particle Filter

Other topics Suitability for Iterative channel decoder PF bit LLR computer π-1 Symbol Prob. computer π Channel Decoder (Resampling)... Thank You