The Additive Inverse Gaussian Noise Channel: an Attempt on Modeling Molecular Communication

Size: px
Start display at page:

Download "The Additive Inverse Gaussian Noise Channel: an Attempt on Modeling Molecular Communication"

Transcription

1 National Chiao Tung University Taiwan Dept. of Electrical and Computer Engineering 2013 IEEE Taiwan/Hong Kong Joint Workshop on Information Theory and Communications The Additive Inverse Gaussian Noise Channel: an Attempt on Modeling Molecular Communication Stefan M. Moser (joint work with Chang Hui-Ting) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 1

2 Nano Devices in Fluid Medium (1) v nano devices communicate by exchange of molecular particles fluid medium flows with constant speed v particles suffer from Brownian motion information is encoded in release time = fundamentally different channel behavior Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 2

3 Nano Devices in Fluid Medium (2) new channel model by Srinivas, Adve, and Eckford [1] simplifying assumptions: perfectly synchronized common clock no stray particles channel is memoryless, i.e., trajectories are independent once arrived at receiver, particle is absorbed receiver can arrange the arriving molecules in correct order of release one-dimensional setup (generalization shouldn t be too hard) [1] K. V. Srinivas, R. S. Adve, and A. W. Eckford, Molecular communication in fluid media: The additive inverse Gaussian noise channel, IEEE Transactions on Information Theory, vol. 58, no. 7, pp , July Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 3

4 Channel Model (1) Brownian motion is modeled as Wiener process: for any time interval τ, the position increment is Gaussian: W N ( vτ,σ 2 τ ) σ 2 parameter depending on type of fluid, type of particle, temperature, etc. v is constant drift velocity of fluid increments of nonoverlapping time intervals are independent Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 4

5 Channel Model (2) we need to invert problem: transmitter at fixed position w = 0 receiver at fixed position w = d (normalized to d = 1) random travel time N = inverse Gaussian distribution N IG(µ,λ) with PDF f N (n) = ) λ ( 2πn 3 exp λ(n µ)2 2µ 2 I{n > 0} n average travel time: µ = d v Brownian motion parameter: λ = d2 σ 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 5

6 Channel Model (3) channel input: release time channel output: arrival time noise: input and noise independent: X Y = X + N N IG(µ,λ) X N = additive inverse Gaussian noise (AIGN) channel channel law: f Y X (y x) = λ 2π(y x) 3 exp ) λ(y x µ)2 ( 2µ 2 I{y > x} (y x) implicit nonnegativity constraint X 0 average-delay constraint E[X] m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 6

7 Properties of IG(µ, λ) (1) For N IG(µ,λ) we have E[N] = µ Var(N) = µ3 λ h(n) = 1 2 log 2πeµ3 λ e2λ µ Ei ( 2λ µ ) (Ei( ) exponential integral function) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 7

8 Properties of IG(µ, λ) (2) For N 1 IG(µ 1,λ 1 ) N 2 IG(µ 2,λ 2 ) N 1 N 2 we have N 1 +N 2 IG ( ( µ 1 +µ 2, λ1 + ) ) 2 λ 2 only if λ 1 µ 2 1 = λ 2 µ 2 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 8

9 First Lower Bound on Capacity (1) ( Lower Bound: choose X IG m, λm2 µ ): 2 C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m { } = max h(y) h(n) P X : E[X] m = max h(y) h(n) P X : E[X] m h(y) ( ) h(n) X IG m, λm2 µ 2 h(n) = 1 2 h(y) ( ) =? X IG m, λm2 µ 2 log 2πeµ3 λ e2λ µ Ei ( 2λ µ ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 9

10 First Lower Bound on Capacity (2) ( Lower Bound: choose X IG m, λm2 µ 2 ): (continued) note: λm 2 µ 2 m 2 = λ µ 2 = Y = X +N ) IG (m, λm2 µ 2 +IG(µ,λ) ( ) 2 λm = IG m+µ, µ + λ ) = IG (m+µ, λ(m+µ)2 µ 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 10

11 First Lower Bound on Capacity (3) ( Lower Bound: choose X IG m, λm2 µ 2 ): (continued) C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m { } = max h(y) h(n) P X : E[X] m = max h(y) h(n) P X : E[X] m h(y) ( ) h(n) X IG m, λm2 µ 2 h(n) = 1 2 log 2πeµ3 λ h(y) ( ) = 1 X IG m, λm2 µ 2 2 log 2πeµ2 (m+µ) λ e2λ µ Ei ( 2λ µ ) e2λ(m+µ) µ 2 Ei ( 2λ(m+µ) µ 2 ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 11

12 First Upper Bound on Capacity (1) Upper Bound: Note: C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m = max h(y) h(n) P X : E[X] m Under mean constraint: E[Y] = E[X]+E[N] m+µ h(y) maximized by exponential distribution Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 12

13 First Upper Bound on Capacity (2) Upper Bound: h(y) h(exponential): Hence: h(y) loge(m+µ) C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m = max h(y) h(n) P X : E[X] m loge(m+µ) h(n) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 13

14 Summary First Bounds (1) Upper Bound: [1]: C 1 2 λe(m+µ)2 log 2πµ 3 3 ( 2 e2λ µ Ei 2λ µ ) Lower Bound: [1]: C 1 2 log m+µ µ e2λ(m+µ) µ 2 Ei ( 2λ(m+µ) µ 2 ) 32 e2λµ Ei ( 2λ µ ) [1] K. V. Srinivas, R. S. Adve, and A. W. Eckford, Molecular communication in fluid media: The additive inverse Gaussian noise channel, IEEE Transactions on Information Theory, vol. 58, no. 7, pp , July Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 14

15 Summary First Bounds (2) 6 5 Capacity C [bits] ZOOM IN Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 15

16 0.5 Summary First Bounds (2) ZOOMED Capacity C [bits] Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 16

17 Summary First Bounds (3) 6 5 ZOOM IN Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 17

18 5 Summary First Bounds (3) ZOOMED Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 18

19 Idea for New Upper Bounds Duality-based upper bound: [ ( C E Q D fy X ( X) )] R( ) for arbitrary choice of R( ): R( ) exponential: (α > 0) = yields first upper bound R(y) = αe αy R( ) power inverse Gaussian: (α,β > 0, η 0) ( ) 1+ η ( α β 2 (y R(y) = exp α )η ( ) )η 2 2 β 2 2πβ 3 y 2η 2 β β y (additional bounding required) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 19

20 New Upper Bounds on Capacity C 1 (1+ 2 log λm )+ 32 ( ( 1 µ(m+µ) log 1+m µ + 1 )) λ C 1 ( η 1 logλ+ (logµ+e 2λµ Ei 2λ )) 2 2 µ ( ) λ ) (m+µ) η log ( 2λ π µ η 1 2 e λ µ Kη+ 1 2 µ + η +2 ( ( 1 log 1+m 2 µ + 1 )) logη λ C 1 2 log λ µ + 1 ( 1 (1+m 2 log µ + 1 λ + 1 ( 2 log 1+ m µ λ ) µ+λ )) e 2λµ Ei ( 2λ µ (0 < η 1, K ν ( ) modified Bessel function of second kind) ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 20

21 Idea for New Lower Bounds Choose exponential input: ( ) 1 X Exp m PDF of Y: convolution of exponential and inverse Gaussian [2]: Y 1 [ ( y m e m +λ µ e kλ Q ( )) ky 1 kλ ky ( ( ))] kλ ky +e kλ 1 Q + ky [2] W. Schwarz, On the convolution of inverse Gaussian and exponential random variables, Communications in Statistics Theory and Methods, vol. 31, no. 12, pp , Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 21

22 New Lower Bound on Capacity C log m λ + µ m λ µ +kλ+ 3 2 log λ µ 3 ( 2 e2λ µ Ei 2λ ) 1 µ 2 log 2π e ( log 1+ 1 ( ) m eλ µ λm 2λ 2+k 2 λm K 1 m +k2 λ ( )) 2m eλ µ λm λ +kλ 1+k 2 λm K 1 2 m +k2 λ 2 where k m 2µ2 λ 1 µ 2 2 mλ Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 22

23 New Bounds on Capacity (1) 6 5 Capacity C [bits] known bounds: black Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 23

24 New Bounds on Capacity (1) 6 5 Capacity C [bits] ZOOM IN known bounds: black our new bounds: colored Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 24

25 0.5 New Bounds on Capacity (1) ZOOMED Capacity C [bits] Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 25

26 New Bounds on Capacity (2) 6 5 Capacity C [bits] known bounds: black Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 26

27 Our Results: New Bounds on Capacity (2) 6 Capacity C [bits] ZOOM IN 1 known bounds: black our new bounds: colored Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 27

28 5 New Bounds on Capacity (2) ZOOMED Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 28

29 Exact Asymptotic Capacity for m : C(m) = logm+ 1 2 λe log 2πµ 3 3 ( 2 e2λ µ Ei 2λ µ ) +o(1) for v : C(v) = 3 2 logv log λm2 e 2π +o(1) [3] M. N. Khormuji, On the Capacity of Molecular Communication over the AIGN Channel, in Proceedings 45th Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA, Mar , 2011, pp Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 29

30 Summary & Outlook interesting new channel model new bounds on capacity exact asymptotics find better bounds for small drift velocity or small delay improve channel model: include peak-delay constraints account for loss of particles account for mixup of particles Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 30

Variance-Constrained Capacity of the Molecular Timing Channel with Synchronization Error

Variance-Constrained Capacity of the Molecular Timing Channel with Synchronization Error Variance-Constrained Capacity of the Molecular Timing Channel with Synchronization Error Malcolm Egan, Yansha Deng, Maged Elkashlan, and Trung Q. Duong Faculty of Electrical Engineering, Czech Technical

More information

The Fading Number of a Multiple-Access Rician Fading Channel

The Fading Number of a Multiple-Access Rician Fading Channel The Fading Number of a Multiple-Access Rician Fading Channel Intermediate Report of NSC Project Capacity Analysis of Various Multiple-Antenna Multiple-Users Communication Channels with Joint Estimation

More information

Some Expectations of a Non-Central Chi-Square Distribution With an Even Number of Degrees of Freedom

Some Expectations of a Non-Central Chi-Square Distribution With an Even Number of Degrees of Freedom Some Expectations of a Non-Central Chi-Square Distribution With an Even Number of Degrees of Freedom Stefan M. Moser April 7, 007 Abstract The non-central chi-square distribution plays an important role

More information

On the Capacity of Diffusion-Based Molecular Timing Channels With Diversity

On the Capacity of Diffusion-Based Molecular Timing Channels With Diversity On the Capacity of Diffusion-Based Molecular Timing Channels With Diversity Nariman Farsad, Yonathan Murin, Milind Rao, and Andrea Goldsmith Electrical Engineering, Stanford University, USA Abstract This

More information

SINCE nanoscale devices have very limited size, energy,

SINCE nanoscale devices have very limited size, energy, IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 32, NO. 2, DECEMBER 24 235 Capacity of the Memoryless Additive Inverse Gaussian Noise Channel Hui Li, Stefan M. Moser, Senior Member, IEEE, and Dongning

More information

EE376A - Information Theory Final, Monday March 14th 2016 Solutions. Please start answering each question on a new page of the answer booklet.

EE376A - Information Theory Final, Monday March 14th 2016 Solutions. Please start answering each question on a new page of the answer booklet. EE376A - Information Theory Final, Monday March 14th 216 Solutions Instructions: You have three hours, 3.3PM - 6.3PM The exam has 4 questions, totaling 12 points. Please start answering each question on

More information

Capacity of Discrete Molecular Diffusion Channels

Capacity of Discrete Molecular Diffusion Channels 211 IEEE International Symposium on Information Theory Proceedings Capacity of Discrete Molecular Diffusion Channels Arash nolghozati, Mohsen Sardari, Ahmad Beirami, Faramarz Fekri School of Electrical

More information

UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, Practice Final Examination (Winter 2017)

UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, Practice Final Examination (Winter 2017) UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, 208 Practice Final Examination (Winter 207) There are 6 problems, each problem with multiple parts. Your answer should be as clear and readable

More information

Gaussian channel. Information theory 2013, lecture 6. Jens Sjölund. 8 May Jens Sjölund (IMT, LiU) Gaussian channel 1 / 26

Gaussian channel. Information theory 2013, lecture 6. Jens Sjölund. 8 May Jens Sjölund (IMT, LiU) Gaussian channel 1 / 26 Gaussian channel Information theory 2013, lecture 6 Jens Sjölund 8 May 2013 Jens Sjölund (IMT, LiU) Gaussian channel 1 / 26 Outline 1 Definitions 2 The coding theorem for Gaussian channel 3 Bandlimited

More information

On the Capacity of Free-Space Optical Intensity Channels

On the Capacity of Free-Space Optical Intensity Channels On the Capacity of Free-Space Optical Intensity Channels Amos Lapidoth TH Zurich Zurich, Switzerl mail: lapidoth@isi.ee.ethz.ch Stefan M. Moser National Chiao Tung University NCTU Hsinchu, Taiwan mail:

More information

EE376A: Homeworks #4 Solutions Due on Thursday, February 22, 2018 Please submit on Gradescope. Start every question on a new page.

EE376A: Homeworks #4 Solutions Due on Thursday, February 22, 2018 Please submit on Gradescope. Start every question on a new page. EE376A: Homeworks #4 Solutions Due on Thursday, February 22, 28 Please submit on Gradescope. Start every question on a new page.. Maximum Differential Entropy (a) Show that among all distributions supported

More information

ECE 302 Division 1 MWF 10:30-11:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding.

ECE 302 Division 1 MWF 10:30-11:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding. NAME: ECE 302 Division MWF 0:30-:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding. If you are not in Prof. Pollak s section, you may not take this

More information

EE/Stats 376A: Homework 7 Solutions Due on Friday March 17, 5 pm

EE/Stats 376A: Homework 7 Solutions Due on Friday March 17, 5 pm EE/Stats 376A: Homework 7 Solutions Due on Friday March 17, 5 pm 1. Feedback does not increase the capacity. Consider a channel with feedback. We assume that all the recieved outputs are sent back immediately

More information

A Simple Memoryless Proof of the Capacity of the Exponential Server Timing Channel

A Simple Memoryless Proof of the Capacity of the Exponential Server Timing Channel A Simple Memoryless Proof of the Capacity of the Exponential Server iming Channel odd P. Coleman ECE Department Coordinated Science Laboratory University of Illinois colemant@illinois.edu Abstract his

More information

Impulse Response of the Channel with a Spherical Absorbing Receiver and a Spherical Reflecting Boundary

Impulse Response of the Channel with a Spherical Absorbing Receiver and a Spherical Reflecting Boundary 1 Impulse Response of the Channel with a Spherical Absorbing Receiver and a Spherical Reflecting Boundary Fatih inç, Student Member, IEEE, Bayram Cevdet Akdeniz, Student Member, IEEE, Ali Emre Pusane,

More information

Estimation of the Capacity of Multipath Infrared Channels

Estimation of the Capacity of Multipath Infrared Channels Estimation of the Capacity of Multipath Infrared Channels Jeffrey B. Carruthers Department of Electrical and Computer Engineering Boston University jbc@bu.edu Sachin Padma Department of Electrical and

More information

ECE Information theory Final (Fall 2008)

ECE Information theory Final (Fall 2008) ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1

More information

EE 4TM4: Digital Communications II Scalar Gaussian Channel

EE 4TM4: Digital Communications II Scalar Gaussian Channel EE 4TM4: Digital Communications II Scalar Gaussian Channel I. DIFFERENTIAL ENTROPY Let X be a continuous random variable with probability density function (pdf) f(x) (in short X f(x)). The differential

More information

Advanced Topics in Information Theory

Advanced Topics in Information Theory Advanced Topics in Information Theory Lecture Notes Stefan M. Moser c Copyright Stefan M. Moser Signal and Information Processing Lab ETH Zürich Zurich, Switzerland Institute of Communications Engineering

More information

On the Throughput, Capacity and Stability Regions of Random Multiple Access over Standard Multi-Packet Reception Channels

On the Throughput, Capacity and Stability Regions of Random Multiple Access over Standard Multi-Packet Reception Channels On the Throughput, Capacity and Stability Regions of Random Multiple Access over Standard Multi-Packet Reception Channels Jie Luo, Anthony Ephremides ECE Dept. Univ. of Maryland College Park, MD 20742

More information

ECE Information theory Final

ECE Information theory Final ECE 776 - Information theory Final Q1 (1 point) We would like to compress a Gaussian source with zero mean and variance 1 We consider two strategies In the first, we quantize with a step size so that the

More information

The Effect upon Channel Capacity in Wireless Communications of Perfect and Imperfect Knowledge of the Channel

The Effect upon Channel Capacity in Wireless Communications of Perfect and Imperfect Knowledge of the Channel The Effect upon Channel Capacity in Wireless Communications of Perfect and Imperfect Knowledge of the Channel Muriel Medard, Trans. on IT 000 Reading Group Discussion March 0, 008 Intro./ Overview Time

More information

Information Transfer through Calcium Signaling

Information Transfer through Calcium Signaling Information Transfer through Calcium Signaling Tadashi Nakano and Jian-Qin Liu Frontier Research Base for Global Young Researchers Graduate School of Engineering Osaka University, Japan tnakano@wakate.frc.eng.osaka-u.ac.jp

More information

Note that the new channel is noisier than the original two : and H(A I +A2-2A1A2) > H(A2) (why?). min(c,, C2 ) = min(1 - H(a t ), 1 - H(A 2 )).

Note that the new channel is noisier than the original two : and H(A I +A2-2A1A2) > H(A2) (why?). min(c,, C2 ) = min(1 - H(a t ), 1 - H(A 2 )). l I ~-16 / (a) (5 points) What is the capacity Cr of the channel X -> Y? What is C of the channel Y - Z? (b) (5 points) What is the capacity C 3 of the cascaded channel X -3 Z? (c) (5 points) A ow let.

More information

ELEC546 Review of Information Theory

ELEC546 Review of Information Theory ELEC546 Review of Information Theory Vincent Lau 1/1/004 1 Review of Information Theory Entropy: Measure of uncertainty of a random variable X. The entropy of X, H(X), is given by: If X is a discrete random

More information

Revision of Lecture 4

Revision of Lecture 4 Revision of Lecture 4 We have completed studying digital sources from information theory viewpoint We have learnt all fundamental principles for source coding, provided by information theory Practical

More information

Interactions of Information Theory and Estimation in Single- and Multi-user Communications

Interactions of Information Theory and Estimation in Single- and Multi-user Communications Interactions of Information Theory and Estimation in Single- and Multi-user Communications Dongning Guo Department of Electrical Engineering Princeton University March 8, 2004 p 1 Dongning Guo Communications

More information

MOLECULAR communication is a biologically inspired. Communication System Design and Analysis for Asynchronous Molecular Timing Channels

MOLECULAR communication is a biologically inspired. Communication System Design and Analysis for Asynchronous Molecular Timing Channels Communication System Design and Analysis for Asynchronous Molecular Timing Channels Nariman Farsad, Member, IEEE, Yonathan Murin, Member, IEEE, Weisi Guo, Senior Member, IEEE, Chan-Byoung Chae, Senior

More information

EE/Stat 376B Handout #5 Network Information Theory October, 14, Homework Set #2 Solutions

EE/Stat 376B Handout #5 Network Information Theory October, 14, Homework Set #2 Solutions EE/Stat 376B Handout #5 Network Information Theory October, 14, 014 1. Problem.4 parts (b) and (c). Homework Set # Solutions (b) Consider h(x + Y ) h(x + Y Y ) = h(x Y ) = h(x). (c) Let ay = Y 1 + Y, where

More information

Chapter 4: Continuous channel and its capacity

Chapter 4: Continuous channel and its capacity meghdadi@ensil.unilim.fr Reference : Elements of Information Theory by Cover and Thomas Continuous random variable Gaussian multivariate random variable AWGN Band limited channel Parallel channels Flat

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Title. Author(s)Tsai, Shang-Ho. Issue Date Doc URL. Type. Note. File Information. Equal Gain Beamforming in Rayleigh Fading Channels

Title. Author(s)Tsai, Shang-Ho. Issue Date Doc URL. Type. Note. File Information. Equal Gain Beamforming in Rayleigh Fading Channels Title Equal Gain Beamforming in Rayleigh Fading Channels Author(s)Tsai, Shang-Ho Proceedings : APSIPA ASC 29 : Asia-Pacific Signal Citationand Conference: 688-691 Issue Date 29-1-4 Doc URL http://hdl.handle.net/2115/39789

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

EE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15

EE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15 EE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15 1. Cascade of Binary Symmetric Channels The conditional probability distribution py x for each of the BSCs may be expressed by the transition probability

More information

WE consider a memoryless discrete-time channel whose

WE consider a memoryless discrete-time channel whose IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 55, NO. 1, JANUARY 2009 303 On the Capacity of the Discrete-Time Poisson Channel Amos Lapidoth, Fellow, IEEE, and Stefan M. Moser, Member, IEEE Abstract The

More information

Adaptive Molecule Transmission Rate for Diffusion Based Molecular Communication

Adaptive Molecule Transmission Rate for Diffusion Based Molecular Communication Adaptive Molecule Transmission Rate for Diffusion Based Molecular Communication Mohammad Movahednasab, Mehdi Soleimanifar, Amin Gohari, Masoumeh Nasiri Kenari and Urbashi Mitra Sharif University of Technology

More information

Energy State Amplification in an Energy Harvesting Communication System

Energy State Amplification in an Energy Harvesting Communication System Energy State Amplification in an Energy Harvesting Communication System Omur Ozel Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland College Park, MD 20742 omur@umd.edu

More information

On the Duality between Multiple-Access Codes and Computation Codes

On the Duality between Multiple-Access Codes and Computation Codes On the Duality between Multiple-Access Codes and Computation Codes Jingge Zhu University of California, Berkeley jingge.zhu@berkeley.edu Sung Hoon Lim KIOST shlim@kiost.ac.kr Michael Gastpar EPFL michael.gastpar@epfl.ch

More information

ASimpleMathematicalModelforInformationRate of Active Transport Molecular Communication

ASimpleMathematicalModelforInformationRate of Active Transport Molecular Communication ASimpleMathematicalModelforInformationRate of Active Transport Molecular Communication Nariman Farsad, Andrew W. Eckford Department of Computer Science and Engineering York University 4700 Keele Street,

More information

Fluctuation theorem in systems in contact with different heath baths: theory and experiments.

Fluctuation theorem in systems in contact with different heath baths: theory and experiments. Fluctuation theorem in systems in contact with different heath baths: theory and experiments. Alberto Imparato Institut for Fysik og Astronomi Aarhus Universitet Denmark Workshop Advances in Nonequilibrium

More information

Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information

Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information 204 IEEE International Symposium on Information Theory Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information Omur Ozel, Kaya Tutuncuoglu 2, Sennur Ulukus, and Aylin Yener

More information

Morning Session Capacity-based Power Control. Department of Electrical and Computer Engineering University of Maryland

Morning Session Capacity-based Power Control. Department of Electrical and Computer Engineering University of Maryland Morning Session Capacity-based Power Control Şennur Ulukuş Department of Electrical and Computer Engineering University of Maryland So Far, We Learned... Power control with SIR-based QoS guarantees Suitable

More information

Soft-Output Trellis Waveform Coding

Soft-Output Trellis Waveform Coding Soft-Output Trellis Waveform Coding Tariq Haddad and Abbas Yongaçoḡlu School of Information Technology and Engineering, University of Ottawa Ottawa, Ontario, K1N 6N5, Canada Fax: +1 (613) 562 5175 thaddad@site.uottawa.ca

More information

RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths

RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths Kasra Vakilinia, Dariush Divsalar*, and Richard D. Wesel Department of Electrical Engineering, University

More information

Chapter 2 Signal Processing at Receivers: Detection Theory

Chapter 2 Signal Processing at Receivers: Detection Theory Chapter Signal Processing at Receivers: Detection Theory As an application of the statistical hypothesis testing, signal detection plays a key role in signal processing at receivers of wireless communication

More information

3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions

3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions Engineering Tripos Part IIA THIRD YEAR 3F: Signals and Systems INFORMATION THEORY Examples Paper Solutions. Let the joint probability mass function of two binary random variables X and Y be given in the

More information

Chapter 4. Data Transmission and Channel Capacity. Po-Ning Chen, Professor. Department of Communications Engineering. National Chiao Tung University

Chapter 4. Data Transmission and Channel Capacity. Po-Ning Chen, Professor. Department of Communications Engineering. National Chiao Tung University Chapter 4 Data Transmission and Channel Capacity Po-Ning Chen, Professor Department of Communications Engineering National Chiao Tung University Hsin Chu, Taiwan 30050, R.O.C. Principle of Data Transmission

More information

Error Exponent Region for Gaussian Broadcast Channels

Error Exponent Region for Gaussian Broadcast Channels Error Exponent Region for Gaussian Broadcast Channels Lihua Weng, S. Sandeep Pradhan, and Achilleas Anastasopoulos Electrical Engineering and Computer Science Dept. University of Michigan, Ann Arbor, MI

More information

Limits on classical communication from quantum entropy power inequalities

Limits on classical communication from quantum entropy power inequalities Limits on classical communication from quantum entropy power inequalities Graeme Smith, IBM Research (joint work with Robert Koenig) QIP 2013 Beijing Channel Capacity X N Y p(y x) Capacity: bits per channel

More information

Digital Band-pass Modulation PROF. MICHAEL TSAI 2011/11/10

Digital Band-pass Modulation PROF. MICHAEL TSAI 2011/11/10 Digital Band-pass Modulation PROF. MICHAEL TSAI 211/11/1 Band-pass Signal Representation a t g t General form: 2πf c t + φ t g t = a t cos 2πf c t + φ t Envelope Phase Envelope is always non-negative,

More information

Shannon meets Wiener II: On MMSE estimation in successive decoding schemes

Shannon meets Wiener II: On MMSE estimation in successive decoding schemes Shannon meets Wiener II: On MMSE estimation in successive decoding schemes G. David Forney, Jr. MIT Cambridge, MA 0239 USA forneyd@comcast.net Abstract We continue to discuss why MMSE estimation arises

More information

Stat 512 Homework key 2

Stat 512 Homework key 2 Stat 51 Homework key October 4, 015 REGULAR PROBLEMS 1 Suppose continuous random variable X belongs to the family of all distributions having a linear probability density function (pdf) over the interval

More information

ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION

ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ZHENLINYANGandRONNIET.C.LEE Department of Statistics and Applied Probability, National University of Singapore, 3 Science Drive 2, Singapore

More information

Mathematical methods in communication June 16th, Lecture 12

Mathematical methods in communication June 16th, Lecture 12 2- Mathematical methods in communication June 6th, 20 Lecture 2 Lecturer: Haim Permuter Scribe: Eynan Maydan and Asaf Aharon I. MIMO - MULTIPLE INPUT MULTIPLE OUTPUT MIMO is the use of multiple antennas

More information

Probability and Statistics for Final Year Engineering Students

Probability and Statistics for Final Year Engineering Students Probability and Statistics for Final Year Engineering Students By Yoni Nazarathy, Last Updated: May 24, 2011. Lecture 6p: Spectral Density, Passing Random Processes through LTI Systems, Filtering Terms

More information

On the Secrecy Capacity of Fading Channels

On the Secrecy Capacity of Fading Channels On the Secrecy Capacity of Fading Channels arxiv:cs/63v [cs.it] 7 Oct 26 Praveen Kumar Gopala, Lifeng Lai and Hesham El Gamal Department of Electrical and Computer Engineering The Ohio State University

More information

ECE353: Probability and Random Processes. Lecture 18 - Stochastic Processes

ECE353: Probability and Random Processes. Lecture 18 - Stochastic Processes ECE353: Probability and Random Processes Lecture 18 - Stochastic Processes Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu From RV

More information

Secret Key Agreement Using Asymmetry in Channel State Knowledge

Secret Key Agreement Using Asymmetry in Channel State Knowledge Secret Key Agreement Using Asymmetry in Channel State Knowledge Ashish Khisti Deutsche Telekom Inc. R&D Lab USA Los Altos, CA, 94040 Email: ashish.khisti@telekom.com Suhas Diggavi LICOS, EFL Lausanne,

More information

Marginal density. If the unknown is of the form x = (x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density

Marginal density. If the unknown is of the form x = (x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density Marginal density If the unknown is of the form x = x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density πx 1 y) = πx 1, x 2 y)dx 2 = πx 2 )πx 1 y, x 2 )dx 2 needs to be

More information

A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback

A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback Vincent Y. F. Tan (NUS) Joint work with Silas L. Fong (Toronto) 2017 Information Theory Workshop, Kaohsiung,

More information

Chapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University

Chapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real

More information

Minimum Message Length Inference and Mixture Modelling of Inverse Gaussian Distributions

Minimum Message Length Inference and Mixture Modelling of Inverse Gaussian Distributions Minimum Message Length Inference and Mixture Modelling of Inverse Gaussian Distributions Daniel F. Schmidt Enes Makalic Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School

More information

Optimal power-delay trade-offs in fading channels: small delay asymptotics

Optimal power-delay trade-offs in fading channels: small delay asymptotics Optimal power-delay trade-offs in fading channels: small delay asymptotics Randall A. Berry Dept. of EECS, Northwestern University 45 Sheridan Rd., Evanston IL 6008 Email: rberry@ece.northwestern.edu Abstract

More information

The Crossover-Distance for ISI-Correcting Decoding of Convolutional Codes in Diffusion-Based Molecular Communications

The Crossover-Distance for ISI-Correcting Decoding of Convolutional Codes in Diffusion-Based Molecular Communications 1 The Crossover-Distance for ISI-Correcting Decoding of Convolutional Codes in Diffusion-Based Molecular Communications Hui Li, Qingchao Li arxiv:1812.11273v1 [cs.it] 29 Dec 2018 Abstract In diffusion

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

Stability and Sensitivity of the Capacity in Continuous Channels. Malcolm Egan

Stability and Sensitivity of the Capacity in Continuous Channels. Malcolm Egan Stability and Sensitivity of the Capacity in Continuous Channels Malcolm Egan Univ. Lyon, INSA Lyon, INRIA 2019 European School of Information Theory April 18, 2019 1 / 40 Capacity of Additive Noise Models

More information

Capacity Region of the Permutation Channel

Capacity Region of the Permutation Channel Capacity Region of the Permutation Channel John MacLaren Walsh and Steven Weber Abstract We discuss the capacity region of a degraded broadcast channel (DBC) formed from a channel that randomly permutes

More information

Channel capacity. Outline : 1. Source entropy 2. Discrete memoryless channel 3. Mutual information 4. Channel capacity 5.

Channel capacity. Outline : 1. Source entropy 2. Discrete memoryless channel 3. Mutual information 4. Channel capacity 5. Channel capacity Outline : 1. Source entropy 2. Discrete memoryless channel 3. Mutual information 4. Channel capacity 5. Exercices Exercise session 11 : Channel capacity 1 1. Source entropy Given X a memoryless

More information

«Random Vectors» Lecture #2: Introduction Andreas Polydoros

«Random Vectors» Lecture #2: Introduction Andreas Polydoros «Random Vectors» Lecture #2: Introduction Andreas Polydoros Introduction Contents: Definitions: Correlation and Covariance matrix Linear transformations: Spectral shaping and factorization he whitening

More information

Cut-Set Bound and Dependence Balance Bound

Cut-Set Bound and Dependence Balance Bound Cut-Set Bound and Dependence Balance Bound Lei Xiao lxiao@nd.edu 1 Date: 4 October, 2006 Reading: Elements of information theory by Cover and Thomas [1, Section 14.10], and the paper by Hekstra and Willems

More information

Design of IP networks with Quality of Service

Design of IP networks with Quality of Service Course of Multimedia Internet (Sub-course Reti Internet Multimediali ), AA 2010-2011 Prof. Pag. 1 Design of IP networks with Quality of Service 1 Course of Multimedia Internet (Sub-course Reti Internet

More information

Consensus Problem under Diffusion-based Molecular Communication

Consensus Problem under Diffusion-based Molecular Communication Consensus Problem under Diffusion-based Molecular Communication Arash Einolghozati, Mohsen Sardari, Ahmad Beirami, Faramarz Fekri School of Electrical and Computer Engineering, Georgia Institute of Technology,

More information

Stochastic Network Calculus

Stochastic Network Calculus Stochastic Network Calculus Assessing the Performance of the Future Internet Markus Fidler joint work with Amr Rizk Institute of Communications Technology Leibniz Universität Hannover April 22, 2010 c

More information

ST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples

ST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples ST3241 Categorical Data Analysis I Generalized Linear Models Introduction and Some Examples 1 Introduction We have discussed methods for analyzing associations in two-way and three-way tables. Now we will

More information

Parameter Estimation

Parameter Estimation 1 / 44 Parameter Estimation Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay October 25, 2012 Motivation System Model used to Derive

More information

Uncertainity, Information, and Entropy

Uncertainity, Information, and Entropy Uncertainity, Information, and Entropy Probabilistic experiment involves the observation of the output emitted by a discrete source during every unit of time. The source output is modeled as a discrete

More information

Constellation Shaping for Communication Channels with Quantized Outputs

Constellation Shaping for Communication Channels with Quantized Outputs Constellation Shaping for Communication Channels with Quantized Outputs, Dr. Matthew C. Valenti and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia University

More information

Gaussian, Markov and stationary processes

Gaussian, Markov and stationary processes Gaussian, Markov and stationary processes Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ November

More information

On the Distribution of Mutual Information

On the Distribution of Mutual Information On the Distribution of Mutual Information J. Nicholas Laneman Dept. of Electrical Engineering University of Notre Dame Notre Dame IN 46556 Email: jnl@nd.edu Abstract In the early years of information theory

More information

Convergence to equilibrium for rough differential equations

Convergence to equilibrium for rough differential equations Convergence to equilibrium for rough differential equations Samy Tindel Purdue University Barcelona GSE Summer Forum 2017 Joint work with Aurélien Deya (Nancy) and Fabien Panloup (Angers) Samy T. (Purdue)

More information

Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process

Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Applied Mathematical Sciences, Vol. 4, 2010, no. 62, 3083-3093 Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Julia Bondarenko Helmut-Schmidt University Hamburg University

More information

Lecture 2. Capacity of the Gaussian channel

Lecture 2. Capacity of the Gaussian channel Spring, 207 5237S, Wireless Communications II 2. Lecture 2 Capacity of the Gaussian channel Review on basic concepts in inf. theory ( Cover&Thomas: Elements of Inf. Theory, Tse&Viswanath: Appendix B) AWGN

More information

Stochastic Networks and Parameter Uncertainty

Stochastic Networks and Parameter Uncertainty Stochastic Networks and Parameter Uncertainty Assaf Zeevi Graduate School of Business Columbia University Stochastic Processing Networks Conference, August 2009 based on joint work with Mike Harrison Achal

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology .203J/6.28J/3.665J/5.073J/6.76J/ESD.26J Quiz Solutions (a)(i) Without loss of generality we can pin down X at any fixed point. X 2 is still uniformly distributed over the square. Assuming that the police

More information

UCSD ECE153 Handout #40 Prof. Young-Han Kim Thursday, May 29, Homework Set #8 Due: Thursday, June 5, 2011

UCSD ECE153 Handout #40 Prof. Young-Han Kim Thursday, May 29, Homework Set #8 Due: Thursday, June 5, 2011 UCSD ECE53 Handout #40 Prof. Young-Han Kim Thursday, May 9, 04 Homework Set #8 Due: Thursday, June 5, 0. Discrete-time Wiener process. Let Z n, n 0 be a discrete time white Gaussian noise (WGN) process,

More information

Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications

Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications CHAPTER 6 Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications 6.1 Introduction Exponential distributions have been introduced as a simple model for statistical analysis

More information

STATISTICAL MODELING OF ASYNCHRONOUS IMPULSIVE NOISE IN POWERLINE COMMUNICATION NETWORKS

STATISTICAL MODELING OF ASYNCHRONOUS IMPULSIVE NOISE IN POWERLINE COMMUNICATION NETWORKS STATISTICAL MODELING OF ASYNCHRONOUS IMPULSIVE NOISE IN POWERLINE COMMUNICATION NETWORKS Marcel Nassar, Kapil Gulati, Yousof Mortazavi, and Brian L. Evans Department of Electrical and Computer Engineering

More information

HOLOGRAPHIC IMPLEMENTATION OF A LINEAR PREDICTOR OF RANDOM PROCESSES: INFLUENCE OF HIGH-PASS AND LOW-PASS FILTERING ON THE PROCESS CHARACTERISTICS

HOLOGRAPHIC IMPLEMENTATION OF A LINEAR PREDICTOR OF RANDOM PROCESSES: INFLUENCE OF HIGH-PASS AND LOW-PASS FILTERING ON THE PROCESS CHARACTERISTICS HOLOGRAPHIC IMPLEMENTATION OF A LINEAR PREDICTOR OF RANDOM PROCESSES: INFLUENCE OF HIGH-PASS AND LOW-PASS FILTERING ON THE PROCESS CHARACTERISTICS Z.S. Bekyasheva, A.V. Pavlov, A.A. Vostrikov St. Petersburg

More information

Fundamental rate delay tradeoffs in multipath routed and network coded networks

Fundamental rate delay tradeoffs in multipath routed and network coded networks Fundamental rate delay tradeoffs in multipath routed and network coded networks John Walsh and Steven Weber Drexel University, Dept of ECE Philadelphia, PA 94 {jwalsh,sweber}@ecedrexeledu IP networks subject

More information

Mapper & De-Mapper System Document

Mapper & De-Mapper System Document Mapper & De-Mapper System Document Mapper / De-Mapper Table of Contents. High Level System and Function Block. Mapper description 2. Demodulator Function block 2. Decoder block 2.. De-Mapper 2..2 Implementation

More information

National University of Singapore Department of Electrical & Computer Engineering. Examination for

National University of Singapore Department of Electrical & Computer Engineering. Examination for National University of Singapore Department of Electrical & Computer Engineering Examination for EE5139R Information Theory for Communication Systems (Semester I, 2014/15) November/December 2014 Time Allowed:

More information

EC2252 COMMUNICATION THEORY UNIT 5 INFORMATION THEORY

EC2252 COMMUNICATION THEORY UNIT 5 INFORMATION THEORY EC2252 COMMUNICATION THEORY UNIT 5 INFORMATION THEORY Discrete Messages and Information Content, Concept of Amount of Information, Average information, Entropy, Information rate, Source coding to increase

More information

Cognitive Multiple Access Networks

Cognitive Multiple Access Networks Cognitive Multiple Access Networks Natasha Devroye Email: ndevroye@deas.harvard.edu Patrick Mitran Email: mitran@deas.harvard.edu Vahid Tarokh Email: vahid@deas.harvard.edu Abstract A cognitive radio can

More information

ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016

ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016 ECE598: Information-theoretic methods in high-dimensional statistics Spring 06 Lecture : Mutual Information Method Lecturer: Yihong Wu Scribe: Jaeho Lee, Mar, 06 Ed. Mar 9 Quick review: Assouad s lemma

More information

X 1 : X Table 1: Y = X X 2

X 1 : X Table 1: Y = X X 2 ECE 534: Elements of Information Theory, Fall 200 Homework 3 Solutions (ALL DUE to Kenneth S. Palacio Baus) December, 200. Problem 5.20. Multiple access (a) Find the capacity region for the multiple-access

More information

Stochastic Stabilization of a Noisy Linear System with a Fixed-Rate Adaptive Quantizer

Stochastic Stabilization of a Noisy Linear System with a Fixed-Rate Adaptive Quantizer 2009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 10-12, 2009 ThA06.6 Stochastic Stabilization of a Noisy Linear System with a Fixed-Rate Adaptive Quantizer Serdar Yüksel

More information

Lecture 7 MIMO Communica2ons

Lecture 7 MIMO Communica2ons Wireless Communications Lecture 7 MIMO Communica2ons Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2014 1 Outline MIMO Communications (Chapter 10

More information

UCSD ECE 153 Handout #20 Prof. Young-Han Kim Thursday, April 24, Solutions to Homework Set #3 (Prepared by TA Fatemeh Arbabjolfaei)

UCSD ECE 153 Handout #20 Prof. Young-Han Kim Thursday, April 24, Solutions to Homework Set #3 (Prepared by TA Fatemeh Arbabjolfaei) UCSD ECE 53 Handout #0 Prof. Young-Han Kim Thursday, April 4, 04 Solutions to Homework Set #3 (Prepared by TA Fatemeh Arbabjolfaei). Time until the n-th arrival. Let the random variable N(t) be the number

More information

Variable Length Codes for Degraded Broadcast Channels

Variable Length Codes for Degraded Broadcast Channels Variable Length Codes for Degraded Broadcast Channels Stéphane Musy School of Computer and Communication Sciences, EPFL CH-1015 Lausanne, Switzerland Email: stephane.musy@ep.ch Abstract This paper investigates

More information

Statistics for Data Analysis. Niklaus Berger. PSI Practical Course Physics Institute, University of Heidelberg

Statistics for Data Analysis. Niklaus Berger. PSI Practical Course Physics Institute, University of Heidelberg Statistics for Data Analysis PSI Practical Course 2014 Niklaus Berger Physics Institute, University of Heidelberg Overview You are going to perform a data analysis: Compare measured distributions to theoretical

More information