The Additive Inverse Gaussian Noise Channel: an Attempt on Modeling Molecular Communication
|
|
- Benjamin Dawson
- 5 years ago
- Views:
Transcription
1 National Chiao Tung University Taiwan Dept. of Electrical and Computer Engineering 2013 IEEE Taiwan/Hong Kong Joint Workshop on Information Theory and Communications The Additive Inverse Gaussian Noise Channel: an Attempt on Modeling Molecular Communication Stefan M. Moser (joint work with Chang Hui-Ting) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 1
2 Nano Devices in Fluid Medium (1) v nano devices communicate by exchange of molecular particles fluid medium flows with constant speed v particles suffer from Brownian motion information is encoded in release time = fundamentally different channel behavior Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 2
3 Nano Devices in Fluid Medium (2) new channel model by Srinivas, Adve, and Eckford [1] simplifying assumptions: perfectly synchronized common clock no stray particles channel is memoryless, i.e., trajectories are independent once arrived at receiver, particle is absorbed receiver can arrange the arriving molecules in correct order of release one-dimensional setup (generalization shouldn t be too hard) [1] K. V. Srinivas, R. S. Adve, and A. W. Eckford, Molecular communication in fluid media: The additive inverse Gaussian noise channel, IEEE Transactions on Information Theory, vol. 58, no. 7, pp , July Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 3
4 Channel Model (1) Brownian motion is modeled as Wiener process: for any time interval τ, the position increment is Gaussian: W N ( vτ,σ 2 τ ) σ 2 parameter depending on type of fluid, type of particle, temperature, etc. v is constant drift velocity of fluid increments of nonoverlapping time intervals are independent Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 4
5 Channel Model (2) we need to invert problem: transmitter at fixed position w = 0 receiver at fixed position w = d (normalized to d = 1) random travel time N = inverse Gaussian distribution N IG(µ,λ) with PDF f N (n) = ) λ ( 2πn 3 exp λ(n µ)2 2µ 2 I{n > 0} n average travel time: µ = d v Brownian motion parameter: λ = d2 σ 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 5
6 Channel Model (3) channel input: release time channel output: arrival time noise: input and noise independent: X Y = X + N N IG(µ,λ) X N = additive inverse Gaussian noise (AIGN) channel channel law: f Y X (y x) = λ 2π(y x) 3 exp ) λ(y x µ)2 ( 2µ 2 I{y > x} (y x) implicit nonnegativity constraint X 0 average-delay constraint E[X] m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 6
7 Properties of IG(µ, λ) (1) For N IG(µ,λ) we have E[N] = µ Var(N) = µ3 λ h(n) = 1 2 log 2πeµ3 λ e2λ µ Ei ( 2λ µ ) (Ei( ) exponential integral function) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 7
8 Properties of IG(µ, λ) (2) For N 1 IG(µ 1,λ 1 ) N 2 IG(µ 2,λ 2 ) N 1 N 2 we have N 1 +N 2 IG ( ( µ 1 +µ 2, λ1 + ) ) 2 λ 2 only if λ 1 µ 2 1 = λ 2 µ 2 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 8
9 First Lower Bound on Capacity (1) ( Lower Bound: choose X IG m, λm2 µ ): 2 C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m { } = max h(y) h(n) P X : E[X] m = max h(y) h(n) P X : E[X] m h(y) ( ) h(n) X IG m, λm2 µ 2 h(n) = 1 2 h(y) ( ) =? X IG m, λm2 µ 2 log 2πeµ3 λ e2λ µ Ei ( 2λ µ ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 9
10 First Lower Bound on Capacity (2) ( Lower Bound: choose X IG m, λm2 µ 2 ): (continued) note: λm 2 µ 2 m 2 = λ µ 2 = Y = X +N ) IG (m, λm2 µ 2 +IG(µ,λ) ( ) 2 λm = IG m+µ, µ + λ ) = IG (m+µ, λ(m+µ)2 µ 2 Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 10
11 First Lower Bound on Capacity (3) ( Lower Bound: choose X IG m, λm2 µ 2 ): (continued) C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m { } = max h(y) h(n) P X : E[X] m = max h(y) h(n) P X : E[X] m h(y) ( ) h(n) X IG m, λm2 µ 2 h(n) = 1 2 log 2πeµ3 λ h(y) ( ) = 1 X IG m, λm2 µ 2 2 log 2πeµ2 (m+µ) λ e2λ µ Ei ( 2λ µ ) e2λ(m+µ) µ 2 Ei ( 2λ(m+µ) µ 2 ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 11
12 First Upper Bound on Capacity (1) Upper Bound: Note: C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m = max h(y) h(n) P X : E[X] m Under mean constraint: E[Y] = E[X]+E[N] m+µ h(y) maximized by exponential distribution Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 12
13 First Upper Bound on Capacity (2) Upper Bound: h(y) h(exponential): Hence: h(y) loge(m+µ) C = max I(X;Y) P X : E[X] m { } = max h(y) h(y X) P X : E[X] m = max h(y) h(n) P X : E[X] m loge(m+µ) h(n) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 13
14 Summary First Bounds (1) Upper Bound: [1]: C 1 2 λe(m+µ)2 log 2πµ 3 3 ( 2 e2λ µ Ei 2λ µ ) Lower Bound: [1]: C 1 2 log m+µ µ e2λ(m+µ) µ 2 Ei ( 2λ(m+µ) µ 2 ) 32 e2λµ Ei ( 2λ µ ) [1] K. V. Srinivas, R. S. Adve, and A. W. Eckford, Molecular communication in fluid media: The additive inverse Gaussian noise channel, IEEE Transactions on Information Theory, vol. 58, no. 7, pp , July Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 14
15 Summary First Bounds (2) 6 5 Capacity C [bits] ZOOM IN Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 15
16 0.5 Summary First Bounds (2) ZOOMED Capacity C [bits] Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 16
17 Summary First Bounds (3) 6 5 ZOOM IN Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 17
18 5 Summary First Bounds (3) ZOOMED Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 18
19 Idea for New Upper Bounds Duality-based upper bound: [ ( C E Q D fy X ( X) )] R( ) for arbitrary choice of R( ): R( ) exponential: (α > 0) = yields first upper bound R(y) = αe αy R( ) power inverse Gaussian: (α,β > 0, η 0) ( ) 1+ η ( α β 2 (y R(y) = exp α )η ( ) )η 2 2 β 2 2πβ 3 y 2η 2 β β y (additional bounding required) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 19
20 New Upper Bounds on Capacity C 1 (1+ 2 log λm )+ 32 ( ( 1 µ(m+µ) log 1+m µ + 1 )) λ C 1 ( η 1 logλ+ (logµ+e 2λµ Ei 2λ )) 2 2 µ ( ) λ ) (m+µ) η log ( 2λ π µ η 1 2 e λ µ Kη+ 1 2 µ + η +2 ( ( 1 log 1+m 2 µ + 1 )) logη λ C 1 2 log λ µ + 1 ( 1 (1+m 2 log µ + 1 λ + 1 ( 2 log 1+ m µ λ ) µ+λ )) e 2λµ Ei ( 2λ µ (0 < η 1, K ν ( ) modified Bessel function of second kind) ) Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 20
21 Idea for New Lower Bounds Choose exponential input: ( ) 1 X Exp m PDF of Y: convolution of exponential and inverse Gaussian [2]: Y 1 [ ( y m e m +λ µ e kλ Q ( )) ky 1 kλ ky ( ( ))] kλ ky +e kλ 1 Q + ky [2] W. Schwarz, On the convolution of inverse Gaussian and exponential random variables, Communications in Statistics Theory and Methods, vol. 31, no. 12, pp , Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 21
22 New Lower Bound on Capacity C log m λ + µ m λ µ +kλ+ 3 2 log λ µ 3 ( 2 e2λ µ Ei 2λ ) 1 µ 2 log 2π e ( log 1+ 1 ( ) m eλ µ λm 2λ 2+k 2 λm K 1 m +k2 λ ( )) 2m eλ µ λm λ +kλ 1+k 2 λm K 1 2 m +k2 λ 2 where k m 2µ2 λ 1 µ 2 2 mλ Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 22
23 New Bounds on Capacity (1) 6 5 Capacity C [bits] known bounds: black Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 23
24 New Bounds on Capacity (1) 6 5 Capacity C [bits] ZOOM IN known bounds: black our new bounds: colored Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 24
25 0.5 New Bounds on Capacity (1) ZOOMED Capacity C [bits] Delay m Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 25
26 New Bounds on Capacity (2) 6 5 Capacity C [bits] known bounds: black Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 26
27 Our Results: New Bounds on Capacity (2) 6 Capacity C [bits] ZOOM IN 1 known bounds: black our new bounds: colored Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 27
28 5 New Bounds on Capacity (2) ZOOMED Capacity C [bits] Drift velocity v Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 28
29 Exact Asymptotic Capacity for m : C(m) = logm+ 1 2 λe log 2πµ 3 3 ( 2 e2λ µ Ei 2λ µ ) +o(1) for v : C(v) = 3 2 logv log λm2 e 2π +o(1) [3] M. N. Khormuji, On the Capacity of Molecular Communication over the AIGN Channel, in Proceedings 45th Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA, Mar , 2011, pp Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 29
30 Summary & Outlook interesting new channel model new bounds on capacity exact asymptotics find better bounds for small drift velocity or small delay improve channel model: include peak-delay constraints account for loss of particles account for mixup of particles Stefan M. Moser, National Chiao Tung University (NCTU), Taiwan 30
Variance-Constrained Capacity of the Molecular Timing Channel with Synchronization Error
Variance-Constrained Capacity of the Molecular Timing Channel with Synchronization Error Malcolm Egan, Yansha Deng, Maged Elkashlan, and Trung Q. Duong Faculty of Electrical Engineering, Czech Technical
More informationThe Fading Number of a Multiple-Access Rician Fading Channel
The Fading Number of a Multiple-Access Rician Fading Channel Intermediate Report of NSC Project Capacity Analysis of Various Multiple-Antenna Multiple-Users Communication Channels with Joint Estimation
More informationSome Expectations of a Non-Central Chi-Square Distribution With an Even Number of Degrees of Freedom
Some Expectations of a Non-Central Chi-Square Distribution With an Even Number of Degrees of Freedom Stefan M. Moser April 7, 007 Abstract The non-central chi-square distribution plays an important role
More informationOn the Capacity of Diffusion-Based Molecular Timing Channels With Diversity
On the Capacity of Diffusion-Based Molecular Timing Channels With Diversity Nariman Farsad, Yonathan Murin, Milind Rao, and Andrea Goldsmith Electrical Engineering, Stanford University, USA Abstract This
More informationSINCE nanoscale devices have very limited size, energy,
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 32, NO. 2, DECEMBER 24 235 Capacity of the Memoryless Additive Inverse Gaussian Noise Channel Hui Li, Stefan M. Moser, Senior Member, IEEE, and Dongning
More informationEE376A - Information Theory Final, Monday March 14th 2016 Solutions. Please start answering each question on a new page of the answer booklet.
EE376A - Information Theory Final, Monday March 14th 216 Solutions Instructions: You have three hours, 3.3PM - 6.3PM The exam has 4 questions, totaling 12 points. Please start answering each question on
More informationCapacity of Discrete Molecular Diffusion Channels
211 IEEE International Symposium on Information Theory Proceedings Capacity of Discrete Molecular Diffusion Channels Arash nolghozati, Mohsen Sardari, Ahmad Beirami, Faramarz Fekri School of Electrical
More informationUCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, Practice Final Examination (Winter 2017)
UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, 208 Practice Final Examination (Winter 207) There are 6 problems, each problem with multiple parts. Your answer should be as clear and readable
More informationGaussian channel. Information theory 2013, lecture 6. Jens Sjölund. 8 May Jens Sjölund (IMT, LiU) Gaussian channel 1 / 26
Gaussian channel Information theory 2013, lecture 6 Jens Sjölund 8 May 2013 Jens Sjölund (IMT, LiU) Gaussian channel 1 / 26 Outline 1 Definitions 2 The coding theorem for Gaussian channel 3 Bandlimited
More informationOn the Capacity of Free-Space Optical Intensity Channels
On the Capacity of Free-Space Optical Intensity Channels Amos Lapidoth TH Zurich Zurich, Switzerl mail: lapidoth@isi.ee.ethz.ch Stefan M. Moser National Chiao Tung University NCTU Hsinchu, Taiwan mail:
More informationEE376A: Homeworks #4 Solutions Due on Thursday, February 22, 2018 Please submit on Gradescope. Start every question on a new page.
EE376A: Homeworks #4 Solutions Due on Thursday, February 22, 28 Please submit on Gradescope. Start every question on a new page.. Maximum Differential Entropy (a) Show that among all distributions supported
More informationECE 302 Division 1 MWF 10:30-11:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding.
NAME: ECE 302 Division MWF 0:30-:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding. If you are not in Prof. Pollak s section, you may not take this
More informationEE/Stats 376A: Homework 7 Solutions Due on Friday March 17, 5 pm
EE/Stats 376A: Homework 7 Solutions Due on Friday March 17, 5 pm 1. Feedback does not increase the capacity. Consider a channel with feedback. We assume that all the recieved outputs are sent back immediately
More informationA Simple Memoryless Proof of the Capacity of the Exponential Server Timing Channel
A Simple Memoryless Proof of the Capacity of the Exponential Server iming Channel odd P. Coleman ECE Department Coordinated Science Laboratory University of Illinois colemant@illinois.edu Abstract his
More informationImpulse Response of the Channel with a Spherical Absorbing Receiver and a Spherical Reflecting Boundary
1 Impulse Response of the Channel with a Spherical Absorbing Receiver and a Spherical Reflecting Boundary Fatih inç, Student Member, IEEE, Bayram Cevdet Akdeniz, Student Member, IEEE, Ali Emre Pusane,
More informationEstimation of the Capacity of Multipath Infrared Channels
Estimation of the Capacity of Multipath Infrared Channels Jeffrey B. Carruthers Department of Electrical and Computer Engineering Boston University jbc@bu.edu Sachin Padma Department of Electrical and
More informationECE Information theory Final (Fall 2008)
ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1
More informationEE 4TM4: Digital Communications II Scalar Gaussian Channel
EE 4TM4: Digital Communications II Scalar Gaussian Channel I. DIFFERENTIAL ENTROPY Let X be a continuous random variable with probability density function (pdf) f(x) (in short X f(x)). The differential
More informationAdvanced Topics in Information Theory
Advanced Topics in Information Theory Lecture Notes Stefan M. Moser c Copyright Stefan M. Moser Signal and Information Processing Lab ETH Zürich Zurich, Switzerland Institute of Communications Engineering
More informationOn the Throughput, Capacity and Stability Regions of Random Multiple Access over Standard Multi-Packet Reception Channels
On the Throughput, Capacity and Stability Regions of Random Multiple Access over Standard Multi-Packet Reception Channels Jie Luo, Anthony Ephremides ECE Dept. Univ. of Maryland College Park, MD 20742
More informationECE Information theory Final
ECE 776 - Information theory Final Q1 (1 point) We would like to compress a Gaussian source with zero mean and variance 1 We consider two strategies In the first, we quantize with a step size so that the
More informationThe Effect upon Channel Capacity in Wireless Communications of Perfect and Imperfect Knowledge of the Channel
The Effect upon Channel Capacity in Wireless Communications of Perfect and Imperfect Knowledge of the Channel Muriel Medard, Trans. on IT 000 Reading Group Discussion March 0, 008 Intro./ Overview Time
More informationInformation Transfer through Calcium Signaling
Information Transfer through Calcium Signaling Tadashi Nakano and Jian-Qin Liu Frontier Research Base for Global Young Researchers Graduate School of Engineering Osaka University, Japan tnakano@wakate.frc.eng.osaka-u.ac.jp
More informationNote that the new channel is noisier than the original two : and H(A I +A2-2A1A2) > H(A2) (why?). min(c,, C2 ) = min(1 - H(a t ), 1 - H(A 2 )).
l I ~-16 / (a) (5 points) What is the capacity Cr of the channel X -> Y? What is C of the channel Y - Z? (b) (5 points) What is the capacity C 3 of the cascaded channel X -3 Z? (c) (5 points) A ow let.
More informationELEC546 Review of Information Theory
ELEC546 Review of Information Theory Vincent Lau 1/1/004 1 Review of Information Theory Entropy: Measure of uncertainty of a random variable X. The entropy of X, H(X), is given by: If X is a discrete random
More informationRevision of Lecture 4
Revision of Lecture 4 We have completed studying digital sources from information theory viewpoint We have learnt all fundamental principles for source coding, provided by information theory Practical
More informationInteractions of Information Theory and Estimation in Single- and Multi-user Communications
Interactions of Information Theory and Estimation in Single- and Multi-user Communications Dongning Guo Department of Electrical Engineering Princeton University March 8, 2004 p 1 Dongning Guo Communications
More informationMOLECULAR communication is a biologically inspired. Communication System Design and Analysis for Asynchronous Molecular Timing Channels
Communication System Design and Analysis for Asynchronous Molecular Timing Channels Nariman Farsad, Member, IEEE, Yonathan Murin, Member, IEEE, Weisi Guo, Senior Member, IEEE, Chan-Byoung Chae, Senior
More informationEE/Stat 376B Handout #5 Network Information Theory October, 14, Homework Set #2 Solutions
EE/Stat 376B Handout #5 Network Information Theory October, 14, 014 1. Problem.4 parts (b) and (c). Homework Set # Solutions (b) Consider h(x + Y ) h(x + Y Y ) = h(x Y ) = h(x). (c) Let ay = Y 1 + Y, where
More informationChapter 4: Continuous channel and its capacity
meghdadi@ensil.unilim.fr Reference : Elements of Information Theory by Cover and Thomas Continuous random variable Gaussian multivariate random variable AWGN Band limited channel Parallel channels Flat
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationTitle. Author(s)Tsai, Shang-Ho. Issue Date Doc URL. Type. Note. File Information. Equal Gain Beamforming in Rayleigh Fading Channels
Title Equal Gain Beamforming in Rayleigh Fading Channels Author(s)Tsai, Shang-Ho Proceedings : APSIPA ASC 29 : Asia-Pacific Signal Citationand Conference: 688-691 Issue Date 29-1-4 Doc URL http://hdl.handle.net/2115/39789
More informationUniversal examples. Chapter The Bernoulli process
Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial
More informationEE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15
EE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15 1. Cascade of Binary Symmetric Channels The conditional probability distribution py x for each of the BSCs may be expressed by the transition probability
More informationWE consider a memoryless discrete-time channel whose
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 55, NO. 1, JANUARY 2009 303 On the Capacity of the Discrete-Time Poisson Channel Amos Lapidoth, Fellow, IEEE, and Stefan M. Moser, Member, IEEE Abstract The
More informationAdaptive Molecule Transmission Rate for Diffusion Based Molecular Communication
Adaptive Molecule Transmission Rate for Diffusion Based Molecular Communication Mohammad Movahednasab, Mehdi Soleimanifar, Amin Gohari, Masoumeh Nasiri Kenari and Urbashi Mitra Sharif University of Technology
More informationEnergy State Amplification in an Energy Harvesting Communication System
Energy State Amplification in an Energy Harvesting Communication System Omur Ozel Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland College Park, MD 20742 omur@umd.edu
More informationOn the Duality between Multiple-Access Codes and Computation Codes
On the Duality between Multiple-Access Codes and Computation Codes Jingge Zhu University of California, Berkeley jingge.zhu@berkeley.edu Sung Hoon Lim KIOST shlim@kiost.ac.kr Michael Gastpar EPFL michael.gastpar@epfl.ch
More informationASimpleMathematicalModelforInformationRate of Active Transport Molecular Communication
ASimpleMathematicalModelforInformationRate of Active Transport Molecular Communication Nariman Farsad, Andrew W. Eckford Department of Computer Science and Engineering York University 4700 Keele Street,
More informationFluctuation theorem in systems in contact with different heath baths: theory and experiments.
Fluctuation theorem in systems in contact with different heath baths: theory and experiments. Alberto Imparato Institut for Fysik og Astronomi Aarhus Universitet Denmark Workshop Advances in Nonequilibrium
More informationCapacity of the Discrete Memoryless Energy Harvesting Channel with Side Information
204 IEEE International Symposium on Information Theory Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information Omur Ozel, Kaya Tutuncuoglu 2, Sennur Ulukus, and Aylin Yener
More informationMorning Session Capacity-based Power Control. Department of Electrical and Computer Engineering University of Maryland
Morning Session Capacity-based Power Control Şennur Ulukuş Department of Electrical and Computer Engineering University of Maryland So Far, We Learned... Power control with SIR-based QoS guarantees Suitable
More informationSoft-Output Trellis Waveform Coding
Soft-Output Trellis Waveform Coding Tariq Haddad and Abbas Yongaçoḡlu School of Information Technology and Engineering, University of Ottawa Ottawa, Ontario, K1N 6N5, Canada Fax: +1 (613) 562 5175 thaddad@site.uottawa.ca
More informationRCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths
RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths Kasra Vakilinia, Dariush Divsalar*, and Richard D. Wesel Department of Electrical Engineering, University
More informationChapter 2 Signal Processing at Receivers: Detection Theory
Chapter Signal Processing at Receivers: Detection Theory As an application of the statistical hypothesis testing, signal detection plays a key role in signal processing at receivers of wireless communication
More information3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions
Engineering Tripos Part IIA THIRD YEAR 3F: Signals and Systems INFORMATION THEORY Examples Paper Solutions. Let the joint probability mass function of two binary random variables X and Y be given in the
More informationChapter 4. Data Transmission and Channel Capacity. Po-Ning Chen, Professor. Department of Communications Engineering. National Chiao Tung University
Chapter 4 Data Transmission and Channel Capacity Po-Ning Chen, Professor Department of Communications Engineering National Chiao Tung University Hsin Chu, Taiwan 30050, R.O.C. Principle of Data Transmission
More informationError Exponent Region for Gaussian Broadcast Channels
Error Exponent Region for Gaussian Broadcast Channels Lihua Weng, S. Sandeep Pradhan, and Achilleas Anastasopoulos Electrical Engineering and Computer Science Dept. University of Michigan, Ann Arbor, MI
More informationLimits on classical communication from quantum entropy power inequalities
Limits on classical communication from quantum entropy power inequalities Graeme Smith, IBM Research (joint work with Robert Koenig) QIP 2013 Beijing Channel Capacity X N Y p(y x) Capacity: bits per channel
More informationDigital Band-pass Modulation PROF. MICHAEL TSAI 2011/11/10
Digital Band-pass Modulation PROF. MICHAEL TSAI 211/11/1 Band-pass Signal Representation a t g t General form: 2πf c t + φ t g t = a t cos 2πf c t + φ t Envelope Phase Envelope is always non-negative,
More informationShannon meets Wiener II: On MMSE estimation in successive decoding schemes
Shannon meets Wiener II: On MMSE estimation in successive decoding schemes G. David Forney, Jr. MIT Cambridge, MA 0239 USA forneyd@comcast.net Abstract We continue to discuss why MMSE estimation arises
More informationStat 512 Homework key 2
Stat 51 Homework key October 4, 015 REGULAR PROBLEMS 1 Suppose continuous random variable X belongs to the family of all distributions having a linear probability density function (pdf) over the interval
More informationON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION
ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ZHENLINYANGandRONNIET.C.LEE Department of Statistics and Applied Probability, National University of Singapore, 3 Science Drive 2, Singapore
More informationMathematical methods in communication June 16th, Lecture 12
2- Mathematical methods in communication June 6th, 20 Lecture 2 Lecturer: Haim Permuter Scribe: Eynan Maydan and Asaf Aharon I. MIMO - MULTIPLE INPUT MULTIPLE OUTPUT MIMO is the use of multiple antennas
More informationProbability and Statistics for Final Year Engineering Students
Probability and Statistics for Final Year Engineering Students By Yoni Nazarathy, Last Updated: May 24, 2011. Lecture 6p: Spectral Density, Passing Random Processes through LTI Systems, Filtering Terms
More informationOn the Secrecy Capacity of Fading Channels
On the Secrecy Capacity of Fading Channels arxiv:cs/63v [cs.it] 7 Oct 26 Praveen Kumar Gopala, Lifeng Lai and Hesham El Gamal Department of Electrical and Computer Engineering The Ohio State University
More informationECE353: Probability and Random Processes. Lecture 18 - Stochastic Processes
ECE353: Probability and Random Processes Lecture 18 - Stochastic Processes Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu From RV
More informationSecret Key Agreement Using Asymmetry in Channel State Knowledge
Secret Key Agreement Using Asymmetry in Channel State Knowledge Ashish Khisti Deutsche Telekom Inc. R&D Lab USA Los Altos, CA, 94040 Email: ashish.khisti@telekom.com Suhas Diggavi LICOS, EFL Lausanne,
More informationMarginal density. If the unknown is of the form x = (x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density
Marginal density If the unknown is of the form x = x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density πx 1 y) = πx 1, x 2 y)dx 2 = πx 2 )πx 1 y, x 2 )dx 2 needs to be
More informationA Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback
A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback Vincent Y. F. Tan (NUS) Joint work with Silas L. Fong (Toronto) 2017 Information Theory Workshop, Kaohsiung,
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationMinimum Message Length Inference and Mixture Modelling of Inverse Gaussian Distributions
Minimum Message Length Inference and Mixture Modelling of Inverse Gaussian Distributions Daniel F. Schmidt Enes Makalic Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School
More informationOptimal power-delay trade-offs in fading channels: small delay asymptotics
Optimal power-delay trade-offs in fading channels: small delay asymptotics Randall A. Berry Dept. of EECS, Northwestern University 45 Sheridan Rd., Evanston IL 6008 Email: rberry@ece.northwestern.edu Abstract
More informationThe Crossover-Distance for ISI-Correcting Decoding of Convolutional Codes in Diffusion-Based Molecular Communications
1 The Crossover-Distance for ISI-Correcting Decoding of Convolutional Codes in Diffusion-Based Molecular Communications Hui Li, Qingchao Li arxiv:1812.11273v1 [cs.it] 29 Dec 2018 Abstract In diffusion
More informationPerformance Evaluation of Queuing Systems
Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems
More informationStability and Sensitivity of the Capacity in Continuous Channels. Malcolm Egan
Stability and Sensitivity of the Capacity in Continuous Channels Malcolm Egan Univ. Lyon, INSA Lyon, INRIA 2019 European School of Information Theory April 18, 2019 1 / 40 Capacity of Additive Noise Models
More informationCapacity Region of the Permutation Channel
Capacity Region of the Permutation Channel John MacLaren Walsh and Steven Weber Abstract We discuss the capacity region of a degraded broadcast channel (DBC) formed from a channel that randomly permutes
More informationChannel capacity. Outline : 1. Source entropy 2. Discrete memoryless channel 3. Mutual information 4. Channel capacity 5.
Channel capacity Outline : 1. Source entropy 2. Discrete memoryless channel 3. Mutual information 4. Channel capacity 5. Exercices Exercise session 11 : Channel capacity 1 1. Source entropy Given X a memoryless
More information«Random Vectors» Lecture #2: Introduction Andreas Polydoros
«Random Vectors» Lecture #2: Introduction Andreas Polydoros Introduction Contents: Definitions: Correlation and Covariance matrix Linear transformations: Spectral shaping and factorization he whitening
More informationCut-Set Bound and Dependence Balance Bound
Cut-Set Bound and Dependence Balance Bound Lei Xiao lxiao@nd.edu 1 Date: 4 October, 2006 Reading: Elements of information theory by Cover and Thomas [1, Section 14.10], and the paper by Hekstra and Willems
More informationDesign of IP networks with Quality of Service
Course of Multimedia Internet (Sub-course Reti Internet Multimediali ), AA 2010-2011 Prof. Pag. 1 Design of IP networks with Quality of Service 1 Course of Multimedia Internet (Sub-course Reti Internet
More informationConsensus Problem under Diffusion-based Molecular Communication
Consensus Problem under Diffusion-based Molecular Communication Arash Einolghozati, Mohsen Sardari, Ahmad Beirami, Faramarz Fekri School of Electrical and Computer Engineering, Georgia Institute of Technology,
More informationStochastic Network Calculus
Stochastic Network Calculus Assessing the Performance of the Future Internet Markus Fidler joint work with Amr Rizk Institute of Communications Technology Leibniz Universität Hannover April 22, 2010 c
More informationST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples
ST3241 Categorical Data Analysis I Generalized Linear Models Introduction and Some Examples 1 Introduction We have discussed methods for analyzing associations in two-way and three-way tables. Now we will
More informationParameter Estimation
1 / 44 Parameter Estimation Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay October 25, 2012 Motivation System Model used to Derive
More informationUncertainity, Information, and Entropy
Uncertainity, Information, and Entropy Probabilistic experiment involves the observation of the output emitted by a discrete source during every unit of time. The source output is modeled as a discrete
More informationConstellation Shaping for Communication Channels with Quantized Outputs
Constellation Shaping for Communication Channels with Quantized Outputs, Dr. Matthew C. Valenti and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia University
More informationGaussian, Markov and stationary processes
Gaussian, Markov and stationary processes Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ November
More informationOn the Distribution of Mutual Information
On the Distribution of Mutual Information J. Nicholas Laneman Dept. of Electrical Engineering University of Notre Dame Notre Dame IN 46556 Email: jnl@nd.edu Abstract In the early years of information theory
More informationConvergence to equilibrium for rough differential equations
Convergence to equilibrium for rough differential equations Samy Tindel Purdue University Barcelona GSE Summer Forum 2017 Joint work with Aurélien Deya (Nancy) and Fabien Panloup (Angers) Samy T. (Purdue)
More informationSequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process
Applied Mathematical Sciences, Vol. 4, 2010, no. 62, 3083-3093 Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Julia Bondarenko Helmut-Schmidt University Hamburg University
More informationLecture 2. Capacity of the Gaussian channel
Spring, 207 5237S, Wireless Communications II 2. Lecture 2 Capacity of the Gaussian channel Review on basic concepts in inf. theory ( Cover&Thomas: Elements of Inf. Theory, Tse&Viswanath: Appendix B) AWGN
More informationStochastic Networks and Parameter Uncertainty
Stochastic Networks and Parameter Uncertainty Assaf Zeevi Graduate School of Business Columbia University Stochastic Processing Networks Conference, August 2009 based on joint work with Mike Harrison Achal
More informationMassachusetts Institute of Technology
.203J/6.28J/3.665J/5.073J/6.76J/ESD.26J Quiz Solutions (a)(i) Without loss of generality we can pin down X at any fixed point. X 2 is still uniformly distributed over the square. Assuming that the police
More informationUCSD ECE153 Handout #40 Prof. Young-Han Kim Thursday, May 29, Homework Set #8 Due: Thursday, June 5, 2011
UCSD ECE53 Handout #40 Prof. Young-Han Kim Thursday, May 9, 04 Homework Set #8 Due: Thursday, June 5, 0. Discrete-time Wiener process. Let Z n, n 0 be a discrete time white Gaussian noise (WGN) process,
More informationMarshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications
CHAPTER 6 Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications 6.1 Introduction Exponential distributions have been introduced as a simple model for statistical analysis
More informationSTATISTICAL MODELING OF ASYNCHRONOUS IMPULSIVE NOISE IN POWERLINE COMMUNICATION NETWORKS
STATISTICAL MODELING OF ASYNCHRONOUS IMPULSIVE NOISE IN POWERLINE COMMUNICATION NETWORKS Marcel Nassar, Kapil Gulati, Yousof Mortazavi, and Brian L. Evans Department of Electrical and Computer Engineering
More informationHOLOGRAPHIC IMPLEMENTATION OF A LINEAR PREDICTOR OF RANDOM PROCESSES: INFLUENCE OF HIGH-PASS AND LOW-PASS FILTERING ON THE PROCESS CHARACTERISTICS
HOLOGRAPHIC IMPLEMENTATION OF A LINEAR PREDICTOR OF RANDOM PROCESSES: INFLUENCE OF HIGH-PASS AND LOW-PASS FILTERING ON THE PROCESS CHARACTERISTICS Z.S. Bekyasheva, A.V. Pavlov, A.A. Vostrikov St. Petersburg
More informationFundamental rate delay tradeoffs in multipath routed and network coded networks
Fundamental rate delay tradeoffs in multipath routed and network coded networks John Walsh and Steven Weber Drexel University, Dept of ECE Philadelphia, PA 94 {jwalsh,sweber}@ecedrexeledu IP networks subject
More informationMapper & De-Mapper System Document
Mapper & De-Mapper System Document Mapper / De-Mapper Table of Contents. High Level System and Function Block. Mapper description 2. Demodulator Function block 2. Decoder block 2.. De-Mapper 2..2 Implementation
More informationNational University of Singapore Department of Electrical & Computer Engineering. Examination for
National University of Singapore Department of Electrical & Computer Engineering Examination for EE5139R Information Theory for Communication Systems (Semester I, 2014/15) November/December 2014 Time Allowed:
More informationEC2252 COMMUNICATION THEORY UNIT 5 INFORMATION THEORY
EC2252 COMMUNICATION THEORY UNIT 5 INFORMATION THEORY Discrete Messages and Information Content, Concept of Amount of Information, Average information, Entropy, Information rate, Source coding to increase
More informationCognitive Multiple Access Networks
Cognitive Multiple Access Networks Natasha Devroye Email: ndevroye@deas.harvard.edu Patrick Mitran Email: mitran@deas.harvard.edu Vahid Tarokh Email: vahid@deas.harvard.edu Abstract A cognitive radio can
More informationECE598: Information-theoretic methods in high-dimensional statistics Spring 2016
ECE598: Information-theoretic methods in high-dimensional statistics Spring 06 Lecture : Mutual Information Method Lecturer: Yihong Wu Scribe: Jaeho Lee, Mar, 06 Ed. Mar 9 Quick review: Assouad s lemma
More informationX 1 : X Table 1: Y = X X 2
ECE 534: Elements of Information Theory, Fall 200 Homework 3 Solutions (ALL DUE to Kenneth S. Palacio Baus) December, 200. Problem 5.20. Multiple access (a) Find the capacity region for the multiple-access
More informationStochastic Stabilization of a Noisy Linear System with a Fixed-Rate Adaptive Quantizer
2009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 10-12, 2009 ThA06.6 Stochastic Stabilization of a Noisy Linear System with a Fixed-Rate Adaptive Quantizer Serdar Yüksel
More informationLecture 7 MIMO Communica2ons
Wireless Communications Lecture 7 MIMO Communica2ons Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2014 1 Outline MIMO Communications (Chapter 10
More informationUCSD ECE 153 Handout #20 Prof. Young-Han Kim Thursday, April 24, Solutions to Homework Set #3 (Prepared by TA Fatemeh Arbabjolfaei)
UCSD ECE 53 Handout #0 Prof. Young-Han Kim Thursday, April 4, 04 Solutions to Homework Set #3 (Prepared by TA Fatemeh Arbabjolfaei). Time until the n-th arrival. Let the random variable N(t) be the number
More informationVariable Length Codes for Degraded Broadcast Channels
Variable Length Codes for Degraded Broadcast Channels Stéphane Musy School of Computer and Communication Sciences, EPFL CH-1015 Lausanne, Switzerland Email: stephane.musy@ep.ch Abstract This paper investigates
More informationStatistics for Data Analysis. Niklaus Berger. PSI Practical Course Physics Institute, University of Heidelberg
Statistics for Data Analysis PSI Practical Course 2014 Niklaus Berger Physics Institute, University of Heidelberg Overview You are going to perform a data analysis: Compare measured distributions to theoretical
More information