Covert Communication with Channel-State Information at the Transmitter
|
|
- Karin Walters
- 5 years ago
- Views:
Transcription
1 Covert Communication with Channel-State Information at the Transmitter Si-Hyeon Lee Joint Work with Ligong Wang, Ashish Khisti, and Gregory W. Wornell July 27, / 21
2 Covert Communication Transmitter and receiver wish to communicate reliably, while ensuring that their communication is not detected by the warden. 2 / 21
3 Covert Communication Hypothesis test by the warden Probability of false alarm: α Probability of missed detection: β Covertness guaranteed if D(P Z,Sending P Z,Not sending ) is small Blind test: α + β = 1 Optimal test: α + β 1 D(P Z,Sending P Z,Not sending ) 3 / 21
4 Square Root Law N Y Transmitter X Y Z Receiver Warden N Z Maximum amount of information scales like the square root of the blocklength AWGN channel [Bash-Goekel-Towsley 13] A broad class of DMC [Bloch 16], [Wang-Wornell-Zheng 16] 4 / 21
5 When We Beat the Square Root Law? Unknown channel statistics at the warden BSCs with unknown cross over probability [Che-Bakshi-Chan-Jaggi 14] AWGN with unknown noise power [Lee-Baxley-Weitnauer-Walkenhorst 15] This talk: State-dependent channel with CSI at the transmitter 5 / 21
6 Binary Symmetric Channel X 0 1 p 0 Z 1 p fixed and known: Zero capacity [Bloch 16], [Wang-Wornell-Zheng 16] p random and unknown: Positive capacity [Che-Bakshi-Chan-Jaggi 14] p fixed and known, realizations known to the transmitter Our model Positive capacity by pre-cancellation 6 / 21
7 Binary Symmetric Channel X 0 1 p 0 Z 1 p fixed and known: Zero capacity [Bloch 16], [Wang-Wornell-Zheng 16] p random and unknown: Positive capacity [Che-Bakshi-Chan-Jaggi 14] p fixed and known, realizations known to the transmitter Our model Positive capacity by pre-cancellation 6 / 21
8 Model K M Transmitter X n p(y, z s, x) Y n Z n Receiver Warden ˆM S i or S n State-dependent DMC (X, S, Y, Z, P S, P Y,Z S,X ) Transmitter and receiver share a secret key K [1 : 2 nr 0 ] Input cost function b(x n ) = 1 n n i=1 b(x i ) State sequence known to the transmitter causally or noncausally (R, R K, n) code for causal CSI Encoding function at time i: (M, K, S i ) X i Decoding function (Y n, K) ˆM 7 / 21
9 Model K M Transmitter X n p(y, z s, x) Y n Z n Receiver Warden ˆM S i or S n State-dependent DMC (X, S, Y, Z, P S, P Y,Z S,X ) Transmitter and receiver share a secret key K [1 : 2 nr 0 ] Input cost function b(x n ) = 1 n n i=1 b(x i ) State sequence known to the transmitter causally or noncausally (R, R K, n) code for noncausal CSI Encoding function: (M, K, S n ) X n Decoding function (Y n, K) ˆM 7 / 21
10 Model K M Transmitter X n p(y, z s, x) Y n Z n Receiver Warden ˆM S i or S n Covert communication: x 0 X : no input symbol, Q 0 ( ) = s S P S (s)p Z S,X ( s, x 0 ) Small D( P Z n Q n 0 ) ensures the warden s best hypothesis test performs not much better than a blind test. A covert rate of R is achievable if a sequence of (R, R K, n) codes that simultaneously satisfies input cost constraint lim sup n E M,K,S n [b(x n )] B reliability constraint lim n P( ˆM M) = 0 covertness constraint lim n D( P Z n Q n 0 ) = 0 Covert capacity C: Supremum of all achievable covert rates 8 / 21
11 Main Results: Causal CSI Theorem 1 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P V, x(v,s): P Z =Q 0, E[b(X )] B I (V ; Y ). Theorem 2 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (V ; Y ). P V, x(v,s): P Z =Q 0, E[b(X )] B, I (V ;Z) I (V ;Y )<R K 9 / 21
12 Main Results: Causal CSI Theorem 1 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P V, x(v,s): P Z =Q 0, E[b(X )] B I (V ; Y ). Theorem 2 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (V ; Y ). P V, x(v,s): P Z =Q 0, E[b(X )] B, I (V ;Z) I (V ;Y )<R K 9 / 21
13 Main Results: Causal CSI Theorem 1 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P V, x(v,s): P Z =Q 0, E[b(X )] B I (V ; Y ). Theorem 2 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (V ; Y ). P V, x(v,s): P Z =Q 0, E[b(X )] B, I (V ;Z) I (V ;Y )<R K 9 / 21
14 Main Results: Noncausal CSI Theorem 3 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P U S, x(u,s): P Z =Q 0, E[b(X )] B I (U; Y ) I (U; S). Theorem 4 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (U; Y ) I (U; S). P U S, x(u,s): P Z =Q 0, E[b(X )] B, I (U;Z) I (U;Y )<R K 10 / 21
15 Main Results: Noncausal CSI Theorem 3 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P U S, x(u,s): P Z =Q 0, E[b(X )] B I (U; Y ) I (U; S). Theorem 4 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (U; Y ) I (U; S). P U S, x(u,s): P Z =Q 0, E[b(X )] B, I (U;Z) I (U;Y )<R K 10 / 21
16 Main Results: Noncausal CSI Theorem 3 (Upper Bound) For R K 0 and B 0, the covert capacity is upper-bounded as C max P U S, x(u,s): P Z =Q 0, E[b(X )] B I (U; Y ) I (U; S). Theorem 4 (Lower Bound) For R K 0 and B 0, the covert capacity is lower-bounded as C max I (U; Y ) I (U; S). P U S, x(u,s): P Z =Q 0, E[b(X )] B, I (U;Z) I (U;Y )<R K 10 / 21
17 Example: Binary Symmetric Channels 0 0 X p Y = Z S Bern(p) 1 R K > 0, x 0 = 0 1 X Y = Z Without CSI at the transmitter: C = 0 With CSI at the transmitter: C = H b (p) for both causal and noncausal cases X = V S, V Bern(p) independent with S 11 / 21
18 Example: Binary Symmetric Channels 0 0 X p Y = Z S Bern(p) 1 R K > 0, x 0 = 0 1 X Y = Z Without CSI at the transmitter: C = 0 With CSI at the transmitter: C = H b (p) for both causal and noncausal cases X = V S, V Bern(p) independent with S 11 / 21
19 Example: Binary Symmetric Channels 0 0 X p Y = Z S Bern(p) 1 R K > 0, x 0 = 0 1 X = V S Y = Z Without CSI at the transmitter: C = 0 With CSI at the transmitter: C = H b (p) for both causal and noncausal cases X = V S, V Bern(p) independent with S 11 / 21
20 Example: Binary Symmetric Channels 0 0 X p Y = Z 1 R K > 0, x 0 = 0 1 V = Y = Z Without CSI at the transmitter: C = 0 With CSI at the transmitter: C = H b (p) for both causal and noncausal cases X = V S, V Bern(p) independent with S 11 / 21
21 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Without CSI at the transmitter: C = 0 With CSI at the transmitter: C > 0 Make room for message transmission by reducing the interference power, i.e., X = X γ S Choose P and γ to simultaneously satisfy { the covertness } constraint and 1, P, T 2T = (1 γ ) 2 T, the input power constraint, i.e., γ = min P = T T 12 / 21
22 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Without CSI at the transmitter: C = 0 With CSI at the transmitter: C > 0 Make room for message transmission by reducing the interference power, i.e., X = X γ S Choose P and γ to simultaneously satisfy { the covertness } constraint and 1, P, T 2T = (1 γ ) 2 T, the input power constraint, i.e., γ = min P = T T 12 / 21
23 Example: AWGN Channels N Y N (0, 1) Y X = X γ S E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Without CSI at the transmitter: C = 0 With CSI at the transmitter: C > 0 Make room for message transmission by reducing the interference power, i.e., X = X γ S Choose P and γ to simultaneously satisfy { the covertness } constraint and 1, P, T 2T = (1 γ ) 2 T, the input power constraint, i.e., γ = min P = T T 12 / 21
24 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P (1 γ )S N (0, (1 γ ) 2 T ) Z N Z N (0, σ 2 ) Without CSI at the transmitter: C = 0 With CSI at the transmitter: C > 0 Make room for message transmission by reducing the interference power, i.e., X = X γ S Choose P and γ to simultaneously satisfy { the covertness } constraint and 1, P, T 2T = (1 γ ) 2 T, the input power constraint, i.e., γ = min P = T T 12 / 21
25 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Without CSI at the transmitter: C = 0 With CSI at the transmitter: C > 0 Make room for message transmission by reducing the interference power, i.e., X = X γ S Choose P and γ to simultaneously satisfy { the covertness } constraint and 1, P, T 2T = (1 γ ) 2 T, the input power constraint, i.e., γ = min P = T T 12 / 21
26 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Causal CSI at the transmitter Choose V = X and treat interference as noise at the receiver 13 / 21
27 Example: AWGN Channels γ = min { } 1, P 2T, T = (1 γ ) 2 T, P = T T Theorem 5 (Causal CSI) If R K > 1 ( ) 2 log 1 + P 12 ) (1 T + σ log + P, 2 T + 1 the covert capacity with causal CSI at the transmitter is lower-bounded as C c 1 ( ) 2 log 1 + P. T + 1 If the warden s channel is degraded, i.e., σ 2 > 1, a secret key is not needed to achieve the rate 14 / 21
28 Example: AWGN Channels N Y N (0, 1) Y X E[X 2 ] P S N (0, T ) Z N Z N (0, σ 2 ) Noncausal CSI at the transmitter Choose U as in the dirty paper coding with input power constraint P and interference power T 15 / 21
29 Example: AWGN Channels γ = min { } 1, P 2T, T = (1 γ ) 2 T, P = T T Theorem 6 (Noncausal CSI) If R K > 1 2 log ( log (1 + (P + P T ) ) 2 P +1 (P + ( P P +1 )2 T )(P + T + σ 2 ) (P + P T P +1 ) 2 (P + P T ) 2 P +1 (P + ( P P +1 )2 T )(P + T + 1) (P + P T P +1 ) 2 the covert capacity with noncausal CSI at the transmitter is given by C nc = 1 2 log (1 + P ). ), If the warden s channel is degraded, i.e., σ 2 > 1, a secret key is not needed to achieve the capacity 16 / 21
30 Example: AWGN Channels For R K sufficiently large, C c 1 ( ) 2 log 1 + P T + 1 C nc = 1 2 log (1 + P ). If T = 0, i.e., T P, Cc = Cnc. 2 As T, P P and hence C nc approaches to the capacity without a covertness constraint 17 / 21
31 Achievability with Noncausal CSI Key idea: Gelfend-Pinsker coding, except that likelihood encoding by [Song-Cuff-Poor 16], [Goldfeld-Kramer-Permuter-Cuff 17] is used instead of joint-typicality encoding. Codebook generation: Fix P U S and x(u, s) such that P Z = Q 0 and E[b(X )] B 1+ɛ. For each k [1 : 2 nr K ] and m [1 : 2 nr ], randomly generate a subcodebook C(k, m) = {u n (k, m, l) : l [1 : 2 nr ]} according to n i=1 P U(u i ). Encoding: Given state sequence s n, secret key k, and message m, evaluate the likelihood g(l s n, k, m) = P n S U (sn u n (k, m, l)) l [1:2 nr ] P n S U (sn u n (k, m, l )). The encoder randomly generates l according to the above and transmits x n where x i = x(u i (k, m, l), s i ). 18 / 21
32 Achievability with Noncausal CSI Decoding: Upon receiving y n, with access to the secret key k, the decoder declares that ˆm is sent if it is the unique message such that (u n (k, ˆm, l), y n ) T (n) ɛ for some l [1 : 2 nr ]; otherwise it declares an error. Covertness analysis: Γ: Joint distribution when the codeword index in the subcodebook is uniformly chosen and then the state sequence is generated in an iid manner according to P S U. PZ n Γ Z n, if R > I (U; S) Γ Z n Q n 0, if R K + R + R > I (U; Z) Reliability analysis: Done by packing lemma R + R < I (U; Y ) 19 / 21
33 Converse with Noncausal CSI Step (a): Bounding techniques for channels with noncausal CSI without covertness constraint, where U i := (M, K, Y i 1, S n i+1 ). Step (b): Characterization of capacity function C(A, B) := max P U S,P X U,S : E[b(X )] B, D(P Z Q 0 ) A (I (U; Y ) I (U; S)) The function C(A, B) is non-decreasing in each of A and B, and concave and continuous in (A, B). Step (c): Application of covertness and input cost constraints R (a) 1 n (b) 1 n (b) C n (I (U i ; Y i ) I (U i ; S i )) + ɛ n i=1 n C(D( P Zi Q 0 ), E[b(X i )]) + ɛ n i=1 ( 1 n (c) C (0, B) ) n D( P Zi Q 0 ), 1 n E[b(X i )] + ɛ n n i=1 i=1 20 / 21
34 Conclusion Considered state dependent channel with state information at the transmitter Characterized the covert capacity when a sufficiently long secret key is shared between the transmitter and the receiver Derived lower bounds on the rate of the secret key that is needed to achieve the covert capacity For certain channel models, showed that the covert capacity is positive with CSI at the transmitter, but is zero without CSI Full version will be uploaded on arxiv soon 21 / 21
EE 4TM4: Digital Communications II. Channel Capacity
EE 4TM4: Digital Communications II 1 Channel Capacity I. CHANNEL CODING THEOREM Definition 1: A rater is said to be achievable if there exists a sequence of(2 nr,n) codes such thatlim n P (n) e (C) = 0.
More informationThe Poisson Channel with Side Information
The Poisson Channel with Side Information Shraga Bross School of Enginerring Bar-Ilan University, Israel brosss@macs.biu.ac.il Amos Lapidoth Ligong Wang Signal and Information Processing Laboratory ETH
More informationLecture 10: Broadcast Channel and Superposition Coding
Lecture 10: Broadcast Channel and Superposition Coding Scribed by: Zhe Yao 1 Broadcast channel M 0M 1M P{y 1 y x} M M 01 1 M M 0 The capacity of the broadcast channel depends only on the marginal conditional
More informationLecture 4 Noisy Channel Coding
Lecture 4 Noisy Channel Coding I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw October 9, 2015 1 / 56 I-Hsiang Wang IT Lecture 4 The Channel Coding Problem
More informationNational University of Singapore Department of Electrical & Computer Engineering. Examination for
National University of Singapore Department of Electrical & Computer Engineering Examination for EE5139R Information Theory for Communication Systems (Semester I, 2014/15) November/December 2014 Time Allowed:
More informationLecture 5: Channel Capacity. Copyright G. Caire (Sample Lectures) 122
Lecture 5: Channel Capacity Copyright G. Caire (Sample Lectures) 122 M Definitions and Problem Setup 2 X n Y n Encoder p(y x) Decoder ˆM Message Channel Estimate Definition 11. Discrete Memoryless Channel
More informationMultiaccess Channels with State Known to One Encoder: A Case of Degraded Message Sets
Multiaccess Channels with State Known to One Encoder: A Case of Degraded Message Sets Shivaprasad Kotagiri and J. Nicholas Laneman Department of Electrical Engineering University of Notre Dame Notre Dame,
More informationPerformance-based Security for Encoding of Information Signals. FA ( ) Paul Cuff (Princeton University)
Performance-based Security for Encoding of Information Signals FA9550-15-1-0180 (2015-2018) Paul Cuff (Princeton University) Contributors Two students finished PhD Tiance Wang (Goldman Sachs) Eva Song
More informationThe Method of Types and Its Application to Information Hiding
The Method of Types and Its Application to Information Hiding Pierre Moulin University of Illinois at Urbana-Champaign www.ifp.uiuc.edu/ moulin/talks/eusipco05-slides.pdf EUSIPCO Antalya, September 7,
More informationLecture 6 I. CHANNEL CODING. X n (m) P Y X
6- Introduction to Information Theory Lecture 6 Lecturer: Haim Permuter Scribe: Yoav Eisenberg and Yakov Miron I. CHANNEL CODING We consider the following channel coding problem: m = {,2,..,2 nr} Encoder
More informationDirty Paper Writing and Watermarking Applications
Dirty Paper Writing and Watermarking Applications G.RaviKiran February 10, 2003 1 Introduction Following an underlying theme in Communication is the duo of Dirty Paper Writing and Watermarking. In 1983
More informationInformation Theory. Lecture 10. Network Information Theory (CT15); a focus on channel capacity results
Information Theory Lecture 10 Network Information Theory (CT15); a focus on channel capacity results The (two-user) multiple access channel (15.3) The (two-user) broadcast channel (15.6) The relay channel
More informationShannon s noisy-channel theorem
Shannon s noisy-channel theorem Information theory Amon Elders Korteweg de Vries Institute for Mathematics University of Amsterdam. Tuesday, 26th of Januari Amon Elders (Korteweg de Vries Institute for
More informationUCSD ECE 255C Handout #12 Prof. Young-Han Kim Tuesday, February 28, Solutions to Take-Home Midterm (Prepared by Pinar Sen)
UCSD ECE 255C Handout #12 Prof. Young-Han Kim Tuesday, February 28, 2017 Solutions to Take-Home Midterm (Prepared by Pinar Sen) 1. (30 points) Erasure broadcast channel. Let p(y 1,y 2 x) be a discrete
More informationLECTURE 10. Last time: Lecture outline
LECTURE 10 Joint AEP Coding Theorem Last time: Error Exponents Lecture outline Strong Coding Theorem Reading: Gallager, Chapter 5. Review Joint AEP A ( ɛ n) (X) A ( ɛ n) (Y ) vs. A ( ɛ n) (X, Y ) 2 nh(x)
More informationGeneralized Writing on Dirty Paper
Generalized Writing on Dirty Paper Aaron S. Cohen acohen@mit.edu MIT, 36-689 77 Massachusetts Ave. Cambridge, MA 02139-4307 Amos Lapidoth lapidoth@isi.ee.ethz.ch ETF E107 ETH-Zentrum CH-8092 Zürich, Switzerland
More informationCovert Communications on Renewal Packet Channels
Covert Communications on Renewal Packet Channels Ramin Soltani, Dennis Goeckel, Don Towsley, and Amir Houmansadr Electrical and Computer Engineering Department, University of Massachusetts, Amherst, {soltani,
More informationELEC546 Review of Information Theory
ELEC546 Review of Information Theory Vincent Lau 1/1/004 1 Review of Information Theory Entropy: Measure of uncertainty of a random variable X. The entropy of X, H(X), is given by: If X is a discrete random
More informationLecture 3: Channel Capacity
Lecture 3: Channel Capacity 1 Definitions Channel capacity is a measure of maximum information per channel usage one can get through a channel. This one of the fundamental concepts in information theory.
More informationEquivalence for Networks with Adversarial State
Equivalence for Networks with Adversarial State Oliver Kosut Department of Electrical, Computer and Energy Engineering Arizona State University Tempe, AZ 85287 Email: okosut@asu.edu Jörg Kliewer Department
More informationSparse Regression Codes for Multi-terminal Source and Channel Coding
Sparse Regression Codes for Multi-terminal Source and Channel Coding Ramji Venkataramanan Yale University Sekhar Tatikonda Allerton 2012 1 / 20 Compression with Side-Information X Encoder Rate R Decoder
More informationCovert Communications on Poisson Packet Channels
Covert Communications on Poisson Packet Channels Ramin Soltani, Dennis Goeckel, Don Towsley, and Amir Houmansadr Electrical and Computer Engineering Department, University of Massachusetts, Amherst, {soltani,
More informationSecond-Order Asymptotics in Information Theory
Second-Order Asymptotics in Information Theory Vincent Y. F. Tan (vtan@nus.edu.sg) Dept. of ECE and Dept. of Mathematics National University of Singapore (NUS) National Taiwan University November 2015
More informationEE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15
EE5139R: Problem Set 7 Assigned: 30/09/15, Due: 07/10/15 1. Cascade of Binary Symmetric Channels The conditional probability distribution py x for each of the BSCs may be expressed by the transition probability
More informationLecture 5 Channel Coding over Continuous Channels
Lecture 5 Channel Coding over Continuous Channels I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw November 14, 2014 1 / 34 I-Hsiang Wang NIT Lecture 5 From
More informationA Novel Asynchronous Communication Paradigm: Detection, Isolation, and Coding
A Novel Asynchronous Communication Paradigm: Detection, Isolation, and Coding The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation
More informationMulticoding Schemes for Interference Channels
Multicoding Schemes for Interference Channels 1 Ritesh Kolte, Ayfer Özgür, Haim Permuter Abstract arxiv:1502.04273v1 [cs.it] 15 Feb 2015 The best known inner bound for the 2-user discrete memoryless interference
More informationEE/Stat 376B Handout #5 Network Information Theory October, 14, Homework Set #2 Solutions
EE/Stat 376B Handout #5 Network Information Theory October, 14, 014 1. Problem.4 parts (b) and (c). Homework Set # Solutions (b) Consider h(x + Y ) h(x + Y Y ) = h(x Y ) = h(x). (c) Let ay = Y 1 + Y, where
More informationarxiv: v1 [cs.it] 4 Jun 2018
State-Dependent Interference Channel with Correlated States 1 Yunhao Sun, 2 Ruchen Duan, 3 Yingbin Liang, 4 Shlomo Shamai (Shitz) 5 Abstract arxiv:180600937v1 [csit] 4 Jun 2018 This paper investigates
More informationLECTURE 13. Last time: Lecture outline
LECTURE 13 Last time: Strong coding theorem Revisiting channel and codes Bound on probability of error Error exponent Lecture outline Fano s Lemma revisited Fano s inequality for codewords Converse to
More informationECE 534 Information Theory - Midterm 2
ECE 534 Information Theory - Midterm Nov.4, 009. 3:30-4:45 in LH03. You will be given the full class time: 75 minutes. Use it wisely! Many of the roblems have short answers; try to find shortcuts. You
More informationSecret Key Agreement Using Conferencing in State- Dependent Multiple Access Channels with An Eavesdropper
Secret Key Agreement Using Conferencing in State- Dependent Multiple Access Channels with An Eavesdropper Mohsen Bahrami, Ali Bereyhi, Mahtab Mirmohseni and Mohammad Reza Aref Information Systems and Security
More informationAppendix B Information theory from first principles
Appendix B Information theory from first principles This appendix discusses the information theory behind the capacity expressions used in the book. Section 8.3.4 is the only part of the book that supposes
More informationCovert Communications on Poisson Packet Channels
Covert Communications on Poisson Packet Channels Ramin Soltani, Dennis Goeckel, Don Towsley, and Amir Houmansadr Electrical and Computer Engineering Department, University of Massachusetts, Amherst, {soltani,
More informationCapacity of a channel Shannon s second theorem. Information Theory 1/33
Capacity of a channel Shannon s second theorem Information Theory 1/33 Outline 1. Memoryless channels, examples ; 2. Capacity ; 3. Symmetric channels ; 4. Channel Coding ; 5. Shannon s second theorem,
More informationA Comparison of Two Achievable Rate Regions for the Interference Channel
A Comparison of Two Achievable Rate Regions for the Interference Channel Hon-Fah Chong, Mehul Motani, and Hari Krishna Garg Electrical & Computer Engineering National University of Singapore Email: {g030596,motani,eleghk}@nus.edu.sg
More informationInformation Theory for Wireless Communications. Lecture 10 Discrete Memoryless Multiple Access Channel (DM-MAC): The Converse Theorem
Information Theory for Wireless Communications. Lecture 0 Discrete Memoryless Multiple Access Channel (DM-MAC: The Converse Theorem Instructor: Dr. Saif Khan Mohammed Scribe: Antonios Pitarokoilis I. THE
More informationSecure Degrees of Freedom of the MIMO Multiple Access Wiretap Channel
Secure Degrees of Freedom of the MIMO Multiple Access Wiretap Channel Pritam Mukherjee Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland, College Park, MD 074 pritamm@umd.edu
More informationA Comparison of Superposition Coding Schemes
A Comparison of Superposition Coding Schemes Lele Wang, Eren Şaşoğlu, Bernd Bandemer, and Young-Han Kim Department of Electrical and Computer Engineering University of California, San Diego La Jolla, CA
More informationFeedback Capacity of a Class of Symmetric Finite-State Markov Channels
Feedback Capacity of a Class of Symmetric Finite-State Markov Channels Nevroz Şen, Fady Alajaji and Serdar Yüksel Department of Mathematics and Statistics Queen s University Kingston, ON K7L 3N6, Canada
More informationOn Multiple User Channels with State Information at the Transmitters
On Multiple User Channels with State Information at the Transmitters Styrmir Sigurjónsson and Young-Han Kim* Information Systems Laboratory Stanford University Stanford, CA 94305, USA Email: {styrmir,yhk}@stanford.edu
More information(Classical) Information Theory III: Noisy channel coding
(Classical) Information Theory III: Noisy channel coding Sibasish Ghosh The Institute of Mathematical Sciences CIT Campus, Taramani, Chennai 600 113, India. p. 1 Abstract What is the best possible way
More informationExercise 1. = P(y a 1)P(a 1 )
Chapter 7 Channel Capacity Exercise 1 A source produces independent, equally probable symbols from an alphabet {a 1, a 2 } at a rate of one symbol every 3 seconds. These symbols are transmitted over a
More informationCapacity of the Discrete Memoryless Energy Harvesting Channel with Side Information
204 IEEE International Symposium on Information Theory Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information Omur Ozel, Kaya Tutuncuoglu 2, Sennur Ulukus, and Aylin Yener
More informationX 1 : X Table 1: Y = X X 2
ECE 534: Elements of Information Theory, Fall 200 Homework 3 Solutions (ALL DUE to Kenneth S. Palacio Baus) December, 200. Problem 5.20. Multiple access (a) Find the capacity region for the multiple-access
More informationIntermittent Communication
Intermittent Communication Mostafa Khoshnevisan, Student Member, IEEE, and J. Nicholas Laneman, Senior Member, IEEE arxiv:32.42v2 [cs.it] 7 Mar 207 Abstract We formulate a model for intermittent communication
More informationarxiv: v2 [cs.it] 28 May 2017
Feedback and Partial Message Side-Information on the Semideterministic Broadcast Channel Annina Bracher and Michèle Wigger arxiv:1508.01880v2 [cs.it] 28 May 2017 May 30, 2017 Abstract The capacity of the
More information4 An Introduction to Channel Coding and Decoding over BSC
4 An Introduction to Channel Coding and Decoding over BSC 4.1. Recall that channel coding introduces, in a controlled manner, some redundancy in the (binary information sequence that can be used at the
More informationA Formula for the Capacity of the General Gel fand-pinsker Channel
A Formula for the Capacity of the General Gel fand-pinsker Channel Vincent Y. F. Tan Institute for Infocomm Research (I 2 R, A*STAR, Email: tanyfv@i2r.a-star.edu.sg ECE Dept., National University of Singapore
More informationChapter 4. Data Transmission and Channel Capacity. Po-Ning Chen, Professor. Department of Communications Engineering. National Chiao Tung University
Chapter 4 Data Transmission and Channel Capacity Po-Ning Chen, Professor Department of Communications Engineering National Chiao Tung University Hsin Chu, Taiwan 30050, R.O.C. Principle of Data Transmission
More informationExplicit Receivers for Optical Communication and Quantum Reading
Explicit Receivers for Optical Communication and Quantum Reading Mark M. Wilde School of Computer Science, McGill University Joint work with Saikat Guha, Si-Hui Tan, and Seth Lloyd arxiv:1202.0518 ISIT
More informationEE376A - Information Theory Final, Monday March 14th 2016 Solutions. Please start answering each question on a new page of the answer booklet.
EE376A - Information Theory Final, Monday March 14th 216 Solutions Instructions: You have three hours, 3.3PM - 6.3PM The exam has 4 questions, totaling 12 points. Please start answering each question on
More informationMidterm Exam Information Theory Fall Midterm Exam. Time: 09:10 12:10 11/23, 2016
Midterm Exam Time: 09:10 12:10 11/23, 2016 Name: Student ID: Policy: (Read before You Start to Work) The exam is closed book. However, you are allowed to bring TWO A4-size cheat sheet (single-sheet, two-sided).
More informationChannel Coding for Secure Transmissions
Channel Coding for Secure Transmissions March 27, 2017 1 / 51 McEliece Cryptosystem Coding Approach: Noiseless Main Channel Coding Approach: Noisy Main Channel 2 / 51 Outline We present an overiew of linear
More informationECE Information theory Final
ECE 776 - Information theory Final Q1 (1 point) We would like to compress a Gaussian source with zero mean and variance 1 We consider two strategies In the first, we quantize with a step size so that the
More informationClassical codes for quantum broadcast channels. arxiv: Ivan Savov and Mark M. Wilde School of Computer Science, McGill University
Classical codes for quantum broadcast channels arxiv:1111.3645 Ivan Savov and Mark M. Wilde School of Computer Science, McGill University International Symposium on Information Theory, Boston, USA July
More informationUpper Bounds on the Capacity of Binary Intermittent Communication
Upper Bounds on the Capacity of Binary Intermittent Communication Mostafa Khoshnevisan and J. Nicholas Laneman Department of Electrical Engineering University of Notre Dame Notre Dame, Indiana 46556 Email:{mhoshne,
More informationFundamental Limits of Invisible Flow Fingerprinting
Fundamental Limits of Invisible Flow Fingerprinting Ramin Soltani, Dennis Goeckel, Don Towsley, and Amir Houmansadr Electrical and Computer Engineering Department, University of Massachusetts, Amherst,
More informationNetwork coding for multicast relation to compression and generalization of Slepian-Wolf
Network coding for multicast relation to compression and generalization of Slepian-Wolf 1 Overview Review of Slepian-Wolf Distributed network compression Error exponents Source-channel separation issues
More informationOn the Capacity of the Two-Hop Half-Duplex Relay Channel
On the Capacity of the Two-Hop Half-Duplex Relay Channel Nikola Zlatanov, Vahid Jamali, and Robert Schober University of British Columbia, Vancouver, Canada, and Friedrich-Alexander-University Erlangen-Nürnberg,
More informationDispersion of the Gilbert-Elliott Channel
Dispersion of the Gilbert-Elliott Channel Yury Polyanskiy Email: ypolyans@princeton.edu H. Vincent Poor Email: poor@princeton.edu Sergio Verdú Email: verdu@princeton.edu Abstract Channel dispersion plays
More informationApproximate Capacity of Fast Fading Interference Channels with no CSIT
Approximate Capacity of Fast Fading Interference Channels with no CSIT Joyson Sebastian, Can Karakus, Suhas Diggavi Abstract We develop a characterization of fading models, which assigns a number called
More informationCapacity bounds for multiple access-cognitive interference channel
Mirmohseni et al. EURASIP Journal on Wireless Communications and Networking, :5 http://jwcn.eurasipjournals.com/content///5 RESEARCH Open Access Capacity bounds for multiple access-cognitive interference
More informationOn the variable-delay reliability function of discrete memoryless channels with access to noisy feedback
ITW2004, San Antonio, Texas, October 24 29, 2004 On the variable-delay reliability function of discrete memoryless channels with access to noisy feedback Anant Sahai and Tunç Şimşek Electrical Engineering
More informationLecture 2. Capacity of the Gaussian channel
Spring, 207 5237S, Wireless Communications II 2. Lecture 2 Capacity of the Gaussian channel Review on basic concepts in inf. theory ( Cover&Thomas: Elements of Inf. Theory, Tse&Viswanath: Appendix B) AWGN
More informationThe Capacity Region of the Gaussian Cognitive Radio Channels at High SNR
The Capacity Region of the Gaussian Cognitive Radio Channels at High SNR 1 Stefano Rini, Daniela Tuninetti and Natasha Devroye srini2, danielat, devroye @ece.uic.edu University of Illinois at Chicago Abstract
More informationNikola Zlatanov, Erik Sippel, Vahid Jamali, and Robert Schober. Abstract
Capacity of the Gaussian Two-Hop Full-Duplex Relay Channel with Residual Self-Interference Nikola Zlatanov, Erik Sippel, Vahid Jamali, and Robert Schober Abstract arxiv:50.07394v6 [cs.it] 6 Nov 06 In this
More informationNew communication strategies for broadcast and interference networks
New communication strategies for broadcast and interference networks S. Sandeep Pradhan (Joint work with Arun Padakandla and Aria Sahebi) University of Michigan, Ann Arbor Distributed Information Coding
More informationThe Gallager Converse
The Gallager Converse Abbas El Gamal Director, Information Systems Laboratory Department of Electrical Engineering Stanford University Gallager s 75th Birthday 1 Information Theoretic Limits Establishing
More informationA Finite Block Length Achievability Bound for Low Probability of Detection Communication
A Finite Block Length Achievability Bound for Low Probability of Detection Communication Nick Letzepis, Member, IEEE. arxiv:80.0507v [cs.it] 30 Jul 08 Abstract Low probability of detection (or covert)
More information18.2 Continuous Alphabet (discrete-time, memoryless) Channel
0-704: Information Processing and Learning Spring 0 Lecture 8: Gaussian channel, Parallel channels and Rate-distortion theory Lecturer: Aarti Singh Scribe: Danai Koutra Disclaimer: These notes have not
More informationCapacity of channel with energy harvesting transmitter
IET Communications Research Article Capacity of channel with energy harvesting transmitter ISSN 75-868 Received on nd May 04 Accepted on 7th October 04 doi: 0.049/iet-com.04.0445 www.ietdl.org Hamid Ghanizade
More informationRefined Bounds on the Empirical Distribution of Good Channel Codes via Concentration Inequalities
Refined Bounds on the Empirical Distribution of Good Channel Codes via Concentration Inequalities Maxim Raginsky and Igal Sason ISIT 2013, Istanbul, Turkey Capacity-Achieving Channel Codes The set-up DMC
More informationAchieving Shannon Capacity Region as Secrecy Rate Region in a Multiple Access Wiretap Channel
Achieving Shannon Capacity Region as Secrecy Rate Region in a Multiple Access Wiretap Channel Shahid Mehraj Shah and Vinod Sharma Department of Electrical Communication Engineering, Indian Institute of
More information5958 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 12, DECEMBER 2010
5958 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 12, DECEMBER 2010 Capacity Theorems for Discrete, Finite-State Broadcast Channels With Feedback and Unidirectional Receiver Cooperation Ron Dabora
More informationTwo Applications of the Gaussian Poincaré Inequality in the Shannon Theory
Two Applications of the Gaussian Poincaré Inequality in the Shannon Theory Vincent Y. F. Tan (Joint work with Silas L. Fong) National University of Singapore (NUS) 2016 International Zurich Seminar on
More informationECE Information theory Final (Fall 2008)
ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1
More informationSimultaneous Nonunique Decoding Is Rate-Optimal
Fiftieth Annual Allerton Conference Allerton House, UIUC, Illinois, USA October 1-5, 2012 Simultaneous Nonunique Decoding Is Rate-Optimal Bernd Bandemer University of California, San Diego La Jolla, CA
More informationOn the Capacity Region of the Gaussian Z-channel
On the Capacity Region of the Gaussian Z-channel Nan Liu Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland, College Park, MD 74 nkancy@eng.umd.edu ulukus@eng.umd.edu
More informationSecret Key Agreement Using Asymmetry in Channel State Knowledge
Secret Key Agreement Using Asymmetry in Channel State Knowledge Ashish Khisti Deutsche Telekom Inc. R&D Lab USA Los Altos, CA, 94040 Email: ashish.khisti@telekom.com Suhas Diggavi LICOS, EFL Lausanne,
More informationLecture 15: Conditional and Joint Typicaility
EE376A Information Theory Lecture 1-02/26/2015 Lecture 15: Conditional and Joint Typicaility Lecturer: Kartik Venkat Scribe: Max Zimet, Brian Wai, Sepehr Nezami 1 Notation We always write a sequence of
More informationSuperposition Encoding and Partial Decoding Is Optimal for a Class of Z-interference Channels
Superposition Encoding and Partial Decoding Is Optimal for a Class of Z-interference Channels Nan Liu and Andrea Goldsmith Department of Electrical Engineering Stanford University, Stanford CA 94305 Email:
More informationFading Wiretap Channel with No CSI Anywhere
Fading Wiretap Channel with No CSI Anywhere Pritam Mukherjee Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland, College Park, MD 7 pritamm@umd.edu ulukus@umd.edu Abstract
More informationOn Third-Order Asymptotics for DMCs
On Third-Order Asymptotics for DMCs Vincent Y. F. Tan Institute for Infocomm Research (I R) National University of Singapore (NUS) January 0, 013 Vincent Tan (I R and NUS) Third-Order Asymptotics for DMCs
More informationInformation Capacity of an Energy Harvesting Sensor Node
Information Capacity of an Energy Harvesting Sensor Node R Rajesh, Vinod Sharma and Pramod Viswanath arxiv:1212.3177v1 [cs.it] 13 Dec 2012 Abstract Energy harvesting sensor nodes are gaining popularity
More informationBroadcasting over Fading Channelswith Mixed Delay Constraints
Broadcasting over Fading Channels with Mixed Delay Constraints Shlomo Shamai (Shitz) Department of Electrical Engineering, Technion - Israel Institute of Technology Joint work with Kfir M. Cohen and Avi
More informationIET Commun., 2009, Vol. 3, Iss. 4, pp doi: /iet-com & The Institution of Engineering and Technology 2009
Published in IET Communications Received on 10th March 2008 Revised on 10th July 2008 ISSN 1751-8628 Comprehensive partial decoding approach for two-level relay networks L. Ghabeli M.R. Aref Information
More informationStructured interference-mitigation in two-hop networks
tructured interference-mitigation in two-hop networks Yiwei ong Department of Electrical and Computer Eng University of Illinois at Chicago Chicago, IL, UA Email: ysong34@uicedu Natasha Devroye Department
More informationLecture 7. Union bound for reducing M-ary to binary hypothesis testing
Lecture 7 Agenda for the lecture M-ary hypothesis testing and the MAP rule Union bound for reducing M-ary to binary hypothesis testing Introduction of the channel coding problem 7.1 M-ary hypothesis testing
More informationNotes 3: Stochastic channels and noisy coding theorem bound. 1 Model of information communication and noisy channel
Introduction to Coding Theory CMU: Spring 2010 Notes 3: Stochastic channels and noisy coding theorem bound January 2010 Lecturer: Venkatesan Guruswami Scribe: Venkatesan Guruswami We now turn to the basic
More informationSoft Covering with High Probability
Soft Covering with High Probability Paul Cuff Princeton University arxiv:605.06396v [cs.it] 20 May 206 Abstract Wyner s soft-covering lemma is the central analysis step for achievability proofs of information
More informationLECTURE 15. Last time: Feedback channel: setting up the problem. Lecture outline. Joint source and channel coding theorem
LECTURE 15 Last time: Feedback channel: setting up the problem Perfect feedback Feedback capacity Data compression Lecture outline Joint source and channel coding theorem Converse Robustness Brain teaser
More informationLecture 18: Gaussian Channel
Lecture 18: Gaussian Channel Gaussian channel Gaussian channel capacity Dr. Yao Xie, ECE587, Information Theory, Duke University Mona Lisa in AWGN Mona Lisa Noisy Mona Lisa 100 100 200 200 300 300 400
More informationOn the Rate-Limited Gelfand-Pinsker Problem
On the Rate-Limited Gelfand-Pinsker Problem Ravi Tandon Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland, College Park, MD 74 ravit@umd.edu ulukus@umd.edu Abstract
More informationOn the Duality between Multiple-Access Codes and Computation Codes
On the Duality between Multiple-Access Codes and Computation Codes Jingge Zhu University of California, Berkeley jingge.zhu@berkeley.edu Sung Hoon Lim KIOST shlim@kiost.ac.kr Michael Gastpar EPFL michael.gastpar@epfl.ch
More informationEnergy State Amplification in an Energy Harvesting Communication System
Energy State Amplification in an Energy Harvesting Communication System Omur Ozel Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland College Park, MD 20742 omur@umd.edu
More informationCSCI 2570 Introduction to Nanocomputing
CSCI 2570 Introduction to Nanocomputing Information Theory John E Savage What is Information Theory Introduced by Claude Shannon. See Wikipedia Two foci: a) data compression and b) reliable communication
More informationLecture 8: Channel and source-channel coding theorems; BEC & linear codes. 1 Intuitive justification for upper bound on channel capacity
5-859: Information Theory and Applications in TCS CMU: Spring 23 Lecture 8: Channel and source-channel coding theorems; BEC & linear codes February 7, 23 Lecturer: Venkatesan Guruswami Scribe: Dan Stahlke
More information1174 IET Commun., 2010, Vol. 4, Iss. 10, pp
Published in IET Communications Received on 26th June 2009 Revised on 12th November 2009 ISSN 1751-8628 Compress-and-forward strategy for relay channel with causal and non-causal channel state information
More informationLecture 4 Channel Coding
Capacity and the Weak Converse Lecture 4 Coding I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw October 15, 2014 1 / 16 I-Hsiang Wang NIT Lecture 4 Capacity
More information