# Entropy in Classical and Quantum Information Theory

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Entropy in Classical and Quantum Information Theory William Fedus Physics Department, University of California, San Diego. Entropy is a central concept in both classical and quantum information theory, measuring the uncertainty and the information content in the state of a physical system. This paper reviews classical information theory and then proceeds to generalizations into quantum information theory. Both Shannon and Von Neumann entropy are discussed, making the connection to compressibility of a message stream and the generalization of compressibility in a quantum system. Finally, the paper considers the application of Von Neumann entropy in entanglement of formation for both pure and mixed bipartite quantum states. CLASSICAL INFORMATION THEORY In statistical mechanics, entropy is the logarithm of the number of arrangements a system can be configured and still remain consistent with the thermodyanmic observables. From this original formulation, entropy has grown to become an important element in many diverse fields of study. One of the first examples was in 1948 when Claude Shannon adopted entropy as a measure of the uncertainty in a random variable, or equivalently, the expected value of information content within a message. Classical information theory, as established by Claude Shannon, sought to resolve two central issues in signal processing 1. The compression achievable for a message while preserving the fidelity of the original information. The rate at which a message can be communicated reliabily over a noisy channel both of these address the issue of the degree of redundancy embedded within a message and, as we will see, entropy is found to be a rigorous and useful approach in this context. Shannon Entropy and Data Compression As alluded to previously, classical information theory is framed in terms of the information content and the transmission of messages. A message may be defined as a string of letters chosen from an alphabet of k letters {a 1, a,..., a k }. Assuming that each letter a x occurs with probability p(a x ) and is independently transmitted, this may be denoted as an ensemble A = {a x, p(a x )}; the Shannon entropy of an ensemble is then defined as H(A) H (p(a x ),..., p(a k )) x p(a x )logp(a x ). (1) where log is taken to be base- since we are transmitting messages with binary bits. This formula is important as it can be used to quantify the resources necessary to store information. For instance, if we use a block code which assigns integers to typical sequences, the information in a string of n letters can be compressed to H(A) bits. With this framework and definition, we may now consider the maximum compression of a length n message without loss of information. The number of bits necessary to transmit the message is given by H(A n ) = nh(a). () which simply states that one needs (n times the entropy of the ensemeble A)-bits. However, a more interesting case may be considered if we allow a small error δ > 0 in the encoding of the message. Specifically, we will only encode messages in set B A such that P (B) 1 δ. The information size is given by H δ (A) which is equal to H(A) in the limit that δ 0. Shannon s noiseless coding theorem then states that 1 lim n n H δ(a n ) = H(A) (3) that is, the optimal compression rate is simply the Shannon entropy; this is Shannon s noiseless coding theorem. As a basic example of this theorem, consider an information source which produces messages composed of the four element alphabet, A = {a 1, a, a 3, a 4 }. (4) Clearly, without any compression, two bits of storage are necessary for each letter transmitted (bit strings 00, 01, 10, 11) as depicted in the left side of Figure 1. However, suppose now that symbol a 1 is produced with probability 1/, symbol a with probability 1/4 and symbols a 3 and a 4 with probability 1/8. We find that by applying Eq. 1, we can calculate the entropy to be,

2 quantum states, X = {p x, ρ x } where ρ x is the quantum state and p x is the a priori probability of selecting that quantum state. This quantum state may be completely characterized via the density matrix ρ = x p x ρ x (7) FIG. 1. Tree representation for the encoding of the above example. H(A) = x p(a x )logp(a x ) = 1 log ( 1 = 7 4 (5a) ) 1 ( ) 1 4 log 1 ( ) log 8 (5b) (5c) Therefore, a coding scheme exists in which the messages may be transmitted with only 7/4 bits per letter on average if we assume that the message being transmitted is of length n and n 1. To realize this compression, we choose to encode a 1 as it string 0, a as bit string 10, a 3 as bit string 110, and a 4 as bit string 111, we find that the average length of the compressed string is = 7 4 (6) indicating that we have achieved the best possible compression for an encoding. Also, it should be noted that this encoding will not compress all messages since clearly an unlucky and improbable message of repeated a 4 s would result in a higher average bit content per letter than both encodings. Also, note that Figure 1 explicitly demonstrates that our encoding must not have duplicate prefixes, otherwise, the encoding is not valid. If letters of the alphabet share a common prefix, message strings may not be uniquely decodable. QUANTUM INFORMATION THEORY In classical information theory, we have considered a message of n letters, where n 1 and each letter is drawn independently from an ensemble A = {a x, p(a x )}. The information content of the ensemble is equal to the Shannon information, H(A), in the limit that n To generalize this formulation to the quantum regime, the message may still be regarded as composed of n letters, but now the letters are drawn from an ensemble of The Von Neumann entropy of a quantum state ρ is then defined as S(ρ) Tr (ρlogρ) (8) where log is taken to be base d, d being the dimension of the Hilbert space containing ρ. Von Neumann entropy enters quantum information theory in three important ways. First, it is a measure of the quantum information content of letters in the ensemble, specifically, how many quibits are needed to encode the message without loss of information. Second, it is also a measure of the classical information content per letter, where we find the maximum amount of information in bits that can be recovered from the message. And finally, as we will see later, Von Neumann entropy is used to quantify the entanglement of pure and mixed bipartite quantum states [1]. Now, returning to Eq. 8, if λ x s are the eigenvalues that diagonalize ρ, then we may rewrite it as, S(ρ) = x λ x logλ x. (9) One now observes that in this orthonormal basis, the Von Neumann entropy is equivalent to the Shannon entropy, Eq. 1, S(ρ) = H(A) (10) for the ensemble A = {a, λ a }. This indicates that if a quantum system is a pure separable system, it reduces to the classical system. For a separable quantum system, the Von Neumann entropy is another quantification of the incompressibility of the information content, analagous to the Shannon entropy of a classical system. Connection to Thermodynamics Entropy in statistical thermodynamics and in information theory are not disjoint concepts. For instance, if we take an open quantum system (in contact with its environment), we may use the mathematical properties of subadditivity and entropic invariance under unitary evolution for Von Neumann entropy to imply the second law of thermodynamics.

3 3 To see this, subadditivity may be succinctly expressed as, and the entire message of length n can then be characterized as the n-tensor product S(ρ AB ) S(ρ A ) + S(ρ B ) (11) where ρ A is the partial trace over B (ρ A Tr B (ρ AB )) and ρ B is defined similarly. If we consider the system (A) and the environment (E) to be initially uncorrelated, we can decompose the density matrix as the tensor product ρ AB = ρ A ρ B which by Eq. 11 implies that the entropy is simply the sum of the two states A and B S(ρ AB ) = S(ρ A ) + S(ρ B ). (1) If we now allow the system to evolve under a unitary operator U which acts on the full system, the density matrix becomes ρ AE = Uρ AE U 1 (13) but we know that the entropy of a system is invariant under unitary evolution S(ρ) = S(UρU 1 ) so therefore, S(ρ AE) = S(ρ AE ). (14) Finally, by invoking Eq. 11 again on the state ρ AE and using Eq. 1 we find that S(ρ A) + S(ρ B) S(ρ AE ) S(ρ A) + S(ρ B) S(ρ A ) + S(ρ B ) (15a) (15b) so therefore, the basic mathematical properties of Von Neumann entropy implies that the entropy of the universe, that is, the sum of A and E, may not decrease, analagous to the second law of thermodynamics. Quantum Data Compression Now, as in the classical case, Von Neumann entropy provides us a tool to address the issue of redundancy within a message. However, now in the quantum regime, we instead are seeking to compress the message into a smaller Hilbert space, H, without compromising the fidelity of the message. As before, consider a message of length n with each letter drawn from an ensemble of pure states {p x, ψ x }, where each ψ x is not necessarily orthonormal. We may characterize each letter via the density matrix ρ = x p x ψ x ψ x (16) ρ n = ρ ρ (17) Now, the best optimal compression of this quantum message to a Hilbert space H as n is given by log(dimh) = S(ρ n ) = ns(ρ) (18) where dim is the dimension of the Hilbert space. This implies that Von Neumann entropy is equal to the number of quibits of quantum information carried for each letter of the message Note that compression is always possible provided that the density matrix is not a maximially mixed state, ρ = 1 1, since we cannot compress random quibits, directly analagous to the classical incompressibility of random bits. ENTANGLEMENT MEASURES Entanglement is a feature of quantum states to exhibit correlations that cannot be accounted for classically. Entanglement theory is underpinned by the paradigm of Local Operations and Classical Communication (LOCC) formulated by Bennett et al []. Under this approach, a quantum state exists between different parties who can perform arbitrary local unitary operations and may communicate with each other over a classical channel. A state is separable if it can be created via only local operations and classical communication, otherwise, the state is considered entangled. Mathematically, a pure bipartite state ψ AB is defined to be entangled if the following tensor decomposition is not possible ψ AB = ψ A ψ A (19) and similarly, a mixed bipartite state ρ AB is defined to be entangled if the density matrix may not be written as ρ AB = ρ A ρ B (0) Since entangled states cannot be generated locally, it may be considered as a resource of the system. This resource is important in different tasks such as quantum computation, quantum communication and quantum cryptography. [3] Many important bipartite entanglement measurements exist (Schmidt number, k-concurrences, I-concurrence, Negativity, Convex roof extended negativity (CREN), etc.), however, in this paper, we shall consider an entropy-based entanglement measure, entanglement of

4 4 formation [3]. We will first consider a pure quantum state and then we will consider the more complicated example of a mixed quantum state. Entanglement of Formation of Pure States For any bipartite system in a pure state, Bennet et al [] demonstrated that it is reasonable to define the entanglement of the system as the von Neumann entropy of either of its two parts. Given a density matrix ρ AB of a pair of quantum systems A and B, consider all possible pure-state decompositions according to Eq. 7. For each pure state, the entanglement, E, may then be defined as the entropy of either quantum subsystem, A or B E(ψ) = Trρ A logρ A = Trρ B logρ B. (1) This definition, utilizing the Von Neumann entropy, indicates the information content of the reduced state. Note that this entanglement measure, E, ranges from 0 for a separable pure state to logn for a maximally entangled state. Entanglement of Formation of Mixed States To extend this definition to mixed states, the entanglement of formation is defined as the minimum of the average entanglement of each possible pure state of the decomposition, E(ρ) = min i p i E(ψ i ) () The probability weighted sum of each individual entanglement, E(ψ i ) is not unique since an infinite number of decompositions exist, therefore, we take the minimum. We choose the minimum (as opposed to another property) since a state which has any decomposition as a sum of separable pure states should have 0 entanglement and therefore the density matrix should be found to have 0 entanglement. For a pair of quibits, Eq. can be written as an explicit function of ρ. To rewrite this equation as such, one must first introduce the spin flip transformation. For a pure state of a single quibit, the spin flip transformation, denoted by a tilde, is defined as ψ = σ y ψ (3) where ψ is the complex conjugate of ψ in a fixed basis such as {, } and σ y in the same basis is the standard Pauli matrix. For n quibits, the spin flip operation may be applied to each individual quibit and for a density matrix, each σ y is applied to both the right and left sides. For instance, ρ = (σ y σ y ) ρ (σ y σ y ) (4) where the complex conjugate is in a fixed basis {,,, } With this definition, Hill and Wootters [4] demonstrated that Eq. can written as, where the concurrence C is defined as and E is defined as E(ψ) = E(C(ψ)) (5) C(ψ) ψ ψ (6) E(C) C log C 1 1 C log 1 1 C (7) This form of entanglement can be motivated by the fact that it allows us to transfer our analysis to the determination of the concurrence. We observe that E monotonically increases from 0 1 as the concurrence increases over that same range, therefore, concurrence may also be regarded as a valid measure of entanglement. This proves useful as we may extend the definition to that of arbitrary bipartite mixed states. With the spin flip and the function E(C), we can now write the entanglement of formation of a mixed state ρ as where E(ρ) = E(C(ρ)) (8) C(ρ) = max{0, λ 1 λ λ 3 λ 4 } (9) where the λ i s are the eigenvalues, in decreasing order, of the Hermitian matrix R ρ ρ ρ and each λi is a non-negative real number. Eq. 8 was proved by Wootters [5] to hold for arbitrary states of a two quibit system. For brevity, the proof will be omitted, but the usefulness of entropy in entanglement measures is welldemonstrated. [1] J. Preskill, Lecture notes on quantum computation, (1998).

5 5 [] C. Bennett, D. DiVincenzo, J. Smolin, and W. Wootters, Physical Review A 54, 384 (1996). [3] C. Eltschka and J. Siewert,, 8 (014), arxiv: [4] S. Hill and W. Wootters, Physical Review Letters 78, 50 (1997). [5] W. Wootters, Physical Review Letters 14, 199 (1998).

### Quantum Entanglement- Fundamental Aspects

Quantum Entanglement- Fundamental Aspects Debasis Sarkar Department of Applied Mathematics, University of Calcutta, 92, A.P.C. Road, Kolkata- 700009, India Abstract Entanglement is one of the most useful

### Ensembles and incomplete information

p. 1/32 Ensembles and incomplete information So far in this course, we have described quantum systems by states that are normalized vectors in a complex Hilbert space. This works so long as (a) the system

### Information measures, entanglement and quantum evolution

Information measures, entanglement and quantum evolution Claudia Zander Faculty of Natural & Agricultural Sciences University of Pretoria Pretoria Submitted in partial fulfilment of the requirements for

### Quantum Information Theory

Chapter 5 Quantum Information Theory Quantum information theory is a rich subject that could easily have occupied us all term. But because we are short of time (I m anxious to move on to quantum computation),

### Entanglement Manipulation

Entanglement Manipulation Steven T. Flammia 1 1 Perimeter Institute for Theoretical Physics, Waterloo, Ontario, N2L 2Y5 Canada (Dated: 22 March 2010) These are notes for my RIT tutorial lecture at the

### Chapter 14: Quantum Information Theory and Photonic Communications

Chapter 14: Quantum Information Theory and Photonic Communications Farhan Rana (MIT) March, 2002 Abstract The fundamental physical limits of optical communications are discussed in the light of the recent

### Entropies & Information Theory

Entropies & Information Theory LECTURE I Nilanjana Datta University of Cambridge,U.K. See lecture notes on: http://www.qi.damtp.cam.ac.uk/node/223 Quantum Information Theory Born out of Classical Information

### Quantum Information Types

qitd181 Quantum Information Types Robert B. Griffiths Version of 6 February 2012 References: R. B. Griffiths, Types of Quantum Information, Phys. Rev. A 76 (2007) 062320; arxiv:0707.3752 Contents 1 Introduction

### Quantum Entanglement: Detection, Classification, and Quantification

Quantum Entanglement: Detection, Classification, and Quantification Diplomarbeit zur Erlangung des akademischen Grades,,Magister der Naturwissenschaften an der Universität Wien eingereicht von Philipp

### An Introduction to Quantum Computation and Quantum Information

An to and Graduate Group in Applied Math University of California, Davis March 13, 009 A bit of history Benioff 198 : First paper published mentioning quantum computing Feynman 198 : Use a quantum computer

### FRAMES IN QUANTUM AND CLASSICAL INFORMATION THEORY

FRAMES IN QUANTUM AND CLASSICAL INFORMATION THEORY Emina Soljanin Mathematical Sciences Research Center, Bell Labs April 16, 23 A FRAME 1 A sequence {x i } of vectors in a Hilbert space with the property

### Quantum Information Chapter 10. Quantum Shannon Theory

Quantum Information Chapter 10. Quantum Shannon Theory John Preskill Institute for Quantum Information and Matter California Institute of Technology Updated January 2018 For further updates and additional

### INSTITUT FOURIER. Quantum correlations and Geometry. Dominique Spehner

i f INSTITUT FOURIER Quantum correlations and Geometry Dominique Spehner Institut Fourier et Laboratoire de Physique et Modélisation des Milieux Condensés, Grenoble Outlines Entangled and non-classical

### Quantum Error Correcting Codes and Quantum Cryptography. Peter Shor M.I.T. Cambridge, MA 02139

Quantum Error Correcting Codes and Quantum Cryptography Peter Shor M.I.T. Cambridge, MA 02139 1 We start out with two processes which are fundamentally quantum: superdense coding and teleportation. Superdense

### Exemple of Hilbert spaces with dimension equal to two. *Spin1/2particle

University Paris-Saclay - IQUPS Optical Quantum Engineering: From fundamentals to applications Philippe Grangier, Institut d Optique, CNRS, Ecole Polytechnique. Eemple of Hilbert spaces with dimension

### BOGOLIUBOV TRANSFORMATIONS AND ENTANGLEMENT OF TWO FERMIONS

BOGOLIUBOV TRANSFORMATIONS AND ENTANGLEMENT OF TWO FERMIONS P. Caban, K. Podlaski, J. Rembieliński, K. A. Smoliński and Z. Walczak Department of Theoretical Physics, University of Lodz Pomorska 149/153,

### Algebraic Theory of Entanglement

Algebraic Theory of (arxiv: 1205.2882) 1 (in collaboration with T.R. Govindarajan, A. Queiroz and A.F. Reyes-Lega) 1 Physics Department, Syracuse University, Syracuse, N.Y. and The Institute of Mathematical

### Uncertainty Relations, Unbiased bases and Quantification of Quantum Entanglement

Uncertainty Relations, Unbiased bases and Quantification of Quantum Entanglement Karol Życzkowski in collaboration with Lukasz Rudnicki (Warsaw) Pawe l Horodecki (Gdańsk) Jagiellonian University, Cracow,

### Entanglement, mixedness, and spin-flip symmetry in multiple-qubit systems

Boston University OpenBU College of General Studies http://open.bu.edu BU Open Access Articles 2003-08-01 Entanglement, mixedness, and spin-flip symmetry in multiple-qubit systems Jaeger, Gregg AMER PHYSICAL

### Indeterminate-length quantum coding

Indeterminate-length quantum coding arxiv:quant-ph/0011014v1 2 Nov 2000 Benjamin Schumacher (1) and Michael D. Westmoreland (2) February 1, 2008 (1) Department of Physics, Kenyon College, Gambier, OH 43022

### A Holevo-type bound for a Hilbert Schmidt distance measure

Journal of Quantum Information Science, 205, *,** Published Online **** 204 in SciRes. http://www.scirp.org/journal/**** http://dx.doi.org/0.4236/****.204.***** A Holevo-type bound for a Hilbert Schmidt

### Lecture 11: Quantum Information III - Source Coding

CSCI5370 Quantum Computing November 25, 203 Lecture : Quantum Information III - Source Coding Lecturer: Shengyu Zhang Scribe: Hing Yin Tsang. Holevo s bound Suppose Alice has an information source X that

### Entanglement in Quantum Field Theory

Entanglement in Quantum Field Theory John Cardy University of Oxford DAMTP, December 2013 Outline Quantum entanglement in general and its quantification Path integral approach Entanglement entropy in 1+1-dimensional

### Information-theoretic treatment of tripartite systems and quantum channels. Patrick Coles Carnegie Mellon University Pittsburgh, PA USA

Information-theoretic treatment of tripartite systems and quantum channels Patrick Coles Carnegie Mellon University Pittsburgh, PA USA ArXiv: 1006.4859 a c b Co-authors Li Yu Vlad Gheorghiu Robert Griffiths

### Quantum rate distortion, reverse Shannon theorems, and source-channel separation

Quantum rate distortion, reverse Shannon theorems, and source-channel separation ilanjana Datta, Min-Hsiu Hsieh, and Mark M. Wilde arxiv:08.4940v3 [quant-ph] 9 Aug 202 Abstract We derive quantum counterparts

### Information and Entropy

Information and Entropy Shannon s Separation Principle Source Coding Principles Entropy Variable Length Codes Huffman Codes Joint Sources Arithmetic Codes Adaptive Codes Thomas Wiegand: Digital Image Communication

### 5. Communication resources

5. Communication resources Classical channel Quantum channel Entanglement How does the state evolve under LOCC? Properties of maximally entangled states Bell basis Quantum dense coding Quantum teleportation

### Entanglement and Quantum Teleportation

Entanglement and Quantum Teleportation Stephen Bartlett Centre for Advanced Computing Algorithms and Cryptography Australian Centre of Excellence in Quantum Computer Technology Macquarie University, Sydney,

### An introduction to basic information theory. Hampus Wessman

An introduction to basic information theory Hampus Wessman Abstract We give a short and simple introduction to basic information theory, by stripping away all the non-essentials. Theoretical bounds on

### Chapter 9 Fundamental Limits in Information Theory

Chapter 9 Fundamental Limits in Information Theory Information Theory is the fundamental theory behind information manipulation, including data compression and data transmission. 9.1 Introduction o For

### Information Theoretic Properties of Quantum Automata

Information Theoretic Properties of Quantum Automata D. Gier Department of Physics and Astronomy, The University of Kansas, Lawrence, KS 66045 and Complexity Sciences Center and Physics Department, University

### Squashed entanglement

Squashed Entanglement based on Squashed Entanglement - An Additive Entanglement Measure (M. Christandl, A. Winter, quant-ph/0308088), and A paradigm for entanglement theory based on quantum communication

### Optimal copying of entangled two-qubit states

Optimal copying of entangled two-qubit states J. Novotný, 1 G. Alber, 2 and I. Jex 1 1 Department of Physics, FJFI ČVUT, Břehová 7, 115 19 Praha 1-Staré Město, Czech Republic 2 Institut für Angewandte

### CALCULATION OF QUANTUM ENTANGLEMENT USING A GENETIC ALGORITHM. A Thesis by. Joseph Lesniak

CALCULATION OF QUANTUM ENTANGLEMENT USING A GENETIC ALGORITHM A Thesis by Joseph Lesniak Bachelor of Science, University of Wisconsin Eau Claire, 1984 Submitted to the Department of Physics And the faculty

### Information Theory CHAPTER. 5.1 Introduction. 5.2 Entropy

Haykin_ch05_pp3.fm Page 207 Monday, November 26, 202 2:44 PM CHAPTER 5 Information Theory 5. Introduction As mentioned in Chapter and reiterated along the way, the purpose of a communication system is

### Entanglement and Symmetry in Multiple-Qubit States: a geometrical approach

Entanglement and Symmetry in Multiple-Qubit States: a geometrical approach Gregg Jaeger Quantum Imaging Laboratory and College of General Studies Boston University, Boston MA 015 U. S. A. Abstract. The

### Entanglement in Open Quantum Systems

SEKTION PHYSIK DER LUDWIG-MAXIMILIANS-UNIVERSITÄT MÜNCHEN Entanglement in Open Quantum Systems Diplomarbeit von Marc Busse Mai 2006 SEKTION PHYSIK DER LUDWIG-MAXIMILIANS-UNIVERSITÄT MÜNCHEN Entanglement

### Coherence, Discord, and Entanglement: Activating one resource into another and beyond

586. WE-Heraeus-Seminar Quantum Correlations beyond Entanglement Coherence, Discord, and Entanglement: Activating one resource into another and beyond Gerardo School of Mathematical Sciences The University

### Information quantique, calcul quantique :

Séminaire LARIS, 8 juillet 2014. Information quantique, calcul quantique : des rudiments à la recherche (en 45min!). François Chapeau-Blondeau LARIS, Université d Angers, France. 1/25 Motivations pour

### arxiv: v4 [quant-ph] 28 Oct 2009

Max- Relative Entropy of Entanglement, alias Log Robustness arxiv:0807.2536v4 [quant-ph] 28 Oct 2009 Nilanjana Datta, Statistical Laboratory, DPMMS, University of Cambridge, Cambridge CB3 0WB, UK (Dated:

### Lecture 18: Quantum Information Theory and Holevo s Bound

Quantum Computation (CMU 1-59BB, Fall 2015) Lecture 1: Quantum Information Theory and Holevo s Bound November 10, 2015 Lecturer: John Wright Scribe: Nicolas Resch 1 Question In today s lecture, we will

### Free probability and quantum information

Free probability and quantum information Benoît Collins WPI-AIMR, Tohoku University & University of Ottawa Tokyo, Nov 8, 2013 Overview Overview Plan: 1. Quantum Information theory: the additivity problem

### A Course in Quantum Information Theory

A Course in Quantum Information Theory Ofer Shayevitz Spring 2007 Based on lectures given at the Tel Aviv University Edited by Anatoly Khina Version compiled January 9, 2010 Contents 1 Preliminaries 3

### Quantum control of dissipative systems. 1 Density operators and mixed quantum states

Quantum control of dissipative systems S. G. Schirmer and A. I. Solomon Quantum Processes Group, The Open University Milton Keynes, MK7 6AA, United Kingdom S.G.Schirmer@open.ac.uk, A.I.Solomon@open.ac.uk

### arxiv: v2 [hep-th] 7 Apr 2015

Statistical Mechanics Derived From Quantum Mechanics arxiv:1501.05402v2 [hep-th] 7 Apr 2015 Yu-Lei Feng 1 and Yi-Xin Chen 1 1 Zhejiang Institute of Modern Physics, Zhejiang University, Hangzhou 310027,

### An instantaneous code (prefix code, tree code) with the codeword lengths l 1,..., l N exists if and only if. 2 l i. i=1

Kraft s inequality An instantaneous code (prefix code, tree code) with the codeword lengths l 1,..., l N exists if and only if N 2 l i 1 Proof: Suppose that we have a tree code. Let l max = max{l 1,...,

### Quantum Teleportation Pt. 1

Quantum Teleportation Pt. 1 PHYS 500 - Southern Illinois University April 17, 2018 PHYS 500 - Southern Illinois University Quantum Teleportation Pt. 1 April 17, 2018 1 / 13 Types of Communication In the

### The Adaptive Classical Capacity of a Quantum Channel,

The Adaptive Classical Capacity of a Quantum Channel, or Information Capacities of Three Symmetric Pure States in Three Dimensions Peter W. Shor 1 AT&T Labs Research Florham Park, NJ 07932 02139 1 Current

### Monogamy, Polygamy and other Properties of Entanglement of Purification

Monogamy, Polygamy and other Properties of Entanglement of Purification Shrobona Bagchi, and Arun Kumar Pati, Quantum Information and Computation Group, Harish-Chandra Research Institute, Chhatnag Road,

### Theory of Quantum Entanglement

Theory of Quantum Entanglement Shao-Ming Fei Capital Normal University, Beijing Universität Bonn, Bonn Richard Feynman 1980 Certain quantum mechanical effects cannot be simulated efficiently on a classical

### arxiv:quant-ph/ v5 10 Feb 2003

Quantum entanglement of identical particles Yu Shi Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Wilberforce Road, Cambridge CB3 0WA, United Kingdom and Theory of

### arxiv: v2 [quant-ph] 17 Nov 2016

Improved Uncertainty Relation in the Presence of Quantum Memory Yunlong Xiao, 1, Naihuan Jing, 3,4 Shao-Ming Fei, 5, and Xianqing Li-Jost 1 School of Mathematics, South China University of Technology,

### 3F1 Information Theory, Lecture 3

3F1 Information Theory, Lecture 3 Jossy Sayir Department of Engineering Michaelmas 2013, 29 November 2013 Memoryless Sources Arithmetic Coding Sources with Memory Markov Example 2 / 21 Encoding the output

### Multi-partite entanglement

Multi-partite entanglement Michael Walter 1, David Gross 2,3, and Jens Eisert 4 1 Stanford Institute for Theoretical Physics, Stanford University, Stanford, CA 94305, USA 2 Institute for Theoretical Physics,

### arxiv:quant-ph/ v1 6 Nov 2003

Tema con variazioni: quantum channel capacity arxiv:quant-ph/0311037v1 6 Nov 2003 Submitted to: New J. Phys. Dennis Kretschmann and Reinhard F Werner Institut für Mathematische Physik, Technische Universität

### Shannon's Theory of Communication

Shannon's Theory of Communication An operational introduction 5 September 2014, Introduction to Information Systems Giovanni Sileno g.sileno@uva.nl Leibniz Center for Law University of Amsterdam Fundamental

.... Quantum Hadamard channels (I) Vlad Gheorghiu Department of Physics Carnegie Mellon University Pittsburgh, PA 15213, U.S.A. July 8, 2010 Vlad Gheorghiu (CMU) Quantum Hadamard channels (I) July 8, 2010

### Quantum Information Theory Tutorial

Quantum Information Theory Tutorial Mark M. Wilde Hearne Institute for Theoretical Physics, Department of Physics and Astronomy, Center for Computation and Technology, Louisiana State University, Baton

### arxiv:gr-qc/ v3 9 Jan 2006

Quantum Black Holes: Entropy and Entanglement on the Horizon Etera R. Livine, Daniel R. Terno Perimeter Institute, 31 Caroline St N, Waterloo, ON, Canada NL Y5 ABSTRACT arxiv:gr-qc/0508085v3 9 Jan 006

### Introduction to Information Theory. Uncertainty. Entropy. Surprisal. Joint entropy. Conditional entropy. Mutual information.

L65 Dept. of Linguistics, Indiana University Fall 205 Information theory answers two fundamental questions in communication theory: What is the ultimate data compression? What is the transmission rate

### Dept. of Linguistics, Indiana University Fall 2015

L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 28 Information theory answers two fundamental questions in communication theory: What is the ultimate data compression? What is the transmission

### Maximal vectors in Hilbert space and quantum entanglement

Maximal vectors in Hilbert space and quantum entanglement William Arveson arveson@math.berkeley.edu UC Berkeley Summer 2008 arxiv:0712.4163 arxiv:0801.2531 arxiv:0804.1140 Overview Quantum Information

### arxiv:quant-ph/ v3 17 Oct 2006

Communications in Mathematical Physics manuscript No. (will be inserted by the editor) Entropy and Quantum Kolmogorov Complexity: A Quantum Brudno s Theorem arxiv:quant-ph/0506080v3 7 Oct 2006 Fabio Benatti,

### arxiv: v1 [quant-ph] 29 Feb 2012

REVIEW ARTICLE Quantum channels and their entropic characteristics arxiv:1202.6480v1 [quant-ph] 29 Feb 2012 A S Holevo 1 and V Giovannetti 2 1 Steklov Mathematical Institute, Gubkina 8, 119991 Moscow,

### Digital Image Processing Lectures 25 & 26

Lectures 25 & 26, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2015 Area 4: Image Encoding and Compression Goal: To exploit the redundancies in the image

### Lecture Notes on QUANTUM COMPUTING STEFANO OLIVARES. Dipartimento di Fisica - Università degli Studi di Milano. Ver. 2.0

Lecture Notes on QUANTUM COMPUTING STEFANO OLIVARES Dipartimento di Fisica - Università degli Studi di Milano Ver..0 Lecture Notes on Quantum Computing 014, S. Olivares - University of Milan Italy) December,

### The Postulates of Quantum Mechanics

p. 1/23 The Postulates of Quantum Mechanics We have reviewed the mathematics (complex linear algebra) necessary to understand quantum mechanics. We will now see how the physics of quantum mechanics fits

### Group representations and quantum information theory. Aram Harrow (Bristol) NII, Tokyo 5 Feb, 2007

Group representations and quantum information theory Aram Harrow (Bristol) NII, Tokyo 5 Feb, 2007 outline Types in classical information theory A quantum analogue: Schur duality Joint types Applications

### Coding of memoryless sources 1/35

Coding of memoryless sources 1/35 Outline 1. Morse coding ; 2. Definitions : encoding, encoding efficiency ; 3. fixed length codes, encoding integers ; 4. prefix condition ; 5. Kraft and Mac Millan theorems

### Teleportation of Quantum States (1993; Bennett, Brassard, Crepeau, Jozsa, Peres, Wootters)

Teleportation of Quantum States (1993; Bennett, Brassard, Crepeau, Jozsa, Peres, Wootters) Rahul Jain U. Waterloo and Institute for Quantum Computing, rjain@cs.uwaterloo.ca entry editor: Andris Ambainis

### (Classical) Information Theory II: Source coding

(Classical) Information Theory II: Source coding Sibasish Ghosh The Institute of Mathematical Sciences CIT Campus, Taramani, Chennai 600 113, India. p. 1 Abstract The information content of a random variable

### Entropic security using conditional min-entropy

Entropic security using conditional min-entropy Frédéric Dupuis and Simon Pierre Desrosiers March 4, 007 1 Preliminary We will use the usual bra and ket notation for pure states where a unit length complex

### Some applications of matrix inequalities in Rényi entropy

Some applications of matrix inequalities in Rényi entropy arxiv:608.03362v [math-ph] Aug 206 Hadi Reisizadeh, and S. Mahmoud Manjegani 2, Department of Electrical and Computer Engineering, 2 Department

### Lectures 1 and 2: Axioms for Quantum Theory

Lectures 1 and 2: Axioms for Quantum Theory Joseph Emerson Course: AMATH 900/AMATH 495/PHYS 490 Foundations and Interpretations of Quantum Theory Course Instructors: Joseph Emerson and Ray Laflamme Hosted

### Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG

Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG Cung Nguyen and Robert G. Redinbo Department of Electrical and Computer Engineering University of California, Davis, CA email: cunguyen,

### Lower Bounds on the Graphical Complexity of Finite-Length LDPC Codes

Lower Bounds on the Graphical Complexity of Finite-Length LDPC Codes Igal Sason Department of Electrical Engineering Technion - Israel Institute of Technology Haifa 32000, Israel 2009 IEEE International

### Chapter 2: Source coding

Chapter 2: meghdadi@ensil.unilim.fr University of Limoges Chapter 2: Entropy of Markov Source Chapter 2: Entropy of Markov Source Markov model for information sources Given the present, the future is independent

### Density Matrices. Chapter Introduction

Chapter 15 Density Matrices 15.1 Introduction Density matrices are employed in quantum mechanics to give a partial description of a quantum system, one from which certain details have been omitted. For

### arxiv:quant-ph/ v1 2 Dec 2005

A Resource Framework for Quantum Shannon Theory arxiv:quant-ph/0512015v1 2 Dec 2005 I. Devetak Department of Electrical Engineering Systems, University of Southern California, Los Angeles, CA 90089, USA

### 1 Introduction to information theory

1 Introduction to information theory 1.1 Introduction In this chapter we present some of the basic concepts of information theory. The situations we have in mind involve the exchange of information through

### On the complementary quantum capacity of the depolarizing channel

On the complementary quantum capacity of the depolarizing channel Debbie Leung 1 and John Watrous 1 Institute for Quantum Computing and Department of Combinatorics and Optimization, University of Waterloo

### Distribution of Bipartite Entanglement of a Random Pure State

Distribution of Bipartite Entanglement of a Random Pure State Satya N. Majumdar Laboratoire de Physique Théorique et Modèles Statistiques,CNRS, Université Paris-Sud, France Collaborators: C. Nadal (Oxford

### Information Theory, Statistics, and Decision Trees

Information Theory, Statistics, and Decision Trees Léon Bottou COS 424 4/6/2010 Summary 1. Basic information theory. 2. Decision trees. 3. Information theory and statistics. Léon Bottou 2/31 COS 424 4/6/2010

### Information Theory - Entropy. Figure 3

Concept of Information Information Theory - Entropy Figure 3 A typical binary coded digital communication system is shown in Figure 3. What is involved in the transmission of information? - The system

### arxiv: v3 [cond-mat.stat-mech] 7 Jan 2015

Entanglement Entropies of Non-Equilibrium Finite-Spin Systems Koichi Nakagawa Hoshi University, Tokyo 14-8501, Japan arxiv:1410.6988v3 [cond-mat.stat-mech] 7 Jan 015 Abstract For the purpose of clarifying

### Selection rules - electric dipole

Selection rules - electric dipole As an example, lets take electric dipole transitions; when is j, m z j 2, m 2 nonzero so that j 1 = 1 and m 1 = 0. The answer is equivalent to the question when can j

### Chapter 2. Basic Principles of Quantum mechanics

Chapter 2. Basic Principles of Quantum mechanics In this chapter we introduce basic principles of the quantum mechanics. Quantum computers are based on the principles of the quantum mechanics. In the classical

### Shunlong Luo. Academy of Mathematics and Systems Science Chinese Academy of Sciences

Superadditivity of Fisher Information: Classical vs. Quantum Shunlong Luo Academy of Mathematics and Systems Science Chinese Academy of Sciences luosl@amt.ac.cn Information Geometry and its Applications

### 4. Quantization and Data Compression. ECE 302 Spring 2012 Purdue University, School of ECE Prof. Ilya Pollak

4. Quantization and Data Compression ECE 32 Spring 22 Purdue University, School of ECE Prof. What is data compression? Reducing the file size without compromising the quality of the data stored in the

### Geometry of Entanglement

Geometry of Entanglement Bachelor Thesis Group of Quantum Optics, Quantum Nanophysics and Quantum Information University of Vienna WS 21 2659 SE Seminar Quantenphysik I Supervising Professor: Ao. Univ.-Prof.

### Chapter 3 Source Coding. 3.1 An Introduction to Source Coding 3.2 Optimal Source Codes 3.3 Shannon-Fano Code 3.4 Huffman Code

Chapter 3 Source Coding 3. An Introduction to Source Coding 3.2 Optimal Source Codes 3.3 Shannon-Fano Code 3.4 Huffman Code 3. An Introduction to Source Coding Entropy (in bits per symbol) implies in average

### Basic Notions of Entropy and Entanglement

Basic Notions of Entropy and Entanglement Frank Wilczek Center for Theoretical Physics, MIT, Cambridge MA 02139 USA March 3, 2014 Abstract Entropy is a nineteenth-century invention, with origins in such

### arxiv: v2 [quant-ph] 3 Nov 2017

Simulation of non-pauli Channels arxiv:706.0538v [quant-ph] 3 Nov 07 Thomas P. W. Cope, Leon Hetzel, Leonardo Banchi, 3 and Stefano Pirandola Computer Science & York Centre for Quantum Technologies, University

### The Theory of Quantum Information

The Theory of Quantum Information John Watrous Institute for Quantum Computing University of Waterloo 2018 John Watrous To be published by Cambridge University Press. Please note that this is a draft,

### Unitary Dynamics and Quantum Circuits

qitd323 Unitary Dynamics and Quantum Circuits Robert B. Griffiths Version of 20 January 2014 Contents 1 Unitary Dynamics 1 1.1 Time development operator T.................................... 1 1.2 Particular

### 4 Matrix product states

Physics 3b Lecture 5 Caltech, 05//7 4 Matrix product states Matrix product state (MPS) is a highly useful tool in the study of interacting quantum systems in one dimension, both analytically and numerically.