9 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è this paper we have considered shaping gain for two interesting quantization procedu

Size: px
Start display at page:

Download "9 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è this paper we have considered shaping gain for two interesting quantization procedu"

Transcription

1 FACTA UNIVERSITATIS èniçsè Series: Electronics and Energetics vol. 11, No.3 è1998è, NONLINEAR TRANSFORMATION OF ONEíDIMENSIONAL CONSTELLATION POINTS IN ORDER TO ERROR PROBABILITY DECREASING Zoran Periçc Abstract. This paper presents the original gradient method for the determination of the optimal signal constellation points disposition after quantization, when the error probability is minimized under the power constraint. This method consists of the nonlinear transformation and rescaling. The method diæers from the method presented in ë1ë, which can be used for uniform constellations with great numbers of points èwhere the continual approximation can be appliedè, since it can be applied for generating the nonequiprobable nonuniform constellations containing any number of points. 1. Introduction The paperë1ëis concerned with the performance of nonlinear encoding in a Gaussian noise environment èwhere the equiprobable constellation points are discussed è.it is interesting to compare scaling gain with shaping gain obtained by nonequiprobable signaling on the Gaussian channel. One cost of shaping gain is constellation expansion. The optimal nonlinear encoder is not the one that results in Gaussian distribution at the channel input. One similarity with shaping is that the warped and rescaled constellation ènonlinear transformation constellationè has been expanded. In ë1ë, the optimal nonlinear transformation èwarping transformationè is done using the continuous approximation for representing a signal constellation. The input distribution that achieves the capacity of the Additive White Gaussian Noise èawgnè channels with an average power constraint is also Gaussian. This paper considers the performance of nonequiprobable nonuniform oneídimensional signal constellations, obtained by shaping and nonlinear transformation when used on the Gaussian channel. In the ærst part of Manuscript received Jule 14, The author is with Faculty of Electronic Engineering, Beogradsa 14, Niçs, Yugoslavia, peric@elfa.ni.ac.yu. 91

2 9 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è this paper we have considered shaping gain for two interesting quantization procedures of the Gaussian source. The Gaussian source is quantized applying the method given in ë3ë èthe ærst methodè, which gives the equiprobable appearance of signal constellation points. After that, the same source is quantized using the Lloyd-Max's iterative quantization method ë4ë èthe second methodè. In the second more important part of the paper a new gradient method for determining the conditional minimum of the average error probability per symbol under the average power constraint is presented ènonlinear transformation constellation pointsè. Using this method, it is possible to determine the optimal arrangement of constellation points, under the average power constraint, for transmission over the Gaussian channel. This signal constellation transformation method is independent ofthe quantization method and information source, and adapts the given source signal constellation to the transmission channel.. Shaping gain determination for diæerent quantization method The saving in average power over equiprobable transmission using a oneí dimensional constellation is referred to as the shaping gain. The maximal shaping gain is achieved when the Gaussian source is applied. In this section, a Gaussian source quantization, using two diæerent methods of nonlinear quantization, is performed. The analysis is done on the basis of the shaping gain. The Gaussian source is quantized applying the method given in ë3ë, which gives the equiprobable appearance of signal constellation points. After that, the same source is quantized using the LloydíMax's iterative quantization method. The numerical analysis is done for the sixteen points of a oneídimensional signal constellation. Using the ærst method èiè, the decision levels èr è and reconstruction levels èm è are determined by: 1 L = p 1 r+1 Z x exp, çp P dx r è1è m = p L r+1 Z ç exp ç, x dx; =1; ;::: ;L; èè çp P r where L is a number of levels and P is an average power.

3 Z. Periçc: Nonlinear transformation of oneídimensional The second method èiiè is Max's iterative quantization which leads to r and m given by ë4ë: r ;opt = 1 èm ;opt+m,1;optè; =; 3;::: ;L; r 1;opt =,1; r L+1;opt = 1; m ;opt = r +1;opt R r ;opt R r +1;opt r ;opt rp r èrèdr è3è ; =1; ;::: ;L è4è p r èrèdr where p r èrè is a probability density function of the source. The shaping gain èg S è is deæned as diæerence between SNR èsignal to noise ratioè for nonuniform constellation èsnr n è, and SNR for uniform constellation èsnr u è èsimilarly as in ë5ëè, when the error probabilities èp e è are equal and the bit rates are almost equal: G S èp e è=snr u èp e è, SNR n èp e è è5è The shaping gains for the previous two quantization methods are shown in Fig. 1. Figure 1. Shaping gain èg S è for two diæerent quantization methods.

4 94 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è The shaping gain depends very much on the quantization method choice. From Fig. 1. it is evident that the ærst method has the negative shaping gain value in the wide range of the error probability, so in this case it is better to use the equiprobable transmission with uniform constellation. In the next section we will show how to compensate the negative shaping gain using the appropriate choice of nonlinear transformation and rescaling. 3. Algorithm for determination of optimal signal constellation points disposition The problem of minimizing the average error probability èp e è under the average power constraint is the nonlinear programming tas where the goal function is P e and constraint isp èaverage powerè. The average error probability and power of oneídimensional signal constellation can be calculated as 3 LX Zy ;l P P e 6, r Z+1, r = p e çn dr + e ç 7 n dr ççn 5 ; P = LX P m ; 4,1 where çn is an average noise power, m is the íth representation level, L is anumber of levels P = Z r +1 p r èrèdr; y ;r è6è r p r èrè is a probability density function of the Gaussian source, and r are the decision levels. y l and y r are deæned in the following way èsee Fig..è y l = m, m,1 y 1l =,1; ç n + ln m, m,1 P P,1 ; =1; ;::: ;L; y r = m +1, m y Lr =+1: + çn ln P ; m +1, m P +1 =1; ;::: ;L; In our case the variables in the goal function are mutual dependent, so the solution in closed form using the Lagrange multiplicator method is impossible.the problem is in fact convex programming problem ëë, in which

5 Z. Periçc: Nonlinear transformation of oneídimensional P e is a convex function and inequality constraint is a convex function èthe constraints form a convex setè. Using the gradient method it is necessary to begin from the starting point M 0 èm è0è 1 ;mè0è ;::: ;mè0è è and to go towards the optimum M L i in each iterative step. The next value of m is determined by m èi+1è = m èiè + çèiè hèiè, where m èi+1è and m èiè represent the íth representation point at the i + 1íth and iíth iterative step, respectively. ç èiè is the weight coeæcient, and h èiè is a step. Figure. Oneídimensional signal constellation and a decision region example. The algorithm for determination of nonequiprobable nonuniform constellation points disposition is as follows: 0è step: The initialization. The point disposition obtained by described quantization methods application is used as the starting values. 1è step: The average error probability gradient rp e e =, P p ç n ç, y l ç n ; =;::: ;L; where æ = y,1;r + y l. è step: Increasing i.e. decreasing distance between two neighbouring points èæ è implies shifting the íth point tolíth point for some small value æh 1 in order to eep the relation among remaining points constant m ;èiè = m èiè +h 1 ; m ;;èiè = m èiè,h 1 ; = ; +1;::: ;L; =1; ;::: ;L: 3è step: The calculation of the changed power values due to æ value

6 96 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è variation X L P ;èiè = av P èm ;èiè è ; X L P ;;èiè = av P èm ;;èiè è ; =1; ;::: ;L: 4è step: The coeæcients ç èiè è = 1; ;::: ;Lè are chosen so that the distances among the constellation points decrease i.e. increase, proportionally to the speed of error probabilitychanging and the power changing ç èiè e P 0 èiè, P av e P 0 èiè av, P av NP + NP P "èiè av, P P "èiè av, P : 5è step: The calculation of new signal point position value m èi+1è = m èiè + ç èiè hèiè, where h èiè is monotonously decreasing function of the ordinal number iterative step. 6è step: The determination of scaling constant, and based of this m èi+1è rescaling value çp èi+1è av = P av ; m èi+1è rescal = p çm èi+1è ; =1; ;::: ;L: 7è step: If condition max ç èiè æ hèiè ç"; where " is required to be accurate, is satisæed the procedure is ænished or if this condition is not satisæed rescaled values are set as the new signal points position values m èiè = m èi+1è rescal ; = 1; ;::: ;L and step 1è is applied. The nonlinear transformation gain is deæned as a diæerence between SNR before èsnr before è and SNR after èsnr after è the nonlinear transformation ègè of the signal constellation, when the error probabilities èp e è are

7 Z. Periçc: Nonlinear transformation of oneídimensional equal GèP e è=snr before èp e è, SNR after èp e è = 10 log P av ç, 10 log P av opt çopt è! P av çopt = 10 log P av opt ç = G scaling + G n ; è7è where G scaling =10 logèp av =P av opt è is a scaling gain and G n =10 logèç opt=ç è is a gain due to the nonlinear transformation, which corresponds to the deænition given in ë1ë èg = G scaling + G n è. The error probability decreasing obtained by using the proposed method, for the ærst quantization method, is illustrated in Fig. 3. Figure 3. Error probability per symbol before and after nonlinear transformation and rescaling for the ærst quantization method. The gain obtained by the nonlinear transformation and rescaling of the signal constellation points initially generated by the ærst and the second quantization method of the Gaussian source are shown in Fig. 4. The signal constellation design is done separately for each SNR value, and the constellation having the maximal gain is obtained. The aim of paper ë1ë is the analysis of nonlinear transformation named warping transformation of the uniform constellation for equiprobable trans-

8 98 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è mission where the solution is obtained using the continual approximation. An increase in nonlinear transformation gain with a decrease of SNR for equiprobable constellations may be observed as in ë1ë. On the contrary, with nonequiprobable nonuniform constellations, the gain decreases with SNR decreasing. The total gain is equal to the sum of the shaping gain and gain caused by the nonlinear transformation and rescaling. Figure 4. Gain ègè after nonlinear transformation and rescaling. 4. Conclusion The original gradient method for generating optimal signal constellations minimizes the error probability under the power constraint.the method consists of the nonlinear transformation and rescaling. This signal constellation transformation method is independent of the quantization method and information source, and adapts the given source signal constellation to the transmission channel. Also, we presented a procedure for accurate calculation of shaping gain for any signal constellation. REFERENCES 1. W. Betts, A.R. Calderban and Raiv Laroia: Performance of Nonuniform Constellations on the Gaussian Channel. IEEE Transaction on Information Theory, Vol. 40, pp. 1633í1638, September 1994.

9 Z. Periçc: Nonlinear transformation of oneídimensional J.J. Petriçc, S. Zlobec: Nonlinear Programming. Nauçcna niga, Belgrade, èin Serbianè. 3. F. Sun and H.C.A. Tilborg: Approaching Capacity by Equiprobable Signaling on the Gaussian Channel. IEEE Transaction on Information Theory, Vol. 39, pp. 1714í1716, September N.S. Jayant, P. Noll: Digital Coding of Waveforms. Englewood Cliæs, NJ: PrenticeíHall, F.R. Kschishong, S. Pasupathy: Optimal Nonuniform Signaling for Gaussion Channels. IEEE Transaction on Information Theory, Vol. 39, pp. 913í99, May 1993.

also has x æ as a local imizer. Of course, æ is typically not known, but an algorithm can approximate æ as it approximates x æ èas the augmented Lagra

also has x æ as a local imizer. Of course, æ is typically not known, but an algorithm can approximate æ as it approximates x æ èas the augmented Lagra Introduction to sequential quadratic programg Mark S. Gockenbach Introduction Sequential quadratic programg èsqpè methods attempt to solve a nonlinear program directly rather than convert it to a sequence

More information

256 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.2 è1998è primarily concerned with narrow range of frequencies near ærst resonance èwhere s

256 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.2 è1998è primarily concerned with narrow range of frequencies near ærst resonance èwhere s FACTA UNIVERSITATIS èni ç Sè Series: Electronics and Energetics vol. 11, No.2 è1998è, 255-261 EFFICIENT CALCULATION OF RADAR CROSS SECTION FOR FINITE STRIP ARRAY ON DIELECTRIC SLAB Borislav Popovski and

More information

EE-597 Notes Quantization

EE-597 Notes Quantization EE-597 Notes Quantization Phil Schniter June, 4 Quantization Given a continuous-time and continuous-amplitude signal (t, processing and storage by modern digital hardware requires discretization in both

More information

Gaussian source Assumptions d = (x-y) 2, given D, find lower bound of I(X;Y)

Gaussian source Assumptions d = (x-y) 2, given D, find lower bound of I(X;Y) Gaussian source Assumptions d = (x-y) 2, given D, find lower bound of I(X;Y) E{(X-Y) 2 } D

More information

LECTURE Review. In this lecture we shall study the errors and stability properties for numerical solutions of initial value.

LECTURE Review. In this lecture we shall study the errors and stability properties for numerical solutions of initial value. LECTURE 24 Error Analysis for Multi-step Methods 1. Review In this lecture we shall study the errors and stability properties for numerical solutions of initial value problems of the form è24.1è dx = fèt;

More information

Radial Basis Functions for Process Control Lyle H. Ungar Tom Johnson Richard D. De Veaux University ofpennsylvania Voice Processing Corp. Princeton Un

Radial Basis Functions for Process Control Lyle H. Ungar Tom Johnson Richard D. De Veaux University ofpennsylvania Voice Processing Corp. Princeton Un Radial Basis Functions for Process Control Lyle H. Ungar Tom Johnson Richard D. De Veaux University ofpennsylvania Voice Processing Corp. Princeton University Abstract Radial basis function èrbfsè neural

More information

BUDKER INSTITUTE OF NUCLEAR PHYSICS. B.V. Chirikov and V.V. Vecheslavov MULTIPLE SEPARATRIX CROSSING: CHAOS STRUCTURE. Budker INP NOVOSIBIRSK

BUDKER INSTITUTE OF NUCLEAR PHYSICS. B.V. Chirikov and V.V. Vecheslavov MULTIPLE SEPARATRIX CROSSING: CHAOS STRUCTURE. Budker INP NOVOSIBIRSK BUDKER INSTITUTE OF NUCLEAR PHYSICS B.V. Chirikov and V.V. Vecheslavov MULTIPLE SEPARATRIX CROSSING: CHAOS STRUCTURE Budker INP 2000-1 NOVOSIBIRSK 2000 chaos structure B.V. Chirikov and V.V. Vecheslavov

More information

The total current injected in the system must be zero, therefore the sum of vector entries B j j is zero, è1;:::1èb j j =: Excluding j by means of è1è

The total current injected in the system must be zero, therefore the sum of vector entries B j j is zero, è1;:::1èb j j =: Excluding j by means of è1è 1 Optimization of networks 1.1 Description of electrical networks Consider an electrical network of N nodes n 1 ;:::n N and M links that join them together. Each linkl pq = l k joints the notes numbered

More information

the x's and the y's unlike the standard k-means clustering on the x's ë8ë. We then present results comparing EMRBF with standard RBF estimation method

the x's and the y's unlike the standard k-means clustering on the x's ë8ë. We then present results comparing EMRBF with standard RBF estimation method EMRBF: A Statistical Basis for Using Radial Basis Functions for Process Control Lyle H. Ungar Department of Chemical Engineering University ofpennsylvania ungar@cis.upenn.edu Richard D. De Veaux Mathematics

More information

A Systematic Description of Source Significance Information

A Systematic Description of Source Significance Information A Systematic Description of Source Significance Information Norbert Goertz Institute for Digital Communications School of Engineering and Electronics The University of Edinburgh Mayfield Rd., Edinburgh

More information

An Effective Method for Initialization of Lloyd Max s Algorithm of Optimal Scalar Quantization for Laplacian Source

An Effective Method for Initialization of Lloyd Max s Algorithm of Optimal Scalar Quantization for Laplacian Source INFORMATICA, 007, Vol. 18, No., 79 88 79 007 Institute of Mathematics and Informatics, Vilnius An Effective Method for Initialization of Lloyd Max s Algorithm of Optimal Scalar Quantization for Laplacian

More information

Quantization 2.1 QUANTIZATION AND THE SOURCE ENCODER

Quantization 2.1 QUANTIZATION AND THE SOURCE ENCODER 2 Quantization After the introduction to image and video compression presented in Chapter 1, we now address several fundamental aspects of image and video compression in the remaining chapters of Section

More information

A New Invariance Property of Lyapunov Characteristic Directions S. Bharadwaj and K.D. Mease Mechanical and Aerospace Engineering University of Califor

A New Invariance Property of Lyapunov Characteristic Directions S. Bharadwaj and K.D. Mease Mechanical and Aerospace Engineering University of Califor A New Invariance Property of Lyapunov Characteristic Directions S. Bharadwaj and K.D. Mease Mechanical and Aerospace Engineering University of California, Irvine, California, 92697-3975 Email: sanjay@eng.uci.edu,

More information

Scalar and Vector Quantization. National Chiao Tung University Chun-Jen Tsai 11/06/2014

Scalar and Vector Quantization. National Chiao Tung University Chun-Jen Tsai 11/06/2014 Scalar and Vector Quantization National Chiao Tung University Chun-Jen Tsai 11/06/014 Basic Concept of Quantization Quantization is the process of representing a large, possibly infinite, set of values

More information

A.V. SAVKIN AND I.R. PETERSEN uncertain systems in which the uncertainty satisæes a certain integral quadratic constraint; e.g., see ë5, 6, 7ë. The ad

A.V. SAVKIN AND I.R. PETERSEN uncertain systems in which the uncertainty satisæes a certain integral quadratic constraint; e.g., see ë5, 6, 7ë. The ad Journal of Mathematical Systems, Estimation, and Control Vol. 6, No. 3, 1996, pp. 1í14 cæ 1996 Birkhíauser-Boston Robust H 1 Control of Uncertain Systems with Structured Uncertainty æ Andrey V. Savkin

More information

In the previous chapters we have presented synthesis methods for optimal H 2 and

In the previous chapters we have presented synthesis methods for optimal H 2 and Chapter 8 Robust performance problems In the previous chapters we have presented synthesis methods for optimal H 2 and H1 control problems, and studied the robust stabilization problem with respect to

More information

problem of detection naturally arises in technical diagnostics, where one is interested in detecting cracks, corrosion, or any other defect in a sampl

problem of detection naturally arises in technical diagnostics, where one is interested in detecting cracks, corrosion, or any other defect in a sampl In: Structural and Multidisciplinary Optimization, N. Olhoæ and G. I. N. Rozvany eds, Pergamon, 1995, 543í548. BOUNDS FOR DETECTABILITY OF MATERIAL'S DAMAGE BY NOISY ELECTRICAL MEASUREMENTS Elena CHERKAEVA

More information

P.B. Stark. January 29, 1998

P.B. Stark. January 29, 1998 Statistics 210B, Spring 1998 Class Notes P.B. Stark stark@stat.berkeley.edu www.stat.berkeley.eduèçstarkèindex.html January 29, 1998 Second Set of Notes 1 More on Testing and Conædence Sets See Lehmann,

More information

Constellation Shaping for Communication Channels with Quantized Outputs

Constellation Shaping for Communication Channels with Quantized Outputs Constellation Shaping for Communication Channels with Quantized Outputs Chandana Nannapaneni, Matthew C. Valenti, and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia

More information

Multimedia Communications. Scalar Quantization

Multimedia Communications. Scalar Quantization Multimedia Communications Scalar Quantization Scalar Quantization In many lossy compression applications we want to represent source outputs using a small number of code words. Process of representing

More information

EE6604 Personal & Mobile Communications. Week 13. Multi-antenna Techniques

EE6604 Personal & Mobile Communications. Week 13. Multi-antenna Techniques EE6604 Personal & Mobile Communications Week 13 Multi-antenna Techniques 1 Diversity Methods Diversity combats fading by providing the receiver with multiple uncorrelated replicas of the same information

More information

Analysis of methods for speech signals quantization

Analysis of methods for speech signals quantization INFOTEH-JAHORINA Vol. 14, March 2015. Analysis of methods for speech signals quantization Stefan Stojkov Mihajlo Pupin Institute, University of Belgrade Belgrade, Serbia e-mail: stefan.stojkov@pupin.rs

More information

Lloyd-Max Quantization of Correlated Processes: How to Obtain Gains by Receiver-Sided Time-Variant Codebooks

Lloyd-Max Quantization of Correlated Processes: How to Obtain Gains by Receiver-Sided Time-Variant Codebooks Lloyd-Max Quantization of Correlated Processes: How to Obtain Gains by Receiver-Sided Time-Variant Codebooks Sai Han and Tim Fingscheidt Institute for Communications Technology, Technische Universität

More information

VECTOR QUANTIZATION TECHNIQUES FOR MULTIPLE-ANTENNA CHANNEL INFORMATION FEEDBACK

VECTOR QUANTIZATION TECHNIQUES FOR MULTIPLE-ANTENNA CHANNEL INFORMATION FEEDBACK VECTOR QUANTIZATION TECHNIQUES FOR MULTIPLE-ANTENNA CHANNEL INFORMATION FEEDBACK June Chul Roh and Bhaskar D. Rao Department of Electrical and Computer Engineering University of California, San Diego La

More information

MODULATION AND CODING FOR QUANTIZED CHANNELS. Xiaoying Shao and Harm S. Cronie

MODULATION AND CODING FOR QUANTIZED CHANNELS. Xiaoying Shao and Harm S. Cronie MODULATION AND CODING FOR QUANTIZED CHANNELS Xiaoying Shao and Harm S. Cronie x.shao@ewi.utwente.nl, h.s.cronie@ewi.utwente.nl University of Twente, Faculty of EEMCS, Signals and Systems Group P.O. box

More information

CHANNEL FEEDBACK QUANTIZATION METHODS FOR MISO AND MIMO SYSTEMS

CHANNEL FEEDBACK QUANTIZATION METHODS FOR MISO AND MIMO SYSTEMS CHANNEL FEEDBACK QUANTIZATION METHODS FOR MISO AND MIMO SYSTEMS June Chul Roh and Bhaskar D Rao Department of Electrical and Computer Engineering University of California, San Diego La Jolla, CA 9293 47,

More information

One Lesson of Information Theory

One Lesson of Information Theory Institut für One Lesson of Information Theory Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany Email: volker.kuehn@uni-rostock.de http://www.int.uni-rostock.de/

More information

= α α ( ) ( ) thr. thr. min. Image quantization and false contours. Why 256 quantization levels? min α. min. max. min. min Φ Φ. max. 4. D α α.

= α α ( ) ( ) thr. thr. min. Image quantization and false contours. Why 256 quantization levels? min α. min. max. min. min Φ Φ. max. 4. D α α. L. Yaroslavsky. Course 5.72 Digital Image Processing: Applications Lect. 3. Image Quantization in Image and Transform Domains Optimal element-ise uantization. ε ( ( ˆ ; E I p( D( ε d; ( ( E L { } ( ( p(

More information

Fast Near-Optimal Energy Allocation for Multimedia Loading on Multicarrier Systems

Fast Near-Optimal Energy Allocation for Multimedia Loading on Multicarrier Systems Fast Near-Optimal Energy Allocation for Multimedia Loading on Multicarrier Systems Michael A. Enright and C.-C. Jay Kuo Department of Electrical Engineering and Signal and Image Processing Institute University

More information

EE4304 C-term 2007: Lecture 17 Supplemental Slides

EE4304 C-term 2007: Lecture 17 Supplemental Slides EE434 C-term 27: Lecture 17 Supplemental Slides D. Richard Brown III Worcester Polytechnic Institute, Department of Electrical and Computer Engineering February 5, 27 Geometric Representation: Optimal

More information

Soft-Output Trellis Waveform Coding

Soft-Output Trellis Waveform Coding Soft-Output Trellis Waveform Coding Tariq Haddad and Abbas Yongaçoḡlu School of Information Technology and Engineering, University of Ottawa Ottawa, Ontario, K1N 6N5, Canada Fax: +1 (613) 562 5175 thaddad@site.uottawa.ca

More information

C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University

C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University Quantization C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University http://www.csie.nctu.edu.tw/~cmliu/courses/compression/ Office: EC538 (03)5731877 cmliu@cs.nctu.edu.tw

More information

Supplementary Figure 1: Scheme of the RFT. (a) At first, we separate two quadratures of the field (denoted by and ); (b) then, each quadrature

Supplementary Figure 1: Scheme of the RFT. (a) At first, we separate two quadratures of the field (denoted by and ); (b) then, each quadrature Supplementary Figure 1: Scheme of the RFT. (a At first, we separate two quadratures of the field (denoted by and ; (b then, each quadrature undergoes a nonlinear transformation, which results in the sine

More information

W 1 æw 2 G + 0 e? u K y Figure 5.1: Control of uncertain system. For MIMO systems, the normbounded uncertainty description is generalized by assuming

W 1 æw 2 G + 0 e? u K y Figure 5.1: Control of uncertain system. For MIMO systems, the normbounded uncertainty description is generalized by assuming Chapter 5 Robust stability and the H1 norm An important application of the H1 control problem arises when studying robustness against model uncertainties. It turns out that the condition that a control

More information

initial work on entropy coding èe.g. Huæman codingè relied on knowing, or measuring,

initial work on entropy coding èe.g. Huæman codingè relied on knowing, or measuring, 161 Chapter 6 Adaptive Quantization Without Side Information 1 Contents 6.1 Introduction : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 161 6.2 Adaptation algorithm : : : : : : : : : :

More information

Optimization of Quantizer s Segment Treshold Using Spline Approximations for Optimal Compressor Function

Optimization of Quantizer s Segment Treshold Using Spline Approximations for Optimal Compressor Function Applied Mathematics, 1, 3, 143-1434 doi:1436/am1331 Published Online October 1 (http://wwwscirporg/ournal/am) Optimization of Quantizer s Segment Treshold Using Spline Approimations for Optimal Compressor

More information

Problem 7.7 : We assume that P (x i )=1/3, i =1, 2, 3. Then P (y 1 )= 1 ((1 p)+p) = P (y j )=1/3, j=2, 3. Hence : and similarly.

Problem 7.7 : We assume that P (x i )=1/3, i =1, 2, 3. Then P (y 1 )= 1 ((1 p)+p) = P (y j )=1/3, j=2, 3. Hence : and similarly. (b) We note that the above capacity is the same to the capacity of the binary symmetric channel. Indeed, if we considerthe grouping of the output symbols into a = {y 1,y 2 } and b = {y 3,y 4 } we get a

More information

energy for systems subject to sector bounded nonlinear uncertainty ë15ë. An extension of this synthesis that incorporates generalized multipliers to c

energy for systems subject to sector bounded nonlinear uncertainty ë15ë. An extension of this synthesis that incorporates generalized multipliers to c Convergence Analysis of A Parametric Robust H Controller Synthesis Algorithm 1 David Banjerdpongchai Durand Bldg., Room 110 Dept. of Electrical Engineering Email: banjerd@isl.stanford.edu Jonathan P. How

More information

A First Course in Digital Communications

A First Course in Digital Communications A First Course in Digital Communications Ha H. Nguyen and E. Shwedyk February 9 A First Course in Digital Communications 1/46 Introduction There are benefits to be gained when M-ary (M = 4 signaling methods

More information

Coding for Discrete Source

Coding for Discrete Source EGR 544 Communication Theory 3. Coding for Discrete Sources Z. Aliyazicioglu Electrical and Computer Engineering Department Cal Poly Pomona Coding for Discrete Source Coding Represent source data effectively

More information

Optimized Symbol Mappings for Bit-Interleaved Coded Modulation with Iterative Decoding

Optimized Symbol Mappings for Bit-Interleaved Coded Modulation with Iterative Decoding Optimized Symbol Mappings for Bit-nterleaved Coded Modulation with terative Decoding F. Schreckenbach, N. Görtz, J. Hagenauer nstitute for Communications Engineering (LNT) Munich University of Technology

More information

322 HENDRA GUNAWAN AND MASHADI èivè kx; y + zk çkx; yk + kx; zk: The pair èx; kæ; ækè is then called a 2-normed space. A standard example of a 2-norme

322 HENDRA GUNAWAN AND MASHADI èivè kx; y + zk çkx; yk + kx; zk: The pair èx; kæ; ækè is then called a 2-normed space. A standard example of a 2-norme SOOCHOW JOURNAL OF MATHEMATICS Volume 27, No. 3, pp. 321-329, July 2001 ON FINITE DIMENSIONAL 2-NORMED SPACES BY HENDRA GUNAWAN AND MASHADI Abstract. In this note, we shall study ænite dimensional 2-normed

More information

consistency is faster than the usual T 1=2 consistency rate. In both cases more general error distributions were considered as well. Consistency resul

consistency is faster than the usual T 1=2 consistency rate. In both cases more general error distributions were considered as well. Consistency resul LIKELIHOOD ANALYSIS OF A FIRST ORDER AUTOREGRESSIVE MODEL WITH EPONENTIAL INNOVATIONS By B. Nielsen & N. Shephard Nuæeld College, Oxford O1 1NF, UK bent.nielsen@nuf.ox.ac.uk neil.shephard@nuf.ox.ac.uk

More information

Impact of channel-state information on coded transmission over fading channels with diversity reception

Impact of channel-state information on coded transmission over fading channels with diversity reception Impact of channel-state information on coded transmission over fading channels with diversity reception Giorgio Taricco Ezio Biglieri Giuseppe Caire September 4, 1998 Abstract We study the synergy between

More information

ECE Information theory Final

ECE Information theory Final ECE 776 - Information theory Final Q1 (1 point) We would like to compress a Gaussian source with zero mean and variance 1 We consider two strategies In the first, we quantize with a step size so that the

More information

Introduction Principally, behaviours focus our attention on the primary level of system dynamics, that is, on empirical observations. In a sense the b

Introduction Principally, behaviours focus our attention on the primary level of system dynamics, that is, on empirical observations. In a sense the b Identiæcation of System Behaviours by Approximation of Time Series Data Wolfgang Scherrer a Christiaan Heij bæ version 9-03-97 a Institut fíur íokonometrie, Operations Research und Systemtheorie, Technische

More information

Principles of Communications

Principles of Communications Principles of Communications Weiyao Lin Shanghai Jiao Tong University Chapter 10: Information Theory Textbook: Chapter 12 Communication Systems Engineering: Ch 6.1, Ch 9.1~ 9. 92 2009/2010 Meixia Tao @

More information

Summary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations

Summary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations TUTORIAL ON DIGITAL MODULATIONS Part 8a: Error probability A [2011-01-07] 07] Roberto Garello, Politecnico di Torino Free download (for personal use only) at: www.tlc.polito.it/garello 1 Part 8a: Error

More information

FORM 1 Physics 240 í Fall Exam 1 CONTI COULTER GRAFE SKALSEY ZORN. Please æll in the information requested on the scantron answer sheet

FORM 1 Physics 240 í Fall Exam 1 CONTI COULTER GRAFE SKALSEY ZORN. Please æll in the information requested on the scantron answer sheet FORM 1 Physics 240 í Fall 1999 Exam 1 Name: Discussion section instructor and time: ècircle ONE TIMEè CONTI COULTER GRAFE SKALSEY ZORN MW 10-11 èè23è MW 8-9 èè4è MW 2-3 èè7è MW 11-12 èè6è MW 9-10 èè12è

More information

Quantization. Introduction. Roadmap. Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory. Source coding.

Quantization. Introduction. Roadmap. Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory. Source coding. Roadmap Quantization Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory Source coding 2 Introduction 4 1 Lossy coding Original source is discrete Lossless coding: bit rate

More information

392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6. Problem Set 2 Solutions

392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6. Problem Set 2 Solutions 392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6 Problem Set 2 Solutions Problem 2.1 (Cartesian-product constellations) (a) Show that if A is a K-fold Cartesian

More information

2 2. EQUATIONS AND ALGORITHMS 2.1. WAITING ELEMENTS Brittle-elastic bar. Consider a stretched rod from a homogeneous elastic-brittle material. If load

2 2. EQUATIONS AND ALGORITHMS 2.1. WAITING ELEMENTS Brittle-elastic bar. Consider a stretched rod from a homogeneous elastic-brittle material. If load DYNAMICS OF DAMAGE IN TWO-DIMENSIONAL STRUCTURES WITH WAITING LINKS Andrej Cherkaev and Liya Zhornitskaya Keywords: Dynamics of damage, Failure, Structures. Abstract The paper deals with simulation of

More information

2 I. Pritsker and R. Varga Wesay that the triple èg; W;æè has the rational approximation property if, iè iiè for any f èzè which is analytic in G and

2 I. Pritsker and R. Varga Wesay that the triple èg; W;æè has the rational approximation property if, iè iiè for any f èzè which is analytic in G and Rational approximation with varying weights in the complex plane Igor E. Pritsker and Richard S. Varga Abstract. Given an open bounded set G in the complex plane and a weight function W èzè which is analytic

More information

Dirty Paper Writing and Watermarking Applications

Dirty Paper Writing and Watermarking Applications Dirty Paper Writing and Watermarking Applications G.RaviKiran February 10, 2003 1 Introduction Following an underlying theme in Communication is the duo of Dirty Paper Writing and Watermarking. In 1983

More information

SPRING Final Exam. May 5, 1999

SPRING Final Exam. May 5, 1999 IE 230: PROBABILITY AND STATISTICS IN ENGINEERING SPRING 1999 Final Exam May 5, 1999 NAME: Show all your work. Make sure that any notation you use is clear and well deæned. For example, if you use a new

More information

Lecture 1. Introduction. The importance, ubiquity, and complexity of embedded systems are growing

Lecture 1. Introduction. The importance, ubiquity, and complexity of embedded systems are growing Lecture 1 Introduction Karl Henrik Johansson The importance, ubiquity, and complexity of embedded systems are growing tremendously thanks to the revolution in digital technology. This has created a need

More information

Vector Quantization and Subband Coding

Vector Quantization and Subband Coding Vector Quantization and Subband Coding 18-796 ultimedia Communications: Coding, Systems, and Networking Prof. Tsuhan Chen tsuhan@ece.cmu.edu Vector Quantization 1 Vector Quantization (VQ) Each image block

More information

Energy State Amplification in an Energy Harvesting Communication System

Energy State Amplification in an Energy Harvesting Communication System Energy State Amplification in an Energy Harvesting Communication System Omur Ozel Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland College Park, MD 20742 omur@umd.edu

More information

PSK bit mappings with good minimax error probability

PSK bit mappings with good minimax error probability PSK bit mappings with good minimax error probability Erik Agrell Department of Signals and Systems Chalmers University of Technology 4196 Göteborg, Sweden Email: agrell@chalmers.se Erik G. Ström Department

More information

3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions

3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions Engineering Tripos Part IIA THIRD YEAR 3F: Signals and Systems INFORMATION THEORY Examples Paper Solutions. Let the joint probability mass function of two binary random variables X and Y be given in the

More information

LECTURE 15. Last time: Feedback channel: setting up the problem. Lecture outline. Joint source and channel coding theorem

LECTURE 15. Last time: Feedback channel: setting up the problem. Lecture outline. Joint source and channel coding theorem LECTURE 15 Last time: Feedback channel: setting up the problem Perfect feedback Feedback capacity Data compression Lecture outline Joint source and channel coding theorem Converse Robustness Brain teaser

More information

November 9, Abstract. properties change in response to the application of a magnetic æeld. These æuids typically

November 9, Abstract. properties change in response to the application of a magnetic æeld. These æuids typically On the Eæective Magnetic Properties of Magnetorheological Fluids æ November 9, 998 Tammy M. Simon, F. Reitich, M.R. Jolly, K. Ito, H.T. Banks Abstract Magnetorheological èmrè æuids represent a class of

More information

Schur-convexity of the Symbol Error Rate in Correlated MIMO Systems with Precoding and Space-time Coding

Schur-convexity of the Symbol Error Rate in Correlated MIMO Systems with Precoding and Space-time Coding Schur-convexity of the Symbol Error Rate in Correlated MIMO Systems with Precoding and Space-time Coding RadioVetenskap och Kommunikation (RVK 08) Proceedings of the twentieth Nordic Conference on Radio

More information

1 Introduction Principally, behaviours focus our attention on the primary level of system dynamics, that is, on empirical observations. In a sense the

1 Introduction Principally, behaviours focus our attention on the primary level of system dynamics, that is, on empirical observations. In a sense the Identiæcation of Factor Models by Behavioural and Subspace Methods Wolfgang Scherrer a Christiaan Heij bæ version 23-09-97 a Institut fíur íokonometrie, Operations Research und Systemtheorie, Technische

More information

where Sènè stands for the set of n æ n real symmetric matrices, and æ is a bounded open set in IR n,typically with a suæciently regular boundary, mean

where Sènè stands for the set of n æ n real symmetric matrices, and æ is a bounded open set in IR n,typically with a suæciently regular boundary, mean GOOD AND VISCOSITY SOLUTIONS OF FULLY NONLINEAR ELLIPTIC EQUATIONS 1 ROBERT JENSEN 2 Department of Mathematical and Computer Sciences Loyola University Chicago, IL 60626, U.S.A. E-mail: rrj@math.luc.edu

More information

ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals

ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals Jingxian Wu Department of Electrical Engineering University of Arkansas Outline Matched Filter Generalized Matched Filter Signal

More information

Continuity of Bçezier patches. Jana Pçlnikovça, Jaroslav Plaçcek, Juraj ç Sofranko. Faculty of Mathematics and Physics. Comenius University

Continuity of Bçezier patches. Jana Pçlnikovça, Jaroslav Plaçcek, Juraj ç Sofranko. Faculty of Mathematics and Physics. Comenius University Continuity of Bezier patches Jana Plnikova, Jaroslav Placek, Juraj Sofranko Faculty of Mathematics and Physics Comenius University Bratislava Abstract The paper is concerned about the question of smooth

More information

Performance Analysis of Multiple Antenna Systems with VQ-Based Feedback

Performance Analysis of Multiple Antenna Systems with VQ-Based Feedback Performance Analysis of Multiple Antenna Systems with VQ-Based Feedback June Chul Roh and Bhaskar D. Rao Department of Electrical and Computer Engineering University of California, San Diego La Jolla,

More information

NUMERICAL COMPUTATION OF THE CAPACITY OF CONTINUOUS MEMORYLESS CHANNELS

NUMERICAL COMPUTATION OF THE CAPACITY OF CONTINUOUS MEMORYLESS CHANNELS NUMERICAL COMPUTATION OF THE CAPACITY OF CONTINUOUS MEMORYLESS CHANNELS Justin Dauwels Dept. of Information Technology and Electrical Engineering ETH, CH-8092 Zürich, Switzerland dauwels@isi.ee.ethz.ch

More information

Least-Squares Performance of Analog Product Codes

Least-Squares Performance of Analog Product Codes Copyright 004 IEEE Published in the Proceedings of the Asilomar Conference on Signals, Systems and Computers, 7-0 ovember 004, Pacific Grove, California, USA Least-Squares Performance of Analog Product

More information

leading to a ænal state with missing energy. The rate for such processes is strongly dependent on the number of extra dimensions as well as the exact

leading to a ænal state with missing energy. The rate for such processes is strongly dependent on the number of extra dimensions as well as the exact SLAC-PUB-8204 July 1999 TESTS OF LOW SCALE QUANTUM GRAVITY IN e, e, AND ææ COLLISIONS a T.G. RIZZO b Stanford Linear Accelerator Center, Stanford University, Stanford, CA 94309, USA Arkani-Hamed, Dimopoulos

More information

Channel Dependent Adaptive Modulation and Coding Without Channel State Information at the Transmitter

Channel Dependent Adaptive Modulation and Coding Without Channel State Information at the Transmitter Channel Dependent Adaptive Modulation and Coding Without Channel State Information at the Transmitter Bradford D. Boyle, John MacLaren Walsh, and Steven Weber Modeling & Analysis of Networks Laboratory

More information

Iterative Improvement plus Random Restart Stochastic Search by X. Hu, R. Shonkwiler, and M. C. Spruill School of Mathematics Georgia Institute of Tech

Iterative Improvement plus Random Restart Stochastic Search by X. Hu, R. Shonkwiler, and M. C. Spruill School of Mathematics Georgia Institute of Tech Iterative Improvement plus Random Restart Stochastic Search by X. Hu, R. Shonkwiler, and M. C. Spruill School of Mathematics Georgia Institute of Technology Atlanta, GA 0 email: shonkwiler@math.gatech.edu,

More information

Quantization for Distributed Estimation

Quantization for Distributed Estimation 0 IEEE International Conference on Internet of Things ithings 0), Green Computing and Communications GreenCom 0), and Cyber-Physical-Social Computing CPSCom 0) Quantization for Distributed Estimation uan-yu

More information

Basic Principles of Video Coding

Basic Principles of Video Coding Basic Principles of Video Coding Introduction Categories of Video Coding Schemes Information Theory Overview of Video Coding Techniques Predictive coding Transform coding Quantization Entropy coding Motion

More information

Simultaneous SDR Optimality via a Joint Matrix Decomp.

Simultaneous SDR Optimality via a Joint Matrix Decomp. Simultaneous SDR Optimality via a Joint Matrix Decomposition Joint work with: Yuval Kochman, MIT Uri Erez, Tel Aviv Uni. May 26, 2011 Model: Source Multicasting over MIMO Channels z 1 H 1 y 1 Rx1 ŝ 1 s

More information

Abstract To characterize color values measured by color devices èe.g. scanners, color copiers and color camerasè in a deviceíindependent fashion these

Abstract To characterize color values measured by color devices èe.g. scanners, color copiers and color camerasè in a deviceíindependent fashion these White-point preserving color correction Graham D. Finlayson Department of Computer Science, University of York, York, United Kingdom YO1 5DD Mark S. Drew School of Computing Science, Simon Fraser University,

More information

Figure 1: Startup screen for Interactive Physics Getting Started The ærst simulation will be very simple. With the mouse, select the circle picture on

Figure 1: Startup screen for Interactive Physics Getting Started The ærst simulation will be very simple. With the mouse, select the circle picture on Experiment Simulations í Kinematics, Collisions and Simple Harmonic Motion Introduction Each of the other experiments you perform in this laboratory involve a physical apparatus which you use to make measurements

More information

Constellation Shaping for Communication Channels with Quantized Outputs

Constellation Shaping for Communication Channels with Quantized Outputs Constellation Shaping for Communication Channels with Quantized Outputs, Dr. Matthew C. Valenti and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia University

More information

ON SCALABLE CODING OF HIDDEN MARKOV SOURCES. Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose

ON SCALABLE CODING OF HIDDEN MARKOV SOURCES. Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose ON SCALABLE CODING OF HIDDEN MARKOV SOURCES Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose Department of Electrical and Computer Engineering University of California, Santa Barbara, CA, 93106

More information

Per-Antenna Power Constrained MIMO Transceivers Optimized for BER

Per-Antenna Power Constrained MIMO Transceivers Optimized for BER Per-Antenna Power Constrained MIMO Transceivers Optimized for BER Ching-Chih Weng and P. P. Vaidyanathan Dept. of Electrical Engineering, MC 136-93 California Institute of Technology, Pasadena, CA 91125,

More information

easy to make g by æ èp,1è=q where æ generates Zp. æ We can use a secure prime modulus p such that èp, 1è=2q is also prime or each prime factor of èp,

easy to make g by æ èp,1è=q where æ generates Zp. æ We can use a secure prime modulus p such that èp, 1è=2q is also prime or each prime factor of èp, Additional Notes to ëultimate Solution to Authentication via Memorable Password" May 1, 2000 version Taekyoung Kwon æ May 25, 2000 Abstract This short letter adds informative discussions to our previous

More information

Compression methods: the 1 st generation

Compression methods: the 1 st generation Compression methods: the 1 st generation 1998-2017 Josef Pelikán CGG MFF UK Praha pepca@cgg.mff.cuni.cz http://cgg.mff.cuni.cz/~pepca/ Still1g 2017 Josef Pelikán, http://cgg.mff.cuni.cz/~pepca 1 / 32 Basic

More information

Machine Learning: Logistic Regression. Lecture 04

Machine Learning: Logistic Regression. Lecture 04 Machine Learning: Logistic Regression Razvan C. Bunescu School of Electrical Engineering and Computer Science bunescu@ohio.edu Supervised Learning Task = learn an (unkon function t : X T that maps input

More information

Minimum BER Linear Transceivers for Block. Communication Systems. Lecturer: Tom Luo

Minimum BER Linear Transceivers for Block. Communication Systems. Lecturer: Tom Luo Minimum BER Linear Transceivers for Block Communication Systems Lecturer: Tom Luo Outline Block-by-block communication Abstract model Applications Current design techniques Minimum BER precoders for zero-forcing

More information

wavelet scalar by run length and Huæman encoding.

wavelet scalar by run length and Huæman encoding. Dead Zone Quantization in Wavelet Image Compression Mini Project in ECE 253a Jacob Stríom May 12, 1996 Abstract A common quantizer implementation of wavelet image compression systems is scalar quantization

More information

Distributed Detection and Estimation in Wireless Sensor Networks: Resource Allocation, Fusion Rules, and Network Security

Distributed Detection and Estimation in Wireless Sensor Networks: Resource Allocation, Fusion Rules, and Network Security Distributed Detection and Estimation in Wireless Sensor Networks: Resource Allocation, Fusion Rules, and Network Security Edmond Nurellari The University of Leeds, UK School of Electronic and Electrical

More information

Multiuser Capacity in Block Fading Channel

Multiuser Capacity in Block Fading Channel Multiuser Capacity in Block Fading Channel April 2003 1 Introduction and Model We use a block-fading model, with coherence interval T where M independent users simultaneously transmit to a single receiver

More information

Principles of Communications

Principles of Communications Principles of Communications Weiyao Lin, PhD Shanghai Jiao Tong University Chapter 4: Analog-to-Digital Conversion Textbook: 7.1 7.4 2010/2011 Meixia Tao @ SJTU 1 Outline Analog signal Sampling Quantization

More information

Economics 472. Lecture 16. Binary Dependent Variable Models

Economics 472. Lecture 16. Binary Dependent Variable Models University of Illinois Fall 998 Department of Economics Roger Koenker Economics 472 Lecture 6 Binary Dependent Variable Models Let's begin with a model for an observed proportion, or frequency. We would

More information

Keywords: machine learning, reinforcement learning, dynamic programming, Markov decision processes èmdpsè, linear programming, convex programming, fun

Keywords: machine learning, reinforcement learning, dynamic programming, Markov decision processes èmdpsè, linear programming, convex programming, fun Approximate Solutions to Markov Decision Processes Geoærey J. Gordon June 1999 CMU-CS-99-143 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Submitted in partial fulællment of

More information

A Lloyd-Max based quantizer of L-values for AWGN and Rayleigh Fading channel

A Lloyd-Max based quantizer of L-values for AWGN and Rayleigh Fading channel A Lloyd-Max based quantizer of L-values for AWGN and Rayleigh Fading channel Yasser Samayoa, Jörn Ostermann Institut für Informationsverarbeitung Gottfried Wilhelm Leibniz Universität Hannover 367 Hannover,

More information

a) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics.

a) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics. Digital Modulation and Coding Tutorial-1 1. Consider the signal set shown below in Fig.1 a) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics. b) What is the minimum Euclidean

More information

Lecture 5b: Line Codes

Lecture 5b: Line Codes Lecture 5b: Line Codes Dr. Mohammed Hawa Electrical Engineering Department University of Jordan EE421: Communications I Digitization Sampling (discrete analog signal). Quantization (quantized discrete

More information

Revision of Lecture 5

Revision of Lecture 5 Revision of Lecture 5 Information transferring across channels Channel characteristics and binary symmetric channel Average mutual information Average mutual information tells us what happens to information

More information

at Some sort of quantization is necessary to represent continuous signals in digital form

at Some sort of quantization is necessary to represent continuous signals in digital form Quantization at Some sort of quantization is necessary to represent continuous signals in digital form x(n 1,n ) x(t 1,tt ) D Sampler Quantizer x q (n 1,nn ) Digitizer (A/D) Quantization is also used for

More information

ECE Information theory Final (Fall 2008)

ECE Information theory Final (Fall 2008) ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1

More information

Energy Harvesting Multiple Access Channel with Peak Temperature Constraints

Energy Harvesting Multiple Access Channel with Peak Temperature Constraints Energy Harvesting Multiple Access Channel with Peak Temperature Constraints Abdulrahman Baknina, Omur Ozel 2, and Sennur Ulukus Department of Electrical and Computer Engineering, University of Maryland,

More information

R TH + V TH. Vport. + Rport V TH

R TH + V TH. Vport. + Rport V TH Massachusetts Institute of Technology Department of Electrical Engineering and omputer Science 6.002 í Electronic ircuits Homework è3 Solution Handout F9827 Exercise 31: When a particular network having

More information

A Scaled Diæerence Chi-square Test Statistic. Albert Satorra. Universitat Pompeu Fabra. and. Peter M. Bentler. August 3, 1999

A Scaled Diæerence Chi-square Test Statistic. Albert Satorra. Universitat Pompeu Fabra. and. Peter M. Bentler. August 3, 1999 A Scaled Diæerence Chi-square Test Statistic for Moment Structure Analysis æ Albert Satorra Universitat Pompeu Fabra and Peter M. Bentler University of California, Los Angeles August 3, 1999 æ Research

More information