Substantiation of the Water Filling Theorem Using Lagrange Multipliers

Similar documents
Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

OFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Jitter Transfer Functions For The Reference Clock Jitter In A Serial Link: Theory And Applications

1 6 = 1 6 = + Factorials and Euler s Gamma function

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

Estimation for Complete Data

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

Kinetics of Complex Reactions

Unbiased Estimation. February 7-12, 2008

Markov Decision Processes

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.

ELEC1200: A System View of Communications: from Signals to Packets Lecture 3

Solution of EECS 315 Final Examination F09

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

MAT 271 Project: Partial Fractions for certain rational functions

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

Diversity Combining Techniques

Topic 5 [434 marks] (i) Find the range of values of n for which. (ii) Write down the value of x dx in terms of n, when it does exist.

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Orthogonal Gaussian Filters for Signal Processing

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

Z - Transform. It offers the techniques for digital filter design and frequency analysis of digital signals.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES

The Method of Least Squares. To understand least squares fitting of data.

Regression, Part I. A) Correlation describes the relationship between two variables, where neither is independent or a predictor.

Lecture 7: Properties of Random Samples

Fall 2013 MTH431/531 Real analysis Section Notes

MATH 10550, EXAM 3 SOLUTIONS

CS/ECE 715 Spring 2004 Homework 5 (Due date: March 16)

Solutions to Odd Numbered End of Chapter Exercises: Chapter 4

18.01 Calculus Jason Starr Fall 2005

Optimization Methods: Linear Programming Applications Assignment Problem 1. Module 4 Lecture Notes 3. Assignment Problem

1.0 Probability of Error for non-coherent BFSK

Maximum Likelihood Estimation

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

Machine Learning for Data Science (CS 4786)

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

Exponential Families and Bayesian Inference

Topic 9: Sampling Distributions of Estimators

Lesson 10: Limits and Continuity

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

Information Theory Model for Radiation

10/2/ , 5.9, Jacob Hays Amit Pillay James DeFelice

Problem Set 4 Due Oct, 12

Lecture 1: Channel Equalization 1 Advanced Digital Communications (EQ2410) 1. Overview. Ming Xiao CommTh/EES/KTH

Introduction to Machine Learning DIS10

17 Phonons and conduction electrons in solids (Hiroshi Matsuoka)

Bayesian Methods: Introduction to Multi-parameter Models

The Phi Power Series

Appendix: The Laplace Transform

ECE 308 Discrete-Time Signals and Systems

1. Hydrogen Atom: 3p State

Lecture 11 and 12: Basic estimation theory

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Sequences and Series of Functions

Convergence of random variables. (telegram style notes) P.J.C. Spreij

6 Sample Size Calculations

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Reliability and Queueing

Monte Carlo Integration

Linear Support Vector Machines

Statistical Theory MT 2008 Problems 1: Solution sketches

EE 505. Lecture 28. ADC Design SAR

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter

x 2 x x x x x + x x +2 x

Problem Set 2 Solutions

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

Fig. 2. Block Diagram of a DCS

EE Midterm Test 1 - Solutions

Statistical Theory MT 2009 Problems 1: Solution sketches

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

Topic 9: Sampling Distributions of Estimators

Chapter 6 Sampling Distributions

Chapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io

Topic 9: Sampling Distributions of Estimators

Chapter 2: Numerical Methods

f(x) dx as we do. 2x dx x also diverges. Solution: We compute 2x dx lim

Random Variables, Sampling and Estimation

DETERMINATION OF MECHANICAL PROPERTIES OF A NON- UNIFORM BEAM USING THE MEASUREMENT OF THE EXCITED LONGITUDINAL ELASTIC VIBRATIONS.

CHEE 221: Chemical Processes and Systems

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall

y ij = µ + α i + ɛ ij,

Output Analysis (2, Chapters 10 &11 Law)

AP Calculus BC Review Applications of Derivatives (Chapter 4) and f,

Probability of error for LDPC OC with one co-channel Interferer over i.i.d Rayleigh Fading

CONTENTS. Course Goals. Course Materials Lecture Notes:

Stochastic Simulation

Linear Regression Models

Math 113 Exam 3 Practice

Chapter 7 z-transform

Transcription:

J.A. Crawford U048 Water Fillig o Multiple Gaussia Chaels.doc Substatiatio of the Water Fillig heorem Usig Lagrage Multipliers Shao s capacity theorem states that i the case of parallel statistically idepedet Gaussia chaels that the chael capacity C is give by E () C = B log + = where B is the badwidth per chael i Hz, ad E ad are the eergy per symbol ad oise variace per symbol respectively. We wat to fid the best allocatio of trasmit power i order to maximize C uder the maximum power costrait that () = E = E he Lagrage Multiplier solutio method is give by the followig rule : I order to determie the extreme values of a cotiuously differetiable fuctio f(x, x,, x ) whose variables are subjected to m cotiuously differetiable costraiig relatios give as (3) ϕ i ( x, x,... x) = 0 for i =,,..., m form the fuctio (4) m F f λϕ = + i= i i ad determie the parameters i ad the values of x k from the equatios F (5) = 0 for k =,,..., x k ad the m equatios give by (3). he objective fuctio that we wish to fid the extremum of is the give by E (6) Λ = B log + λ E + E = = Differetiatig (6) with respect to E results i I.S., Sokolikoff, R.M. Redheffer, Mathematics of Physics ad Moder Egieerig, McGraw-Hill Book, 966 May 004 004 J.A. Crawford

J.A. Crawford U048 Water Fillig o Multiple Gaussia Chaels.doc Λ B (7) = 0 λ = E l() E + from which we obtai the requiremet that B (8) l() E + = λ for ay (positive) FKRLFH RI FRQVWDQW for all which meas that E + = µ a costat for all thereby providig us the classical water fillig criteria for maximizig the system capacity. Sice it is ot possible to have a egative value for E, the miimum allowable value for µ is the maximum value of the. Substitutig this result ito the capacity formula, we fid that (9) µ µ C = B log + B log = = = Parallel Gaussia BPSK Chaels ow assume that we have parallel Gaussia chaels each supportig ucoded BPSK, ad we wish to miimize the overall average bit error rate (BER) subject to the same total power costrait as used above. he average BER is give by E (0) BER = erfc = ad the total power costrait is give agai by () = E = E Employig the Lagrage multiplier method, the objective fuctio that we seek the extremum values for is give by E () Λ = erfc λ E E = + = Differetiatig () with respect to E ad settig the derivatives to zero results i the criteria that May 004 004 J.A. Crawford

J.A. Crawford U048 Water Fillig o Multiple Gaussia Chaels.doc 3 (3) λ = E exp π E which is obviously a trascedetal equatio i E which must be satisfied for all give a costat SDUDPHWHU his equatio ca be rearraged to give E i terms of the other parameters as E + l E = l λ π (4) ( ) A o-trascedetal result ca be obtaied if we use the Cheroff boud expressio for BER rather tha the exact form. I this case, the objective fuctio ivolved is give by E (5) Λ = exp E + λ E = = Upo takig derivatives of (5) ad settig them to zero, the relatioship for extremum values that results is give by (6) E = l( λ) It is iterestig to compare the results for E usig the exact result foud by solvig (3) ad the o-trascedetal result provided by (6). A example case is show i the Mathcad worksheet that follows. U0333 Miimize Ave BER o Parallel Faded Chaels.mcd May 004 004 J.A. Crawford

J.A. Crawford U0333 Miimize Ave BER o Parallel Faded Chaels.mcd Miimizig BER for Parallel Gaussia BPSK Chaels := 5 umber of parallel chaels := 0.. var0 := (..0 0.75 0.6 0.3 0. 0.5 0.5 0.5.0 3.0 5.0.0 0.5 0.03 ) var := var0 var := var0 var E := 0.3 Give λ e E var var π E 05 = 0 CompE λ, var ( ) Fid E CompE( 0.5, 0.) = 0.0 := ( ) Solutio for Idividual chael eergy usig rigorous derivatio from Lagrage multiplier March 004 Copyright 004 J.A. Crawford

J.A. Crawford U0333 Miimize Ave BER o Parallel Faded Chaels.mcd λ := 0.00000 E := CompE( λ, var ) E = 3.636 AvSR db 0 log E := var E BER := erfc BER =.9 0 4 var E E = 3.636 0 log = 9.6 var Rigorous BER Optimizatio 0 AvSR db = 9.74 5 SR (db), E (db) 0 5 0 λ := 0.0000 ( ) E := var l λ var 5 0 4 6 8 0 4 Parallel Chael umber SR E E = 0 3 4 5 6 7 8 9 0 4.53 7.867 6.09 4.99.678 0.99.7.7.7 4.53 E ( E ) =.7 0 3 0 log = 9.68 var March 004 Copyright 004 J.A. Crawford

J.A. Crawford U0333 Miimize Ave BER o Parallel Faded Chaels.mcd 3 E Loadig 0.5 SR (db), E (db) 0 9.5 9 8.5 0 4 6 8 0 4 Parallel Chael umber Rigorously Accuracy BER Upper Boud del := 0 log E var 0 log E var 0.04 Differece Betwee Exact & Approx 0.0 0 Differece, db 0.0 0.04 0.06 0.08 0 4 6 8 0 4 Chael March 004 Copyright 004 J.A. Crawford

Advaced Phase-Lock echiques James A. Crawford 008 Artech House 50 pages, 480 figures, 00 equatios CD-ROM with all MALAB scripts ISB-3: 978--59693-40-4 ISB-0: -59693-40-X Chapter Brief Descriptio Pages Phase-Locked Systems A High-Level Perspective 6 A expasive, multi-disciplied view of the PLL, its history, ad its wide applicatio. Desig otes 44 A compilatio of desig otes ad formulas that are developed i details separately i the text. Icludes a exhaustive list of closed-form results for the classic type- PLL, may of which have ot bee published before. 3 Fudametal Limits 38 A detailed discussio of the may fudametal limits that PLL desigers may have to be attetive to or else ever achieve their lofty performace objectives, e.g., Paley-Wieer Criterio, Poisso Sum, ime-badwidth Product. 4 oise i PLL-Based Systems 66 A extesive look at oise, its sources, ad its modelig i PLL systems. Icludes special attetio to /f oise, ad the creatio of custom oise sources that exhibit specific power spectral desities. 5 System Performace 48 A detailed look at phase oise ad clock-jitter, ad their effects o system performace. Attetio give to trasmitters, receivers, ad specific sigalig waveforms like OFDM, M- QAM, M-PSK. Relatioships betwee EVM ad image suppressio are preseted for the first time. he effect of phase oise o chael capacity ad chael cutoff rate are also developed. 6 Fudametal Cocepts for Cotiuous-ime Systems 7 A thorough examiatio of the classical cotiuous-time PLL up through 4 th -order. he powerful Haggai costat phase-margi architecture is preseted alog with the type-3 PLL. Pseudo-cotiuous PLL systems (the most commo PLL type i use today) are examied rigorously. rasiet respose calculatio methods, 9 i total, are discussed i detail. 7 Fudametal Cocepts for Sampled-Data Cotrol Systems 3 A thorough discussio of samplig effects i cotiuous-time systems is developed i terms of the z-trasform, ad closed-form results give through 4 th -order. 8 Fractioal- Frequecy Sythesizers 54 A historic look at the fractioal- frequecy sythesis method based o the U.S. patet record is first preseted, followed by a thorough treatmet of the cocept based o -Σ methods. 9 Oscillators 6 A exhaustive look at oscillator fudametals, cofiguratios, ad their use i PLL systems. 0 Clock ad Data Recovery Bit sychroizatio ad clock recovery are developed i rigorous terms ad compared to the theoretical performace attaiable as dictated by the Cramer-Rao boud. 5