Low Complexity Soft-Input Soft-Output Hamming Decoder
|
|
- Hugh Norman
- 6 years ago
- Views:
Transcription
1 Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg 85, Hamburg, Germany Abstract We nvestgate a low complexty Soft-Input Soft-Output (SISO) Hammng Der. The Decodng s based on error patterns whch belong to the same syndrome. It s shown that t s suffcent to nvestgate error patterns wth one and two errors to gan up to 1.35 db compared to hard decson decodng. The proposed decodng algorthm has a lnearly rsng complexty, O(N c), wth the word length N c. The further consderaton of error patterns wth three errors whch belong to the determned syndrome gan further 0.2 db and mproves the qualty of the soft-output due to the ncreased number of comparsons wth vald words. However, ths also ncreases the complexty of the decodng process to O(N 2 c ). We present smulaton results for soft decodng of Hammng s up to a word length of 63 bt. Furthermore, we present results for turbo decodng wth the 63, 57-Hammng as a component. Index Terms Syndrome based soft decodng, Hammng Code, low complexty, soft-output, turbo decodng I. INTRODUCTION The decodng algorthms of Hammng-s were nvestgated n several papers. The exhaustve maxmum lkelhood decodng of a (63, 57)-Hammng would requre the comparson of 2 57 vald words. Chase reduced the complexty by checkng a fxed number of the error patterns wth a slght performance degradaton [1]. A further reducton of consdered error patterns was obtaned n [2]. Based on ths approach we show that the group of error patterns can be reduced to sngle and double errors to gan up to 1.35 db compared to hard decson decodng (HDD). In contrasts to the proposed decodng technque there are Trells-based decodng algorthms [3] [4] whch have a quadratc complexty O(N 2 c ) for Hammng and Reed-Muller s. A further dfferent approach was consdered n [5], whch s based on systematc bt-flppng. In [6] MAP decodng s performed based on Hadamard transforms, whch leads to a complexty of O(N c ldn c ). One of the here proposed decodng algorthms can acheve a lnear complexty wth a performance degradaton of 0.2 db compared to maxmum lkelhood decodng. For a (63, 57)-Hammng, only 32 vald words have to be compared n terms of ther soft nformaton whch s equvalent to a lnear complexty O(N c ), wth the word length N c. In addton, the proposed soft-output decodng makes the algorthm sutable for further applcatons lke turbo decodng. II. ENCODING AND TRANSMISSION The encodng of the message bts a can be performed by a modulo 2 vector matrx multplcaton of a and the generator matrx G c a G (1) The expresson s equvalent wth c = (a G) mod 2. The generator matrx of systematc 7, 4-Hammng s gven by G = (2) } {{ } I } {{ } P c s modulated, so that a logcal zero s equvalent to a +1 and a logcal one s equvalent to a 1, x {+1, 1}. The modulated sgnal x s dstorted by the addtve whte Gaussan nose (AWGN) w and results n the receve sgnal y, y = x + w. (3) III. HARD DECISION DECODING For hard decson decodng (HDD) t s requred to derve the bt sequence c from the dstorted sgnal y. The syndrome z can be calculated as follows z c H T (c + e) H T, (4) where H s the party check matrx and e s the error pattern belongng to the syndrome. In ths manner, every syndrome leads to exactly one sngle error pattern and the decodng can be performed based on a syndrome table. If the error pattern s 0, the syndrome s also 0 whch means that the receved word s a vald word and no decodng s requred. Error patterns wth 2 (duets) or 3 errors (trplets) whch belong to the same syndrome are not taken nto account for the decodng and the dstorted word c s corrected to
2 ĉ c + e. (5) In fact, every double error s ded to a vald but wrong word. Ths explans the poor performance of HDD for Hammng s, whch are llustrated n Fg. 2, 3, 4 and 5 for the dfferent word lengths. IV. SYNDROME BASED SOFT DECISION DECODING For the syndrome based soft decson decodng t s requred to calculate the log-lkelhood ratos (LLR or L-values) from the receved sgnal y, whch fnally leads to L (x y) = ln ( exp L (x y) = ln exp P (x = +1 y) P (x = 1 y), (6) E b (y 1) 2) ( E b (y + 1) 2) = 4E b y, (7) assumng that a logcal zero and one have the same probablty [7]. Let us assume that the syndrome of a dstorted bt sequence of a 7, 4-Hammng s z = (0 0 1). The possble error patterns are collected n matrx E wth ts elements e j, E = , (8) where the second to fourth row bears the duets and the ffth to eghth row bears the trplets. The error patterns for all syndromes are determned n advance and stored n a lst. The sze of the lst rses quadratcally for double errors and cubcally for trple errors (see Tab. I). Every row of E s multpled by the absolute value of log-lkelhood ratos of the receved sgnal L (x y). Afterwards, the resultng row vector s added up. The vector wth the lowest sum of L-values suggests the error pattern wth the hghest probablty of a correct decodng. For the 7, 4-Hammng N e1 + N e2 = 4 error patterns have to be multpled by L (x y) to cover sngle and double errors. If t s requred to take trplets nto account, N e3 = 4 more error patterns have to be multpled by L (x y). In order to estmate the complexty, the number of duets belongng to one syndrome s gven by N e2 = 1 N c! N c (N c 2)! 2! = N c 1, (9) 2 wth N c beng the length of the word. The number of trplets can be calculated smlarly by N e3 = 1 ( N c! N c (N c 3)! 3! N ) e2 = N c 1 Nc (10) Eq. 9 and 10 show that the complexty rses lnearly for the duets and quadratcally for the trplets. Table I shows the number of duets N e2 and trplets N e3 belongng to one syndrome. TABLE I NUM OF DUETS N e2 AND TRIPLETS N e3 BELONGING TO ONE SYNDROME, SIZE OF ERROR PATTERN LISTS FOR ALL SYNDROMES N c N e2 Lst sze N e3 Lst sze V. SOFT-OUTPUT DECODING In general, soft-output decodng provdes output values for teratve or turbo decodng. In order to generate soft-outputs, the followng algorthm s proposed. The probablty values of a word are gven by P ( c j = c j y j ) = exp ( L (x j y j ) ) 1 + exp ( L (x j y j ) ). (11) In the next step, the probablty values are multpled columnwse for the gven error pattern of every row. P = j { P ( cj = c j y j ) f e,j = 0 1 P ( c j = c j y j ) f e,j = 1 (12) Now P s normalzed, so that the sum of the normalzed probabltes P over all rows s equal to 1, P = 1. The normalzed probabltes P are gven by P P = P. (13) P can be nterpreted as the probablty of correct decodng for the gven error pattern of row. In a last step, the probablty that x j = +1, for a gven receved word y, s calculated by the sum of P over all rows, f e,j = c j, where c j s defned as the logcal receved bt sequence. ˆ ndcates the estmaton of the new probabltes after the soft decodng. ˆP (x j = +1 y) = e,j= c j P (14) Due to the normalzaton, so that P = 1, the probablty of ˆP (x j = 1 y) can be calculated by ˆP (x j = 1 y) = 1 ˆP (x j = +1 y). (15) In order to exchange the nformaton for turbo decodng t s requred to calculate L-values from the derved probabltes.
3 VI. TURBO DECODING Wth the ablty of soft-output decodng, we can utlze the soft-outputs for turbo decodng. In order to do so, the systematc data bts have to be end twce. The frst encodng can be performed as shown n Eq. 1. The second encodng requres an addtonal nterleaver pror to the encodng. We only nvestgate an nterleaver of the length of the systematc bts of one word. The nterleaved data bts are bt reverse to the unnterleaved data bts. Ths short nterleaver enables smlar delays as for the orgnal length. Fnally the unnterleaved and the party bts of the frst enr and the second enr are multplexed to the word whch s transmtted. Fg. 1 shows the schematc structure of a turbo der. The receved word y s separated nto systematc bts and the party bts of the frst enr and the party bts of the second enr. Based on the soft-nput the enrs calculate soft-outputs as descrbed n secton V. The enr output, subtracted by ther soft-nput, result n the extrnsc nformaton of the decodng process. Ths extrnsc nformaton s drected to the other enr and s added to the soft nformaton of the receved systematc bts. TABLE II SIMULATION RESULTS FOR REQUIRED E b / IN db FOR A BIT ERROR RATE OF AND THE RESULTING CODING GAIN (UNCODED 8.37 db FOR = ) N c K c HDD Gan Duets Gan Trplets Gan (7,4) HDD (7,4) duets (7,4) trplets unon bound y Demux Party 1 Party 2 Int. Fg. 1. Systematc Int. Der 1 Der Schematcs of turbo decodng VII. SIMULATION RESULTS Dent. Ded systematc Fg. 2. Bt error rate for dfferent types of decodng for a 7, 4-Hammng The extenson of the word length, up to 15 bt, results n a further performance gan. It s also apparent that the dfference between duet decodng and trplet decodng rses. The codng gan amounts to 0.95 db for the HDD and 2.23 db for the duet decodng. Further 0.1 db can be ganed by trplet decodng. (15,11) HDD (15,11) duets (15,11) trplets unon bound For the smulaton results Hammng s of a word length for 7 tll 63 bt were nvestgated. Fg. 2, 3, 4 and 5 llustrate the performance of the dfferent decodng strateges for a certan word length. Tab. II summarzes the results for all non-teratve s. Fg. 2 shows the bt error rate of the 7, 4-Hammng for dfferent types of decodng. It s shown that the decodng performance of the duet and trplet decodng s qute smlar and very close to the unon bound whch s an upper bound for the bt error probablty after maxmum lkelhood decodng. For the evaluaton we focus on a =. The codng gan amounts to 0.31 db for the HDD and 1.66 db for the duet decodng. Fg. 3. Bt error rate for dfferent types of decodng for a 15, 11-Hammng The 32, 26-Hammng obtaned the best results for the non-teratve s, for duets as well as for trplets. Fg. 4 shows that the codng gan amounts to 2.35 db for the duet decodng and 2.49 db for the trplet decodng.
4 (31,26) HDD (31,26) duets (31,26) trplets unon bound process. In addton, the assumpton of a normalzaton for P = 1 can lead to naccurate soft-outputs. Fg. 4. Bt error rate for dfferent types of decodng for a 31, 26-Hammng Qute a smlar pcture can be drawn for the 63, 57-Hammng whch has the hghest rate (R c = 0.905) of the consdered Hammng s (see Fg. 5). The codng gan s lower than for the 32, 26-Hammng (2.26 db gan for the duet and 2.45 db gan for the trplets), but the bt error curve falls more sharply. It s also shown that the dfference between duet and trplet decodng s the hghest wth 0.19 db. Fg. 5. (63,57) HDD (63,57) duets (63,57) trplets unon bound [8] Bt error rate for dfferent types of decodng for a 63, 57-Hammng Fg. 6 shows the smulaton results of the bt error rate of turbo decodng wth the 63, 57-Hammng as a component. The soft-outputs for the turbo decodng were calculated as shown n secton V for double and trple errors. The turbo der consderng sngle error, duets and trplets performs 0.36 db better than the non-teratve trplet der. Turbo decodng only consderng sngle and double errors leads to no further gan compared to non-teratve duet or trplet decodng. In fact, the codng gan decreases by 0.5 db compared to non-teratve duet decodng. Ths can be explaned wth the small numbers of comparson wth other vald words whch lead to an naccurate soft-output after the decodng (63,57) duets (63,57) trplets (69,57) Turbo duets (69,57) Turbo trplets Fg. 6. Comparson of non-teratve decodng and turbo decodng for duet and trplet decodng VIII. CONCLUSION We have proposed a soft-nput Hammng der whch ether consders error patterns wth up to 2 or up to 3 errors belongng to the determned syndrome. The complexty of duet decodng rses lnearly wth the word length and quadratcally for trplet decodng. The duet decodng can gan up to 1.35 db compared to hard decson decodng (= ). Consderng error patterns up to 3 errors gans further 0.2 db, where the gan for trplet decodng ncreases wth the word length. Furthermore, we proposed a soft-output der based on the soft-nput Hammng der. The soft-outputs where utlzed for turbo decodng. It was shown that duet decodng s unsutable for turbo decodng, due to the poor qualty of the soft-outputs. The turbo decodng based on trplet decodng (69, 57-Hammng ) showed a performance gan of 0.36 db compared to the trplet decodng of the 63, 57-Hammng. These results were obtaned wth the smallest possble nterleaver of one data word length. REFERENCES [1] D. Chase, Class of algorthms for decodng block s wth channel measurement nformaton, Informaton Theory, IEEE Transactons on, vol. 18, no. 1, pp , Jan [2] J. Snyders, Reduced lsts of error patterns for maxmum lkelhood soft decodng, Informaton Theory, IEEE Transactons on, vol. 37, no. 4, pp , July [3] J. Wolf, Effcent maxmum lkelhood decodng of lnear block s usng a trells, Informaton Theory, IEEE Transactons on, vol. 24, no. 1, pp , Jan [4] T. Kasam, T. Takata, T. Fujwara, and S. Ln, On the optmum bt orders wth respect to the state complexty of trells dagrams for bnary lnear s, Informaton Theory, IEEE Transactons on, vol. 39, no. 1, pp , Jan [5] Smon Hrst and Bahram Honary, A smple soft-nput/soft-output der for hammng s, n Proceedngs of the 8th IMA Internatonal Conference on Cryptography and Codng, London, UK, 2001, pp , Sprnger-Verlag.
5 [6] A. Ashkhmn and S. Ltsyn, Smple MAP decodng of frst-order Reed- Muller and Hammng s, Informaton Theory, IEEE Transactons on, vol. 50, no. 8, pp , [7] L. Hanzo, T. Lew, and B. Yeap, Turbo codng, turbo equalsaton and space-tme codng, Wley, [8] Marco Bald, Govann Canceller, and Franco Charaluce, Low complexty soft-decson decodng of BCH and RS s based on belef propagaton, n Runone Annuale GTTI 2008 Sessone su Trasmssone Numerca, 2008.
Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations
Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationDC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms
Proceedngs of the 5th WSEAS Internatonal Conference on Telecommuncatons and Informatcs, Istanbul, Turkey, May 27-29, 26 (pp192-197 DC-Free Turbo Codng Scheme Usng MAP/SOVA Algorthms Prof. Dr. M. Amr Mokhtar
More informationDecoding of the Triple-Error-Correcting Binary Quadratic Residue Codes
Automatc Control and Informaton Scences, 04, Vol., No., 7- Avalable onlne at http://pubs.scepub.com/acs/// Scence and Educaton Publshng DOI:0.69/acs--- Decodng of the rple-error-correctng Bnary Quadratc
More informationLecture 3: Shannon s Theorem
CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts
More informationError Probability for M Signals
Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal
More informationConsider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.
PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n
More informationPop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing
Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationChapter 7 Channel Capacity and Coding
Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationIterative Multiuser Receiver Utilizing Soft Decoding Information
teratve Multuser Recever Utlzng Soft Decodng nformaton Kmmo Kettunen and Tmo Laaso Helsn Unversty of Technology Laboratory of Telecommuncatons Technology emal: Kmmo.Kettunen@hut.f, Tmo.Laaso@hut.f Abstract
More informationChapter 7 Channel Capacity and Coding
Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationPulse Coded Modulation
Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationThe Synchronous 8th-Order Differential Attack on 12 Rounds of the Block Cipher HyRAL
The Synchronous 8th-Order Dfferental Attack on 12 Rounds of the Block Cpher HyRAL Yasutaka Igarash, Sej Fukushma, and Tomohro Hachno Kagoshma Unversty, Kagoshma, Japan Emal: {garash, fukushma, hachno}@eee.kagoshma-u.ac.jp
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationHigh-Speed Decoding of the Binary Golay Code
Hgh-Speed Decodng of the Bnary Golay Code H. P. Lee *1, C. H. Chang 1, S. I. Chu 2 1 Department of Computer Scence and Informaton Engneerng, Fortune Insttute of Technology, Kaohsung 83160, Tawan *hpl@fotech.edu.tw
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationS Advanced Digital Communication (4 cr) Targets today
S.72-3320 Advanced Dtal Communcaton (4 cr) Convolutonal Codes Tarets today Why to apply convolutonal codn? Defnn convolutonal codes Practcal encodn crcuts Defnn qualty of convolutonal codes Decodn prncples
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationSISO Algorithms for the Nordstrom-Robinson code
SISO Algorthms for the Nordstrom-Robnson code Yannck Saouter, LABSTICC, Brest, France. Insttut Mnes-Télécom 04, August 8th ISTC 04, Bremen, Germany. An hstorcal note Robnson noted, for bnary codes of length
More informationSpeeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem
H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence
More informationMemory ecient adaptation of vector quantizers to time-varying channels
Sgnal Processng 83 (3) 59 58 www.elsever.com/locate/sgpro Memory ecent adaptaton of vector quantzers to tme-varyng channels orbert Gortz a;,jorg Klewer b a Insttute for Communcatons Engneerng (LT), Munch
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationOn the correction of the h-index for career length
1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat
More informationLecture 5 Decoding Binary BCH Codes
Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture
More informationFinite Length Weight Enumerator Analysis of Braided Convolutional Codes
Fnte Length Weght Enumerator Analyss of Braded Convolutonal Codes Saeedeh Moloud, Mchael Lentmaer, and Alexandre Graell Amat Department of Electrcal and Informaton Technology, Lund Unversty, Lund, Sweden
More informationEfficient Algorithm for Detecting Layered Space-Time Codes
4TH INTERNATIONAL ITG CONFERENCE ON SOURCE AND CHANNEL CODING, BERLIN, JANUARY 2002 1 Effcent Algorthm for Detectng Layered Space-Tme Codes D. Wübben, J. Rnas, R. Böhnke, V. Kühn and K.D. Kammeyer Department
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationEGR 544 Communication Theory
EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources
More informationCHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER. In real environmental conditions the speech signal may be
55 CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER 4.1 Introducton In real envronmental condtons the speech sgnal may be supermposed by the envronmental nterference. In general, the spectrum
More informationIntroduction to Information Theory, Data Compression,
Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures
More informationECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006)
ECE 534: Elements of Informaton Theory Solutons to Mdterm Eam (Sprng 6) Problem [ pts.] A dscrete memoryless source has an alphabet of three letters,, =,, 3, wth probabltes.4,.4, and., respectvely. (a)
More informationIntroduction to information theory and data compression
Introducton to nformaton theory and data compresson Adel Magra, Emma Gouné, Irène Woo March 8, 207 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on March 9th 207 for a Data Structures
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationTornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003
Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationA Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach
A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland
More informationMULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN
MULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN S. Chtwong, S. Wtthayapradt, S. Intajag, and F. Cheevasuvt Faculty of Engneerng, Kng Mongkut s Insttute of Technology
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationAttacks on RSA The Rabin Cryptosystem Semantic Security of RSA Cryptology, Tuesday, February 27th, 2007 Nils Andersen. Complexity Theoretic Reduction
Attacks on RSA The Rabn Cryptosystem Semantc Securty of RSA Cryptology, Tuesday, February 27th, 2007 Nls Andersen Square Roots modulo n Complexty Theoretc Reducton Factorng Algorthms Pollard s p 1 Pollard
More informationAverage Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1
Average Decson hreshold of CA CFAR and excson CFAR Detectors n the Presence of Strong Pulse Jammng Ivan G. Garvanov and Chrsto A. Kabachev Insttute of Informaton echnologes Bulgaran Academy of Scences
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationLecture 4: November 17, Part 1 Single Buffer Management
Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input
More informationHomework Assignment 3 Due in class, Thursday October 15
Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.
More informationTHE SUMMATION NOTATION Ʃ
Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the
More informationThe Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD
he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationSampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING
Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationUsing the estimated penetrances to determine the range of the underlying genetic model in casecontrol
Georgetown Unversty From the SelectedWorks of Mark J Meyer 8 Usng the estmated penetrances to determne the range of the underlyng genetc model n casecontrol desgn Mark J Meyer Neal Jeffres Gang Zheng Avalable
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationNotes on Frequency Estimation in Data Streams
Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to
More informationSecret Communication using Artificial Noise
Secret Communcaton usng Artfcal Nose Roht Neg, Satashu Goel C Department, Carnege Mellon Unversty, PA 151, USA {neg,satashug}@ece.cmu.edu Abstract The problem of secret communcaton between two nodes over
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationA new construction of 3-separable matrices via an improved decoding of Macula s construction
Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationSuppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl
RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationPower Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization
Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty
More informationClassification as a Regression Problem
Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class
More informationA Comparison between Weight Spectrum of Different Convolutional Code Types
A Comparson between Weght Spectrum of fferent Convolutonal Code Types Baltă Hora, Kovac Mara Abstract: In ths paper we present the non-recursve systematc, recursve systematc and non-recursve non-systematc
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationRegularized Discriminant Analysis for Face Recognition
1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths
More informationDepartment of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification
Desgn Project Specfcaton Medan Flter Department of Electrcal & Electronc Engneeng Imperal College London E4.20 Dgtal IC Desgn Medan Flter Project Specfcaton A medan flter s used to remove nose from a sampled
More informationLecture 12: Classification
Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationInductance Calculation for Conductors of Arbitrary Shape
CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors
More informationLearning from Data 1 Naive Bayes
Learnng from Data 1 Nave Bayes Davd Barber dbarber@anc.ed.ac.uk course page : http://anc.ed.ac.uk/ dbarber/lfd1/lfd1.html c Davd Barber 2001, 2002 1 Learnng from Data 1 : c Davd Barber 2001,2002 2 1 Why
More informationA NEW DISCRETE WAVELET TRANSFORM
A NEW DISCRETE WAVELET TRANSFORM ALEXANDRU ISAR, DORINA ISAR Keywords: Dscrete wavelet, Best energy concentraton, Low SNR sgnals The Dscrete Wavelet Transform (DWT) has two parameters: the mother of wavelets
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationEnsemble Methods: Boosting
Ensemble Methods: Boostng Ncholas Ruozz Unversty of Texas at Dallas Based on the sldes of Vbhav Gogate and Rob Schapre Last Tme Varance reducton va baggng Generate new tranng data sets by samplng wth replacement
More informationChannel Encoder. Channel. Figure 7.1: Communication system
Chapter 7 Processes The model of a communcaton system that we have been developng s shown n Fgure 7.. Ths model s also useful for some computaton systems. The source s assumed to emt a stream of symbols.
More informationMAXIMUM A POSTERIORI TRANSDUCTION
MAXIMUM A POSTERIORI TRANSDUCTION LI-WEI WANG, JU-FU FENG School of Mathematcal Scences, Peng Unversty, Bejng, 0087, Chna Center for Informaton Scences, Peng Unversty, Bejng, 0087, Chna E-MIAL: {wanglw,
More informationIdentification of Linear Partial Difference Equations with Constant Coefficients
J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents
More informationLecture Nov
Lecture 18 Nov 07 2008 Revew Clusterng Groupng smlar obects nto clusters Herarchcal clusterng Agglomeratve approach (HAC: teratvely merge smlar clusters Dfferent lnkage algorthms for computng dstances
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationParameter Estimation for Dynamic System using Unscented Kalman filter
Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,
More information