Channel Capacity Course - Information Theory - Tetsuo Asano and Tad matsumoto {t-asano,
|
|
- Brett Gregory
- 6 years ago
- Views:
Transcription
1 School of Iformato Scc Chal Capacty Cours - Iformato Thory - Ttsuo Asao ad Tad matsumoto Emal: {t-asao matumoto}@jast.ac.jp Japa Advacd Isttut of Scc ad Tchology Asahda - Nom Ishkawa 93-9 Japa I th last Chaptrs w lard.. School of Iformato Scc Iformato Sourc + Ecodr Tx Rx Dcodr Dstato Nos ow to ffctvly cod th sourc wth th kowldg of sourc apparac probablty. hat th thortcal asymptotc proprts of th sourc codg tchqus ar wth th kowldg of th probablty.
2 School of Iformato Scc I ths Chaptrs w lar.. Commucato systms us chal as mdum for formato trasfr. - Th qusto arss that what s th maxmum capablty of th chal. - ow ca th commucato systms us th chal s capablty. - hat ar thortcal asymptotc proprts of th chal codg tchqus for rror protcto gv th kowldg of th chal charactrstcs. skp th trasmttr ad rcvr!!!! Assumptos: Chal Ecodr + Chal Dcodr Bary/No-bary ft alphabt Nos Error sourc Th trasmttr ad rcvrs ar gord Chal output s drctly coctd to th chal dcodr. Th both chal codr output ad os tak form of bary or o-bary ft alphabt. Not: Thos assumptos ar to b lmatd th xt Chaptr. Outl School of Iformato Scc. Chal Capacty - Dfto - Som Exampls - Som Proprts. Radom Codg 3. Chal Codg Thorm - Proof for Suffccy 4. Fao s Iqualty for Extso - Proof for Ncssty
3 Chal Modl: Rvw School of Iformato Scc Chal Ecodr + Chal Dcodr Bary/No-bary ft alphabt Nos Error sourc Chal put squc: 0. Ft Alphabt: {x x x 3. x q }whr q s th alphabt sz. Chal output squc: 0. Ft Alphabt: {y y y 3. y r }whr r s th alphabt sz. Lt th codtoal jot probablty of 0 y 0 y - y - codtod upo 0 x 0 x - x - b dotd as P y y... y x x x Chal Capacty Dfto 8..0: Chal Matrx School of Iformato Scc Th chal matrx T{t j } s gv as a matrx of whch try s dfd as th probablty that th trasmttd symbol x s rcvd as y j as: y t y t M M yr tr y Tx t t t r L O L t q x t q x M M t r q xq x x M x q... T { t j }... y y M y r Dfto 8..: Chal Capacty Th formato chal capacty C of mmory-lss chal s dfd as: C max { I ; p x whr th maxmzato s tak ovr all possbl put dstrbutos px.
4 School of Iformato Scc Chal Capacty Exampl: Bary Symmtrc Chal -q 0 0 q q -q I ; x 0 p x x p x q q q x 0 whr th qualty holds f th put dstrbuto s uform. Thrfor w ca coclud that C q bts. Exampl: Bary Erasur Chal -α 0 0 α α Erasur Rx ca ot dcd - α Chal Capacty 3 School of Iformato Scc Df th rasur vt by E. Sc th probablts of o-rror ad rasur vts ar dstctv Dot that Prπ E E + E π α π α + πα π α π α α π α α + α π c C max { α max { α π + α α α wth π /. p x π
5 School of Iformato Scc Chal Capacty 4 Exampl: Nosy Chal wth o Ovrlappg Outputs 0 -α - β 3 β 4 I ; p y y y α Ths s bcaus th rcvr ca dtfy whch of 0 or was trasmttd oly by lookg at th rcvd symbol. Sc th trasmttd symbols ar bary. wth PrPr0/. C max I ; max bt 0 Exrcs: Nosy Typ rtr Chal Capacty 5 School of Iformato Scc A B C D / / / / / / A B C D Calculat th capacty of ths osy typ wrtr assumg that all charactrs A-Z appars wth qual probablty. / Z / / / Z
6 School of Iformato Scc Chal Capacty 6 Dfto 8..: Symmtrc Chal Th chal s calld symmtrc f th rows of th chal trasto matrx ar prmutato of ach othr ad so ar th colums. Exampl: A chal havg th followg trasto matrx s symmtrc p y x Ths chal has th capacty: I ; r log r whr r s a row of th chal trasto matrx. Th qualty holds f th output dstrbuto s uform. owvr f px s uform p y p y x p x p y x ad hc py s also uform. x x Chal Capacty 7 School of Iformato Scc Proprty 8..: Th chal capacty s o gatv.. C 0 bcaus C max I ; I ; 0 C log bcaus C max I ; max log 3 C log bcaus C max I ; max log 4 I ; s a cotuous ad cocav fucto of px. S Thorm 4.3.4
7 School of Iformato Scc Chal Capacty 8 Burst Error Chal: Sc thr s o chac that w chag Error th apparac probablty of th alphabt Sourc from thsourc capacty s: C-E E Errors whr E E{p:ProbEp} + Iput wth x-xlog Output x--xlog -x. Mmory Chal Statoary Stat Probablts: p 0 ad p 0/0.9 /0. /0.8 S 0 S 0/0. Etropy of th Error Sourc: p0 0.9 p p 0.8 p 0 wth p 0 + p p 0 /3 ad p /3 E/3 0. +/3 0.8 / / Capacty: C-E bts/symbol Chal Capacty 9 School of Iformato Scc Bt Error Rat: P b 0. p p /3 Mmory-lss Chal P b /3 Capacty: C-E-/ bts/symbol Capacty wth Mmory Chal >>> Capacty wth Mmory-lss Chal Fadg chal wthout Itrlavg: Mmory Chal Itrlavd chals: Mmory-lss Chal
8 School of Iformato Scc Chal Codg Thorm: Prparato Assum that a mssag to b trasmttd ovr th chal s draw from th dx st { M}.. ach mssag s dxd by a umbr from ths st. Th followg summarzs how th commucato systm w aalyz works: Th mssag s th codd to a lgth block of symbols x x x. Th codd mssag s dotd as. Th trasmttd mssag x x x suffrs from os th chal ad rcvd as a radom squc y y y by th rcvr. 3 Th chal has ts trasto matrx as dscrbd by a codtoal probablty py x py y y x x x. 4 Th rcvr ams to rtrv th trasmttd mssag by a stmato rul g. ˆ whr g. 5 Th rcvr maks a rror f ˆ. Dfto 8..: Commucato Systm Th commucato systm that follows th rul dscrbd abov s dotd as: p y x Obvously accordg to ths dfto th chal s th -th xtso of th mmory-lss chal p y x. School of Iformato Scc Chal Codg Thorm: Prparato Dfto 8..: Mmory-lss Chal Th chal accordg to Dfto 8.. s mmory-lss f k k p yk x y p yk xk k L Th trasto fucto for th mmory-lss chal rducs to: p y x p y x Dfto 8..3: Chal Cod A M cod s dfd for th chal p y x whr M s th umbr of th mssags to b trasmttd ad s th lgth of th codd squc. Th Rols of th codr ad dcodr ar dfd as follows: Ecodr maps th M mssags to thr corrspodg squcs. M. Th st of th cod words s calld cod book. Th dcodr fucto g. maps th rcvd squc of radom varabl o to th most lkly mssag stmat g L M. { }
9 School of Iformato Scc Chal Codg Thorm: Prparato 3 Dfto 8..3: Probablty of Error Th codtoal probablty λ gv th mssag dxd by has b trasmttd s gv by: λ Pr{ g } p y x I g y y whr I. s th dcator fucto whch taks valu f th argumt s satsfd ad othrws t taks valu 0. Dfto 8..4: Maxmal Probablty of Error Th maxmal rror probablty λ for a M cod s dfd as: λ max λ { { L M } Dfto 8..5: Avrag Probablty of Error Th avrag rror probablty P for a M cod s dfd as: P M M λ School of Iformato Scc Chal Codg Thorm: Prparato 4 Proprty 8..: Avrag Probablty of Error Th followg proprts hold: P P Pr g λ f th mssag trasmttd s chos uformly from th st. Dfto 8..6: Cod Rat Th rat R of a M cod s dfd as: R log M
10 Radom Codg School of Iformato Scc Cosdr R cod. Grat a cod at radom accordg to th probablty dstrbuto px of th symbols x. Sc thr ar R cod words radomly slctd from th codbook C whch s dotd as: x C M R x x x M R L O L x M R x whr th argumt of. dcats th cod word dx ad th subscrpt dcats th symbol dx. Sc th apparac of th symbols s dpdt p x p R { x w } for w... Sc ach cod word s gratd radomly ths codbook C tslf s radom varabl. Th probablty of gratg a partcular cod word s gv by: PrC R w p x w Radom Codg School of Iformato Scc Th cod C s kow to th both trasmttr ad rcvr. Thy ar assumd to also kow th chal trasto matrx py x. A mssag s chos qu-probably. Thrfor R R Pr w w... Assum that th w-th cod word w corrspodg to th w-th row of C s trasmttd. A squc rcvd by th rcvr dotd as follows th dstrbuto: P y x w p ˆ arg max P y w { y x w } Th rcvr gusss whch of th R squcs s most lkly to hav b st by comparg th codtoal probablts of th possbl cod words ad slcts th o satsfyg: If ˆ thr s a dcodg rror. x w Th codbook C s updatd at vry trasmsso tmg. Thrfor ths tchqu s calld radom codg.
11 Chal Codg Thorm Thorm 8.3.: Chal Codg Thorm School of Iformato Scc Thr xsts a R rat R cod such that th maxmum rror probablty λ ca b mad arbtrarly small f th cod rat s lowr tha th capacty R<C. Covrsly ay R rat R cod that ca achv arbtrarly small λ must satsfy R<C. Proof of : Th proof uss th proprts of radom codg. Th dtald proof s far byod th xpctd lvl of ths cours ad thrfor a proof outl s dscrbd stad blow: Bfor rcvr rcvs y t has th oly kowldg that thr ar radomly slctd squcs to b st from th trasmttr. Th rcvr rcvs y. Rcvr crass kowldg about th cod word x by rcvg th squc y. owvr stll thr rmas ucrtaty whch s avragd ovr all possbl cod words. Th avragd ucrtaty s xprssd by th codtoal tropy. Chal Codg Thorm School of Iformato Scc Proof of Cotud: R Cod ords Possbl Squcs w Iput to th Chal Possbl squcs Output from th Chal Possbl Squcs y Ths mas that thr ar caddat squcs wth whch rcvd squc s most probably y ad th probablty that th othr cod words ar rcvd th form of th squc y ca b mad arbtrarly small f R<C as show blow: Th probablty that s slctd squc slctd from amog th all possbl lgth- Squcs s a cod word of th rat R cod s R / th avrag probablty that ay cod word othr tha w s NOT slctd s gv by: P g y w x w P g y w x w R R
12 Proof of Cotud: Chal Codg Thorm R School of Iformato Scc whr C- bcaus of th cod radomss maxmzato wth rspct to px dos t hav to b tak. Sc th probablty dscrbd abov dcats that th trasmttd cod word s dcodd corrctly th rror probablty s gv by { CR } P g y w x w c th avrag rror probablty ca b mad arbtrarly small by makg th cod lgth larg ough f R<C. Th probablty that ca b mad arbtrarly small s avragd rror probablty ad thrfor roughly spakg th bst half of th cod words hav a maxmal rror probablty lss tha -C-R ad aothr half s hghr. Throwg away th cod words havg rror probablty hghr tha -C-R ad R- cod words rmas. Ths mas that th cod rat s chagd to: R-/ bcaus R- R-/. Ths rat loss s glgbl f s larg ough. Th th maxmal rror probablty satsfs: { CR } λ { R } { CR } Chal Codg Thorm 3 Proof of : Th proof s comprsd of th followg stps: A P 0 mpls R C B P 0 mpls R C School of Iformato Scc Proof of A: Assum that w us R rat R cod. Thr ar cod words that ar slctd qu-probably ad st to th rcvr; Assum that th mssag s to b st. Th th tropy of s: R + I ; owvr by th assumpto that g 0. c R I ; I ; I ; C a b a: From th data procssg qualty whr Markov cha holds. b: To b prov th xt slds Thorm 8.4. c: By dfto of Capacty c for ay cods achvg P 0 R C. c
13 School of Iformato Scc Fao s Iqualty for Extso Proof of B rqurs Fao s Iqualty for Extso. Lt s df th vt: ˆ ˆ 0 ˆ g wth f f E Th by usg th cha rul a E E + b E E E a: Bcaus E s a fucto of ad. b: Bcaus E s bary-valud. Furthrmor E E P E E P E log ˆ Pr 0 ˆ Pr + R P whr ˆ Pr P Combg all w hav R P + Ths s Fao s qualty. owvr bcaus s a fucto of Th w hav Fao s qualty for xtso: R P + School of Iformato Scc Fao s Iqualty for Extso Thorm 8.4.: Proof: ; x p ay for C I ; I L bcaus th chal s mmory-lss. owvr Thrfor C I I ; ; th ths rsult th proof of A-of- of th chal codg thorm s compltd.
14 School of Iformato Scc Fao s Iqualty for Extso 3 Proof of B ow kow that R + I ; But w do t assum th fact g s kow ths cas. c >0. R + I ; + I ; + P R + I ; + P R + C whr w hav usd Fao s qualty for xtso. Dvdg th both sds by R P R by assumpto 0 { + C Fally w kow that R C has to b satsfd. C also kow that P R R Summary School of Iformato Scc hav vstd... Chal Capacty - Dfto - Som Exampls - Som Proprts. Radom Codg 3. Chal Codg Thorm - Proof for Suffccy 4. Fao s Iqualty for Extso - Proof for Ncssty
3.4 Properties of the Stress Tensor
cto.4.4 Proprts of th trss sor.4. trss rasformato Lt th compots of th Cauchy strss tsor a coordat systm wth bas vctors b. h compots a scod coordat systm wth bas vctors j,, ar gv by th tsor trasformato
More informationUnbalanced Panel Data Models
Ubalacd Pal Data odls Chaptr 9 from Baltag: Ecoomtrc Aalyss of Pal Data 5 by Adrás alascs 4448 troducto balacd or complt pals: a pal data st whr data/obsrvatos ar avalabl for all crosssctoal uts th tr
More informationIndependent Domination in Line Graphs
Itratoal Joural of Sctfc & Egrg Rsarch Volum 3 Issu 6 Ju-1 1 ISSN 9-5518 Iddt Domato L Grahs M H Muddbhal ad D Basavarajaa Abstract - For ay grah G th l grah L G H s th trscto grah Thus th vrtcs of LG
More informationIntroduction to logistic regression
Itroducto to logstc rgrsso Gv: datast D { 2 2... } whr s a k-dmsoal vctor of ral-valud faturs or attrbuts ad s a bar class labl or targt. hus w ca sa that R k ad {0 }. For ampl f k 4 a datast of 3 data
More informationTotal Prime Graph. Abstract: We introduce a new type of labeling known as Total Prime Labeling. Graphs which admit a Total Prime labeling are
Itratoal Joural Of Computatoal Egrg Rsarch (crol.com) Vol. Issu. 5 Total Prm Graph M.Rav (a) Ramasubramaa 1, R.Kala 1 Dpt.of Mathmatcs, Sr Shakth Isttut of Egrg & Tchology, Combator 641 06. Dpt. of Mathmatcs,
More informationCorrelation in tree The (ferromagnetic) Ising model
5/3/00 :\ jh\slf\nots.oc\7 Chaptr 7 Blf propagato corrlato tr Corrlato tr Th (frromagtc) Isg mol Th Isg mol s a graphcal mol or par ws raom Markov fl cosstg of a urct graph wth varabls assocat wth th vrtcs.
More informationDepartment of Mathematics and Statistics Indian Institute of Technology Kanpur MSO202A/MSO202 Assignment 3 Solutions Introduction To Complex Analysis
Dpartmt of Mathmatcs ad Statstcs Ida Isttut of Tchology Kapur MSOA/MSO Assgmt 3 Solutos Itroducto To omplx Aalyss Th problms markd (T) d a xplct dscusso th tutoral class. Othr problms ar for hacd practc..
More informationReliability of time dependent stress-strength system for various distributions
IOS Joural of Mathmatcs (IOS-JM ISSN: 78-578. Volum 3, Issu 6 (Sp-Oct., PP -7 www.osrjourals.org lablty of tm dpdt strss-strgth systm for varous dstrbutos N.Swath, T.S.Uma Mahswar,, Dpartmt of Mathmatcs,
More informationCOMPLEX NUMBERS AND ELEMENTARY FUNCTIONS OF COMPLEX VARIABLES
COMPLEX NUMBERS AND ELEMENTARY FUNCTIONS OF COMPLEX VARIABLES DEFINITION OF A COMPLEX NUMBER: A umbr of th form, whr = (, ad & ar ral umbrs s calld a compl umbr Th ral umbr, s calld ral part of whl s calld
More informationMODEL QUESTION. Statistics (Theory) (New Syllabus) dx OR, If M is the mode of a discrete probability distribution with mass function f
MODEL QUESTION Statstcs (Thory) (Nw Syllabus) GROUP A d θ. ) Wrt dow th rsult of ( ) ) d OR, If M s th mod of a dscrt robablty dstrbuto wth mass fucto f th f().. at M. d d ( θ ) θ θ OR, f() mamum valu
More informationSecond Handout: The Measurement of Income Inequality: Basic Concepts
Scod Hadout: Th Masurmt of Icom Iqualty: Basc Cocpts O th ormatv approach to qualty masurmt ad th cocpt of "qually dstrbutd quvalt lvl of com" Suppos that that thr ar oly two dvduals socty, Rachl ad Mart
More informationAPPENDIX: STATISTICAL TOOLS
I. Nots o radom samplig Why do you d to sampl radomly? APPENDI: STATISTICAL TOOLS I ordr to masur som valu o a populatio of orgaisms, you usually caot masur all orgaisms, so you sampl a subst of th populatio.
More informationBinary Choice. Multiple Choice. LPM logit logistic regresion probit. Multinomial Logit
(c Pogsa Porchawssul, Faculty of Ecoomcs, Chulalogor Uvrsty (c Pogsa Porchawssul, Faculty of Ecoomcs, Chulalogor Uvrsty 3 Bary Choc LPM logt logstc rgrso probt Multpl Choc Multomal Logt (c Pogsa Porchawssul,
More informationEntropy Equation for a Control Volume
Fudamtals of Thrmodyamcs Chaptr 7 Etropy Equato for a Cotrol Volum Prof. Syoug Jog Thrmodyamcs I MEE2022-02 Thrmal Egrg Lab. 2 Q ds Srr T Q S2 S1 1 Q S S2 S1 Srr T t t T t S S s m 1 2 t S S s m tt S S
More informationAlmost all Cayley Graphs Are Hamiltonian
Acta Mathmatca Sca, Nw Srs 199, Vol1, No, pp 151 155 Almost all Cayly Graphs Ar Hamltoa Mg Jxag & Huag Qogxag Abstract It has b cocturd that thr s a hamltoa cycl vry ft coctd Cayly graph I spt of th dffculty
More information3. Basic Concepts: Consequences and Properties
: 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8
More informationLECTURE 6 TRANSFORMATION OF RANDOM VARIABLES
LECTURE 6 TRANSFORMATION OF RANDOM VARIABLES TRANSFORMATION OF FUNCTION OF A RANDOM VARIABLE UNIVARIATE TRANSFORMATIONS TRANSFORMATION OF RANDOM VARIABLES If s a rv wth cdf F th Y=g s also a rv. If w wrt
More informationOn Estimation of Unknown Parameters of Exponential- Logarithmic Distribution by Censored Data
saqartvlos mcrbata rovul akadms moamb, t 9, #2, 2015 BULLETIN OF THE GEORGIAN NATIONAL ACADEMY OF SCIENCES, vol 9, o 2, 2015 Mathmatcs O Estmato of Ukow Paramtrs of Epotal- Logarthmc Dstrbuto by Csord
More informationChiang Mai J. Sci. 2014; 41(2) 457 ( 2) ( ) ( ) forms a simply periodic Proof. Let q be a positive integer. Since
56 Chag Ma J Sc 0; () Chag Ma J Sc 0; () : 56-6 http://pgscccmuacth/joural/ Cotrbutd Papr Th Padova Sucs Ft Groups Sat Taș* ad Erdal Karaduma Dpartmt of Mathmatcs, Faculty of Scc, Atatürk Uvrsty, 50 Erzurum,
More informationChapter 5 Special Discrete Distributions. Wen-Guey Tzeng Computer Science Department National Chiao University
Chatr 5 Scal Dscrt Dstrbutos W-Guy Tzg Comutr Scc Dartmt Natoal Chao Uvrsty Why study scal radom varabls Thy aar frqutly thory, alcatos, statstcs, scc, grg, fac, tc. For aml, Th umbr of customrs a rod
More informationCounting the compositions of a positive integer n using Generating Functions Start with, 1. x = 3 ), the number of compositions of 4.
Coutg th compostos of a postv tgr usg Gratg Fuctos Start wth,... - Whr, for ampl, th co-ff of s, for o summad composto of aml,. To obta umbr of compostos of, w d th co-ff of (...) ( ) ( ) Hr for stac w
More informationChain Rules for Entropy
Cha Rules for Etroy The etroy of a collecto of radom varables s the sum of codtoal etroes. Theorem: Let be radom varables havg the mass robablty x x.x. The...... The roof s obtaed by reeatg the alcato
More informationA Measure of Inaccuracy between Two Fuzzy Sets
LGRN DEMY OF SENES YERNETS ND NFORMTON TEHNOLOGES Volum No 2 Sofa 20 Masur of accuracy btw Two Fuzzy Sts Rajkumar Vrma hu Dv Sharma Dpartmt of Mathmatcs Jayp sttut of formato Tchoy (Dmd vrsty) Noda (.P.)
More informationOn the Design of Finite-State Shaping Encoders for Partial-Response Channels
O th Dsg of Ft-Stat Shapg Ecodrs for Partal-Rspos Chals Josph B. Soraga Qualcomm, Ic. 5775 Morhous Drv, Sa Dgo, CA 922 Emal: jsoraga@qualcomm.com Paul H. Sgl Ctr for Magtc Rcordg Rsarch Uvrsty of Calfora,
More informationEstimation Theory. Chapter 4
Estmato ory aptr 4 LIEAR MOELS W - I matrx form Estmat slop B ad trcpt A,,.. - WG W B A l fttg Rcall W W W B A W ~ calld vctor I gral, ormal or Gaussa ata obsrvato paramtr Ma, ovarac KOW p matrx to b stmatd,
More informationRepeated Trials: We perform both experiments. Our space now is: Hence: We now can define a Cartesian Product Space.
Rpatd Trals: As w hav lood at t, th thory of probablty dals wth outcoms of sgl xprmts. I th applcatos o s usually trstd two or mor xprmts or rpatd prformac or th sam xprmt. I ordr to aalyz such problms
More informationChapter 6. pn-junction diode: I-V characteristics
Chatr 6. -jucto dod: -V charactrstcs Tocs: stady stat rsos of th jucto dod udr ald d.c. voltag. ucto udr bas qualtatv dscusso dal dod quato Dvatos from th dal dod Charg-cotrol aroach Prof. Yo-S M Elctroc
More informationChapter (8) Estimation and Confedence Intervals Examples
Chaptr (8) Estimatio ad Cofdc Itrvals Exampls Typs of stimatio: i. Poit stimatio: Exampl (1): Cosidr th sampl obsrvatios, 17,3,5,1,18,6,16,10 8 X i i1 17 3 5 118 6 16 10 116 X 14.5 8 8 8 14.5 is a poit
More informationLecture 1: Empirical economic relations
Ecoomcs 53 Lctur : Emprcal coomc rlatos What s coomtrcs? Ecoomtrcs s masurmt of coomc rlatos. W d to kow What s a coomc rlato? How do w masur such a rlato? Dfto: A coomc rlato s a rlato btw coomc varabls.
More informationPower Spectrum Estimation of Stochastic Stationary Signals
ag of 6 or Spctru stato of Stochastc Statoary Sgas Lt s cosr a obsrvato of a stochastc procss (). Ay obsrvato s a ft rcor of th ra procss. Thrfor, ca say:
More informationInternational Journal of Mathematical Archive-6(5), 2015, Available online through ISSN
Itratoal Joural of Mathmatal Arhv-6), 0, 07- Avalabl ol through wwwjmafo ISSN 9 06 ON THE LINE-CUT TRANSFORMATION RAPHS B BASAVANAOUD*, VEENA R DESAI Dartmt of Mathmats, Karatak Uvrsty, Dharwad - 80 003,
More informationMath Tricks. Basic Probability. x k. (Combination - number of ways to group r of n objects, order not important) (a is constant, 0 < r < 1)
Math Trcks r! Combato - umbr o was to group r o objcts, ordr ot mportat r! r! ar 0 a r a s costat, 0 < r < k k! k 0 EX E[XX-] + EX Basc Probablt 0 or d Pr[X > ] - Pr[X ] Pr[ X ] Pr[X ] - Pr[X ] Proprts
More informationFILTER BANK MULTICARRIER WITH LAPPED TRANSFORMS
FILTER BANK ULTICARRIER WITH LAPPED TRANSFORS aurc Bllagr, CNA Davd attra, aro Tada, Uv.Napol arch 5 Obctvs A multcarrr approach to mprov o OFD for futur wrlss systms - asychroous mult-usr accss - spctral
More informationNumerical Method: Finite difference scheme
Numrcal Mthod: Ft dffrc schm Taylor s srs f(x 3 f(x f '(x f ''(x f '''(x...(1! 3! f(x 3 f(x f '(x f ''(x f '''(x...(! 3! whr > 0 from (1, f(x f(x f '(x R Droppg R, f(x f(x f '(x Forward dffrcg O ( x from
More informationOrdinary Least Squares at advanced level
Ordary Last Squars at advacd lvl. Rvw of th two-varat cas wth algbra OLS s th fudamtal tchqu for lar rgrssos. You should by ow b awar of th two-varat cas ad th usual drvatos. I ths txt w ar gog to rvw
More informationDifferent types of Domination in Intuitionistic Fuzzy Graph
Aals of Pur ad Appld Mathmatcs Vol, No, 07, 87-0 ISSN: 79-087X P, 79-0888ol Publshd o July 07 wwwrsarchmathscorg DOI: http://dxdoorg/057/apama Aals of Dffrt typs of Domato Itutostc Fuzzy Graph MGaruambga,
More informationWeights Interpreting W and lnw What is β? Some Endnotes = n!ω if we neglect the zero point energy then ( )
Sprg Ch 35: Statstcal chacs ad Chcal Ktcs Wghts... 9 Itrprtg W ad lw... 3 What s?... 33 Lt s loo at... 34 So Edots... 35 Chaptr 3: Fudatal Prcpls of Stat ch fro a spl odl (drvato of oltza dstrbuto, also
More informationIntroduction to logistic regression
Itroducto to logstc rgrsso Gv: datast D {... } whr s a k-dmsoal vctor of ral-valud faturs or attrbuts ad s a bar class labl or targt. hus w ca sa that R k ad {0 }. For ampl f k 4 a datast of 3 data pots
More informationAotomorphic Functions And Fermat s Last Theorem(4)
otomorphc Fuctos d Frmat s Last Thorm(4) Chu-Xua Jag P. O. Box 94 Bg 00854 P. R. Cha agchuxua@sohu.com bsract 67 Frmat wrot: It s mpossbl to sparat a cub to two cubs or a bquadrat to two bquadrats or gral
More informationEstimating the Variance in a Simulation Study of Balanced Two Stage Predictors of Realized Random Cluster Means Ed Stanek
Etatg th Varac a Sulato Study of Balacd Two Stag Prdctor of Ralzd Rado Clutr Ma Ed Stak Itroducto W dcrb a pla to tat th varac copot a ulato tudy N ( µ µ W df th varac of th clutr paratr a ug th N ulatd
More informationComplex Numbers. Prepared by: Prof. Sunil Department of Mathematics NIT Hamirpur (HP)
th Topc Compl Nmbrs Hyprbolc fctos ad Ivrs hyprbolc fctos, Rlato btw hyprbolc ad crclar fctos, Formla of hyprbolc fctos, Ivrs hyprbolc fctos Prpard by: Prof Sl Dpartmt of Mathmatcs NIT Hamrpr (HP) Hyprbolc
More informationOn the Possible Coding Principles of DNA & I Ching
Sctfc GOD Joural May 015 Volum 6 Issu 4 pp. 161-166 Hu, H. & Wu, M., O th Possbl Codg Prcpls of DNA & I Chg 161 O th Possbl Codg Prcpls of DNA & I Chg Hupg Hu * & Maox Wu Rvw Artcl ABSTRACT I ths rvw artcl,
More informationERDOS-SMARANDACHE NUMBERS. Sabin Tabirca* Tatiana Tabirca**
ERDO-MARANDACHE NUMBER b Tbrc* Tt Tbrc** *Trslv Uvrsty of Brsov, Computr cc Dprtmt **Uvrsty of Mchstr, Computr cc Dprtmt Th strtg pot of ths rtcl s rprstd by rct work of Fch []. Bsd o two symptotc rsults
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationBrief Introduction to Statistical Mechanics
Brif Introduction to Statistical Mchanics. Purpos: Ths nots ar intndd to provid a vry quick introduction to Statistical Mchanics. Th fild is of cours far mor vast than could b containd in ths fw pags.
More informationln x = n e = 20 (nearest integer)
H JC Prlim Solutios 6 a + b y a + b / / dy a b 3/ d dy a b at, d Giv quatio of ormal at is y dy ad y wh. d a b () (,) is o th curv a+ b () y.9958 Qustio Solvig () ad (), w hav a, b. Qustio d.77 d d d.77
More informationSuzan Mahmoud Mohammed Faculty of science, Helwan University
Europa Joural of Statstcs ad Probablty Vol.3, No., pp.4-37, Ju 015 Publshd by Europa Ctr for Rsarch Trag ad Dvlopmt UK (www.ajourals.org ESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN WEIBULL DISTRIBUTION
More informationChapter 6 Student Lecture Notes 6-1
Chaptr 6 Studnt Lctur Nots 6-1 Chaptr Goals QM353: Busnss Statstcs Chaptr 6 Goodnss-of-Ft Tsts and Contngncy Analyss Aftr compltng ths chaptr, you should b abl to: Us th ch-squar goodnss-of-ft tst to dtrmn
More informationThe real E-k diagram of Si is more complicated (indirect semiconductor). The bottom of E C and top of E V appear for different values of k.
Modr Smcoductor Dvcs for Itgratd rcuts haptr. lctros ad Hols Smcoductors or a bad ctrd at k=0, th -k rlatoshp ar th mmum s usually parabolc: m = k * m* d / dk d / dk gatv gatv ffctv mass Wdr small d /
More informationOn Approximation Lower Bounds for TSP with Bounded Metrics
O Approxmato Lowr Bouds for TSP wth Boudd Mtrcs Mark Karpsk Rchard Schmd Abstract W dvlop a w mthod for provg xplct approxmato lowr bouds for TSP problms wth boudd mtrcs mprovg o th bst up to ow kow bouds.
More informationThe probability of Riemann's hypothesis being true is. equal to 1. Yuyang Zhu 1
Th robablty of Ra's hyothss bg tru s ual to Yuyag Zhu Abstract Lt P b th st of all r ubrs P b th -th ( ) lt of P ascdg ordr of sz b ostv tgrs ad s a rutato of wth Th followg rsults ar gv ths ar: () Th
More informationTriple Play: From De Morgan to Stirling To Euler to Maclaurin to Stirling
Tripl Play: From D Morga to Stirlig To Eulr to Maclauri to Stirlig Augustus D Morga (186-1871) was a sigificat Victoria Mathmaticia who mad cotributios to Mathmatics History, Mathmatical Rcratios, Mathmatical
More informationMachine Learning. Principle Component Analysis. Prof. Dr. Volker Sperschneider
Mach Larg Prcpl Compot Aalyss Prof. Dr. Volkr Sprschdr AG Maschlls Lr ud Natürlchsprachlch Systm Isttut für Iformatk chsch Fakultät Albrt-Ludgs-Uvrstät Frburg sprschdr@formatk.u-frburg.d I. Archtctur II.
More information1985 AP Calculus BC: Section I
985 AP Calculus BC: Sctio I 9 Miuts No Calculator Nots: () I this amiatio, l dots th atural logarithm of (that is, logarithm to th bas ). () Ulss othrwis spcifid, th domai of a fuctio f is assumd to b
More information2. Grundlegende Verfahren zur Übertragung digitaler Signale (Zusammenfassung) Informationstechnik Universität Ulm
. Grundlgnd Vrfahrn zur Übrtragung dgtalr Sgnal (Zusammnfassung) wt Dc. 5 Transmsson of Dgtal Sourc Sgnals Sourc COD SC COD MOD MOD CC dg RF s rado transmsson mdum Snk DC SC DC CC DM dg DM RF g physcal
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationMATHEMATICAL IDEAS AND NOTIONS OF QUANTUM FIELD THEORY. e S(A)/ da, h N
MATHEMATICAL IDEAS AND NOTIONS OF QUANTUM FIELD THEORY 9 4. Matrx tgrals Lt h N b th spac of Hrmta matrcs of sz N. Th r product o h N s gv by (A, B) = Tr(AB). I ths scto w wll cosdr tgrals of th form Z
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationInner Product Spaces INNER PRODUCTS
MA4Hcdoc Ir Product Spcs INNER PRODCS Dto A r product o vctor spc V s ucto tht ssgs ubr spc V such wy tht th ollowg xos holds: P : w s rl ubr P : P : P 4 : P 5 : v, w = w, v v + w, u = u + w, u rv, w =
More informationIn 1991 Fermat s Last Theorem Has Been Proved
I 99 Frmat s Last Thorm Has B Provd Chu-Xua Jag P.O.Box 94Bg 00854Cha Jcxua00@s.com;cxxxx@6.com bstract I 67 Frmat wrot: It s mpossbl to sparat a cub to two cubs or a bquadrat to two bquadrats or gral
More informationThe Hyperelastic material is examined in this section.
4. Hyprlastcty h Hyprlastc matral s xad n ths scton. 4..1 Consttutv Equatons h rat of chang of ntrnal nrgy W pr unt rfrnc volum s gvn by th strss powr, whch can b xprssd n a numbr of dffrnt ways (s 3.7.6):
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationDiscrete Fourier Transform (DFT)
Discrt Fourir Trasorm DFT Major: All Egirig Majors Authors: Duc guy http://umricalmthods.g.us.du umrical Mthods or STEM udrgraduats 8/3/29 http://umricalmthods.g.us.du Discrt Fourir Trasorm Rcalld th xpotial
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationAdagba O Henry /International Journal Of Computational Engineering Research / ISSN: OPERATION ON IDEALS
Adagba O Hry /Itratoal Joural Of Computatoal Egrg Rsarh / ISSN 50 3005 OPERATION ON IDEALS Adagba O Hry, Dpt of Idustral Mathmats & Appld Statsts, Eboy Stat Uvrsty, Abakalk Abstrat W provd bas opratos
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationA Stochastic Approximation Iterative Least Squares Estimation Procedure
Joural of Al Azhar Uvrst-Gaza Natural Sccs, 00, : 35-54 A Stochastc Appromato Itratv Last Squars Estmato Procdur Shahaz Ezald Abu- Qamar Dpartmt of Appld Statstcs Facult of Ecoomcs ad Admstrato Sccs Al-Azhar
More informationInformation Theoretic Upper Bound on the Capacity of Wireless Backhaul Networks
Iformato Thortc Uppr Boud o th Capacty of Wrlss Bachaul Ntwors Harprt S Dhllo ad Guspp Car Abstract W drv a formato thortc uppr boud o th capacty of a wrlss bachaul twor modld as a classcal radom xtdd
More informationConsistency of the Maximum Likelihood Estimator in Logistic Regression Model: A Different Approach
ISSN 168-8 Joural of Statstcs Volum 16, 9,. 1-11 Cosstcy of th Mamum Lklhood Estmator Logstc Rgrsso Modl: A Dffrt Aroach Abstract Mamuur Rashd 1 ad Nama Shfa hs artcl vstgats th cosstcy of mamum lklhood
More informationThe Matrix Exponential
Th Matrix Exponntial (with xrciss) by D. Klain Vrsion 207.0.05 Corrctions and commnts ar wlcom. Th Matrix Exponntial For ach n n complx matrix A, dfin th xponntial of A to b th matrix A A k I + A + k!
More information7THE DIFFUSION OF PRODUCT INNOVATIONS AND MARKET STRUCTURE
7THE DIFFUSION OF PRODUCT INNOVATIONS AND MARKET STRUCTURE Isttut of Ecoomc Forcastg Roxaa IDU Abstract I ths papr I aalyz th dffuso of a product ovato that was rctly mad avalabl for lcsd purchas wth a
More informationWorksheet: Taylor Series, Lagrange Error Bound ilearnmath.net
Taylor s Thorm & Lagrag Error Bouds Actual Error This is th ral amout o rror, ot th rror boud (worst cas scario). It is th dirc btw th actual () ad th polyomial. Stps:. Plug -valu ito () to gt a valu.
More informationMultipath diversity of precoded OFDM with linear equalization
Uvrsty of Wollogog Rsarch Ol Faculty of Iformatcs - aprs (Archv) Faculty of Egrg ad Iformato Sccs 8 ultpath dvrsty of prcodd OFD wth lar qualzato Xaojg uag Uvrsty of Wollogog, huag@uow.du.au ublcato Dtals
More information8. Queueing systems. Contents. Simple teletraffic model. Pure queueing system
8. Quug sysms Cos 8. Quug sysms Rfrshr: Sml lraffc modl Quug dscl M/M/ srvr wag lacs Alcao o ack lvl modllg of daa raffc M/M/ srvrs wag lacs lc8. S-38.45 Iroduco o Tlraffc Thory Srg 5 8. Quug sysms 8.
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationECE602 Exam 1 April 5, You must show ALL of your work for full credit.
ECE62 Exam April 5, 27 Nam: Solution Scor: / This xam is closd-book. You must show ALL of your work for full crdit. Plas rad th qustions carfully. Plas chck your answrs carfully. Calculators may NOT b
More informationAnalysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems
Char for Network Archtectures ad Servces Prof. Carle Departmet of Computer Scece U Müche Aalyss of System Performace IN2072 Chapter 5 Aalyss of No Markov Systems Dr. Alexader Kle Prof. Dr.-Ig. Georg Carle
More informationThe Matrix Exponential
Th Matrix Exponntial (with xrciss) by Dan Klain Vrsion 28928 Corrctions and commnts ar wlcom Th Matrix Exponntial For ach n n complx matrix A, dfin th xponntial of A to b th matrix () A A k I + A + k!
More informationONLY AVAILABLE IN ELECTRONIC FORM
OPERTIONS RESERH o.287/opr.8.559c pp. c c8 -copao ONLY VILLE IN ELETRONI FORM fors 28 INFORMS Elctroc opao Optzato Mols of scrt-evt Syst yacs by Wa K (Vctor ha a L Schrub, Opratos Rsarch, o.287/opr.8.559.
More informationNotation for Mixed Models for Finite Populations
30- otato for d odl for Ft Populato Smpl Populato Ut ad Rpo,..., Ut Labl for,..., Epctd Rpo (ovr rplcatd maurmt for,..., Rgro varabl (Luz r for,...,,,..., p Aular varabl for ut (Wu z μ for,...,,,..., p
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationA COMPARISON OF SEVERAL TESTS FOR EQUALITY OF COEFFICIENTS IN QUADRATIC REGRESSION MODELS UNDER HETEROSCEDASTICITY
Colloquum Bomtrcum 44 04 09 7 COMPISON OF SEVEL ESS FO EQULIY OF COEFFICIENS IN QUDIC EGESSION MODELS UNDE HEEOSCEDSICIY Małgorzata Szczpa Dorota Domagała Dpartmt of ppld Mathmatcs ad Computr Scc Uvrsty
More informationRandom Variables and Probability Distributions
Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x
More informationSlide 1. Slide 2. Slide 3 DIGITAL SIGNAL PROCESSING CLASSIFICATION OF SIGNALS
Slid DIGITAL SIGAL PROCESSIG UIT I DISCRETE TIME SIGALS AD SYSTEM Slid Rviw of discrt-tim signals & systms Signal:- A signal is dfind as any physical quantity that varis with tim, spac or any othr indpndnt
More informationNew bounds on Poisson approximation to the distribution of a sum of negative binomial random variables
Sogklaaka J. Sc. Tchol. 4 () 4-48 Ma. -. 8 Ogal tcl Nw bouds o Posso aomato to th dstbuto of a sum of gatv bomal adom vaabls * Kat Taabola Datmt of Mathmatcs Faculty of Scc Buaha Uvsty Muag Chobu 3 Thalad
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationData Assimilation 1. Alan O Neill National Centre for Earth Observation UK
Data Assimilation 1 Alan O Nill National Cntr for Earth Obsrvation UK Plan Motivation & basic idas Univariat (scalar) data assimilation Multivariat (vctor) data assimilation 3d-Variational Mthod (& optimal
More informationEstimation of Population Variance Using a Generalized Double Sampling Estimator
r Laka Joural o Appl tatstcs Vol 5-3 stmato o Populato Varac Us a Gralz Doubl ampl stmator Push Msra * a R. Kara h Dpartmt o tatstcs D.A.V.P.G. Coll Dhrau- 8 Uttarakha Ia. Dpartmt o tatstcs Luckow Uvrst
More informationNuclear Chemistry -- ANSWERS
Hoor Chstry Mr. Motro 5-6 Probl St Nuclar Chstry -- ANSWERS Clarly wrt aswrs o sparat shts. Show all work ad uts.. Wrt all th uclar quatos or th radoactv dcay srs o Urau-38 all th way to Lad-6. Th dcay
More informationSuperbosonization meets Free Probability
Suprbosoato mts Fr Probablty M Zrbaur jot wor wth S Madt Eulr Symposum St Ptrsburg Ju 3 009 Itroducto From momts to cumulats Larg- charactrstc fucto by fr probablty Suprbosoato Applcato to dsordrd scattrg
More informationEstimation of the Present Values of Life Annuities for the Different Actuarial Models
h Scod Itratoal Symposum o Stochastc Modls Rlablty Egrg, Lf Scc ad Opratos Maagmt Estmato of th Prst Valus of Lf Auts for th Dffrt Actuaral Modls Gady M Koshk, Oaa V Guba omsk Stat Uvrsty Dpartmt of Appld
More informationIranian Journal of Mathematical Chemistry, Vol. 2, No. 2, December 2011, pp (Received September 10, 2011) ABSTRACT
Iraa Joral of Mathatcal Chstry Vol No Dcbr 0 09 7 IJMC Two Tys of Gotrc Arthtc dx of V hylc Naotb S MORADI S BABARAHIM AND M GHORBANI Dartt of Mathatcs Faclty of Scc Arak Ursty Arak 856-8-89 I R Ira Dartt
More informationDr. Junchao Xia Center of Biophysics and Computational Biology. Fall /21/2016 1/23
BIO53 Bosascs Lcur 04: Cral Lm Thorm ad Thr Dsrbuos Drvd from h Normal Dsrbuo Dr. Juchao a Cr of Bophyscs ad Compuaoal Bology Fall 06 906 3 Iroduco I hs lcur w wll alk abou ma cocps as lsd blow, pcd valu
More informationMore Statistics tutorial at 1. Introduction to mathematical Statistics
Mor Sttstcs tutorl t wwwdumblttldoctorcom Itroducto to mthmtcl Sttstcs Fl Soluto A Gllup survy portrys US trprurs s " th mvrcks, drmrs, d lors whos rough dgs d ucompromsg d to do t thr ow wy st thm shrp
More informationLinear Extractors for Extracting Randomness from Noisy Sources
011 IEEE Itratoal Syposu o Iforato Thory Procdgs Lar Extractors for Extractg Radoss fro Nosy Sourcs Hogchao Zhou Elctrcal Egrg Dpartt Calfora Isttut of Tchology Pasada, CA 9115 Eal: hzhou@caltch.du Jhoshua
More information