SOFTWARE. Computer Architecture Topics. Shared Memory, Message Passing, Data Parallelism. Network Interfaces. Interconnection Network

Transcription

1 Lctu 1: Cot/Pfomac, DLX, Pipliig, Cach, Bach Pictio Pof. F Chog ECS 250A Comput Achitctu Wit 1999 Comput Achitctu I th attibut of a [computig] ytm a by th pogamm, i.., th cocptual tuctu a fuctioal bhavio, a itict fom th ogaizatio of th ata flow a cotol th logic ig, a th phyical implmtatio. Amahl, Blaaw, a Book, 1964 SFTWARE Comput Achitctu Chagig Dfiitio 1950 to 1960: Comput Achitctu Cou Comput Aithmtic 1970 to mi 1980: Comput Achitctu Cou Ituctio St Dig, pcially ISA appopiat fo compil 1990: Comput Achitctu Cou Dig of CPU, mmoy ytm, I/ ytm, Multipoco (Sli ba upo Patto UCB CS252 Spig 1998) FTC.W99 1 FTC.W99 2 FTC.W99 3 Comput Achitctu Topic Comput Achitctu Topic ECS 250A Cou Focu Iput/utput a Stoag Mmoy Hiachy VLSI DRAM L2 Cach L1 Cach Ituctio St Achitctu Dik, WRM, Tap Pipliig, Haza Rolutio, Supcala, Roig, Pictio, Spculatio, Vcto, DSP Emgig Tchologi Itlavig Bu potocol Cohc, Bawith, Latcy Aig, Potctio, Excptio Halig RAID Pipliig a Ituctio Lvl Paalllim FTC.W99 4 P M S P M P M P M Itcoctio Ntwok Poco-Mmoy-Switch Multipoco Ntwok a Itcoctio Sha Mmoy, Mag Paig, Data Paalllim Ntwok Itfac Topologi, Routig, Bawith, Latcy, Rliability FTC.W99 5 Utaig th ig tchiqu, machi tuctu, tchology facto, valuatio mtho that will tmi th fom of comput i 21t Ctuy Applicatio patig Sytm Tchology Paalllim Comput Achitctu: Ituctio St Dig gaizatio Hawa Maumt & Evaluatio Pogammig Laguag Itfac Dig (ISA) Hitoy FTC.W99 6 Pag 1

2 Topic Covag Txtbook: Hy a Patto, Comput Achitctu: A Quatitativ Appoach, 2 E., Pfomac/Cot, DLX, Pipliig, Cach, Bach Pictio ILP, Loop Uollig, Scoboaig, Tomaulo, Dyamic Bach Pictio Tac Schulig, Spculatio Vcto Poco, DSP Mmoy Hiachy I/ Itcoctio Ntwok Multipoco Itucto: F Chog ECS250A: Staff ffic: EUII-3031 chog@c ffic Hou: Mo 4-6pm o by appt. T. A: Diaa K Cla: Txt: ffic: EUII-2239 k@c TA ffic Hou: Fi 1-3pm Mo 6:10-9pm Comput Achitctu: A Quatitativ Appoach, Sco Eitio (1996) Wb pag: Lctu availabl oli bfo 1PM ay of lctu Nwgoup: uc.cla.c250a{.} Gaig Poblm St 35% 1 I-cla xam (plim imulatio) 20% Pojct Popoal a Daft 10% Pojct Fial Rpot 25% Pojct Pot Sio (CS colloquium) 10% FTC.W99 7 FTC.W99 8 FTC.W99 9 VLSI Taito CMS Ivt CMS NAND Gat A A G B G I ut I ut A C B A B C B FTC.W99 10 FTC.W99 11 FTC.W99 12 Pag 2

3 Itgat Cicuit Cot IC cot = Di cot + Ttig cot + Packagig cot Fial tt yil Di cot = Waf cot Di p Waf * Di yil Di p waf = š * ( Waf_iam / 2) 2 š * Waf_iam Tt i Di Aa 2 * Di Aa Di Yil = Waf yil * 1 + { α Dfct_p_uit_aa * Di_Aa } α Di Cot go oughly with i aa 4 FTC.W99 13 Ral Wol Exampl Chip Mtal Li Waf Dfct Aa Di/ Yil Di Cot lay with cot /cm 2 mm 2 waf 386DX $ % $4 486DX $ % $12 PowPC $ % $53 HP PA $ % $73 DEC Alpha $ % $149 SupSPARC $ % $272 Ptium $ % $417 Fom "Etimatig IC Maufactuig Cot, by Lily Gwap, Micopoco Rpot, Augut 2, 1993, p. 15 FTC.W99 14 Cot/Pfomac What i Rlatiohip of Cot to Pic? Compot Cot Dict Cot (a 25% to 40%) cuig cot: labo, puchaig, cap, waaty Go Magi (a 82% to 186%) ocuig cot: R&D, maktig, al, quipmt maitac, tal, fiacig cot, ptax pofit, tax Avag Dicout to gt Lit Pic (a 33% to 66%): volum icout a/o tail makup Lit Pic Avg. Sllig Pic Avag Dicout Go Magi Dict Cot Compot Cot 25% to 40% 34% to 39% 6% to 8% 15% to 33% FTC.W99 15 Chip Pic (Augut 1993) Aum pucha 10,000 uit Summay: Pic v. Cot 100% 80% Avag Dicout Tchology T: Micopoco Capacity Chip Aa Mfg. Pic Multi- Commt mm 2 cot pli 386DX 43 $9 $ It Comptitio 486DX2 81 $35 $ No Comptitio PowPC $77 $ DEC Alpha 234 $202 $ Rcoup R&D? Ptium 296 $473 $ Ealy i hipmt FTC.W % 40% 20% 0% Mii W/S PC Mii W/S PC Go Magi Dict Cot Compot Cot Avag Dicout Go Magi Dict Cot Compot Cot FTC.W i4004 Moo Law i8080 i8086 i Ya i80386 i80486 Ptium Alpha 21264: 15 millio Ptium Po: 5.5 millio PowPC 620: 6.9 millio Alpha 21164: 9.3 millio Spac Ulta: 5.2 millio CMS impovmt: Di iz: 2X vy 3 y Li with: halv / 7 y FTC.W99 18 Pag 3

4 Mmoy Capacity (Sigl Chip DRAM) iz Tchology T (Summay) 1000 Poco Pfomac T Ya ya iz(mb) cyc tim Capacity Sp (latcy) Logic 2x i 3 ya 2x i 3 ya DRAM 4x i 3 ya 2x i 10 ya Dik 4x i 3 ya 2x i 10 ya Supcomput Miicomput Micopoco Maifam FTC.W99 19 FTC.W99 20 Ya FTC.W99 21 Poco Pfomac (1.35X bfo, 1.55X ow) Pfomac T (Summay) Comput Egiig Mthoology X/y DEC Alpha 21264/600 Woktatio pfomac (mau i Spc Mak) impov oughly 50% p ya (2X vy 18 moth) DEC Alpha 5/ DEC DEC Alpha 5/300 IBM HP 200 Su MIPS MIPS AXP/ 9000/ -4/ M M/ RS/ 500 DEC Alpha 4/ IBM PWER FTC.W99 22 Impovmt i cot pfomac timat at 70% p ya FTC.W99 23 Tchology T FTC.W99 24 Pag 4

5 Comput Egiig Mthoology Comput Egiig Mthoology Comput Egiig Mthoology Evaluat Exitig Sytm fo Bottlck Evaluat Exitig Sytm fo Bottlck Implmtatio Complxity Evaluat Exitig Sytm fo Bottlck Tchology T Bchmak Bchmak Tchology T Simulat Nw Dig a gaizatio Bchmak Tchology T Implmt Nxt Simulat Nw Gatio Sytm Dig a gaizatio FTC.W99 25 Wokloa FTC.W99 26 Wokloa FTC.W99 27 Maumt Tool Bchmak, Tac, Mix Hawa: Cot, lay, aa, pow timatio Simulatio (may lvl) ISA, RT, Gat, Cicuit Quuig Thoy Rul of Thumb Fuamtal Law /Picipl Pla Boig 747 BAD/Su Coco Th Bottom Li: Pfomac (a Cot) DC to Pai 6.5 hou 3 hou Sp 610 mph 1350 mph Pag Tim to u th tak (ExTim) Excutio tim, po tim, latcy Tak p ay, hou, wk, c, (Pfomac) Thoughput, bawith Thoughput (pmph) 286, ,200 Th Bottom Li: Pfomac (a Cot) "X i tim fat tha Y" ma ExTim(Y) Pfomac(X) = ExTim(X) Pfomac(Y) Sp of Coco v. Boig 747 Thoughput of Boig 747 v. Coco FTC.W99 28 FTC.W99 29 FTC.W99 30 Pag 5

6 Amahl' Law Spup u to hacmt E: ExTim w/o E Pfomac w/ E Spup(E) = = ExTim w/ E Pfomac w/o E Amahl Law ExTim w = ExTim ol x (1 - Factio hac ) + Factio hac Spup hac Amahl Law Floatig poit ituctio impov to u 2X; but oly 10% of actual ituctio a FP Suppo that hacmt E acclat a factio F of th tak by a facto S, a th mai of th tak i uaffct Spup ovall = ExTim 1 ol = (1 - Factio ExTim hac ) + Factio hac w Spup hac ExTim w = Spup ovall = FTC.W99 31 FTC.W99 32 FTC.W99 33 Amahl Law Floatig poit ituctio impov to u 2X; but oly 10% of actual ituctio a FP ExTim w = ExTim ol x ( /2) = 0.95 x ExTim ol Spup ovall = = Mtic of Pfomac Applicatio Pogammig Laguag Compil ISA Datapath Cotol Fuctio Uit Taito Wi Pi Aw p moth patio p co (millio) of Ituctio p co: MIPS (millio) of (FP) opatio p co: MFLP/ Mgabyt p co Cycl p co (clock at) Apct of CPU Pfomac CPU CPU tim tim = Sco = Ituctio x Cycl x Sco Pogam Pogam Ituctio Cycl It Cout CPI Clock Rat Pogam X Compil X (X) It. St. X X gaizatio X X Tchology X FTC.W99 34 FTC.W99 35 FTC.W99 36 Pag 6

7 Cycl P Ituctio Avag Cycl p Ituctio CPI = (CPU Tim * Clock Rat) / Ituctio Cout = Cycl / Ituctio Cout CPU tim = CyclTim * Σ CPI i * I i i = 1 Ituctio Fqucy CPI = Σ CPI i * F i wh F i = I i i = 1 Ituctio Cout Ivt Rouc wh tim i Spt! FTC.W99 37 Exampl: Calculatig CPI Ba Machi (Rg / Rg) p Fq Cycl CPI(i) (% Tim) ALU 50% 1.5 (33%) Loa 20% 2.4 (27%) Sto 10% 2.2 (13%) Bach 20% 2.4 (27%) 1.5 Typical Mix FTC.W99 38 SPEC: Sytm Pfomac Evaluatio Coopativ Fit Rou pogam yilig a igl umb ( SPECmak ) Sco Rou 1992 SPECIt92 (6 itg pogam) a SPECfp92 (14 floatig poit pogam)» Compil Flag ulimit. Mach 93 of DEC 4000 Mol 610: pic: uix.c:/f=(yv,ha_bcopy, bcopy(a,b,c)= mmcpy(b,a,c) wav5: /ali=(all,com=at)/ag=a/u=4/u=200 aa7: /ocu/ag=a/u=4/u2=200/lc=bla Thi Rou 1995 w t of pogam: SPECit95 (8 itg pogam) a SPECfp95 (10 floatig poit) bchmak uful fo 3 ya Sigl flag ttig fo all pogam: SPECit_ba95, SPECfp_ba95 FTC.W99 39 How to Summaiz Pfomac Aithmtic ma (wight aithmtic ma) tack xcutio tim: Σ(T i )/ o Σ(W i *T i ) Hamoic ma (wight hamoic ma) of at (.g., MFLPS) tack xcutio tim: / Σ(1/R i ) o / Σ(W i /R i ) Nomaliz xcutio tim i hay fo calig pfomac (.g., X tim fat tha SPARCtatio 10) But o ot tak th aithmtic ma of omaliz xcutio tim, u th gomtic: (Π x i )^1/) FTC.W99 40 SPEC Fit Rou pogam: 99% of tim i igl li of co Nw fot- compil coul impov amatically gcc po li pic ouc aa7 Bchmak qtott matix300 fpppp tomcatv FTC.W99 41 Impact of Ma o SPECmak89 fo IBM 550 Ratio to VAX: Tim: Wight Tim: Pogam Bfo Aft Bfo Aft Bfo Aft gcc po pic ouc aa li qtott matix fpppp tomcatv Ma Gomtic Aithmtic Wight Aith. Ratio 1.33 Ratio 1.16 Ratio 1.09 FTC.W99 42 Pag 7

8 Pfomac Evaluatio Fo btt o wo, bchmak hap a fil Goo pouct cat wh hav: Goo bchmak Goo way to ummaiz pfomac Giv al i a fuctio i pat of pfomac lativ to comptitio, ivtmt i impovig pouct a pot by pfomac ummay If bchmak/ummay iaquat, th choo btw impovig pouct fo al pogam v. impovig pouct to gt mo al; Sal almot alway wi! Excutio tim i th mau of comput Ituctio St Achitctu (ISA) oftwa ituctio t hawa A goo itfac: Itfac Dig Lat though may implmtatio (potability, compatibility) I u i may iffy way (gality) Povi covit fuctioality to high lvl Pmit a fficit implmtatio at low lvl u u u Itfac imp 1 imp 2 imp 3 tim pfomac! FTC.W99 43 FTC.W99 44 FTC.W99 45 Evolutio of Ituctio St Sigl Accumulato (EDSAC 1950) Accumulato + Ix Rgit (Macht Mak I, IBM 700 i 1953) Spaatio of Pogammig Mol fom Implmtatio High-lvl Laguag Ba Cocpt of a Family (B ) (IBM ) Gal Pupo Rgit Machi Complx Ituctio St Loa/Sto Achitctu (Vax, Itl ) (CDC 6600, Cay ) RISC (Mip,Spac,HP-PA,IBM RS6000, ) FTC.W99 46 Evolutio of Ituctio St Majo avac i comput achitctu a typically aociat with lamak ituctio t ig Ex: Stack v GPR (Sytm 360) Dig ciio mut tak ito accout: tchology machi ogaizatio pogammig laguag compil tchology opatig ytm A thy i tu ifluc th FTC.W99 47 A "Typical" RISC 32-bit fix fomat ituctio (3 fomat) bit GPR (R0 cotai zo, DP tak pai) 3-a, g-g aithmtic ituctio Sigl a mo fo loa/to: ba + iplacmt o iictio Simpl bach coitio Dlay bach : SPARC, MIPS, HP PA-Ric, DEC Alpha, IBM PowPC, CDC 6600, CDC 7600, Cay-1, Cay-2, Cay-3 FTC.W99 48 Pag 8

9 Rgit-Rgit p Exampl: MIPS R1 Rgit-Immiat R p R1 R immiat Bach p tagt R px p R1 R2/px immiat Jump / Call FTC.W99 49 Summay, #1 Digig to Lat though T Capacity Sp Logic 2x i 3 ya 2x i 3 ya DRAM 4x i 3 ya 2x i 10 ya Dik 4x i 3 ya 2x i 10 ya 6y to gauat => 16X CPU p, DRAM/Dik iz Tim to u th tak Excutio tim, po tim, latcy Tak p ay, hou, wk, c,, Thoughput, bawith X i tim fat tha Y ma ExTim(Y) Pfomac(X) = ExTim(X) Pfomac(Y) FTC.W99 50 Summay, #2 Amahl Law: Spup ovall = ExTim 1 ol = ExTim (1 - Factio hac ) + Factio hac w CPI Law: Spup hac CPU CPU tim tim = Sco = Ituctio x Cycl x Sco Pogam Pogam Ituctio Cycl Excutio tim i th REAL mau of comput pfomac! Goo pouct cat wh hav: Goo bchmak, goo way to ummaiz pfomac Di Cot go oughly with i aa 4 Ca PC iuty uppot giig/ach ivtmt? FTC.W99 51 Pipliig: It Natual! Lauy Exampl A, Bia, Cathy, Dav ach hav o loa of cloth to wah, y, a fol Wah tak 30 miut Dy tak 40 miut Fol tak 20 miut A B C D FTC.W99 52 T a k A B C D Squtial Lauy 6 PM Miight Tim Squtial lauy tak 6 hou fo 4 loa If thy la pipliig, how log woul lauy tak? FTC.W99 53 T a k A B C D Pipli Lauy Stat wok ASAP 6 PM Miight Tim Pipli lauy tak 3.5 hou fo 4 loa FTC.W99 54 Pag 9

10 T a k A B C D Pipliig Lo 6 PM Tim Pipliig o t hlp latcy of igl tak, it hlp thoughput of ti wokloa Pipli at limit by lowt pipli tag Multipl tak opatig imultaouly Pottial pup = Numb pip tag Ubalac lgth of pip tag uc pup Tim to fill pipli a tim to ai it uc pup FTC.W99 55 Comput Pipli Excut billio of ituctio, o thoughput i what matt DLX iabl fatu: all ituctio am lgth, git locat i am plac i ituctio fomat, mmoy opa oly i loa o to FTC.W99 56 Ituctio Ftch 5 Stp of DLX Datapath Figu 3.1, Pag 130 IR It. Dco Rg. Ftch Excut A. Calc Mmoy Acc L M D Wit Back FTC.W99 57 Ituctio Ftch Pipli DLX Datapath Figu 3.4, pag 137 It. Dco Rg. Ftch Excut A. Calc. Data tatioay cotol local co fo ach ituctio pha / pipli tag Mmoy Acc FTC.W99 58 Wit Back I t. Viualizig Pipliig Figu 3.3, Pag 133 Tim (clock cycl) FTC.W99 59 It Not That Eay fo Comput Limit to pipliig: Haza pvt xt ituctio fom xcutig uig it igat clock cycl Stuctual haza: HW caot uppot thi combiatio of ituctio (igl po to fol a put cloth away) Data haza: Ituctio p o ult of pio ituctio till i th pipli (miig ock) Cotol haza: Pipliig of bach & oth ituctiotall th pipli util th hazabubbl i th pipli FTC.W99 60 Pag 10

11 Mmoy Pot/Stuctual Haza Figu 3.6, Pag 142 I t. Loa It 1 It 2 It 3 It 4 Tim (clock cycl) FTC.W99 61 I t. Mmoy Pot/Stuctual Haza Loa It 1 It 2 tall It 3 Figu 3.7, Pag 143 Tim (clock cycl) FTC.W99 62 Sp Up Equatio fo Pipliig CPI pipli = Ial CPI + Pipli tall clock cycl p it Spup = Ial CPI x Pipli pth Clock Cycl x upipli Ial CPI + Pipli tall CPI Clock Cycl pipli Spup = Pipli pth Clock Cycl x upipli 1 + Pipli tall CPI Clock Cycl pipli FTC.W99 63 Exampl: Dual-pot v. Sigl-pot Machi A: Dual pot mmoy Machi B: Sigl pot mmoy, but it pipli implmtatio ha a 1.05 tim fat clock at Ial CPI = 1 fo both Loa a 40% of ituctio xcut Data Haza o R1 Figu 3.9, pag 147 SpUp A = Pipli Dpth/(1 + 0) x (clock upip /clock pip ) = Pipli Dpth SpUp B = Pipli Dpth/( x 1) a 6,1,7 x (clock upip /(clock upip / 1.05) = (Pipli Dpth/1.4) x 1.05 = 0.75 x Pipli Dpth o 8,1,9 SpUp A / SpUp B = Pipli Dpth/(0.75 x Pipli Dpth) = 1.33 Machi A i 1.33 tim fat FTC.W99 64 xo 10,1,11 FTC.W99 65 I t. Tim (clock cycl) a 1,2,3 ub 4,1,3 IF ID/RF EX MEM WB Th Gic Data Haza It I follow by It J Ra Aft Wit (RAW) It J ti to a opa bfo It I wit it FTC.W99 66 Pag 11

12 Th Gic Data Haza It I follow by It J Th Gic Data Haza It I follow by It J Fowaig to Avoi Data Haza Figu 3.10, Pag 149 Tim (clock cycl) Wit Aft Ra (WAR) It J ti to wit opa bfo It I a i Gt wog opa Ca t happ i DLX 5 tag pipli bcau: All ituctio tak 5 tag, a Ra a alway i tag 2, a Wit a alway i tag 5 FTC.W99 67 Wit Aft Wit (WAW) It J ti to wit opa bfo It I wit it Lav wog ult ( It I ot It J ) Ca t happ i DLX 5 tag pipli bcau: All ituctio tak 5 tag, a Wit a alway i tag 5 Will WAR a WAW i lat mo complicat pip FTC.W99 68 I t. a 1,2,3 ub 4,1,3 a 6,1,7 o 8,1,9 xo 10,1,11 FTC.W99 69 HW Chag fo Fowaig Figu 3.20, Pag 161 I t. Data Haza Ev with Fowaig Figu 3.12, Pag 153 Tim (clock cycl) lw 1, 0(2) ub 4,1,6 a 6,1,7 o 8,1,9 I t. Data Haza Ev with Fowaig Figu 3.13, Pag 154 Tim (clock cycl) lw 1, 0(2) ub 4,1,6 a 6,1,7 o 8,1,9 FTC.W99 70 FTC.W99 71 FTC.W99 72 Pag 12

13 Softwa Schulig to Avoi Loa Haza Ty poucig fat co fo a = b + c; = f; aumig a, b, c,,, a f i mmoy. Slow co: LW LW ADD SW LW LW SUB SW Rb,b Rc,c Ra,Rb,Rc a,ra R, Rf,f R,R,Rf,R Cotol Haza o Bach Th Stag Stall Fat co: LW Rb,b LW Rc,c LW R, ADD Ra,Rb,Rc LW Rf,f SW a,ra SUB R,R,Rf SW,R FTC.W99 74 FTC.W99 73 Bach Stall Impact If CPI = 1, 30% bach, Stall 3 cycl => w CPI = 1.9! Two pat olutio: Dtmi bach tak o ot oo, AND Comput tak bach a ali DLX bach tt if git = 0 o 0 DLX Solutio: Mov Zo tt to ID/RF tag A to calculat w PC i ID/RF tag 1 clock cycl palty fo bach vu 3 FTC.W99 75 Pipli DLX Datapath Figu 3.22, pag 163 Fou Bach Haza Altativ Fou Bach Haza Altativ Ituctio Ftch It. Dco Rg. Ftch Excut A. Calc. Mmoy Acc Thi i th coct 1 cycl latcy implmtatio! Wit Back #1: Stall util bach ictio i cla #2: Pict Bach Not Tak Excut ucco ituctio i quc Squah ituctio i pipli if bach actually tak Avatag of lat pipli tat upat 47% DLX bach ot tak o avag PC+4 alay calculat, o u it to gt xt ituctio #3: Pict Bach Tak 53% DLX bach tak o avag But hav t calculat bach tagt a i DLX» DLX till icu 1 cycl bach palty» th machi: bach tagt kow bfo outcom #4: Dlay Bach Dfi bach to tak plac AFTER a followig ituctio bach ituctio qutial ucco 1 qutial ucco 2... qutial ucco bach tagt if tak Bach lay of lgth 1 lot lay allow pop ciio a bach tagt a i 5 tag pipli DLX u thi FTC.W99 76 FTC.W99 77 FTC.W99 78 Pag 13

14 Dlay Bach Wh to gt ituctio to fill bach lay lot? Bfo bach ituctio Fom th tagt a: oly valuabl wh bach tak Fom fall though: oly valuabl wh bach ot tak Cacllig bach allow mo lot to b fill Compil ffctiv fo igl bach lay lot: Fill about 60% of bach lay lot About 80% of ituctio xcut i bach lay lot uful i computatio About 50% (60% x 80%) of lot ufully fill Dlay Bach owi: 7-8 tag pipli, multipl ituctio iu p clock (upcala) FTC.W99 79 Evaluatig Bach Altativ Pipli pup = Pipli pth 1 +Bach fqucy Bach palty Schulig Bach CPI pup v. pup v. chm palty upipli tall Stall pipli Pict tak Pict ot tak Dlay bach Coitioal & Ucoitioal = 14%, 65% chag PC FTC.W99 80 Pipliig Summay Jut ovlap tak, a ay if tak a ipt Sp Up Š Pipli Dpth; if ial CPI i 1, th: Spup = Pipli Dpth 1 + Pipli tall CPI Clock Cycl Upipli X Clock Cycl Pipli Haza limit pfomac o comput: Stuctual: mo HW ouc Data (RAW,WAR,WAW): fowaig, compil chulig Cotol: lay bach, pictio FTC.W99 81 Pag 14