Revisiting Memory Errors in Large-Scale Production Data Centers

Transcription

1 Revisiting Memory Errors in Large-Scale Production Da Centers Analysis and Modeling of New Trends from the Field Justin Meza Qiang Wu Sanjeev Kumar Onur Mutlu

2 Overview Study of DRAM reliability: on modern devices and workloads at a large scale in the field

3 Overview Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

4 Overview Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Errors follow a power-law distribution and a large number of errors occur due to sockets/channels Modeling errors Architecture & workload

5 Overview Error/failure occurrence We find that newer cell fabrication technologies have higher failure rates Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

6 Overview Error/failure occurrence Chips per DIMM, transfer width, and workload type (not necessarily CPU/ memory utilization) affect reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

7 Overview Error/failure occurrence We have made publicly available a stistical model for assessing server memory reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

8 Overview Error/failure occurrence Page offlining at scale First large-scale study of page offlining; real-world limitions of technique New reliability trends Technology scaling Modeling errors Architecture & workload

9 Outline background and motivation server memory organization error collection/analysis methodology memory reliability trends summary

10 Background and motivation

11 DRAM errors are common examined extensively in prior work charged particles, wear-out variable retention time (next lk) error correcting codes used to detect and correct errors require additional storage overheads

12 Our goal Strengthen undersnding of DRAM reliability by studying: new trends in DRAM errors modern devices and workloads at a large scale billions of device-days, across 4 months

13 Our main contributions identified new DRAM failure trends developed a model for DRAM errors evaluated page offlining at scale

14 Server memory organization

15

16 Socket

17 Memory channels

18 DIMM slots

19 DIMM 24 2

20 Chip 24 2

21 Banks 24 2

22 24 2 Rows and columns

23 24 2 Cell

24 User da 24 2 ECC meda additional 2.% overhead

25 Reliability events Fault the underlying cause of an error DRAM cell unreliably stores charge Error the manifestion of a fault permanent: every time transient: only some of the time

26 Error collection/ analysis methodology

27 DRAM error measurement measured every correcble error across Facebook's fleet for 4 months meda associated with each error parallelized Map-Reduce to process used R for further analysis

28 System characteristics 6 different system configurations Web, Hadoop, Ingest, Dabase, Cache, Media diverse CPU/memory/storage requirements modern DRAM devices DDR communication protocol (more aggressive clock frequencies) diverse organizations (banks, ranks,...) previously unexamined characteristics density, # of chips, transfer width, workload

29 Memory reliability trends

30 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

31 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

32 Server error rate )UaFtion of seuveus CoUUeFEle euuous (C() 8nFoUUeFEle euuous (8C() % 7/ 8/ 9/ / / 2/ /4 2/4 /4 4/4 /4 6/4 7/4 8/4.% onth

33 Memory error distribution

34 Memory error distribution creasing hazard rate

35 Memory error distribution creasing hazard rate How are errors mapped to memory organization?

36 Sockets/channels: many errors Socket Channel Bank Row Column Cell Spurious Fraction of errors...

37 Sockets/channels: many errors Fraction of errors... Socket Channel Bank Row Not mentioned in prior chiplevel studies Column Cell Spurious

38 Sockets/channels: many errors Fraction of errors... Socket Channel Bank Row Not accounted for in prior chiplevel studies At what rate do components fail on servers? Column Cell Spurious

39 Bank/cell/spurious failures are common Socket Channel Bank Row Column Cell Spurious Fraction of servers...

40 # of servers # of errors Socket Channel Fraction of servers... Fraction of errors Socket Channel... nial-ofservice like behavior

41 # of servers # of errors Socket Channel Fraction of servers... Socket Fraction of errors Channel... nial-ofservice like behavior What factors contribute to memory failures at scale?

42 Analytical methodology measure server characteristics not feasible to examine every server examined all servers with errors (error group) sampled servers without errors (control group) bucket devices based on characteristics measure relative failure rate of error group vs. control group within each bucket

43 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

44 Prior work found inconclusive trends with respect to memory capacity Relative server failure rate DIMM capacity (GB)

45 Prior work found inconclusive trends with respect to memory capacity Relative server failure rate... Examine characteristic more closely related to cell fabrication technology DIMM capacity (GB)

46 Use DRAM chip density to examine technology scaling (closely related to fabrication technology)

47 Relative server failure rate Chip density (Gb)

48 Relative server failure rate... Intuition: quadratic increase in capacity 2 4 Chip density (Gb)

49 Error/failure occurrence We find that newer cell fabrication technologies have higher failure rates Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

50 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

51 DIMM architecture chips per DIMM, transfer width 8 to 48 chips x4, x8 = 4 or 8 bits per cycle electrical implications D Registe Clock il C. il D Back 2..2 Side 24 2 f Con B.46mm m il of Con C il of Con D ~

52 DIMM architecture Does DIMM organization affect memory reliability? chips per DIMM, transfer width 8 to 48 chips x4, x8 = 4 or 8 bits per cycle electrical implications D Registe Clock il C. il D Back 2..2 Side 24 2 f Con B.46mm m il of Con C il of Con D ~

53 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

54 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

55 Gb 2 Gb 4 Gb Relative server failure rate... x8 No consistent trend across only chips per DIMM x Da chips per DIMM

56 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

57 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

58 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

59 Gb 2 Gb 4 Gb Relative server failure rate... x8 x4 More chips higher failure rate Da chips per DIMM

60 Gb 2 Gb 4 Gb Relative server failure rate... x8 x Da chips per DIMM

61 Gb 2 Gb 4 Gb Relative server failure rate... x8 x4 More bits per cycle higher failure rate Da chips per DIMM

62 Gb 2 Gb 4 Gb Relative server failure rate... x8 x4 Intuition: increased electrical loading Da chips per DIMM

63 Workload dependence prior studies: homogeneous workloads web search and scientific warehouse-scale da centers: web, hadoop, ingest, dabase, cache, media

64 Workload dependence prior studies: homogeneous workloads What affect to heterogeneous workloads have on reliability? web search and scientific warehouse-scale da centers: web, hadoop, ingest, dabase, cache, media

65 Gb 2 Gb 4 Gb Relative server failure rate... Relative server failure rate CPU utilization.2..7 Memory utilization

66 Gb 2 Gb 4 Gb Relative server failure rate... Relative server failure rate No consistent trend across CPU/memory utilization CPU utilization.2..7 Memory utilization

67 Web Hadoop Ingest Dabase Memcache Media Relative server failure rate...

68 Web Hadoop Ingest Dabase Memcache Media Relative server failure rate... Varies by up to 6.x

69 Error/failure occurrence Chips per DIMM, transfer width, and workload type (not necessarily CPU/ memory utilization) affect reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

70 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

71 A model for server failure use stistical regression model compare control group vs. error group linear regression in R trained using da from analysis enable exploratory analysis high perf. vs. low power systems

72 nsity Chips Age Memory error model Relative server failure rate...

73 nsity Chips Age Memory error model Relative server failure rate... Number of physical CPU cores in the server. 2 Yes ln ŒF=. F/ç D ˇIntercept C.Capacity ˇCapacity / C.nsity2Gb ˇnsity2Gb / C.nsity4Gb ˇnsity4Gb / C.Chips ˇChips / C.CPU% ˇCPU% / C.Age ˇAge / C.CPUs ˇCPUs /

74 Available online

75 Error/failure occurrence We have made publicly available a stistical model for assessing server memory reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

76 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

77 Prior page offlining work [Tang+,DSN'6] proposed technique "retire" faulty pages using OS do not allow software to allocate them [Hwang+,ASPLOS'2] simulated eval. error traces from Google and IBM recommended retirement on first error large number of cell/spurious errors

78 Prior page off lining work [Tang+,DSN'6] proposed technique "retire" faulty pages using OS How effective is page offlining in the wild? do not allow software to allocate them [Hwang+,ASPLOS'2] simulated eval. error traces from Google and IBM recommended retirement on first error large number of cell/spurious errors

79 Cluster of 2,276 servers

80 Cluster of 2,276 servers -67%

81 Cluster of 2,276 servers -67% Prior work: -86% to -94%

82 Cluster of 2,276 servers -67% 6% of page offlining attempts failed due to OS Prior work: -86% to -94%

83 Error/failure occurrence Page offlining at scale First large-scale study of page offlining; real-world limitions of technique New reliability trends Technology scaling Modeling errors Architecture & workload

84 Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

85 More results in paper Vendors Age Processor cores Correlation analysis Memory model case study

86 Summary

87 Modern systems Large scale

88 Summary Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

89 Summary Error/failure occurrence Page offlining at scale New reliability trends Technology scaling Errors follow a power-law distribution and a large number of errors occur due to sockets/channels Modeling errors Architecture & workload

90 Summary Error/failure occurrence We find that newer cell fabrication technologies have higher failure rates Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

91 Summary Error/failure occurrence Chips per DIMM, transfer width, and workload type (not necessarily CPU/ memory utilization) affect reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

92 Summary Error/failure occurrence We have made publicly available a stistical model for assessing server memory reliability Page offlining at scale New reliability trends Technology scaling Modeling errors Architecture & workload

93 Summary Error/failure occurrence Page offlining at scale First large-scale study of page offlining; real-world limitions of technique New reliability trends Technology scaling Modeling errors Architecture & workload

94 Revisiting Memory Errors in Large-Scale Production Da Centers Analysis and Modeling of New Trends from the Field Justin Meza Qiang Wu Sanjeev Kumar Onur Mutlu

95 Backup slides

96 creasing hazard rate

97 A n Co of. il et llim mi s: t i Un s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle..8 A n Co of. il B ts c on fc il o s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle D A n Co of. il il o e.8 B ts c on fc il o C. et llim mi s: t i Un f n Co 2.. s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. x ma ~ ted s ise w r e 2. mm.. et llim mi s: t i Un f C on fc D.8 D il o e n Co. x ma ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc 2. mm ted s ise w r e ~. o il.2 D.8 B ts c on fc il o f C on fc 6m.4 D il o e n Co e Sid m max 6m.4 o il. x ma P_ W :WP_ 89 _482 CWM APCP 2. mm 7.2. A n Co of. il.6 on fc 7. D. ~..2 o il.. X 2 e Sid m max 2 ck Ba C il. 47 6m.4 D.. 7. il D B ts c on fc il o C 4X 2..8 on fc il A 2.. X. e Sid m max 6m D 24 f 9 8. TS 2 SPD il B ck Ba C il il D 2.. nt Fro. 2. 4X 2. il o e. A R8 BF 2 R7 G MT -H.2 7. o il n Co il A 2.. X. e Sid m max ck Ba C il. 47. X il D x7 G il B.8 4X 9 8. TS 2 SPD il A nt Fro. P_ W :WP_ 89 _482 CWM APCP. 7.2 C il. 47. A R8 BF 2 R7 G MT -H x7 G il B il D ck Ba 9 8. TS 2 SPD X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc 2.. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e s er 7

98 A n Co of. il Errors. : te No. nsity..8 B ts c on fc il o et llim mi s: t i Un c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 4Gb oth ss nle. ted s ise w r e s er D.8 B ts c on fc il o. et llim mi s: t i Un f C s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle Gb x ma D A n Co of. il il o e B ts c on fc il o C. et llim mi s: t i Un f n Co mm ted s ise w r e ~. on fc. s er 2. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 2Gb..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. il o e n Co o il D. x ma A n Co of. il on fc 6m.4 D 2. mm 7.2. ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc o il P_ W :WP_ 89 _482 CWM APCP D ~. e Sid m max 6m.4.8 f C 7..2 D il o e n Co.2 4, A n Co of. il.2 x ma e Sid m max.. X on fc C il ck Ba 2.. 6m.4 2. mm X il D ~ B ts c on fc il o 7. o il 2. D 24 f C il A e Sid m max.. X D 2. il o e 6m.4 on fc C il o il n Co ck Ba. 4X il D X. e Sid m max 7. il A 9 8. TS 2 SPD il B X C il ck Ba 2.. il D nt Fro.. 7 4X 2 x7 G il B. 7 A R8 BF 2 R7 G MT -H TS 2 SPD.2 il A 2. C il. 47. nt Fro. P_ W :WP_ 89 _482 CWM APCP.. 2. A R8 BF 2 R7 G MT -H.. 2 x7 G il B. 7 il D ck Ba 9 8. TS 2 SPD.8 4X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e 2Gb s er 7

99 A n Co of. il Errors. : te No. nsity..8 B ts c on fc il o et llim mi s: t i Un c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 4Gb. ted s ise w r e s er D.8 B ts c on fc il o. et llim mi s: t i Un f C s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle Gb x ma D A n Co of. il il o e B ts c on fc il o C. et llim mi s: t i Un f n Co mm ted s ise w r e ~. on fc. s er 2. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 2Gb Errors nsity..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. il o e n Co o il D. x ma A n Co of. il on fc 6m.4 D 2. mm 7.2. ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc o il P_ W :WP_ 89 _482 CWM APCP D ~. e Sid m max 6m.4.8 f C 7..2 D il o e n Co.2 4, A n Co of. il.2 x ma e Sid m max.. X on fc C il ck Ba 2.. 6m.4 2. mm X il D ~ B ts c on fc il o 7. o il 2. D 24 f C il A e Sid m max.. X D 2. il o e 6m.4 on fc C il o il n Co ck Ba. 4X il D X. e Sid m max 7. il A 9 8. TS 2 SPD il B X C il ck Ba 2.. il D nt Fro.. 7 4X 2 x7 G il B. 7 A R8 BF 2 R7 G MT -H TS 2 SPD.2 il A 2. C il. 47. nt Fro. P_ W :WP_ 89 _482 CWM APCP.. 2. A R8 BF 2 R7 G MT -H.. 2 x7 G il B. 7 il D ck Ba 9 8. TS 2 SPD.8 4X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e 2Gb s er 7

100 A n Co of. il Errors. : te No. nsity..8 B ts c on fc il o et llim mi s: t i Un c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 4Gb. ted s ise w r e s er D.8 B ts c on fc il o. et llim mi s: t i Un f C s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle Gb x ma D A n Co of. il il o e B ts c on fc il o C. et llim mi s: t i Un f n Co mm ted s ise w r e ~. on fc. s er 2. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 2Gb Buckets Errors nsity..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. il o e n Co o il D. x ma A n Co of. il on fc 6m.4 D 2. mm 7.2. ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc o il P_ W :WP_ 89 _482 CWM APCP D ~. e Sid m max 6m.4.8 f C 7..2 D il o e n Co.2 4, A n Co of. il.2 x ma e Sid m max.. X on fc C il ck Ba 2.. 6m.4 2. mm X il D ~ B ts c on fc il o 7. o il 2. D 24 f C il A e Sid m max.. X D 2. il o e 6m.4 on fc C il o il n Co ck Ba. 4X il D X. e Sid m max 7. il A 9 8. TS 2 SPD il B X C il ck Ba 2.. il D nt Fro.. 7 4X 2 x7 G il B. 7 A R8 BF 2 R7 G MT -H TS 2 SPD.2 il A 2. C il. 47. nt Fro. P_ W :WP_ 89 _482 CWM APCP.. 2. A R8 BF 2 R7 G MT -H.. 2 x7 G il B. 7 il D ck Ba 9 8. TS 2 SPD.8 4X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e 2Gb s er 7

101 A n Co of. il Errors. : te No. nsity..8 B ts c on fc il o et llim mi s: t i Un c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 4Gb. ted s ise w r e s er D.8 B ts c on fc il o. et llim mi s: t i Un f C s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle Gb x ma D A n Co of. il il o e B ts c on fc il o C. et llim mi s: t i Un f n Co mm ted s ise w r e ~. on fc. s er 2. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 2Gb Errors nsity..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. il o e n Co o il D. x ma A n Co of. il on fc 6m.4 D 2. mm 7.2. ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc o il P_ W :WP_ 89 _482 CWM APCP D ~. e Sid m max 6m.4.8 f C 7..2 D il o e n Co.2 4, A n Co of. il.2 x ma e Sid m max.. X on fc C il ck Ba 2.. 6m.4 2. mm X il D ~ B ts c on fc il o 7. o il 2. D 24 f C il A e Sid m max.. X D 2. il o e 6m.4 on fc C il o il n Co ck Ba. 4X il D X. e Sid m max 7. il A 9 8. TS 2 SPD il B X C il ck Ba 2.. il D nt Fro.. 7 4X 2 x7 G il B. 7 A R8 BF 2 R7 G MT -H TS 2 SPD.2 il A 2. C il. 47. nt Fro. P_ W :WP_ 89 _482 CWM APCP.. 2. A R8 BF 2 R7 G MT -H.. 2 x7 G il B. 7 il D ck Ba 9 8. TS 2 SPD.8 4X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e 2Gb s er 7

102 A n Co of. il Errors. : te No. nsity..8 B ts c on fc il o et llim mi s: t i Un c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 4Gb. ted s ise w r e s er D.8 B ts c on fc il o. et llim mi s: t i Un f C s er. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle Gb x ma D A n Co of. il il o e B ts c on fc il o C. et llim mi s: t i Un f n Co mm ted s ise w r e ~. on fc. s er 2. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2 oth ss nle 2Gb Errors nsity..6. : te No. c ran tole Re v.. eo /A na ug u ns sio en im ll d.2. ~. mm 7.2 x ma. et llim mi s: t i Un 7.2. ted s ise w r e.. il o e n Co o il D. x ma A n Co of. il on fc 6m.4 D 2. mm 7.2. ring r iste Reg k Drive Cloc ring r iste Reg k Drive Cloc o il P_ W :WP_ 89 _482 CWM APCP D ~. e Sid m max 6m.4.8 f C 7..2 D il o e n Co.2 4, A n Co of. il.2 x ma e Sid m max.. X on fc C il ck Ba 2.. 6m.4 2. mm X il D ~ B ts c on fc il o 7. o il 2. D 24 f C il A e Sid m max.. X D 2. il o e 6m.4 on fc C il o il n Co ck Ba. 4X il D X. e Sid m max 7. il A 9 8. TS 2 SPD il B X C il ck Ba 2.. il D nt Fro.. 7 4X 2 x7 G il B. 7 A R8 BF 2 R7 G MT -H TS 2 SPD.2 il A 2. C il. 47. nt Fro. P_ W :WP_ 89 _482 CWM APCP.. 2. A R8 BF 2 R7 G MT -H.. 2 x7 G il B. 7 il D ck Ba 9 8. TS 2 SPD.8 4X..2 il A nt Fro. P_ W :WP_ 89 _482 CWM APCP 2. ring r iste Reg k Drive Cloc 2 x7 G il B A R8 BF 2 R7 G MT -H TS 2 SPD ring r iste Reg k Drive Cloc. nt Fro P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP 2 x7 G :WP_ 89 _482 CWM APCP P_ W A R8 BF R7 G MT -H P_ W :WP_ 89 _482 CWM APCP P_ W :WP_ 89 _482 CWM APCP oth ss nle. ted s ise w r e 2Gb s er 7

103 Case study

104 Case study Factor Low-end High-end (HE) Capacity 4 GB 6 GB nsity2gb nsity4gb Chips 6 2 CPU% % 2% Age CPUs 8 6 Predicted relative failure rate.2.78 Inputs Output

105 Case study Factor Low-end High-end (HE) Capacity 4 GB 6 GB nsity2gb nsity4gb Chips a higher 6 impact? 2 CPU% % 2% Age CPUs 8 6 Predicted relative failure rate.2.78 Does CPUs or density have Inputs Output

106 Exploratory analysis Factor Low-end High-end (HE) HE/#density HE/#CPUs Capacity 4 GB 6 GB 4 GB 6 GB nsity2gb nsity4gb Chips CPU% % 2% 2% % Age CPUs Predicted relative failure rate

107 Exploratory analysis Factor Low-end High-end (HE) HE/#density HE/#CPUs Capacity 4 GB 6 GB 4 GB 6 GB nsity2gb nsity4gb Chips CPU% % 2% 2% % Age CPUs Predicted relative failure rate