Building Validation Suites with Eclipse for M odel-based G eneration Tools 24.6.2010 D r. O scar Slotosch Validas A G
C ontent M o d el-b ased D evelo p m en t (o f Em b ed d ed Syst em s) ISO 26262 Valid at io n Su it e - A r ch it ect u r e - U sed Eclip se Tech n o lo gies fo r b u ild in g - Ex p er ien ces C o n clu sio n 2
Validas A G Founded 2000 20 Employes Motto: Validated Quality Model-based Development Model-based Testing Tool Qualifications We solve Your Challanges! Clients BMW EADS ESG Giesecke & Devrient MAN Eurocopter
M o d els in Em b ed d ed Syst em D evelo p m en t Pr o cess M o d el-b ased T est in g Test-Generator Integration Test M o d el-b ased D evelo p m en t Code-Generator Su p p o r t in g T o o ls Unit Test A p p licat io n / D o m ain Sp ecific ( Syst em ) M o d els U n ified M o d els M o d el-b ased T o o ls 4
M o d el-b ased D evelo p m en t D evelo p m en t M o d el C r eat io n = > G r ap h ical To o l C o d e G en er at io n = > G en er at o r C o d e C o m p ilat io n = > C o m p iler Im p o r t an t Ver ificat io n M et h o d s fo r M o d els Sim u lat io n (M IL,SIL,PIL) R u le C h eck in g ( Su b set -C h ecker ) Pr o p er t y Ver ificat io n (Fo r m al M et h o d s) M o d el C o ver age Back -To -Back -Test in g: M IL= SIL= PIL Out1=(In1+In2)*In3; maddf a15,a4,d15,#0 5
ISO 26262-8, C hapter 11: Q ualification of software tools C lassificat io n in To o l C o n fid en ce Level (T C L) To o l Im p act (T I) - T I0: n o im p act = > To o l is T C L1 - T I1 : so m e im p act To o l Er r o r D et ect io n /p r even t io n p r o b ab ilit y (T D ) T D 1 :h igh co n fid en ce = > To o l is T C L1 T D 2:m ed iu m co n fid en ce = > To o l is T C L2 T D 3: lo w co n fid en ce = > To o l is T C L3 T D 4: o t h er = > To o l is T C L4 6
Example: Tool C hains in M odel-based D evelopment M o d el C o d e G en er at o r C -C o d e PC C o m p iler SIL-C o d e SIL T est t o o l R esu lt s PIL T est t o o l M o d el R eq u ir em en t s Sim u lat o r C -C o d e R esu lt s T ar get C o m p iler T ar get C o d e T ar get C o d e C u st o m er : can ver ify t o o l r esu lt s To o l p r o vid er A n fo r d er u n gen - H as t o r eq u ir e ver ificat o n o f h is t o o ls ( r ed u n d an cy ) o r - Valid at e h is t o o l (Valid at io n Su it e / Pr o ven in u se) 7
Process of Tool Q ualification R eq u ir em en t s / St an d ar d M an u al o f To o l w it h - U sed Fu n ct io n s To o l D evelo p er G u id e (Pr o cess) Valid at io n an d Ver ificat io n Plan fo r - R eq u ir em en t s V alid at io n - Functions Su it e - C o m p lian ce w it h Pr o cess Valid at io n an d Ver ificat io n R ep o r t Q u o t e fr o m A d a-t est Su it e (A C A T S): t h e A C A T S t est s t h e n o r m al u sage o f t h ese feat u r es, not unusual corner-cases. 8
Test M ethod for G enerators C onstruction of Validation Suites Test Sp ecificat io n : D o m ain /To o l Sp ecific Lan gu age Test In p u t s: (M o d el-)g en er at o r Test O u t p u t s: To o l In t er p r et er (R efer en ce To o l) Test A u t o m at isat io n o f - C o d e G en er at io n, C o m p ilat io n an d - Ex ecu t io n (o n Tar get ) A n alysis t o o ls: - R ep o r t G en er at io n - R o o t C au se A n alysis U n t il: - A ll M o d el/feat u r es ar e co ver ed -> M o d el C o ver age - A ll Test s h ave b een Ex ecu t ed - A ll D eviat io n s h ave b een an alyzed 9
Eclipse-M odeling for the C onstruction of Suites M o d els/c o d e M o d el C o d e G en er at o r C o m p iler uint8 Out; int16 In1,In2; Out = In1 % In2; V alid at io n Su it ite - M o d els - T est D at a D SL M 1 M 2 M et a M o d el Param Type; Param Op; Out uint8; In1,In2 Type; Out = Op(In1,In2); x T ex t / A T L M 2M A T L O C L Pr o ject io n Sem an t ik Fu n ct io n s? En d? C o r r ect n ess? Sp ecificat io n? 10
C overage: M odel-projektion In p u t : Set o f R efer en ce - - - M o d els / Elem en t s o f M et a M o d els X M L-St r u ct u r es Pr o cect io n R esu lt s (h ier ar chy) O u t p u t : List o f u sed - - - M o d el Elem en t s M o d el Pr o p er t ies Set t in gs / C o n figu r at io n s Filt er M ech an ism fo r n o t r elevan t p r o p er t ies (co lo r,..) C o m p ar isio n o f t w o Set s - - Valid at io n Su it e A p p licat io n m o d els 11
Example of M eta M odel O r ien t ed o n M o d el Elem en t s / Fu n ct io n s 12
U sed Eclipse Tools D SL (x Tex t ) fo r Sp ecificat io n - Par am et er : O p er at o r s, Typ es, C o n st an t s AT L fo r Tr an slat io n x Tex t -> M 1 M 2M zu r G en er at io n o f M o d els M 2M D efin it io n o f Sem an t ic O C L fo r M o d elin g R u le C h ecker M o d el-pr o jek t io n o n EM F-M o d els fo r C o ver age/fu n ct io n s 13
D SL for Test Specification and G eneration Sp ecificat io n = M o d el D escr ip t io n + Par am et er 14
Eclipse Experiences M 1 : ap p r o x. 1 50 C lasses M 2: ap p r o x. 350 C lasses M 2M : ap p r o x. 1 3000 Lin es o f AT L Tr an sfo r m at io n s D SL: ap p r o x 4000 Lin es o f Test Sp ecificat io n R esu lt s (Test su it e), gen er at ed in so m e h o u r s: - 1 0000 M o d els w it h - 600000 Test seq u en ces St ab ile & p er fo r m an t so lu t io n W e w o u ld d o it again u sin g t h ese Eclip se t o o ls 15
Vision: Validation Framework for D ifferent C C ompilers Compiler C for T Compiler (incl. Source-Code) -Target-Semantic -Libraries -Target-Spezifica Opt. Restrictions -Configuration -Features Compiler Validation Framework Generic Part Validation Suite for Compiler C and Target T Bugs / Restrictions Qualification Report C Code Static Checker OK / NOK Test Data Dynamic Test-Checker OK / NOK 16
Summary M o d els in D evelo p m en t o f Em b ed d ed Syst em s ISO 26262 To o l C lassificat io n Valid at io n Su it es Eclip se is su it ab le fo r b u ild in g Su it es 17
T h an k Yo u! Your partner for innovation in embedded quality Arnulfstraße 27 80335 München www.validas.de info@validas.de 18