arxiv: v1 [cond-mat.mtrl-sci] 10 Aug 2017

Transcription

1 rxiv: v1 [ond-mt.mtrl-si] 1 Aug 217 Knowledge-Trnsfer sed Cost-effetive Serh for Interfe Strutures: A Cse Study on f-al [11] Tilt Grin Boundry Tomohiro Yonezu 1, Tomoyuki Tmur 2,3, Ihiro Tkeuhi 1,3, nd Msyuki Krsuym 1,3,4 1 Deprtment of Computer Siene, Ngoy Institute of Tehnology, Gokiso, Show, Ngoy, Aihi , Jpn 2 Deprtment of Physil Siene nd Engineering, Ngoy Institute of Tehnology, Gokiso, Show, Ngoy, Aihi , Jpn 3 Center for Mterils reserh y Informtion Integrtion, Ntionl Institute for Mterils Siene, Tsuku 35-47, Jpn 4 PRESTO, Jpn Siene nd Tehnologil Ageny, Honho, Kwguhi, Sitm, , Jpn Corresponding uthor tmur.tomoyuki@niteh..jp Corresponding uthor krsuym@niteh..jp 1

2 Astrt Determining the tomi onfigurtion of n interfe is one of the most importnt issues in the mterils reserh. Although theoretil simultions re effetive tools for tht purpose, the exhustive serh is omputtionlly prohiitive due to high degrees of freedom of the interfe struture. For the fst explortion of the interfe strutures, we introdue two mhine-lerning onepts, lled trnsfer lerning nd ost-sensitive serh. To solve multiple different (ut relted) tsks, trnsferring knowledge of eh tsk improves effiieny of mhine-lerning methods. In the interfe-struture serh, multiple energy surfes reted y vriety of different orienttion ngles need to e explored to understnd interfe properties. A knowledge-trnsfer sed mhine-lerning lgorithm n provide n effiient serh for the interfe strutures y exploiting similrity mong multiple energy surfes. Further, we onsider diversity of superell sizes of interfe models, whih results in different omputtionl ost of eh serh spe. The ide of the ost-sensitive serh is to ompre ndidte strutures sed on oth of possile energy derese nd the omputtionl ost, mening tht eh ndidte is evluted y its ost-effetiveness for the energy derese. By omining the ove two mhine-lerning onepts, our method relizes ost-effetive simultneous serh for multiple energy surfes. As se study, we show effiieny of our method using the f-al [11] tilt grin oundry. 2

3 1 Introdution A grin oundry (GB) is the interfe etween two grins or rystllines in polyrystlline mteril, nd hs signifintly different tomi onfigurtion from single rystl. Sine this uses peulir mehnil nd eletril properties of mterils, one of the most importnt issues in mterils reserh is determining the tomi onfigurtion of n interfe. Experimentl oservtions, suh s the tomi-resolution trnsmission eletron mirosope (TEM) oservtion [1], nd theoretil simultions, suh s first-priniples lultions sed on density funtionl theory nd stti lttie lultions with empiril potentils, hve een extensively performed to investigte interfe strutures. Determining n interfe struture y using theoretil simultions needs huge omputtionl ost due to the geometril degree of freedom. Nine degrees of freedom re present in GB: five mrosopi nd four mirosopi [2], nd huge numer of GB models should e onsidered. In even simplified oinidene site lttie (CSL) GB, nmely Σ GB, for monotomi system, three dimensionl rigid ody trnsltion (RBT) sttes should e onsidered. To understnd the whole nture of GBs, one hs to otin stle interfe strutures over ll rottion ngles nd ll rottion xes. In strightforwrd mnner, ll possile ndidtes of GB models re optimized nd the lowest-energy onfigurtion is otined. But this pproh is prtilly exhusting, nd developing effiient pprohes to determining the interfe struture without serhing ll possile ndidtes is strongly demnded. In reent yers, mterils informtis tehniques sed on mhine lerning hve een introdued in the literture s n inexpensive mens of exploiting mterils dt [3]. For the struture serh, whih is our min interest in this pper, mhine lerning tehnique lled Byesin optimiztion [4] hs proven its usefulness minly y the pplition to determining stle ulk strutures [5, 6]. Byesin optimiztion is generl glol optimiztion method whih is sed on Byesin inferene of the serh spe, nd it n del with vriety of mteril-disovery prolems, suh s identifying the low energy region in 3

4 potentil energy surfe [7]. For the interfe struture, some ppers [8, 9] proposed to pply Byesin optimiztion to the GB-struture serh, nd shown its effiieny, for exmple, y using the f-cu Σ5 [1](21) CSL GB. However, their serh method is stndrd Byesin optimiztion sme s the method employed in the ulk se, nd the serh methodology speifi for GBs hs not een introdued so fr to the est of our knowledge. We onsider generl prolem setting in the GB-struture serh whih is to explore vriety of rottion ngles for some fixed rottion xis. Suppose tht we hve T different ngles to serh, nd ndidte strutures re reted y RBTs for eh of them. A nive pproh to this prolem is to pply some serh method, suh s Byesin optimiztion [8, 9], T times seprtely, ut this pproh is not effiient euse it ignores the following two importnt hrteristis of the GB struture: 1. Energy-surfe similrity: The energy surfes of different ngles re often quite similr. This similrity is explined y struturl unit model [1, 11, 12, 13] whih hs een widely epted to desrie GB strutures in mny mterils. This model suggests tht different GBs n ontin ommon struturl units, nd then they shre the similr lol tomi environments. Although struturlly similr GBs n produe similr energy surfes, the nive pproh does not utilize this similrity nd restrts the struture serh from srth for eh ngle. 2. Cost imlne: The omputtionl time sles s O(M) O(M 3 ) for numer of toms M in the superells, depending on the omputtionl sheme. GB superells usully hve vriety of sizes euse of the diversity of the Σ vlue, whih is the inverse density of lttie sites. This mens tht omputtionl osts for lrge Σ GBs drmtilly inrese euse the numer of toms in superell inreses. Thus, the struture serh for lrge Σ GBs is more time-onsuming thn smll Σ GBs. Figure 1 shows () lulted stle GB energies for f-al [11] tilt GBs nd () energy surfes reted y two dimensionl RBTs for the rottion ngles 141 4

5 (top), 134 (ottom left) nd 145 (ottom right). The entire lndspe of the surfes re similr, while their omputtionl osts re lrgely different sine the iggest superell (Σ89) ontins lmost 1 times lrger numer of toms thn the smllest superell (Σ9). In this pper, we propose mhine-lerning sed stle struture serh method whih is prtiulrly effiient for GB y tking two hrteristis of the GB-struture into ount. For energy-surfe similrity, we introdue mhine-lerning onept lled trnsfer lerning [14]. The si ide is to trnsfer knowledge mong different (ut relted) tsks to improve effiieny of mhine-lerning methods. A tsk is GB-struture serh for fixed ngle in this pper. When tsks hve similrity eh other, informtion umulted for one speifi tsk n e useful for the other tsks. For our struture-serh prolem, in perspetive of the Byesin inferene, smpled GB model for n ngle provides informtion to other ngles proilistilly, given some similrity mesure etween ngles. A vriety of similrity mesures re ville to desrie ngle differenes, inluding the rottion ngle nd rdil distriution of toms, nd thus we n exploit similrity mong struture serhes with different ngles for fst onvergene of the optimiztion. For the ost imlne issue, we introdue ost-sensitive serh. Our method inorportes ost informtion into the smpling deision, whih mens tht we evlute eh ndidte sed on oth of possiility of n energy improvement nd ost of smpling. By omining the ost-sensitive serh with trnsfer lerning, our method umultes informtion y smpling low ost surfes in the initil stge of the serh, nd n identify the stle strutures in high ost surfes with smll numer of smpling sed on trnsferred surfe informtion. As se study, we evlute ost-effetiveness of our method sed on f-al [11] tilt GBs. 5

6 2 Methods 2.1 Prolem Setting Suppose tht we hve t = 1,..., T different rottion ngles θ t, for eh of whih we hve N t ndidte-gb models reted y rigid ody trnsltions (RBTs). Figure 2 shows n exmple of superell of Σ9 GB model (see 3.1 for detil of our GB model), from whih N t GB models re reted y RBTs. The totl numer of the GB models is denoted s N = T t=1 N t. We would like to serh the stle GB strutures with respet to ll of the given rottion ngles. In this pper, GB energy is defined ginst the totl energy of the ulk rystl s E GB = Etot GB E ulk, (1) 2S where E GB is the totl energy of the GB superell, E BS is the ulk energy with the sme numer of toms s the GB superell, nd S is the ross-setion re of the GB model in the superell. In the denomintor, the ross-setion re S is multiplied y 2 sine the superell ontins two GB plnes s shown in Figure 2. Note tht the GB energy for eh GB model is lulted through tomi relxtion. A set of GB energies for ll N GB models is represented s vetor E = (E (1) GB,..., E(N) GB ), where E (i) GB is the GB energy of the i-th GB model. A stle struture serh for some fixed ngle n e mthemtilly formulted s prolem to find lower energy strutures with smller numer of smpling from ndidtes. The numer of ndidte strutures is often too lrge to exhustively ompute their energies, nd we usully do not know the ext energy surfe s funtion in the serh spe. This prolem setting is thus sometime lled lk-ox optimiztion prolem in the optimiztion literture. We ll stle struture serh for eh ngle tsk. Let τ i {1,..., T } e the tsk index tht the i-th GB model is inluded, nd C t e ost to ompute the GB energy in the t-th tsk. We ssume tht the ost n e esily estimted sed on the employed omputtionl method nd the numer of toms in the superell. For exmple, emedded tom method 6

7 (EAM) [15] needs O(M) omputtions, where M is the numer of toms in superell. Then, we n set C t s the numer of toms M in superell. Insted of ounting the numer of smpling, we re interested in the sum of the ost C t tken in the serh proess, for more prtil evlution of serh effiieny. Assuming tht set S {1,..., N} is n index set of smpled GB models, the totl ost of smpling is written s C = C τi. (2) i S 2.2 Single-tsk Byesin Optimiztion Byesin optimiztion is mhine-lerning method for solving generl lkox optimiztion, nd it hs een shown to e effetive for mterils-serh prolems [5, 6, 7, 8, 9]. The si ide is to estimte stle struture itertively, sed on proilisti model whih is sttistilly onstruted y using lredy smpled strutures. Here, we riefly review si onept nd tehnil detils of Byesin optimiztion for some fixed t-th ngle, whih we ll single-tsk Byesin optimiztion (STB) in this pper. Gussin proess regression (GPR) [16] is proilisti model whih is often employed in Byesin optimiztion. GPR represents unertinty of unoserved energies y using rndom vrile vetor with multivrite Gussin distriution: f N (u, K), (3) where f = (f 1,..., f Nt ) is vetor of rndom vriles for pproximting the energies E, nd N (u, K) is Gussin distriution hving u R Nt s men vetor nd K R Nt Nt s ovrine mtrix. Note tht sine we here only fous on the serh for fixed ngle θ t, the indexes of GB models re 1,..., N t. Let x i R p e p dimensionl desriptor vetor for the i-th GB model. The i, j-th element of the ovrine mtrix is defined y kernel funtion k(x i, x j ) whih gives similrity of two ritrry GB models i nd j. As kernel funtion 7

8 k : R p R p R, the following Gussin kernel is often employed: k(x i, x j ) = exp ( γ x i x j 2 2), (4) where γ > is sling prmeter nd 2 is the L 2 norm. When we lredy hve GB energies for suset of GB models S {1,..., N t }, GPR updtes its preditions for unknown GB energies using onditionl proility. Let v S e su-vetor of n ritrry vetor v R Nt with the elements orresponding to S, nd M S e su-mtrix of n ritrry mtrix M R Nt Nt with the rows nd the olumns orresponding to S. The onditionl proility, lled preditive distriution, of the i-th GB model given energies for S is written s f i E S N (µ(x i ), σ(x)), (5) where f i E S is rndom vrile f i fter oserving E S, nd µ(x i ) = K i,s (K S + ɛi) 1 (E S u S ), (6) σ(x i ) = k(x i, x i ) K i,s (K S + ɛi) 1 K S,i, (7) in whih K i,s is row vetor hving the i-th row nd the olumns of S in K (nd K S,i is its trnspose), nd ɛ is noise term. In Byesin optimiztion, funtion lled quisition funtion evlutes possiility tht eh ndidte GB model would e more stle thn the smpled GB models in S. Expeted improvement (EI) is one of most stndrd quisition funtions to selet next struture: ( EI i = E fi E S mx{, E est f i } ), for i = 1,..., N t, (8) where E fi E S is n expettion with respet to f i E S, nd E est is the minimum energy mong lredy omputed GB models S. EI is n expeted vlue (sed on the preditive distriution of the urrent GPR) of the energy derese. Byesin optimiztion itertively selets next GB model y tking the mximum of EI, nd the newly omputed GB model is dded to S. 8

9 2.3 Multi-tsk Byesin Optimiztion Although energy surfes for different ngles re often quite similr, STB n not utilize the surfe similrity nd serhes eh surfe independently. In mhine lerning, it hs een known tht, for solving set of similr tsks, trnsferring (or shring) the knowledge (or dt) ross the tsks n e effetive. This ide is lled trnsfer lerning [14]. In our prolem setting, we hve multiple struture serh tsks for whih effiieny of the serh n e improved y trnsferring knowledge of the surfes. We here introdue tehnique lled multi-tsk lerning, whih is stndrd trnsfer-lerning method. Byesin optimiztion with multi-tsk lerning is lled multi-tsk Byesin optimiztion (MTB) in this pper. To trnsfer knowledge mong different tsks, we employ multi-tsk Gussin proess regression (MTGPR) [17]. Let z t R q e desriptor of the t-th tsk, nd k (tsk) : R q R q R e kernel funtion for given pir of tsks. For exmple, rottion ngle n e tsk desriptor (See 3.2 for our setting of the tsk desriptors). The tsk kernel funtion k (tsk) (z t, z t ) provides similrity of two given tsks t nd t. We employ the following form of the kernel funtion to define k (tsk) : ( ) k (tsk) (z t, z t ) = α exp γ (tsk) z t z t (1 α)δ t,t (9) where γ (tsk) > nd α [, 1] re prmeters, nd δ t,t is defined s 1 if t = t otherwise. The dditionl prmeter α is to ontrol independene of tsks. When we set α = 1, k (tsk) (z t, z t ) is 1 only when t = t, nd for ll other ses. This speil se is redued to pply T seprted Gussin proess models for ll tsks independently. MTGPR is defined y kernel onstruted s produt of two kernels on x nd z. The i, j-element of the ovrine mtrix of MTGPR is defined s K (MT) i,j = k(x i, x j )k (tsk) (z τi, z τj ), for i, j = 1,..., N. (1) Note tht we here use the index 1,..., N ross ll T tsks, nd the tsk in whih the i-th GB model is ontined is represented s τ i {1,..., T }. Then, 9

10 we define rndom vriles for unoserved energies y f N (u, K (MT) ), (11) where f = (f 1,..., f N ) is the rndom vrile vetor for GB energy nd u R N is men vetor. Given set of lredy smpled GB models is S {1,..., N}, the preditive distriution is derived y the sme mnner s in GPR: f i E S N (µ (MT) (x i ), σ (MT) (x)), (12) where ( µ (MT) (x i ) = K (MT) i,s K (MT) σ (MT) (x i ) = K (MT) i,i S 1 + ɛi) (ES u S ), (13) ( ) 1 K (MT) (MT) S + ɛi K S,i. (14) K (MT) i,s Figure 3 is shemti illustrtion of MTGPR. In ddition to the struture desriptor x, the xis of the tsk desriptor z is introdued in the figure. The knowledge of the surfe is trnsferred through this xis sed on the similrity evluted y the tsk kernel. The figure lso shows tht the ury of the funtion estimtion is improved y the trnsfer (), ompred to the single-tsk estimtion (). 2.4 Cost-sensitive Aquisition Funtion For the ost-imlne issue, we introdue ost-sensitive quisition funtion. In the ost-sensitive quisition funtion, to selet next ndidte to ompute, eh GB model is evluted sed not only on the possile improvement of the energy ut lso on the omputtionl ost of tht GB model. This strtegy prefers low ost GB models in the erly phse of the serh, nd explores high ost GB models fter the informtion of the energy surfe is umulted. This enles us to identify stle GB strutures with smller numer of smplings in the high ost energy surfes thn methods whih ignore ost differenes. MTB with the ost-sensitive quisition funtion is denoted s CMTB (ost-sensitive MTB). 1

11 For the ost-sensitive seletion of next GB model, we use the following quisition funtion: where E est t EI (CMTB) i = E f i E S ( mx{, E est τ i f i } ) C τi, (15) is the urrent minimum energy (inluded in S) for the t-th tsk. This quisition funtion selets the est GB model to smple in sense of the expeted improvement of the GB energy per omputtionl ost, while usul EI without the ost onsidertion selets struture in sense of the expeted improvement of the GB energy per smpling itertion. This mens tht EI (CMTB) i is effetive to minimize the GB energy while keeping the totl ost in Eq. (2) s smll s possile. Figure 4 shows shemti illustrtion of CMTB. In the figure, the two surfes re low ost to smple nd the other two surfes re high ost. CMTB first selets low ost surfes nd umultes surfe informtion, y whih the minimums in high ost surfes n e effiiently identified. 11

12 3 Results (Cse Study on f-al) In this setion, we demonstrte effetiveness of the proposed method through stle GB-struture serhes for f-al [11] tilt GBs. 3.1 GB Model We first onstruted f-al [11] symmetri tilt (ST) GBs using the oinidene site lttie (CSL) model. The CSL is usully hrterized y the Σ vlue, whih is defined s the reiprol of the density of the oinident sites. Figure 2 () shows n exmple of superell of Σ9 STGB model. Two symmetri GBs re introdued to stisfy three-dimensionl periodiity. To void rtifiil intertions etween GBs, we set the distnes etween GBs more thn 1 Å. For n tomi pir nerer thn the ut-off, one of the two is removed if the lulted GB energy (Clultion method is desried lter.) with the removl of one tom is smller thn tht without the removl. For the energy lultions nd tomi relxtions, we used the EAM potentil for Al in Ref. [15], nd the omputtionl time sles s O(M) for the numer of toms M with the linked-list ell lgorithm. Figure 2 () shows the onstrution of superell y RBT from the STGB model. Figure 5 shows the numer of toms M for ll 31 ngles. We see tht GB models ontin lrgely different numers of toms in the superells from 34 to 37 whih results in strong ost imlne in the serh spe. For eh ngle, the two-dimensionl RBTs, denoted s X nd Y whih re illustrted in Figure 2 (), were generted (we omit the other xis, i.e., Z xis, whih did not hve strong effet on the energy surfe in this time). The grid spe is.2å for the diretion X, nd.1å for the diretion Y. In totl, we reted ndidte GB models for whih the exhustive serh is omputtionlly expensive. 12

13 3.2 Settings of Gussin Proess As the desriptor for eh GB model x, we employed the two-dimensionl xes of RBTs: X nd Y. The kernel funtion for x ws the Gussin kernel with the prmeter γ set y medin heuristis (γ is set s the reiprol of medin of the squred distnes). For the tsk desriptor z, we used rottion ngle θ nd rdil distriution funtion (RDF) of the (X, Y ) = (, ) GB model. As n ngle desriptor, we pplied the following trnsformtion to the rottion ngles: θ t = θ t if θ t 9, otherwise θ t = 18 θ t. In the se of the f-al [1] GBs, θ t nd θ t is equivlent. Although the omplete equivlene does not hold for f-al [11] GBs, we used this trnsformed ngle s n pproximted similrity mesure. We defined the tsk kernel s ( k (tsk) (z t, z t ) = α exp γ (tsk) θ θ t θ ) t 2 2 γ (tsk) RDF ρ t ρ t (1 α)δ t,t where ρ R 1 is vetor reted from RDF y tking 1 eqully sped grids from to 6 Å. In this se, the tsk desriptor is written s z t = ( θ t, ρ t ), nd the kernel evlutes the tsk similrity sed on oth of the ngle nd RDF. In other words, two tsks whih hve similr ngles nd RDFs simultneously re regrded s similr in MTGP. The prmeters γ (tsk) θ nd γ (tsk) RDF ws set y medin heuristis gin, nd the independeny prmeter α is estimted y mrginl likelihood mximiztion [16]. For eh tsk, the vlues of the men prmeter u ws set seprtely s the verge of smpled GB energies. The noise term prmeter ɛ ws lso seleted y mrginl likelihood mximiztion. The prmeter tuning for α nd ɛ ws performed every 1 smplings. prmeter C t ws set y the numer of toms in eh superell. Cost 3.3 Performne Evlution We ompred the following five methods: 1. rndom smpling (Rndom): At eh itertion, next ndidte ws rndomly seleted with uniform smpling. 13

14 2. single tsk Byesin optimiztion (STB): STB is the onventionl Byesin optimiztion desried in 2.2. At eh itertion, GB model whih hd the mximum EI ws seleted ross ll the ngles. 3. ost-sensitive single tsk Byesin optimiztion (CSTB): CSTB is sme s STB exept tht EI is divided y the ost C t. 4. multi-tsk Byesin optimiztion (MTB): MTB is Byesin optimiztion with multi-tsk GP y whih surfe knowledge of different ngles is trnsferred eh other. For the quisition funtion, we here employed usul EI. 5. ost-sensitive multi-tsk Byesin optimiztion (CMTB): CMTB is MTB with the ost-sensitive quisition funtion. All methods strted with rndomly seleted one struture in eh ngle, nd the results re shown s n verge with 1 trils with different initil smpling. Figure 6 shows performne omprison. We refer to the differene etween the lowest energy identified y some method nd the true minimum s energy gp. The vertil xis of the figure is the verge of the gps for the 31 different ngles, nd the horizontl xis is the totl ost (2). We first fous on the differene etween the single-tsk sed methods nd the multitsk sed methods. The derese of the single-tsk sed methods (STB nd CSTB) re muh slower thn multi-tsk sed methods (MTB nd CMTB). Until out C = 25, the rndom seletion is even omprle with the single-tsk sed methods. In generl, Byesin optimiztion inreses its ury with the inrese of smpled dt, nd the multi-tsk sed methods n fully exploit smpled dt sine MTGP shres the dt ross different tsks (ngles). For the effet of the ost-sensitive quisition funtion, we see tht oth of single-tsk nd multi-tsk sed methods improved their onvergene. However, we here note tht the ost-sensitive pproh is enefiil espeilly for multi-tsk methods sine it n trnsfer knowledge umulted in low ost surfes to high ost surfes, while single-tsk methods does not trnsfer the 14

15 surfe informtion. We will see the effet of the ost-sensitive quisition funtion in more detil (in Figure 9). The sum of the omputtionl osts for ll ndidte strutures is N i=1 C τ i = The rtios of the omputtionl ost tht CMTB needed to reh 1 mj/m 2, 5 mj/m 2 nd 1 mj/m 2 verge energy gp were / , / nd / , respetively. Figures 7 nd 8 re ngle-wise omprisons of GB energies, nd distnes etween the true minimums nd identified GB strutures, respetively. oth figures re verges of the 1 runs for rndom, STB (onventionl Byesin optimiztion), nd CMTB. In Figure 7, ll the energies re normlized in suh wy tht the minimum for eh ngle eomes zero. We see tht the energies identified y CMTB were muh loser to the true minimums prtiulrly for C = 2 nd C = 3, while STB did not show ler dvntge even ompred to the rndom seletion. In CMTB, the tsk t = 19 hs the reltively lrge GB energy ompred to the other tsks t C = 2 nd 3. This tsk orresponds to the Σ81 GB model ontining 38 toms in the superell, whih is one of the highest ost surfes. The To oserve the serh progress in more detil, Figure 8 ompres onvergene in the RBT spe (X, Y ) for eh ngle. t-th tsk. Let S t = {τ i = t i S} e set of smpled GB models from the Suppose tht (X (St), Y (St) ) is the RBT whih hs the minimum energy mong the smpled GB models S t, nd (X (Ot), Y (Ot) ) is the RBT whih hs the true minimum for the tsk t. The vertil xis of Figure 8 is defined y (X (St) X (Ot) ) 2 + (Y (St) Y (Ot) ) 2 (Note tht this distne n inrese even when the GB energy dereses). In the plot, we n lerly see tht CMTB pprohed to the minimums muh fster thn the other two methods. In CMTB, the tsk t = 19, whih hd the lrge GB energy in Figure 7, is not prtiulrly lrge ompred to the other severl tsks hving lrge distnes. To oserve the effet of the ost-sensitive quisition funtion (15) on the smpling, Figure 9 ompres the serh progress of MTB nd CMTB. In the figure, the plotted vlue is tken from the Byesin optimiztion itertion t whih 3 GB models re smpled from the t-th tsk, i.e., S t = 3 (note tht 15

16 the itertions re different for different horizontl xis vlues). The tsks in the horizontl xis re sorted y the sending order of C t. Eh vertil xis is defined y sutrtion of result of MTB from CMTB, nd thus the r plots eome negtive when CMTB hs smller vlues thn MTB. Figure 9 () ompres the numer of smpled GB models S when S t = 3. We see tht CMTB hs smller vlues for low ost tsks, while lrger vlues for high ost tsks ompred to MTB. This indites tht CMTB first umulted surfe informtion using low ost surfes efore smpling from high ost surfes. Figure 9 () ompres the lowest energies identified y CMTB nd MTB. Although the energy differene flututes (euse it depends on mny ftors inluding similrity reltions mong tsks), s generl tendeny, we see tht CMTB hieved lower energies for high ost surfes, while MTB hs lower energies for low ost surfes, reltively. This indites ost-effetiveness of CMTB euse reduing smpling from high ost surfes led low totl ost s indited y Figure 6 4 Conlusions We introdued multi-tsk Byesin optimiztion (MTB) sed simultneous struture serh for vriety of rottion ngles of grin oundry (GB). Eh GB struture serh n e regrded s tsk, nd our si ide is to trnsfer/shre knowledge out the energy surfes mong different tsks. This strtegy is effetive euse GBs hving different ngles often hve quite similr energy surfes due to their similrity of struturl units. Further, we lso onsidered the imlne of the omputtionl ost of GB models used y different sizes of superells. We employed n quisition funtion whih inorportes ost informtion in ddition to the expeted vlue of the improvement. By using the f-al [11] tilt GBs, we demonstrted the effetiveness of our method ompred to rndom serh nd onventionl Byesin optimiztion. 16

17 Aknowledgement We would like to thnk R. Arkw for helpful disussions on GB models. This work ws finnilly supported y grnts from the Jpnese Ministry of Edution, Culture, Sports, Siene nd Tehnology to I.T. (16H6538, 17H758), M.K. (16H6538, 17H4694), Jpn Siene nd Tehnology Ageny (JST) PRESTO to M.K. (Grnt Numer JPMJPR15N2), nd y Mterils reserh y Informtion Integrtion Inititive (MI 2 I) projet of Support Progrm for Strting Up Innovtion Hu from JST to T.T., I.T., nd M.K.. Referenes [1] M. Hider, S. Uhlemnn, E. Shwn, H. Rose, B. Kius, nd K. Urn. Nture, 392: , [2] A. P. Sutton nd R. W. Blluffi. Interfes in Crystlline Mterils. Oxford University Press, [3] J. R. Rodgers nd D. Ceon. MRS Bulletin, 31(12):97598, 26. [4] B. Shhriri, K. Swersky, Z. Wng, R. P. Adms, nd N. de Freits. Proeedings of the IEEE, 14(1): , 216. [5] A. Seko, A. Togo, H. Hyshi, K. Tsud, L. Chput, nd I. Tnk. Phys. Rev. Lett., 115:2591, Nov 215. [6] T. Ueno, T. D. Rhone, Z. Hou, T. Mizoguhi, nd K. Tsud. COMBO: An effiient yesin optimiztion lirry for mterils siene. Mterils Disovery, 4:18 21, 216. [7] K. Toyour, D. Hirno, A. Seko, M. Shig, A. Kuwr, M. Krsuym, K. Shitr, nd I. Tkeuhi. Phys. Rev. B, 93:54112, Fe 216. [8] S. Kiyohr, H. Od, K. Tsud, nd T. Mizoguhi. Jpnese Journl of Applied Physis, 55(4):4552,

18 [9] S. Kikuhi, H. Od, S. Kiyohr, nd T. Mizoguhi. Physi B: Condensed Mtter, 217. [1] A. P. Sutton nd V. Vitek. Philos. Trns. R. So., 39:1, [11] A. P. Sutton nd V. Vitek. Philos. Trns. R. So., 39:37, [12] A. P. Sutton nd V. Vitek. Philos. Trns R. So., 39:55, [13] A. P. Sutton nd R. W. Blluff. Philos. Mg. Lett., 61:91, 199. [14] S. J. Pn nd Q. Yng. IEEE Trnstions on Knowledge nd Dt Engineering, 22(1): , 21. [15] Y. Mishin, D. Frks, M. J. Mehl, nd D. A. Pponstntopoulos. Phys. Rev. B, 59:3393, [16] C. E. Rsmussen nd C. K. I. Willims. Gussin Proesses for Mhine Lerning (Adptive Computtion nd Mhine Lerning). The MIT Press, 25. [17] E. Bonill, K. M. Chi, nd C. Willims. In J.C. Pltt, D. Koller, Y. Singer, nd S. Roweis, editors, Advnes in Neurl Informtion Proessing Systems 2, pges MIT Press, Cmridge, MA,

19 () GB energy (mj/m2) 5 () GB energy (mj/m2) A A B 8 7 B A Trnsltion of X (Å) A B A A 9 145, 338, Σ89 (994) A B B Trnsltion of X (Å) for f-al [11] tilt GB, nd () energy surfes reted y two dimensionl RBTs for the ngles 141 (top), 134 (ottom left) nd 145 (ottom right). The struturl units re lso shown long with the surfes in whih the units re denoted s A nd B. The red nd light lue lls denote Al toms in (11).5 Figure 1: () Clulted stle GB energies s funtion of the rottion ngle nd (22) tomi lyers. Trnsltion of Y (Å) Trnsltion of Y (Å) 134, 228, Σ59 (553) Trnsltion of X (Å) 1.5 B A.5 Rottion ngle, # toms in superell, Σ 141, 34, Σ9 (221) Rottion ngle Trnsltion of Y (Å) 5 GB energy (mj/m2) GB energy (mj/m2) Σ59 Σ9 Σ89 1

20 () GB GB y z x () ΔY ΔX ΔX ΔY Figure 2: () Atomi onfigurtion of the GB superell of the f-al [11] Σ9 symmetri tilt GB. The red nd lue lls denote Al toms in the (11) nd (22) tomi lyers. () One of two grins is rigidly shifted in the two dimension with X nd Y. 2

21 3 2 1 z 3 z x z z z z z 1 1 x x Figure 3: A shemti illustrtion of MTGP. The left three dimensionl plot () shows the MTGP men funtion surfe µ (MT) in the spe of the GB model desriptor x nd the tsk desriptor z (the lk points re the smpled dt). The enter plots () show the surfes for the three different tsks neighoring eh other in the tsk xis. The lue lines re men funtions with the lue shded stndrd devitions, nd dshed red lines re underlying true funtions. Sine informtion of the smpled dt is shred, ll the men funtions provide good pproximtions for the true funtions ompred with the seprted estimtion of eh tsk illustrted in (). For exmple, in z = 2 y MTGP (-3), the smllest points round x = 2.5 is urtely pproximted y MTGP with smpling only one point whih is fr from the minimum. This is possile euse point lose to the minimum is lredy smpled in the neighoring tsk z = (-2). This informtion is trnsferred to z = 2 with unertinty determined y the tsk kernel (tsk similrity). The minimum of the z = 2 (-1) is lso urtely pproximted ompred with () euse of the informtion trnsfer. 21

22 Itertion Predition (Gussin proess men) Unertinty (Gussin proess stndrd devition) Aquisition funtion (Normlized) True energy surfe Smpled struture z t C t Tsk desriptor Smpling ost Itertion 1 Itertion 5 Figure 4: An illustrtive exmple of the proposed method for the syntheti four tsks t = 1,..., 4 with ost C 1 = 1, C 2 = 2, C 3 = 8, nd C 4 = 1. In the itertion, the initil points re rndomly set. Our method first investigtes the low ost surfes t = 1 nd 2 s indited y the quisition funtion (green lines). In the itertion 5, with the inrese of the low ost surfe points, unertinty of the Gussin proess model is redued even for the high ost surfes t = 3 nd 4 in whih no dditionl points re smpled yet. Then, the quisition funtion vlues for the low ost surfes re deresed euse possile improvement is not lrge ny more, nd quisition funtion vlues for the high ost surfes eome reltively lrge. In the itertion 1, the smll energy points in the high ost surfes re identified with the smll numers of smplings. 22

23 # toms Rottion ngle Figure 5: The numer of toms ontined in the superells of the different ngles. 23

24 Rndom STB CSTB MTB CMTB Figure 6: The GB energy gps from the minimums to the identified struture y eh method. The vertil xis is the men for ll ngles. 24

25 Rndom STB CMTB GB energy (mj/m 2 ) GB energy (mj/m 2 ) GB energy (mj/m 2 ) Tsk index t Tsk index t Tsk index t () Totl ost C = 1 Rndom STB CMTB GB energy (mj/m 2 ) GB energy (mj/m 2 ) GB energy (mj/m 2 ) Tsk index t Tsk index t Tsk index t () Totl ost C = 2 Rndom STB CMTB GB energy (mj/m 2 ) GB energy (mj/m 2 ) GB energy (mj/m 2 ) Tsk index t Tsk index t Tsk index t () Totl ost C = 3 Figure 7: Comprison of the identified GB energies within given totl ost vlues (the verge of 1 runs). The vertil xis is seprtely stndrdized in suh wy tht the minimum in eh ngle eomes zero. The horizontl xis is the tsk index t. 25

26 Rndom STB CMTB Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t () Totl ost C = 1 Rndom STB CMTB Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t () Totl ost C = 2 Rndom STB CMTB Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t Distne from minimum (Å) Tsk index t () Totl ost C = 3 Figure 8: Comprison of distnes in the RBT spe (X, Y ) from the true minimums to the GB struture hving the smllest GB energy in the smpled GB within given totl ost vlues (the verge of 1 runs). The horizontl xis is the tsk index t. 26

27 15 3 # smpled GB models Tsks sorted y C t (sending) GB energy (mj/m 2 ) () The numer of smpled GB models S. () GB energy Figure 9: The omprison etween MTB nd CMTB t the itertion in whih 3 GB models re smpled for the tsk indited y the horizontl xis (note tht here the numer of itertion is different for eh r). The vertil xis of the oth plots re defined y sutrting results of MTB from CMTB. 27