arxiv: v3 [stat.ml] 4 May 2017

Transcription

1 arxiv: v3 [stat.ml] 4 May R 2

2 R 2

3

4

5

6

7 x F P L z Ll R l {1, 2,..., F P D } z x R F P L z x score = f(z x W output H + b output H )W output O + b output O W output H W output O R HLS dout all R 1 HLS b output O R F P L HLS b output H R 1 dout all d out all = 1 d out all = 4 softmax p(i x) = i escore(x) i 4 j=1 escore(x) j i score(x) i

8 β 1 = 0.9, β 2 = 0.999

9 L2 16, 32, 48, 64, 80, 96, 112, 128 1, 2, 3, 4 5, 10, 15, 20 50, 60, 70, 80, 90, 100 log 6, 5, 4, 3, 2, 1, 0, 1, 2 log 6, 5, 4, 3, 2 log 8, 7, 6, 5, 4

10 J(θ) = 1 n n (ŷ i y i ) 2 + α θ 2 i=1 J(θ) = 1 n [ n i=1 k 1 { y (i) = j } ] e θt j x(i) k + α θ 2 l=1 eθt l x(i) j=1 J(θ) L2

11 log log log softmax

12 F P L

13 y X y ŷ RMSE = n i=1 (ŷ i y i ) 2 n MAE = 1 n n ŷ i y i i=1 P CC 2 = [ ] n i=1 (x 2 i x)(y i ȳ) n i=1 (x i x) 2 n i=1 (y i ȳ) 2

14 log

15 1 RM1 RM2 RM3 RM4 RM5 RM6 RM7 RM8 RM9 RM10 Consensus PCC MAE RMSE 0 Training set Validation set Test set I I II III IV I % I II III IV I % Prediction II % III % Prediction II % III % IV % 73.3% 65.1% 90.3% 40.4% 76.1% Reference of training set IV % 84.4% 76.9% 93.2% 60.1% 85.2% Reference of validation set I II III IV I II III IV I % I % Prediction II % III % Prediction II % III % IV % 71.7% 73.6% 93.4% 63.1% 85.6% Reference of test set I IV % 70.2% 60.2% 92.3% 14.3% 72.3% Reference of test set II 2

16 log log log log

17 I II III IV I % I II III IV I % Prediction II % III % Prediction II % III % IV % 93.8% 90.2% 94.5% 84.5% 92.1% Reference of training set IV % 97.3% 95.9% 96.9% 88.2% 95.8% Reference of validation set I II III IV I II III IV I % I % Prediction II % III % Prediction II % III % IV % IV % 96.7% 91.8% 97.2% 90.8% 95.5% Reference of test set I I II III IV I % 98.2% 95.7% 97.3% 90.5% 96.3% Reference of test set II I II III IV I % Prediction II % III % Prediction II % III % IV % 99.9% 96.9% 92.1% 99.1% 94.9% Reference of training set IV % 90.2% 85.7% 84.9% 75.9% 84.8% Reference of validation set I II III IV I II III IV I % I % Prediction II % III % Prediction II % III % IV % 87.0% 84.8% 88.8% 73.0% 86.6% Reference of test set I IV % 98.2% 95.7% 90.2% 97.6% 93.6% Reference of test set II

18 J(θ) = J C (θ) + βj R (θ) + α θ 2

19 J C (θ) J R (θ) β (0, 1]

20 N 50

21 i i i {{1, 2,..., 10}} 2 2 C γ

22 i i i {{1, 2,..., 10}} ± ± ± ±

23 αβ

24

25

26

27

28

29

30

31

32

33

34

35

36