US 20140177023A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2014/0177023 A1 Gao et al. (43) Pub. Date: Jun. 26, 2014 (54) (71) (72) (73) (21) (22) APPARATUS FOR OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH MUTUAL OCCLUSION AND OPAQUENESS CONTROL CAPABILITY Applicant: AUGMENTED VISION INC., (US) Inventors: Chunyu Gao, Tucson, AZ (US); YuXiang Lin, Tucson, AZ (US); Hong Hua, Tucson, AZ (US) Assignee: AUGMENTED VISION INC., Tucson, AZ (US) App1.No.: 13/857,656 (60) (51) (52) Filed: Apr. 5, 2013 and vice versa. Related US. Application Data Provisional application No. 61/620,574,?led on Apr. 5, 2012, provisional application No. 61/620,581,?led onapr. 5, 2012. Publication Classi?cation Int. Cl. G02B 27/01 (2006.01) US. Cl. CPC..... G02B 27/0172 (2013.01) USPC..... 359/238 (57) ABSTRACT The present invention comprises a compact optical see through head-mounted display capable of combining, a see through image path With a virtual image path such that the opaqueness of the see-through image path can be modulated and the virtual image occludes parts of the see-through image 30!},/ l/ WCRWWSPi-AY omcrsva QPTBCS $.51}; \_ $6 \ _/ 32g} '\ / ~ - ~ BEAMSPLBTTER 339 SUV! - '"m 55 EYEPIECE 310 - / x.... : ACOMBNG \ \\. E LIGHT /' r EXIT 3&2 PUPii.,/ \ BACK LAYER / \FRONT LAYER 32-1 31.5 ~~~~~~~~~ - W VERTUAL ViEW SEE-THROUGH PATH 511$ PATH 30?
Patent Application Publication Jun. 26, 2014 Sheet 1 0f 25 US 2014/0177023 A1 PLATFO RM ViRTUAL CAR Fig. 1b
Patent Application Publication Jun. 26, 2014 Sheet 3 0f 25 US 2014/0177023 A1.... Y E....i 316 \ E \ 54 x... i. {NCOMENG 1. LIGHT BACK LAYER/ \ FRGNT LAYER 3.1.2 3.1.5; 4 --------- ~- W vzm'um vmw ssmaaouea PATH 595 PATH 393 Fig.3
Patent Application Publication Jun. 26, 2014 Sheet 5 0f 25 US 2014/0177023 A1 50:1 Mime-ms,va,// 550 \. sum / BEAMSPLBTTER 5.59 53 \»--- 527 evamca 510 mss QBJECTWE GPTzcs 51 \ _/ 529 incoming -?lwm '''''' - f LiGHT E \\ / $4 / sz PL:sz / 5.92;. f \ BACK LAYER / mam LAYER 5;;112 5.2-5;. \ Q ~~~~~~~~~ H VERTUAL VIEW PATH m W SEE-THRQUGH PATH so? Fig.5
Patent Application Publication Jun. 26, 2014 Sheet 6 0f 25 US 2014/0177023 A1 If S6 2.254 incoming UG HT / sz PUPiL / / 662 / \ / 52 \ aack LAYER/ \fbqeyiimxer 617 5-35 4 ~~~~~~~~~ ~~ <+-------~ VERTUAL VEEW $EE?THRGUGH PATH 625; PATH 567 Fig. 6
Patent Application Publication Jun. 26, 2014 Sheet 9 0f 25 US 2014/0177023 A1 diagram F éeid Angie iject in Y 5mm ~ % 5_ 13" "15 213 ~19 {iv O a Q; r2 0 o O w as X Haw?mgie in Ubg'ect Space * degrees Minimum == {3,12%3 Maximum = {$33.83, Average = QAZSOQ Std Kiev = 9.1362? Fig.9
Patent Application Publication Jun. 26, 2014 Sheet 10 0f 25 US 2014/0177023 A1, 1000 PLATE BEAMSPLBTTER // 1959 " QBJECTBVE omcs /.....,,,- ss mama 52 '''' \ $2 / / ROOF PRISM / Fig. 10
Patent Application Publication Jun. 26, 2014 Sheet 11 0f 25 US 2014/0177023 A1 Minimum $656859 Maximum 831261; Avamge = ilé33?8 SH} 53% :{i giey513-3 Fig.1}.
Patent Application Publication Jun. 26, 2014 Sheet 12 0f 25 US 2014/0177023 A1,. '. 4 Mask Generation Depth Map 9f \1 1mm Obj {a Aigorithm External Scene Virtuai image Mask image.? 5 Spatial Lioht M on dis Ea *2 Ext is i ) p y Modulator X 6mm 66% The combined image with currect oeciusion Fig.12
Patent Application Publication Jun. 26, 2014 Sheet 13 0f 25 US 2014/0177023 A1 Tabie 1: thicai surface prescription of surface 1 of the eyepiece prism X Curvature (Ci) 41381000502 Y Curvature (cy) 2988130802 Y Cnnic Constant (KY) 1987470501 4th Grder Symmetric Coefficient (AR) ~4.287832E3-06 6th Order Symmetric Coefficient (BR) 3633440569 8th Cinder Symmetric Coefficient (CR) ~1.116535E -11 10th Order Symmetric Cnefficient (DR) 1223496514 X Conic Constant (Kxi ~8.920693 E-01 4th Order Asymmetric (Inefficient (AP) 9693257561 6th Order Asymmetric Coefficient (BF) 8.481634E-Ol 8th Order Asymmetric Coefficient (CP) 43669705431 10th Grater Asymmetric Coefficient (DP) 1.459675E-01 Fig.8
Patent Application Publication Jun. 26, 2014 Sheet 14 0f 25 US 2014/0177023 A1 Tabie 2: Opticai surface prescription of surface 2 of the eyepiece prism X Cu rveture (cx) 4511284803 Y Curvature (Cy) 5184986503 Y Conic Constant (KY) ~4.9793296+OO 4th Order Symmetric Coefficient (AR) 43258138011 6th Order Symmetric Coefficient (BR) 27199405017 8th Order Symmetric Coefficient (CR) 1442892525 16th Order Symmetric Coefficient (DR) X Conic Constant (KX) 4th Order Asymmetric Coefficient (AP) ~4.878044E-18 1.000000E+01 2.838?84E+02 6th Order Asymmetric Coefficient (SP) 818975312431 8th Order Asymmetric Coefficient (CP) 45043189503 10th Order Asymmetric Coefficient (DP) 2.19897OE+OO Fig.14
Patent Application Publication Jun. 26, 2014 Sheet 15 0f 25 US 2014/0177023 A1 Tabie 3: Opticai surface prescription 02 surface 3 0f the eyepiece prism X Curvature (cy) 3264493802 Y Curvature (cy) Y Ccmic Constant (Pi- 1) 16048895le ~6.037602E+00 4th Order Symmetric Coef?cient (AR) 8012300507 6th Order Symmetric Coefficient (BR) 8.479952E'15 81h Order Symmetric Coefficient (CR) 6754428811 10th Order Symmetric Coefficient (DR) 1354349813 X Conic Constant (KX) 4th Order Asymmetric Ceefficient (AP) 6th Grder Asymmetric Coefficient (8P) 81h Order Asymmetric Coefficient (CP) -9.850983E+OO 3.3?5134E+OO 8.002480E-e-01 ~7586874E-Gl 10th Order Asymmetric Coef?cient (DP) ~8.514982 ~01 FigiS
Patent Application Publication Jun. 26, 2014 Sheet 16 0f 25 US 2014/0177023 A1 Tabie 4: Position and orientatien parameters of the eyepiece prism Surface Reference Position Orientation X(mm) Y(mm) 2(mm) RX(Degree) 51 Exit Pupil 0 9.5606 19.6489 {17.6526 52 Exit Pupii 0 4.0538 273329 4195143 S3 Exit Pupii 0 14.6035 23.4707 85.6210 Notes: The orientations of the surface related to Y and Z 2065 are zerosw
Patent Application Publication Jun. 26, 2014 Sheet 17 0f 25 US 2014/0177023 A1 Table 5: Optical surface prescription of surface 4 0f the objective prism X Curvature (ex) 2434364802 Y Curvature icy) ~2~209971502 Y Conic Constant (Ky) 4th Order Symmetric Coef?cient (AR) 6th Order Symmetric Ceef?cient (BR) 8th Order Symmetric Coefficient (CR) ~1.0000QOE+01 1.562099E 05-2.061756E~08 1.0174857E'02 10th Order Symmetric Coefficient (DR) 8756049514 X Conic Constant (Kx) dbgoooohol 4th Order Asymmetric Ceefiicient (AP) 95126537501 61h Order Asymmetric Coefficient (8P) 1.99357ZE+OO 8th Order Asymmetric Coefficient (C?) 1~900420 +02 10th Order Asymmetric Coefficient (DP) 9336468801
Patent Application Publication Jun. 26, 2014 Sheet 18 0f 25 US 2014/0177023 A1 Table 6: thicai surface prescriptien of surface 5 0f the abjeetive prism X Curvature (ex) Y Curvature icy) ~3.8G9807E-04 ~8.?'64721E 33 Y Conic Constant (Ky) 4000060501 4th Order Symmetric Coefficient (AR) 1979731506 6th Order Symmetric Coefficient (BR) ~8.425507E-11 8th Order Symmetric (Ioefficient (CR) 6394541512 10th Order Symmetric Coefficient (DR) 1.58822OE-14 X Cenic Constant (Ky) 1000000134431 4th Grder Asymmetric Coefficient (AP) 4734191612432 6th Order Asymmetric Coefficient (SP) 23662205100 8th Order Asymmetric (Inefficient (CP) 44172711201 l?th Order Asymmetric Coefficient (DP) 868617253431 Fig.18
Patent Application Publication Jun. 26, 2014 Sheet 19 0f 25 US 2014/0177023 A1 Table 7: Optical surface prescription 0f surface 6 of the eyepiece prism X Curvature (cx) 4346197502 Y Curvature (CY) Y Conic Constant (KY) ~5.219668E-03 LOOOOOOE+01 4th Order Symmetric Coefficient (AR) 3576498905 6th Order Symmetric Coef?cient (BR) 5151877568 8th Order Symmetric Coefficient (CR) 6047876812 10th Order Symmetric Ceetficierit (DR) 1412166513 X Conic Ccinstant (KX) ~1237477E+OO 4th Order Asymirietric Coef?cient (AP) 8171339591 5th Order Asymmetric Coefficient (8P) 8th Order Asymrrietric Coef?cient (CF) 10th Order Asymmetric Coefficient (DP) 9.892018E-01 1.883807E+OO 8.762SSlE-Ol Fig.19