RDWT and Image Watermarking

Size: px
Start display at page:

Download "RDWT and Image Watermarking"

Transcription

1 RDWT and Image Watermarkng L Hua and James E. Fowler Engneerng Research Center Msssspp State Unversty Techncal Report MSSU-COE-ERC-0-8 December 00. Introducton Image watermarkng s a technque for labelng dgtal mages by embeddng electronc stamps or so-called watermarks nto the mages for the purpose of copyrght protecton. Due to the exploson n use of the dgtal meda, watermarkng has been attractng sgnfcant nterest from both academc and ndustry recently. In order to be effectve, a watermark should exhbt a number of desrable characterstcs [,, 3, 4]. Unobtrusveness: The watermark should be perceptually nvsble and should not degrade the qualty of the mage content. Robustness: The watermark must be robust to transformatons ncludng common sgnal processngs, common geometrc dstortons and subterfuge attacks. Blndness: The watermark should not requre the orgnal nonwatermarked mage for watermark detecton. Unambguousness: Retreval of the embedded watermark should unambguously dentfy the ownershp and dstrbuton of data. number of technques have been developed for watermarkng. wdely used technque s spreadspectrum watermarkng whch embed whte Gaussan nose onto transform coeffcents []. The watermark s detected by computng a correlaton between the watermarked coeffcents and the watermark sequence whch s compared to a properly selected threshold. The DWT s an appealng transform for spread-spectrum watermarkng because ts space-frequency tlng exhbts a strong smlarty to the way the human vsual system (HVS processes natural mages [4]. Therefore, watermarkng technques n the wavelet doman can largely explot the HVS characterstcs and effectvely hde a robust watermark. Unlke the DWT, the redundant dscrete wavelet transform (RDWT gves an overcomplete representaton of the nput sequence and functons as a better approxmaton to the contnuous wavelet transform. The RDWT s shft nvarant and ts redundancy ntroduces an overcomplete frame expanson. It has been proved that frame expansons add numercal robustness n case of addng whte nose [5, 6] such n the case of quantzaton. Ths property makes RDWT-based sgnal processng tends to be more robust than DWT. It s well known that RDWT s very successful n nose reducton and feature detecton, and pror work has proposed usng the RDWT for mage watermarkng [7]. Intally, one mght thnk that, snce frame expansons such as the RDWT offer ncreased robustness to added nose, such overcomplete expansons outperform tradtonal orthonormal expanson n the watermarkng problem. In ths report, we offer analyss that contradcts ths ntuton. Specfcally, we present analyss that shows that, although watermarkng coeffcents n a tght-frame expanson does produce less mage dstorton for the same watermarkng energy, the correlaton-detector performance of tght-frame based watermarkng s dentcal to that obtaned by usng an orthonormal expanson. Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

2 . RDWT & Frame. RDWT The RDWT removes the decmaton operators from DWT flter banks. To retan the multresoluton characterstc, the wavelet flters must be adusted accordngly at each scale. Specfcally, h J [k] h[k] where J s the start scale, h J [k] s the RDWT scalng flter at scale J. h[k] s a normal DWT scalng flter. Flters at later scales are upsampled versons from the flter coeffcents at the upper stage, h [k] h + [k] and smlar defntons s appled to g [k], the wavelet flter of the orthonormal DWT. The RDWT multresoluton analyss can be mplemented va the flter bank equatons: nalyss: c [k] h + [ k] c + [k] ( d [k] g + [ k] d + [k] ( Synthess: c + [k] [ ] h + [k] c [k] + g + [k] d [k] (3 The lack of downsamplng n the RDWT analyss yelds a redundant representaton of the nput sequence; specfcally, two vald descrptons of the coeffcents exst after one stage of RDWT analyss.. Frames DEFINITION. [5] famly of functons (ψ J n a Hlbert space H s called a frame f there exst > 0, and B < so that, for all f n H, f J < ψ, f > B f (4 and B are called the frame bounds. The dual frame ( ψ of (ψ s an expanson set n Hlbert space H and for all f n H, B f < ψ, f > f (5 ny functon f H can be expanded as f α ψ β ψ < ψ, f > ψ (6 < ψ, f > ψ (7 If two frame bounds are equal, B, the frame s called a tght frame. In a tght frame, for all f H, < ψ, f > f (8 J ψ ψ (9 f ψ, f ψ (0 In ths case, >, and gves the redundancy rato, a measure of the degree of overcompleteness of the expanson. Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

3 .3 RDWT and frame expanson Theorem. RDWT s a frame expanson wth frame bounds and B J, where J s the number of levels n the transform. Thus, for one level, the RDWT s a tght frame. Proof: One level RDWT nalyss c [0] c [0] c [] c [] c + [0] c + [] c + [] c + [3] d [0] d [0] d [] d [] Fgure : One scale of RDWT decomposton. s shown n Fg., for the lowpass coeffcents c, t s composed wth two parts, c and c, each of them s a vald DWT lowpass descrpton of c +. It s a smlar case for the hghpass coeffcents d. Thus, Parseval s theory holds for each of the descrptons: c + d c + c + d c + Thus, for the RDWT coeffcents all together, we have c + d c + ( Therefore, one-level RDWT decomposton s a tght frame wth. For decomposton level J >, suppose the decomposton starts at scale J. We have then cj ( c J + d J Whle, the energy for the RDWT coeffcents s: cj + dj + dj J J cj J + dj ( E c J J + J dj (3 3 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

4 So that, On the other hand, J J c J E ( J d J (snce... J, we have J, so that J c J E 0 E J c J (4 E c J ( J c J J + J ( d J (snce J > and... J, we have, so that E c J 0 E c J (5 The bounds of and B J are the tghtest bounds snce we can fnd sequences that meet the bounds. Specfcally, for a constant sequence x [n], only the lowpass coeffcents are nonzero and all hghpass subbands are zero valued. That s, c J J 0 but d J 0, for... J. J J c J E ( J d J 0 E J c J (6 For an oscllatory sequence x [n] ( n, only the fnest detal coeffcents would be nonzero. That s, cj J 0 and d J 0, for... J. E c J ( J c J J + J ( d J 0 E c J (7 Therefore, for decomposton level J >, the energy of the decomposton coeffcents are well bounded. Thus, the RDWT s a frame expanson accordng to the defnton. 3. Robustness of ddng Whte Nose We are to compare the robustness of three dfferent transforms,.e. orthonormal bass, tght frame and frame bass, after addng whte Gaussan nose n the correspondng transform domans. Suppose the addtve nose s a zero mean, varance ɛ Gaussan nose, the robustness s measured as the mean square error (MSE of the reconstructed sgnal wth the orgnal sgnal. MSE E[ f ˆf ] E[< f ˆf, f ˆf >] E[< f, f >] E[< f, ˆf >] + E[< ˆf, ˆf >] In ths analyss, f s the orgnal sgnal, ˆf s the watermarked sgnal, and the MSE s the dstorton produced by watermarkng f wth watermark energy equal to ɛ. 4 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

5 3. Orthonormal bass f ˆf where the Gaussan nose s n (0, ɛ. The error sgnal So that, 3. Tght frame α ψ ψ, f ψ (α + n ψ e ˆf f n ψ MSE E e E[ n ] E[n ] Nɛ (8 ( ( Snce f ˆf ψ, f ψ (α + n ψ α ψ MSE E[< f, f >] E[< f, ˆf >] + E[< ˆf, ˆf >] E[< f, f >] E E[< f, ˆf >] E α ψ, E[α α ] ψ, ψ α ψ, (α + n ψ α ψ E[α α ] ψ, ψ + E[α n ] ψ, ψ E[α α ] ψ, ψ 5 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

6 (3 E[< ˆf, ˆf >] E (α + n ψ, (α + n ψ E[α α ] ψ, ψ E[n n ] ψ, ψ Combnng the three components: MSE E[ f ˆf ] E[< f, f >] E[< f, ˆf >] + E[< ˆf, ˆf >] E[n n ] ψ, ψ E[n ] ψ, ψ ɛ Nɛ (9 Note that, snce >, Nɛ does an orthonormal bass. < Nɛ, and watermarkng n the tght frame yelds less dstorton to f than 3.3 Frame expanson f ˆf α ψ < ψ, f > ψ (α + n ψ MSE E[< f, f >] E[< f, ˆf >] + E[< ˆf, ˆf >] ( E[< f, f >] E[< α ψ, α ψ >] E[α α ] < ψ, ψ > ( E[< f, ˆf >] E[< α ψ, (α + n ψ >] E[α α ] < ψ, ψ > + E[α n ] < ψ, ψ > E[α α ] < ψ, ψ > 6 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

7 (3 E[< ˆf, ˆf >] E[< (α + n ψ, (α + n ψ >] E[α α ] < ψ, ψ > + E[n n ] < ψ, ψ > E[α α ] < ψ, ψ > + E[n ] < ψ, ψ > Combnng all the components: MSE E[< f, f >] E[< f, ˆf >] + E[< ˆf, ˆf >] E[n ] < ψ, ψ > ɛ ψ (0 Theorem. s n the lterature of [6], but we derved n a dfferent way. For frame expanson, M B k ψ k M ( Proof: Substtute f ψ k nto nequaltes Eq. 5 and substtute f ψ k nto nequaltes Eq. 4, we have: B ψ k < ψ, ψ k > ψ k ψ k < ψ, ψ k > B ψ k Because for each k, we have ψ, ψ k and ψ, ψ k be postve, we have correspondngly: B ψ k < ψ, ψ k > k k k ψ k < ψ, ψ k > k k k ψ k B ψ k Snce the dmenson of the frame bass ψ s same wth the dmenson of the dual frame bass ψ, equals to M, t s obvous that: < ψ, ψ k > < ψ, ψ k > T k k Thus T must satsfy the two nequaltes smultaneously k k B ψ k T k ψ k ψ k T B ψ k 7 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00 k

8 Ths s only possble f k k ψ k ψ k ( k B ψ k B ψ k (3 k Snce frame ψ k are normalzed, ψ k, we have Eq. Smlarly, Eq. 3 k k ψ k ψ k k ψ k M k B ψ k B ψ k fracb k k ψ k M B k k Therefore, the bounds for the k ψ k are establshed. M B k ψ k M So that, MSE E[ f ˆf ] ɛ ψ Mɛ B Mɛ MSE Note that, snce the redundancy of r M N guarantee the lower bound of the MSE n the frame expanson case Mɛ B dstorton n the orthonormal bass case Nɛ. 4. Tght Frame and Watermarkng 4. Watermarkng s between the frame bounds and B(B >, we can rnɛ B be smaller than the In the spread-spectrum watermarkng problem, the sgnal s transformed usng an expanson bass, f α ψ 8 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

9 and the watermark sequence, a whte Gaussan nose, n, s added to the coeffcents n the transform doman, to form the watermarked mage. f α ψ (α + ɛn ψ where n s a zero-mean, unt-varance whte Gaussan nose, and ɛ s a parameter that controls the watermark strength. The watermark can be detected assumng the watermark random sequence s known exactly. Ths s done by performng the forward transform on the watermarked sgnal, and then runnng the correlaton operaton on the coeffcents, ρ ˆα n where ˆα are the expanson coeffcents of the watermarked mage f. ˆα ψ, f For watermark detecton, the correlaton s compared to a threshold to decde the presence of the watermark. n optmal threshold can be set to mnmze the probablty of mssng the presence of the watermark error to a gven false-detecton error accordng to the Neyman-Pearson crteron [4]. Below, we compare the watermark performance of two procedures: usng an orthonormal bass and usng a tght-frame expanson. We ensure these two watermark procedures acheve the same MSE and the same false-alarm error P F, and the performance s measured by the mnmum mssed-detecton error, P M, as obtaned wth the Neyman-Pearson procedure. Three hypothess cases are possble for the watermark problem [4]. Case : mage s not watermarked. Case B: mage s watermarked wth a random sequence other than the detecton watermark, but s usng a same watermarkng approach. Case C: mage s watermarked exactly wth the detecton watermark. However, we wll not do a multple-hypothess testng. Instead we wll do two bnary hypothess testngs, on case v.s. case C and case B v.s. case C respectvely. 4. Neyman Pearson test[8] Neyman-Pearson test s also called the most powerful (MP test. The decson rule s obtaned by mnmzng the mssng error P M subect to the constrant on the false alarm error P F, P F α. The obectve functon s constructed based on the Lagrange multpler method. Suppose the decson rule s J P M + λ(p F α ρ H H 0 T ρ We derve the Neyman Pearson test on two bnary hypothess problems. 9 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

10 4.. No watermarkng vs. correct watermarkng ccordng to [4], modelng the correlaton ρ as a normally dstrbuted nose s realstc and ft the central lmt theorem. H 0 : Case P (ρ H 0 H : Case C P (ρ H πσρ e ρ σ ρ πσ e (ρ µ σ False larm Error: P F P (D H 0 T ρ Q( T ρ σ ρ T ρ πσρ e P (ρ H 0 dρ ρ σ ρ dρ erfc( T ρ σρ (4 Mssng Error: P M P (D 0 H 4.. Watermarkng Dscrmnaton Tρ Tρ P (ρ H dρ e (ρ µ σ dρ πσ G( T ρ µ σ H 0 : Case B P (ρ H 0 H : Case C P (ρ H Q( T ρ µ σ + erf( Tρ µ σ T ρ µ erfc( µ T ρ (5 σ T ρ < µ πσρb e ρ σ ρb πσ e (ρ µ σ False larm Error: Mssng Error: T ρ P F P (D H 0 erfc( (6 σρb P M P (D 0 H + erf( Tρ µ σ T ρ µ erfc( µ T ρ (7 σ T ρ < µ 0 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

11 4.3 Correlatons In order to obtan the Neyman-Pearson test for each watermarkng procedure, the probablty dstrbutons of the watermark correlaton under each hypothess must be obtaned frst. The correlaton dstrbuton s modeled as a Gaussan nose Orthonormal bass Case no watermark ρ α n µ ρ E[ρ] 0 (8 σρ E[ρ µ ρ ] E[ρ ] E[ α n ] E[ α n ] + E[ α α n n ] α E[n ] + 0,, α f (9 Case B watermarked wth another random sequence ρ (α + ɛ m m n µ ρb E[ρ] E[α n ] + E[ɛ m m n ] 0 σρb E[ρ µ ρb ] E[ρ ] E[ (α + ɛ m m n ] E[ (α + ɛ m m n ] + E[ (α + ɛ m m n (α + ɛ m m n ],, E[α + ɛ mm + ɛ m m α ]E[n ] + 0 (30 α + ɛ m f + Nɛ m f + Nɛ (3 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

12 Case C watermarked wth the correct watermark ρ (α + ɛn n µ E[ρ] ɛ N (3 σ E[ρ µ ] E[ρ ] µ E[ (α + ɛn n ] ɛ N E[ (α n + ɛn ] + E[ (α n + ɛn (α n + ɛn ] ɛ N,, E[α n + ɛ n 4 + ɛα n 3 ] + E[ (α n α n + ɛα n n + ɛα n n + ɛ n n ] ɛ N,, α E[n ] + ɛ E[n 4 ] + ɛα E[n 3 ] + ɛ E[n ]E[n ] ɛ N,, Snce n s zero mean, unt varance whte Gaussan nose, we have: E[n ] E[n 3 ] 0 E[n 4 ] 3 σ α + 3Nɛ + ɛ (N N ɛ N f + Nɛ (33 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

13 4.3. Tght frame Case no watermark ρ α n µ ρ E[ρ] 0 (34 σρ E[ρ µ ρ ] E[ρ ] E[ α n ] α E[n ] α f (35 Case B watermarked wth another random sequence 3 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

14 ρ ˆα n ψ, f n ψ, (α + ɛ m m ψ n [ (α + ɛ m m ψ, ψ ]n (α + ɛ m m n ψ, ψ µ ρb E[ρ] 0 (36 σρb E[ρ µ ρb ] E[ρ ] E[ (α + ɛ m m n ψ, ψ ] [ E[ α n ψ, ψ ] + E[ ɛ m m n ψ, ψ ] + E[ α n ψ, ψ ] ɛ m m l n k ψ k, ψ l ] k l E[ α n ψ, ψ ] + E[ ɛ m m n ψ, ψ ] E[n ][ α ψ, ψ ] + ɛ me[m n ] ψ, ψ α ψ, ψ ] + ɛ m ψ, ψ [ Snce for the tght frame, we have: f ψ, f ψ α ψ So that, [ α ψ, ψ ] nd also because tght frame has the property of: ψ, f f 4 ψ, f ψ, f α (37 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

15 Then we have the second tem of the expresson: ψ, ψ σ ρb α + ɛ mn ψ N α + ɛ m N f + ɛ mn f + ɛ N (38 Case C watermarked wth the correct watermark ρ α n ψ, ψ + ɛn n ψ, ψ µ E[ρ] ɛ N (39 σ E[ρ µ ] E[ρ ] µ [ E[ α n ψ, ψ ] + E[ ɛn n ψ, ψ ] + E[ α n ψ, ψ ] ɛn l n k ψ k, ψ l ] ɛ N k l [ E[n ][ α ψ, ψ ] + E[ ɛn n ψ, ψ ɛn l n k ψ k, ψ l ] k l + E[ α n ψ, ψ ] ɛn l n k ψ k, ψ l ] ɛ N For each of the tem n the expresson, k l ( From the Eq. 37, we have E[n ][ α ψ, ψ ] [ α ψ, ψ ] α 5 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

16 ( The second tem n the expresson E[ ɛn n ψ, ψ ɛn l n k ψ k, ψ l ] E[ + E[ + E[ ɛ n 4 ψ k, ψ l ] ɛ n ψ, ψ n k ψ k, ψ k ] k ɛ n n ψ, ψ ] + 0 else ɛ E[n 4 ] + ɛ,k, k k l k l E[n ]E[n k ] + ɛ 3Nɛ + ɛ ( N N + ɛ [ N, k l, k k, l, or l, k,,, 3Nɛ + ɛ ( N N + ɛ ( N N ɛ N + ɛ N ɛ (N + N E[n ]E[n ] ψ, ψ ψ, ψ (3 The thrd tem n the expresson E[ α n ψ, ψ ɛn l n k ψ k, ψ l ] k l E[ ɛα n 3 ψ, ψ ψ, ψ ] k l + 0 else 0 ψ, ψ ] σ [ ] α + ɛ (N + N ɛ N α + ɛ (N + N ɛ N f + ɛ N ( Performance comparson We know the MSE ncurred by the watermarkng process: Orthonormal Bass: Tght Frame: Frame Bass: MSE E[ f f ] Nɛ D MSE E[ f f ] Nɛ Mɛ B MSE E[ f f ] Mɛ 6 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

17 To acheve same MSE s for the three expansons, the watermarkng strength ɛ must be adusted as: D Orthonormal Bass: ɛ (4 N D Tght Frame: ɛ (4 N D D Frame Bass: M ɛ M B (43 The statstcal parameters of the Gaussan modeled correlatons are lsted n Table 4.4. Table : Mean and standard devaton of the watermark correlaton. Orthonormal Bass Tght Frame Case µ ρ 0 µ ρ 0 σρ f σ ρ f Case B µ ρb 0 µ ρb 0 σρb f + Nɛ f + D σ ρb f + Nɛ f + D Case C µ ɛ N ND µ ɛ N ND σ f + Nɛ f + D σ f + Nɛ f + D 4.4. No watermarkng vs. correct watermarkng H 0 : Case H : Case C For Orthonormal Bass: For Tght Frame: T ρ P F erfc( σρ erfc( T ρ f T ρ P F erfc( σ ρ erfc( T ρ f In order for the false alarm error be the same, P F P F, we need T ρ f T ρ f So that T ρ T ρ Snce the mssng error s: P M + erf( Tρ µ σ T ρ µ erfc( µ T ρ σ T ρ < µ 7 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

18 ( f T ρ µ, then T ρ T ρ µ µ We have P M + erf(t ρ µ σ P M + erf(t ρ µ σ Snce T ρ µ σ Tρ µ f + Nσ Tρ µ σ T ρ µ σ Therefore, we have P M P M. ( Smlarly, f T ρ < µ, we have T ρ < µ, and P M erfc(µ T ρ σ P M erfc(µ T ρ σ Snce, µ T ρ σ µ T ρ σ we have P M P M also. That s, the probablty of mssed detecton error s the same regardless of whether an orthonormal or tght frame s used Watermarkng Dscrmnaton H 0 : Case B H : Case C For Orthonormal Bass: T ρ P F erfc( σρb erfc( T ρ f + D 8 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

19 For Tght Frame: T ρ P F erfc( σ ρb erfc( T ρ f + D In order for P F P F, we need erfc( T ρ f + D erfc( f + D T ρ So that T ρ T ρ ( f T ρ µ, then T ρ T ρ µ µ we have P M + erf(t ρ µ σ P M + erf(t ρ µ σ T ρ µ Tρ µ σ σ T ρ µ σ Therefore, we have P M P M. ( f T ρ < µ, we have T ρ < µ, and P M erfc(µ T ρ σ P M erfc(µ T ρ σ µ T ρ µ T ρ σ σ µ T ρ σ So that we wll have P M P M also. 9 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

20 gan, the performance s the same. 5. Conclusons fter the above theoretcal analyss, we can draw the followng conclusons:. RDWT expanson s a frame expanson, and one scale RDWT s a tght frame wth the redundancy.. Frame expanson s more robust than the orthonormal bass expanson when addng whte nose onto the transform doman;.e., less dstorton s obtaned when water-markng wth a fxed watermark energy. 3. However, tght frame doesn t show obvous performance advantages over the orthonormal bass when consderng the spread-spectrum watermarkng problems, as the addtonal robustness of the overcomplete expanson does not ad watermark detecton by correlaton operators. 0 Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

21 References [] I. J. Cox, J. Kllan, F. T. Leghton, and T. Sharmoon, Secure Spread Spectrum Watermarkng for Multmeda, IEEE Transactons on Image Processng, vol. 6, no., pp , December 997. [] I. J. Cox and M. L. Mller, Revew of Watermarkng and The Importance of Perceptual Modelng, n Human Vson and Electronc Imagng II, B. E. Rogowtz and T. N. Pappas, Eds., February 997, pp. 9 99, Proc. SPIE 306. [3] M. D. Swanson, M. Kobayash, and. H. Tewfk, Multmeda Data-Embeddng and Watermarkng Technologes, Proceedngs of the IEEE, vol. 86, no. 6, pp , June 998. [4] M. Barn, F. Bartoln, and. Pva, Improved Wavelet-Based Watermarkng Through Pxel-Wse Maskng, IEEE Transactons on Image Processng, vol. 0, no. 5, pp , May 00. [5] I. Daubeches, Ten Lectures on Wavelets, Socety for Industral and ppled Mathematcs, Phladelpha, P, 99. [6] V. K. Goyal, M. Vetterl, and N. T. Thao, Quantzed Overcomplete Expansons n IR N : nalyss, Synthess, and lgorthms, IEEE Transactons on Informaton Theory, vol. 44, no., pp. 6 3, January 998. [7] J.-G. Cao, J. E. Fowler, and N. H. Younan, n Image-daptve Watermark Based on a Redundant Wavelet Transform, n Proceedngs of the Internatonal Conference on Image Processng, Thessalonk, Greece, October 00, pp [8] M. D. Srnath, P. K. Raasekaran, and R. Vswanathan, Introducton to Statstcal Sgnal Processng wth pplcatons, Prentce-Hall, Upper Saddle Rver, NJ, 996. Techncal Report MSSU-COE-ERC-0-8, Engneerng Research Center, Msssspp State Unversty, December 00

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

arxiv:cs.cv/ Jun 2000

arxiv:cs.cv/ Jun 2000 Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São

More information

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering,

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering, COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION Erdem Bala, Dept. of Electrcal and Computer Engneerng, Unversty of Delaware, 40 Evans Hall, Newar, DE, 976 A. Ens Cetn,

More information

A NEW DISCRETE WAVELET TRANSFORM

A NEW DISCRETE WAVELET TRANSFORM A NEW DISCRETE WAVELET TRANSFORM ALEXANDRU ISAR, DORINA ISAR Keywords: Dscrete wavelet, Best energy concentraton, Low SNR sgnals The Dscrete Wavelet Transform (DWT) has two parameters: the mother of wavelets

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Digital Modems. Lecture 2

Digital Modems. Lecture 2 Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera

More information

AN ADAPTIVE WATERMARKING ALGORITHM FOR DEM BASED ON DFT

AN ADAPTIVE WATERMARKING ALGORITHM FOR DEM BASED ON DFT AN ADAPTIVE WATERMARKING ALGORITHM FOR DEM BASED ON DFT Changqng Zhu 1 Zhwe Wang 2 Y Long 1 Chengsong Yang 2 1 Key Laboratory of Vrtual Geographc Envronment, Nanjng Normal Unversty, Nanjng 210054;2 Insttute

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

Novel Pre-Compression Rate-Distortion Optimization Algorithm for JPEG 2000

Novel Pre-Compression Rate-Distortion Optimization Algorithm for JPEG 2000 Novel Pre-Compresson Rate-Dstorton Optmzaton Algorthm for JPEG 2000 Yu-We Chang, Hung-Ch Fang, Chung-Jr Lan, and Lang-Gee Chen DSP/IC Desgn Laboratory, Graduate Insttute of Electroncs Engneerng Natonal

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

A Self-embedding Robust Digital Watermarking Algorithm with Blind Detection

A Self-embedding Robust Digital Watermarking Algorithm with Blind Detection Sensors & Transducers Vol 77 Issue 8 August 04 pp 50-55 Sensors & Transducers 04 by IFSA Publshng S L http://wwwsensorsportalcom A Self-embeddng Robust Dgtal Watermarkng Algorthm wth Blnd Detecton Gong

More information

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1 Average Decson hreshold of CA CFAR and excson CFAR Detectors n the Presence of Strong Pulse Jammng Ivan G. Garvanov and Chrsto A. Kabachev Insttute of Informaton echnologes Bulgaran Academy of Scences

More information

A Novel Quality Measure for Information Hiding in Images

A Novel Quality Measure for Information Hiding in Images A Novel Qualty Measure for Informaton Hdng n s KA Navas Aravnd M SasKumar M Asstant rofessor G student rofessor College Of Engneerng College of Engneerng Maran Engneerng College Trvandrum,Inda Trvandrum,Inda

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

White Noise Reduction of Audio Signal using Wavelets Transform with Modified Universal Threshold

White Noise Reduction of Audio Signal using Wavelets Transform with Modified Universal Threshold Whte Nose Reducton of Audo Sgnal usng Wavelets Transform wth Modfed Unversal Threshold MATKO SARIC, LUKI BILICIC, HRVOJE DUJMIC Unversty of Splt R.Boskovca b.b, HR 1000 Splt CROATIA Abstract: - Ths paper

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Adjusted Control Lmts for U Charts Copyrght 207 by Taylor Enterprses, Inc., All Rghts Reserved. Adjusted Control Lmts for U Charts Dr. Wayne A. Taylor Abstract: U charts are used

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP Proceedngs of the 6th WSEAS Int Conf on Artfcal Intellgence, Knowledge Engneerng and Data Bases, Corfu Island, Greece, February 6-9, 007 7 Comparson of Wener Flter soluton by SVD wth decompostons QR and

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS

COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS Robert J. Barsant, and Jordon Glmore Department of Electrcal and Computer Engneerng The Ctadel Charleston, SC, 29407 e-mal: robert.barsant@ctadel.edu

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Improvement of Histogram Equalization for Minimum Mean Brightness Error

Improvement of Histogram Equalization for Minimum Mean Brightness Error Proceedngs of the 7 WSEAS Int. Conference on Crcuts, Systems, Sgnal and elecommuncatons, Gold Coast, Australa, January 7-9, 7 3 Improvement of Hstogram Equalzaton for Mnmum Mean Brghtness Error AAPOG PHAHUA*,

More information

Improved Lossless Data Hiding for JPEG Images Based on Histogram Modification

Improved Lossless Data Hiding for JPEG Images Based on Histogram Modification Copyrght 2018 Tech Scence Press CMC, vol.55, no.3, pp.495-507, 2018 Improved Lossless Data Hdng for JPEG Images Based on Hstogram Modfcaton Yang Du 1, Zhaoxa Yn 1, 2, * and Xnpeng Zhang 3 Abstract: Ths

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Natural Images, Gaussian Mixtures and Dead Leaves Supplementary Material

Natural Images, Gaussian Mixtures and Dead Leaves Supplementary Material Natural Images, Gaussan Mxtures and Dead Leaves Supplementary Materal Danel Zoran Interdscplnary Center for Neural Computaton Hebrew Unversty of Jerusalem Israel http://www.cs.huj.ac.l/ danez Yar Wess

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

GEMINI GEneric Multimedia INdexIng

GEMINI GEneric Multimedia INdexIng GEMINI GEnerc Multmeda INdexIng Last lecture, LSH http://www.mt.edu/~andon/lsh/ Is there another possble soluton? Do we need to perform ANN? 1 GEnerc Multmeda INdexIng dstance measure Sub-pattern Match

More information

System in Weibull Distribution

System in Weibull Distribution Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co

More information

PHYS 450 Spring semester Lecture 02: Dealing with Experimental Uncertainties. Ron Reifenberger Birck Nanotechnology Center Purdue University

PHYS 450 Spring semester Lecture 02: Dealing with Experimental Uncertainties. Ron Reifenberger Birck Nanotechnology Center Purdue University PHYS 45 Sprng semester 7 Lecture : Dealng wth Expermental Uncertantes Ron Refenberger Brck anotechnology Center Purdue Unversty Lecture Introductory Comments Expermental errors (really expermental uncertantes)

More information

Homework Assignment 3 Due in class, Thursday October 15

Homework Assignment 3 Due in class, Thursday October 15 Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.

More information

Ph 219a/CS 219a. Exercises Due: Wednesday 23 October 2013

Ph 219a/CS 219a. Exercises Due: Wednesday 23 October 2013 1 Ph 219a/CS 219a Exercses Due: Wednesday 23 October 2013 1.1 How far apart are two quantum states? Consder two quantum states descrbed by densty operators ρ and ρ n an N-dmensonal Hlbert space, and consder

More information

CS 468 Lecture 16: Isometry Invariance and Spectral Techniques

CS 468 Lecture 16: Isometry Invariance and Spectral Techniques CS 468 Lecture 16: Isometry Invarance and Spectral Technques Justn Solomon Scrbe: Evan Gawlk Introducton. In geometry processng, t s often desrable to characterze the shape of an object n a manner that

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Lecture 14: Forces and Stresses

Lecture 14: Forces and Stresses The Nuts and Bolts of Frst-Prncples Smulaton Lecture 14: Forces and Stresses Durham, 6th-13th December 2001 CASTEP Developers Group wth support from the ESF ψ k Network Overvew of Lecture Why bother? Theoretcal

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Rotation Invariant Shape Contexts based on Feature-space Fourier Transformation

Rotation Invariant Shape Contexts based on Feature-space Fourier Transformation Fourth Internatonal Conference on Image and Graphcs Rotaton Invarant Shape Contexts based on Feature-space Fourer Transformaton Su Yang 1, Yuanyuan Wang Dept of Computer Scence and Engneerng, Fudan Unversty,

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification Desgn Project Specfcaton Medan Flter Department of Electrcal & Electronc Engneeng Imperal College London E4.20 Dgtal IC Desgn Medan Flter Project Specfcaton A medan flter s used to remove nose from a sampled

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Orientation Model of Elite Education and Mass Education

Orientation Model of Elite Education and Mass Education Proceedngs of the 8th Internatonal Conference on Innovaton & Management 723 Orentaton Model of Elte Educaton and Mass Educaton Ye Peng Huanggang Normal Unversty, Huanggang, P.R.Chna, 438 (E-mal: yepeng@hgnc.edu.cn)

More information

Discretization of Continuous Attributes in Rough Set Theory and Its Application*

Discretization of Continuous Attributes in Rough Set Theory and Its Application* Dscretzaton of Contnuous Attrbutes n Rough Set Theory and Its Applcaton* Gexang Zhang 1,2, Lazhao Hu 1, and Wedong Jn 2 1 Natonal EW Laboratory, Chengdu 610036 Schuan, Chna dylan7237@sna.com 2 School of

More information

Tutorial 2. COMP4134 Biometrics Authentication. February 9, Jun Xu, Teaching Asistant

Tutorial 2. COMP4134 Biometrics Authentication. February 9, Jun Xu, Teaching Asistant Tutoral 2 COMP434 ometrcs uthentcaton Jun Xu, Teachng sstant csjunxu@comp.polyu.edu.hk February 9, 207 Table of Contents Problems Problem : nswer the questons Problem 2: Power law functon Problem 3: Convoluton

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

NON-LINEAR CONVOLUTION: A NEW APPROACH FOR THE AURALIZATION OF DISTORTING SYSTEMS

NON-LINEAR CONVOLUTION: A NEW APPROACH FOR THE AURALIZATION OF DISTORTING SYSTEMS NON-LINEAR CONVOLUTION: A NEW APPROAC FOR TE AURALIZATION OF DISTORTING SYSTEMS Angelo Farna, Alberto Belln and Enrco Armellon Industral Engneerng Dept., Unversty of Parma, Va delle Scenze 8/A Parma, 00

More information

Goodness of fit and Wilks theorem

Goodness of fit and Wilks theorem DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),

More information

Transform Coding. Transform Coding Principle

Transform Coding. Transform Coding Principle Transform Codng Prncple of block-wse transform codng Propertes of orthonormal transforms Dscrete cosne transform (DCT) Bt allocaton for transform coeffcents Entropy codng of transform coeffcents Typcal

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

Non-linear Canonical Correlation Analysis Using a RBF Network

Non-linear Canonical Correlation Analysis Using a RBF Network ESANN' proceedngs - European Smposum on Artfcal Neural Networks Bruges (Belgum), 4-6 Aprl, d-sde publ., ISBN -97--, pp. 57-5 Non-lnear Canoncal Correlaton Analss Usng a RBF Network Sukhbnder Kumar, Elane

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

T E C O L O T E R E S E A R C H, I N C.

T E C O L O T E R E S E A R C H, I N C. T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Analysis of Discrete Time Queues (Section 4.6)

Analysis of Discrete Time Queues (Section 4.6) Analyss of Dscrete Tme Queues (Secton 4.6) Copyrght 2002, Sanjay K. Bose Tme axs dvded nto slots slot slot boundares Arrvals can only occur at slot boundares Servce to a job can only start at a slot boundary

More information

A SVD-BASED WATERMARKING SCHEME FOR PROTECTING RIGHTFUL OWNERSHIP *

A SVD-BASED WATERMARKING SCHEME FOR PROTECTING RIGHTFUL OWNERSHIP * SVD-BSED TERMRKIG SCEME OR PROTECTIG RIGTUL OERSIP * Ruzhen Lu and Tenu Tan atonal Lab of Pattern Recognton Insttute of utomaton, Chnese cademy of Scences P. O. Box 78, Bejng, 18, P. R. Chna Emal: {lurz,

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control A ower Bound on SIR Threshold for Call Admsson Control n Multple-Class CDMA Systems w Imperfect ower-control Mohamed H. Ahmed Faculty of Engneerng and Appled Scence Memoral Unversty of ewfoundland St.

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Discrete Wavelet Transform: An Introduction

Discrete Wavelet Transform: An Introduction A.. Skodras, Dscrete Wavelet Transform: An Introducton Techncal Report HOU-CS-TR-3--E Dscrete Wavelet Transform: An Introducton Α.. Skodras Hellenc Open Unversty: Techncal Report HOU-CS-TR-3--E A.. Skodras,

More information

F statistic = s2 1 s 2 ( F for Fisher )

F statistic = s2 1 s 2 ( F for Fisher ) Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

FFT Based Spectrum Analysis of Three Phase Signals in Park (d-q) Plane

FFT Based Spectrum Analysis of Three Phase Signals in Park (d-q) Plane Proceedngs of the 00 Internatonal Conference on Industral Engneerng and Operatons Management Dhaka, Bangladesh, January 9 0, 00 FFT Based Spectrum Analyss of Three Phase Sgnals n Park (d-q) Plane Anuradha

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information