Application of Hopfield neural network for extracting Doppler spectrum from ocean echo

Transcription

1 RADIO SCIENCE, VOL. 41,, doi:10.109/005rs00334, 006 Application of Hopfield neural network for extracting Doppler spectrum from ocean echo Renzhuo Gui 1 and Zijie Yang 1 Received 5 July 005; revised 4 February 006; accepted 9 March 006; published 7 July 006. [1] This paper proposes the method of a Hopfield-type neural network (HNN) for extracting Doppler spectrum from ocean echo. First, it introduces the basic principle of HNN for optimized processing. Second, expanding the principle of utilizing autoregression (AR) to estimate frequency spectrum, we point out how to apply HNN in spectrum estimation. Last, the three methods are utilized to process actual data, that is, the conventional fast Fourier transform method, modern spectrum estimation AR method, and the spectrum estimation method based on HNN. The results obtained by the three methods prove that the spectrum estimation method based on HNN is feasible for extracting the Doppler spectrum from ocean echo. Citation: Gui, R., and Z. Yang (006), Application of Hopfield neural network for extracting Doppler spectrum from ocean echo, Radio Sci., 41,, doi:10.109/005rs Introduction [] High-frequency ground wave radar is widely exploited to detect ocean dynamic parameters and targets such as icebergs and vessels. At present, we are utilizing the system of frequency-modulated continuous wave (FMCW) in which we process ocean echo with dual fast Fourier transform (FFT). Range information is extracted through the first FFT. We acquire Doppler information of certain range cells with a second FFT which is used to process the results from the first FFT during certain coherent integration times. Thus information of ocean dynamic parameters and targets can be extracted. Generally, it takes an accumulation time about 13 min to sense ocean dynamic parameters, and it takes an accumulation time about 3 min to detect the target [Barrick et al., 1994; Knan and Mitchell, 1991]. The modern spectrum estimation autoregression (AR) method takes less accumulation time than conventional FFT because it requires less data. However, its computation is complex and consumes more time [Vizinho and Wyatt, 1996]. This paper proposes the spectrum estimation method based on a Hopfield-type neural network (HNN) that can overcome the disadvantage of modern spectrum estimation while preserving its advantage of taking less accumulation time. Moreover, because the spectrum estimation method based on HNN has the capabilities of parallel 1 School of Electronic Information, Wuhan University, Wuhan, China. Copyright 006 by the American Geophysical Union /06/005RS00334 processing and computation by iterative algorithm, its computation is not complex and does not consume much time [Ham and Kostanic, 003; Hopfield, 198].. HNN Basic Principles [3] The American physicist J. J. Hopfield published two influential papers concerning neural networks [Hopfield, 198; Hopfield and Tank, 1985]. He proposed a design which consists of interconnected devices and defined energy function which concerns the state and joining weight of neurons. HNN composed of three neurons is shown in Figure 1 for illuminating the structure of HNN. The first layer is treated as the input of the network; there are no neurons in the first layer which do not have the function of computation. However, the second layer, composed of true neurons, executes the function of accumulating the results which are produced by utilizing input information to multiply weight coefficients. Then the nonlinear transfer function of neurons is exploited to process accumulating results. Thus the output of HNN is acquired. Generally speaking, the model of HNN is a circular neural network because output is connected with input. Thus the input of HNN produces continuous state change. When the input of HNN is selected, the output of HNN can be acquired. Moreover, its feedback can change the value of the input. Thus new output is produced. The feedback can run continuously. If HNN is the network of stabilization, the change caused by feedback and iterative computation is smaller and smaller. HNN can reach the state of balance. At this time, the output of HNN is fixed. 1of6

2 Figure 1. Structure of HNN composed of three neurons. [4] Then HNN is widely applied in many fields such as the traveling salesman problem, pattern recognition, and optimization control. It can be utilized to solve the problems of association memory and optimization computation. The output of neural networks can be either continuous or discrete. Correspondingly, HNN can be divided into two kinds, that is, continuous and discrete. Continuous HNN can solve the problem of optimization computation. Discrete HNN can solve the problem of association memory. Continuous HNN is a singlelayered feedback network. The operation mode of each neuron is shown as the following formula: du i dt ¼ 1 t u i þ XM j¼1 W ij X j þ I i ; ð1þ where X i = F(u i ), i =1,,, N, W ij = W ji, N is the number of neurons, u i is the middle output of the ith neuron, I i is the threshold value of the ith neuron, and F() is the transfer function, which is usually a sigmoid function. In fact, continuous HNN is the continuous system of nonlinear dynamics; it can be described with one group of nonlinear equations. When the initial state is determined, we can compute the trace of the network by solving the nonlinear differential equations. If the system is steady, it will converge to a certain steady point. We can define one Lyapunov energy function for the description of continuous HNN: X N X M E ¼ 1 W ij X i X j XN j¼1 Z ui f 1 ðhþdh: 0 X i I i þ XN 1 t ðþ We can prove that the energy function of HNN is limited. The formula de/dt 0 can demonstrate that the system is steady. The state of network always changes with the tendency of making E decrease until E reaches minimum. Meanwhile, X i, namely, the steady value of the ith neuron, is constant. Therefore HNN has the function of computing minimum automatically. As has been discussed above, continuous HNN can be utilized to solve the optimization problem [Ham and Kostanic, 003; Hopfield, 198]. 3. HNN Design [5] At first, we will briefly describe AR spectrum estimation. One pth-order AR model is presumed to satisfy the difference equation xn ð Þþa 1 xn ð 1Þþþa p xn ð pþ ¼ eðnþ: ð3þ of6

3 Here a 1, a,, a p are constant, a p 6¼ 0, and e(n) indicates the noise sequence whose mean and variance are e(n) and s e, respectively. We define that the predicted value ^x(n) is computed from parameters a 1, a,, a p. Then the difference exists and can be described by the equation eðnþ ¼^xðÞþ n Xp a i xn ð iþ: ð4þ We realize the AR spectrum estimation by estimating parameters a 1, a,, a p, which are produced by making E[e (n)] reach minimum E[e (n)] min. More concrete details about how to solve the Yule-Walker equation are illuminated as follows: 3 3 r x ð0þ r x ð1þ r x ðpþ 1 r x ð1þ r x ð0þ r x ðp 1Þ að1þ r x ðpþ r x ðp 1Þ r x ð0þ aðpþ E e 3 ½ ðnþš min 0 ¼ : ð5þ 0 Then we acquire the values of coefficients a 1, a,, a p and E[e (n)] min. Here r x (m) = E[x(n) x(n + m)]. According to the equation ^P x ðwþ ¼ E½e ðnþš min 1 þ Xp ; ð6þ a k e jwk k¼1 we can estimate the signal frequency spectrum [Cristi, 003]. Here E[e (n)] min is the variance of white noise in the AR model. We pay more attention to coefficients a 1, a,, a p. E[e (n)] min should not be neglected, so we are not normalizing by giving it the value 1. Thus there is the unitary equation ^P x ðwþ ¼ 1 þ Xp k¼1 1 ð7þ a k e jwk that can be utilized to realize spectrum estimation [Kay and Marple, 1981]. [6] In order to utilize the neural network to solve the optimization problem, we must set up the relationship between the neural network and the problem. In this section, we illuminate how to set up the relationship between HNN and the problem of acquiring parameters a 1, a,, a p by minimizing E[e (n)]. E[e (n)] can be expressed as the equation ( ) 3 E e ðnþ X p ¼ E 4 x ð n Þ a i xn ð iþ 5: ð8þ It is not difficult to discover that we can estimate AR model parameters a 1, a,, a p by minimizing the formula P N n¼pþ1 {x(n) Pp a i x(n i)}. Here N is the number of data that are used to estimate the spectrum. Moreover, the formula PN n¼pþ1 {x(n) Pp a i x(n i)} can be expressed as the following matrix norm form: kb XAk ; ð9þ where B =[x(p + 1), x(p + ),, x(n)] t, X =[X 1, X,, X P ] X 1 ¼ ½xðpÞ; xðpþ 1Þ; ; xn ð 1Þ X ¼ ½xðp 1Þ; xðpþ; ; xn ð Þ... X p ¼ ½xðÞ; 1 xðþ; ; xn ð pþš t t: A ¼ a 1 ; a ; ; a p We unfold equation (9) to acquire the equation kb XA k ¼ Bt B B t XA ðxaþ t B þ ðxaþ t XA: ð10þ B t B is neglected because it is irrelevant to parameters a 1, a,, a p. We can transform the right-hand part of equation (10) into the polynomial Pp P p X t i X j a i a j Pp j¼1 B t X i a i. By comparing it with the energy function of HNN, we can easily set up the relationship between them. That is to say, the joining weight between the ith neuron and the jth neuron is expressed as W ij = X i t X j, and the threshold value of the ith neuron is computed through the formula I i = B t X i. According to the relation between the AR method and the HNN method, the number of neurons in the HNN method corresponds to the number of order in the AR method. A sigmoid function whose output is always positive cannot be selected as the transfer function F() because the output value of neurons in HNN can be either positive or negative. The rule which can decide the selection of transfer function F() is that the derivative of transfer function F() cannot be negative [Minsky and Papert, 1988]. Here we select a special purelin function [Hopfield and Tank, 1985] v i = u i /b, which is specially designed for the problem in the paper. The value of b is selected according to the weight and threshold values of Š t Š t 3of6

4 Figure. Processing results using the conventional FFT method in the middle range for the detection of ocean dynamic parameters. HNN. A suitable one can make the network converge to minimum quickly. The value of b is 40 in my simulating experiment. [7] HNN usually has the problem of local minimum, which may interfere with its converging to global minimum and may produce wrong results. However, the equation in this paper for computing the minimum is a simple quadratic polynomial without any constraint, so it has only one global minimum without local minimum. Figure 4. Processing results using the spectrum estimation method based on HNN in the middle range for the detection of ocean dynamic parameters. As a result, it is impossible for the network of HNN to converge to an incorrect local minimum. 4. Application and Comparison [8] In this section, we want to prove the feasibility of the spectrum estimation method based on HNN. The three methods, that is, the conventional FFT method, the modern spectrum estimation AR method, and the spectrum estimation method based on HNN, are utilized to process the same actual data. Then we compare processing results. Figure 3. Processing results using the AR spectrum estimation method in the middle range for the detection of ocean dynamic parameters. Figure 5. Processing results using the conventional FFT method for target detection. 4of6

5 [9] At first, we select actual data which come from the Radio Propagation Lab in Wuhan University to extract ocean dynamic parameters at 0645 UT on 13 April 004 on the Zhujiajian Island of Zhejiang province in China. The radar parameters are set as follows. The carrying frequency is MHz, and range resolution is.5 km. The sweep period is s, and coherent integration time is about 13 min. The number of range cells is 8. The number of data is 104. The same data are processed by the three methods. The FFT method utilizes the whole data, and the AR and HNN methods utilize the data whose number is 56. The length of the slide window is 19. The number of moving slide windows is 64 in the AR and HNN methods. The order of the AR method is 64, and the number of neurons in HNN is also 64. The results of processing with the three methods are shown in Figures, 3, and 4, respectively. [10] From Figures 4, it can be seen that the spectrum estimation method based on HNN can produce a satisfactory processing result in the detection of ocean dynamic parameters. The region of the first-order echo spectrum produced by the spectrum estimation method based on HNN is consistent with the regions produced by the other two methods; moreover, the signal noise ratio (SNR) is about 35 db, which is higher than the SNR of the other two methods, which is 0 db. [11] Then we consider the application of the HNNbased spectrum estimation method in the field of detecting the target. Actual data from the Radio Propagation Lab in Wuhan University are selected for extracting information on the target at 005 UT on 19 April 004 on the Zhujiajian Island of Zhejiang province in China. The radar parameters are set as follows. The carrying frequency is 7.98 MHz, and range resolution is 1.5 km. The sweep period is s, and coherent integration Figure 6. Processing results using the AR spectrum estimation method for target detection. Figure 7. Processing results using the spectrum estimation method based on HNN for target detection. time is about 3 min. The number of range cells is 44. The order of the AR method is 64, and the number of neurons in HNN is also 64. The results of processing by the three methods are shown in Figures 5, 6, and 7, respectively. [1] The spectrum estimation method based on HNN can be utilized to detect the target as the other two methods can. The SNR is 30 db, which is higher than the 0 db of the other two methods. Because the number of neurons is consistent with the order of the AR method, the Akaike information criterion rule that is utilized to ascertain the order of the AR method [Kashyap, 1980] can be also exploited to ascertain the number of neurons. However, the drawback-caused spectrum spread in the method based on HNN should be considered in future research. We can select the middle value in the region of the first-order spectrum to overcome the disadvantage. 5. Conclusions [13] We have shown that we can apply HNN to extract the Doppler spectrum from ocean echo. The spectrum estimation method based on HNN has two advantages. Like modern spectrum estimation, it reduces the accumulation time because less data are required. Moreover, it has the capabilities of parallel processing and computation by iterative algorithm that allow it to avoid the complex and large computation which appears in AR spectrum estimation. The results of processing actual data indicate that the spectrum estimation method based on HNN may be feasible for the extraction of Doppler spectrum from ocean echo. 5of6

6 [14] Acknowledgment. This work was supported by the 863 High Technology Project of China (001AA631050). References Barrick, D. E., et al. (1994), Gated FMCW DF radar and signal processing for range/doppler/angle determination, Patent , U.S. Patent and Trademark Off., Washington, D. C. Cristi, R. (003), Modern Digital Signal Processing, China Machine Press, Beijing. Ham, F. M., and I. Kostanic (003), Principles of Neurocomputing for Science and Engineering, China Machine Press, Beijing. Hopfield, J. J. (198), Neural networks and physical systems with emergent collective computational geometry, Proc. Natl. Acad. Sci. U.S.A., 79, Hopfield, J. J., and D. W. Tank (1985), Neural computation of decisions in optimization problems, Biol. Cybern., 5, Kashyap, R. L. (1980), Inconsistency of the AIC rule for estimating the order of autoregressive models, IEEE Trans. Autom. Control, 5(5), Kay, S. M., and S. L. Marple (1981), Spectrum analysis: A modern perspective, Proc. IEEE, 69, Knan, R. H., and D. K. Mitchell (1991), Waveform analysis for high-frequency FMICW radar, IEE Proc. Part F Radar Signal Process., 138(5), Minsky, M. L., and S. A. Papert (1988), Perceptrons, expanded ed., MIT Press, Cambridge, New York. Vizinho, A., and L. R. Wyatt (1996), Modern spectral analysis in HF radar remote sensing, in Oceans 96 MTS/IEEE: Coastal Ocean, Prospects for the 1st Century: Conference Proceedings, vol. 3, pp , IEEE Press, Piscataway, N. J. R. Gui and Z. Yang, School of Electronic Information, Wuhan University, Wuhan, , China. (rzgui@16.com) 6of6