Information-Based Adaptive Sensor Management for Sensor Networks

Size: px
Start display at page:

Download "Information-Based Adaptive Sensor Management for Sensor Networks"

Transcription

1 2011 American Contro Conference on O'Farre Street, San Francisco, CA, USA June 29 - Juy 01, 2011 Information-Based Adaptive Sensor Management for Sensor Networks Karen L. Jenkins and David A. Castañón Abstract Consider the probem of controing a network of surveiance sensors that are capabe of seecting which areas to observe and which modes to observe these areas. In this paper, we study the probem of controing the observations of these sensors adaptivey in order to cassify accuratey a coection of objects using information on their observed features. Our proposed approach is modeing objects as tempates of 3-D features, and modeing sensors as observing features of individua objects, subject to degradation by noise, obscuration, missed detections and background cutter. We expoit a statistica framework based on random sets simiar to those used in mutitarget tracking to mode the statistica reationship between observed features and object types to compute informationtheoretic estimates of the probabiity of error in cassification. We present a nove approach for computation of these distances between distributions of random sets using k-best assignment agorithms. These estimates are combined with rea time information to generate predictions of the information vaue of individua measurements for sensor management. Using these predictions, we deveop assignment agorithms to compute sensor management strategies to minimize this bound. The resuting sensor management agorithms are capabe of soving probems invoving a arge numbers of objects in rea-time. We show simuations of the resuting agorithms for cassifying 3- dimensiona objects from 2-dimensiona noisy projections that iustrate how the agorithms seect compementary views to overcome obscuration and provide accurate cassification. Our resuts show that our information-based sensor management agorithms achieve comparabe cassification accuracy to adaptive simuation-based approaches that evauate the vaue of information, whie requiring neary five orders of magnitude ess computation. I. INTRODUCTION Inteigent sensors of mutipe modaities are increasingy avaiabe in diverse appications, ranging from buiding security and defense to transportation and medicine. In turn, this has created a need for automated processing and reduction of sensor information, and the opportunity for controing the nature of information coected so that the resuting systems can accompish their task faster. One of the key tasks that these systems perform is is object recognition, such as the identification of exposives inside uggage, determining the type of vehice in surveiance, or identifying the persons in a given ocation. These are compex tasks due to the arge number of variations in ambient iumination as we as object appearance and pose in the sensed information. Robust object recognition is often based on extracting features of objects provide discrimination information, and which can be reiaby observed under the range of sensed conditions. The This work was supported by AFOSR grants FA and by ODDR&E MURI Grants FA and FA D. Castañón is with the Eectrica and Computer Engineering Department at Boston University. K. Jenkins is with Livevo, Inc set of observabe features of an object by a specific sensor depends on factors such as environmenta conditions, reative sensor-object position and orientation, positions of other objects and sensing modaity. Thus, accurate recognition often requires fusion of information from mutipe sensors using different views to obtain a sufficient coection of discriminating features on each object. In this paper, we consider the probem of adaptive management of a team of distributed sensors in order to cassify accuratey a set of spatiay distributed objects by observing errored subsets of their features. These sensors can be oriented dynamicay to coect information on seected objects from different points of view in order to compement best the avaiabe information to achieve rapid cassification. Sensor management has received increased attention in recent years, as summarized in the recent book [1]. Most of this work focuses on finding and tracking objects, and not on identifying them [2] [5]. A common approach in sensor management is to use information theory metrics as the basis for evauating aternative sensing actions [6] [11]. Aternative approaches use expected task performance such as as tracking error or Bayesian cassification costs, eading to stochastic contro formuations and corresponding agorithms [12] [16]. The work in [17] compares taskdriven sensor management schemes with information-driven schemes, and determines that the performance difference between the two casses of approaches was sma. The probem of sensor management for cassification objectives was studied in [18] using information theoretic criteria. Aternative approaches based on stochastic contro techniques and partiay observed Markov decision processes were deveoped in [12], [15], [19]. In these papers, the sensor mode for cassification assumes that sensors observe a conditionay independent estimate of object type, which is a highy unreaistic assumption. In actuaity, processing of information generated by sensors with a simiar point of view wi resut in highy correated tentative cassification decisions because they wi be based on the same set of features. Instead, a more accurate mode woud represent sensor measurements as providing conditionay independent information about object features, and determine how observation of additiona features yieds improved object cassification decisions. In our previous work [20], we proposed a mode for feature-based sensor management representing objecdts as spatiay reated coections of features, characterized by object type and pose. Such modes have been proposed for object recognition by severa authors [21] [23]. In this mode, sensors obtain noisy observations of subsets of object /11/$ AACC 4934

2 features, where the observed subset of features depend on object type, and reative sensor/object pose, and incudes missed features due to obscuration as we as missed detections, and cutter features, and are modeed as random point sets [24] derived from the object modes. The resuts of [20] used as the objective for coected information the reduction in the expected probabiity of cassification error. Rea-time evauation of these metrics requires the use of time-consuming simuations of future measurements. [20] deveoped a nove approach that combines off-ine computation of a priori vaue of measurements using Bhattacharyya distances between modes of random sets of point features, and rea-time estimates of object type and pose generated from past measurements, to generate a prediction of the vaue of information that a sensor coud coect on an object. This vaue was used in assignment agorithms to compute sensor management strategies to maximize the expected information coected. In this paper, we extend the resuts of [20] to incorporate more accurate estimates of the reduction in probabiity of cassification error. In particuar, we deveop estimates based on Chernoff coefficients instead of Bhattacharyya distances, which can ead to the use of more accurate Chernoff bounds on the expected probabiity of error between two random sets. We derive a new set of bounds on the expected reduction in probabiity of error based on the Chernoff coefficients, and integrate them into a rea-time adaptive sensor management agorithm that scaes we to scenarios with arge numbers of objects. We aso describe an efficient way for computation of Chernoff coefficients that avoids a combinatoria enumeration of hypotheses using k-best data association agorithms and importance samping techniques. We evauate the proposed sensor management agorithms using data generated from synthetic 3-D modes of object casses. We aso evauate the agorithms on synthetic aperture radar data generated under DARPA s MSTAR program and simuate sensors as extracting features from 2-D projections of these modes. We compare the performance of our reatime sensor management agorithm with other informationtheory approaches that use measurement simuations. Our rea-time agorithms achieve comparabe cassification accuracy, whie requiring neary three orders of magnitude ess computation. Our resuts estabish the feasibiity of a practica, scaabe and accurate approach for the rea-time management of a team of sensors. An overview of the remainder of this paper is as foows: Section II, presents an overview of the mathematica formuation of feature-based sensor management using random set observations introduced in [20]. Section III describes two approaches for adaptive sensor management based on information-theory criteria, incuding our soution for combining off-ine bounds with on-ine estimates. Section IV discusses simuation resuts that compare the two agorithms in terms of cassification performance and computation time. Section V discusses our resuts and presents directions for future work. Fig. 1: Exampe of a three-dimensiona mode II. PROBLEM FORMULATION Assume that there are M known ocations that contain objects, with centers at ocations z m R 3. Each ocation m contains an object of type c m {1,..., k}, that is oriented with a pose consisting of azimuth ange θm az and eevation (or simiary, incination) ange θm. e We assume that the center ocations z m are known, and that objects are stationary. The unknown state of an object at ocation m is (c m, θ az m, θ e m) and the overa unknown system state is X (x 1,..., x M ) Assume for the purposes of inferencing that the set of possibe azimuth and eevation orientations is finite, and that the states are independent random variabes across ocation, with margina prior distributions specified by p m ( ), m 1,..., M. Associated with each object type k 1,..., K is a coection of features, described by their spatia ocations in a reative coordinate frame centered at the object centroid. Extending our formuation to adding additiona information to features such as type is straightforward (e.g. [25]). Exampes of such features can incude extreme points of modes such as corners, as iustrated in Fig. 1. Denote the reative ocations of features for object type k as M k {M1 k, M2 k,..., Mn k k }, where Mi k R 3. Given an object state at known ocation m, the mode M cm specifies unambiguousy the number of features and their 3-D positions through appication of the appropriate rotation matrices R z (θm az ), R y (θm), e where R z (θ) represent a cockwise rotation through an ange θ about the z axis and and R y (θ) is a cockwise rotation through an ange θ about the y axis. The true feature ocations F m of object m with state are generated by transating and rotating mode features from cass c m as: F m i z m o +R z (θ az m ) R y (θ e m) M cm i, i 1,..., n cm (1) In this manner, three-dimensiona objects can be generated as coections of points, spatiay distributed about the known ocation of the object centroid. Sensors coect measurements on object ocations to estimate the states X. A singe sensor observes ony one 4935

3 ocation at a time and generates a set of projected noisy feature positions for that ocation, that misses obscured features, and incudes random missed feature detections as cutter features. The statistica mode for the observation is a random finite point set [24]. The measurement mode is described constructivey as foows: Denote the random set corresponding to measurement of ocation m by sensor j as mj. For each feature ocation Mi k for object type k, we assume that there is a visibiity map Ii k (θ, δ) which is a function of reative azimuth θ and eevation ange δ to a sensor ocation, which takes vaue 1 whenever this feature is visibe from a reative direction corresponding to (θ, δ), and 0 otherwise because of sef-obscuration. Without oss of generaity, assume that the sensor is in the far fied, so this obscuration depends ony on the reative ange and not on the range to the sensor. Thus, given sensor ocation s j and object state at ocation m, the reative azimuth and orientation anges can be computed, and the subset of visibe features for object type c m are readiy identified. The sensor s ocation s j defines a ine-of-sight vector to the ocation z m, and a projection pane perpendicuar to this vector. The sensor measures the projections of the features which are visibe according to the visibiity map to the measurement pane. If feature i is visibe, then its projected ocation is mj i (F m i s j) (zm sj)(f m i s j) T (z m s j) z m s j 2 These projected ocations are represented as twodimensiona ocations in a sensor-centered coordinate frame. Misdetection of visibe features is modeed by a Bernoui detection process which is independent across features, measurements and sensors, with probabiity of detection p D. Let d i {0, 1} denote the indicator that feature i for object of type c m is both visibe and detected when viewed from sensor j, for i 1,..., n cm. Detected projected ocations as measured imprecisey, with Gaussian additive errors, independent across features and measurements, yieding noisy measurements for Ỹ mj mj i i + v mji where v mji N(0, σmj 2 ) has covariance that depends on the sensor-object ocation geometry and is a 2-dimensiona random error in the projection measurement pane of sensor j. The coection of these detected noisy features for sensor j of ocation m are denoted as mj d, defined as mj d {Ỹ mj i d i 1, i 1,..., n cm } Cutter features in the measurement sets are modeed by a homogeneous spatia Poisson point process with tota intensity λ distributed uniformy over the sensor s fied of view, independent across sensors and measurement times. Denote this random set of points c mj of ocation m by sensor j is defined as mj mj. Then, the observation c mj The resuting observation mj is a random set of projected ocations [24], [26], [27]. d The above mode defines the ikeihood p( mj ). Let I m (t) denote a the random set observations of ocation m coected for a times prior to and incuding time t, and the sensor actions u j (m) s that coected the observations. The sufficient statistic or information state summarizing the observations at ocation m is the conditiona probabiity p( I m (t)). Let I(t) N m1i m (t). Given the independence assumptions, it is straightforward to show that the sufficient statistic for the overa state X at time t is given by M p(x I(t)) Π(t + 1) p( I m(t)) m1 The evoution of the information state is governed by Bayes rue, given the new observation mj (t) at time t, as p( I m (t)) p( mj (t) )p( I m (t 1)) x m p( mj (t) x m)p(x m I m (t 1)) This inference invoves averaging over possibe data associations from the random set ocations to the features of object m under state [26], [27]. With the above setup, adaptive sensor management probem seects sensing actions u j (t) {1,..., M} for each sensor, sensors j 1,..., J identifying the ocation at for each time t that each sensor wi observe, based on knowedge of the information state Π(t). Sensor actions are constrained so that a sensor can ony observe ocations which are within its fied of regard. In this paper, we pursue the approach of [20] to use surrogate performance measures based on information theory as the basis for seection of sensor actions, as discussed in the next section. III. INFORMATION-BASED ADAPTIVE SENSOR MANAGEMENT The adaptive sensor management schemes we consider are based on generating stage-by-stage optima poicies. At time t, the sensor management system must seect a sensing action u i (t) for each sensor i, that are functions of the information state Π(t). We define utiity functions R(j, m) associated with the vaue of measuring ocation m with sensor j at time t, which depend on the current information state Π(t) and the random set observation modes described in Section II. Given these utiity functions, computed for each sensor-ocation pair, the actions at time t wi be seected to maximize the tota coected utiity by soving an inequaity-constrained inear assignment probem of the form max m1 M R j,ma j,m subject to (2) M a j,m 1, j 1,..., N m1 a j,m 1, m 1,..., M a j,m {0, 1}, j 1,... N, m 1,..., M 4936

4 where a j,m 1 if sensor i is assigned to measure ocation m at time t, and 0 otherwise. The soution of this probem transates to decision actions at time t, as u j (t) m if a j,m 1. Note that this formuation restricts the actions of sensors so that no two sensors can observe the same ocation at the same time. This restriction coud be reaxed, but the resuting probem woud require a combinatoria enumeration of the predicted performance of combinations of sensors for each ocation, significanty increasing the computation. Given the presence of mutipe observation times, the oss in performance by this restriction is minima, as sensors that shoud observe a ocation that is aso currenty observed by other sensors can simpy deay their observation to another time. The main issue in our approach is the choice of surrogate utiity function that decomposes additivey over sensor actions, as required by the optimization approach. One aternative is the discrimination gain, or equivaenty, the expected reduction in sampe conditiona entropy of the underying conditiona probabiity distributions of the object states at each time [4], [10], [18]. The sampe conditiona entropy of the sufficient statistic Π(t) as H[Π(t))] M p( I m(t 1)) og p( I m(t 1) m1 M H m[p( I m(t))] (3) m1 Note that we are not averaging over I(t) as woud be required for the standard definition of conditiona entropy, since H[Π(t)] is adapted to the sufficient statistic Π(t). As in [18], the expected discrimination gain at time t of a coection of sensing actions U(t) is the sum of the expected sampe conditiona entropy reduction for each action. For action u j (t) m, the discrimination gain from ocation m is D j,m(p( I m(t 1))) H m[p( I m(t 1))] [ E mj (t) Hm[p( I m(t 1), u j(t) m, mj (t))] ] (4) For sensor management, we define the stage t utiity functions R(j, m) D j,m (p( I m (t 1))). Note that the overa cost (3) is additive in the individua ocation discrimination gains. Direct computation of the expectation in (4) using our random set mode is difficut, so the functions R(j, m) are typicay estimated through simuation of the random sets mj (t) for each ocation m and sensor j. A different metric for sensor management is reduction in the expected probabiity of object cassification error based on maximum a posteriori cassification for each ocation. For ocation m, given the information state Π(t) at state t, the probabiity of making a cassification error using the maximum a posteriori cassifier before coecting additiona measurements is R m (t) 1 max p( I m (t 1)) Simiary, after sensor j coects a measurement mj (t), the posterior probabiity of cassification error is R m (t, mj (t)) 1 max p( I m (t 1), mj (t)) The expected reduction in probabiity of error from measuring ocation m with sensor j is R j,m E mj [max p( I m (t 1), mj (t))] max p( I m (t 1)) (5) By summing over the set of possibe sensing actions, the utiity functions R j,m in (5) maximize the expected reduction in the number of cassification errors over the set of ocations. Again, direct computation of this objective requires averaging over the random sets mj (t) for each sensor-ocation pair using Monte Caro techniques. The approach proposed in [20] is to use bounds on the probabiity of error to estimate the expected reduction above. In particuar, these bounds do not require on-ine simuation of random sets, and use quantities based on informationtheoretic distances that can be computed off-ine. We extend the resuts of [20] to use bounds on the probabiities of error in confusing potentia states, x m in terms of Chernoff coefficients [28], as described next. Assume we have two distributions for the same random variabe, given by p( x) and p( x ). The Chernoff coefficient for parameter 0 < α < 1 between these distributions is defined as ρ α x,x p( x) α p( x ) 1 α d (6) The specia symmetric case for α 1/2 is the Bhattacharyya coefficient, which was used in [20], and is denoted without superscript as ρ x,x p( x)p( x )d (7) The Chernoff coefficients in (6) depend on the distribution of the random set measurements conditioned on the discrete states, x m, and not on the rea-time information I m (t). Thus, these coefficients can be computed off-ine, which we wi expoit for fast rea-time sensor management. The Chernoff coefficient provides a bound on the probabiity of cassification error in making a decision between a pair of hypotheses and x m. If the prior probabiities on the casses are p( ), p(x m), and the maximum a posteriori (MAP) rue is used to seect one of the two vaues or x m, the average probabiity of error can be bounded by P err(, x p( xm)p (xm) m) E [min(, p( x m)p (x m) )] P ( ) P ( ) min(p()p( ), p(x m)p( x m))d p() α p(x m) 1 α ρ α,x m Note that the above bound combines the avaiabe information given by the prior probabiities, together with the off-ine computation of the Chernoff coefficient. We can compute this (8) 4937

5 bound for mutipe vaues of the Chernoff coefficients α, and choose the minimum as the best bound on the probabiity of error. The above bound on the average probabiity of error in seecting between two hypotheses can be extended to compute a bound for the probabiity of error when there are many discrete states {Xm, 1..., Xm N } assuming that the estimate is seected by the MAP rue. Theorem 1: Assume there are N possibe hypothesis for ocation m, with prior probabiities p( ), and that we observe a measurement with known conditiona probabiities P ( ), 1,..., N. Then, for any α (0, 1), the expected probabiity of error for the maximum ikeihood decision rue, P err is bounded by P err p( j) α p( j ) 1 α ρ α j,j The proof appears in the appendix. Theorem 1 gives a bound on the probabiity of cassification error for a muti-hypothesis probem, in terms of the Chernoff coefficients between pairs of measurement ikeihood modes. For sensor management, we want to use this bound to approximate the expected reduction in probabiity of error in (5). The expected reduction R(j, m) is R(j, m) R m (t) R m (t, mj (t)) The expected probabiity of error after coecting a measurement from sensor j to ocation m, denoted by R m (t, mj (t)) is bounded above from Theorem 1, by R m (t, mj ) p( k I m (t 1)) α k1 k k+1 p( k I m (t 1)) 1 α ρ α k,k We use this bound to define the utiity function R(j, m) R m (t) p( k I m (t 1)) α k1 k k+1 p( k I m (t 1)) 1 α ρ α k,k (9) which is an estimate of the reduction in expected probabiity of error in estimating the state given a new random set measurement mj (t) by sensor j. Note in particuar that this utiity is easiy computed given the information states Π(t) and the precomputed Chernoff coefficients. A. Computation of Chernoff Coefficients Computing Chernoff coefficients requires integration over random sets, a time-consuming task to perform exacty. Instead of (6), we propose to compute the Chernoff coefficient between two possibe states, x m using importance samping, as: ρ α x [p( mj )] αp( mj m,x m p( mj x x m)d mj (10) m) We use sampes Ỹ mj, 1,..., L generated from the distribution p( mj x m), aong with the ikeihood modes of Section II to evauate ρ xm,x m to yied the resut: Lemma 1: The estimator ˆρ α,x m using Monte Caro techniques L [p(ỹ mj ) p(ỹ mj x m) 1 is an unbiased estimator of ρ α,x m The proof is straightforward from the properties of independent sampes. The computation of Chernoff coefficients from Monte Caro sampes Ỹ mj invoves the computation of ikeihoods p( mj ). Note that mj is a random set, therefore computation of this ikeihood requires summation over a possibe data associations of points in mj with the predicted visibe features for sensor j from the modes at ocation m with state [24]. From our mode in Section II, these ikeihoods become: p( mj ) M ] α p( mj, M)p(M ) (11) where M is a data association hypothesis that expains uniquey the correspondence of points in mj to cutter points and visibe features for sensor j for an object in state at ocation m. The detais of this computation can be found in [23], and other simiar references. The number of terms in the summation in (11) grows exponentiay with the number of features. Furthermore, most of the terms p( mj, M) tend to be vanishingy sma, so the sum is dominated by few terms. A common approach in mutiobject tracking is to compute ony the argest term in the sum, using a generaized ikeihood method, for which efficient soutions are avaiabe [23]. The idea is to approximate M max argmax M p( mj, M)p(M ) p( mj ) p( mj, M max ) However, this generaized ikeihood method can be very inaccurate. Instead, we use a K-best approximation, where we compute the probabiities of the K most-ikey matchings from the simuated measurements to the mode for state to approximate the sum in (11). The best K matches can be found efficienty in time that scaes poynomiay with the number of points in the random sets using variations of assignment agorithms [29]. IV. EXPERIMENTS The experiments in this section consist of scenarios with 7 sensors and 20 objects corresponding to two different casses of cars, shown in Figure 2. Sensors correspond to cameras that image objects that are within a sensing radius, but are constrained to be capabe of viewing just one object at a time. In our simuations, we start with the a priori information that each car type is equay ikey. Each object is presented at an unknown azimuth ange which is uniformy distributed between 0 and 2π, with respect to the system reference axis. We mode a non-fat terrain by a distribution on object 4938

6 eevation ange, which is uniformy distributed on π/6 to +π/6. Object tempates are three-dimensiona modes of cars, with features defined as the ocations of corner points. Objects are opaque, so features can be obscured based on observation orientation. Visibe features are projected noisiy onto the sensor viewing pane. Measurements of object features are conditionay independent and Gaussian distributed with a measurement noise variance of σ m 0.5. On average, each sensor has 4 objects within its sensing radius. Features are detected with a probabiity p D 0.9 and fase aarms are generated at a rate of λ 1 uniformy on the measured image Entropy Reduction Bhattacharyya Distance Chernoff Distance Fig. 3: Comparison between Discrimination Gain and our agorithms using Bhattacharyya and Chernoff coefficients Fig. 2: Two object modes at the same pose Figure 3 shows the performance of our rea-time approach to sensor management, in terms of average probabiity of error versus number of decision times. The resuts compare an on-ine discrimination gain maximization agorithm with our rea-time agorithms using two different approaches at computing off-ine bounds: the Bhattacharyya indices proposed in [20], and the minimum bound obtained by seecting the optima index for Chernoff coefficient α in the bound of (6). The performance curves represent Monte Caro averages in cassification error over 100 simuations, where each simuation varied the ocation and orientation of the objects present as we as the measurement errors. Note that the performances of the agorithm using Bhattacharyya indices and Chernoff indices are neary identica, which suggests that the choice of best sensor/object geometry is not very sensitive to the quaity of the bound used. The main point to note is that the performance achieved by our onine/off-ine approach is comparabe to that achieved by the discrimination gain agorithm, but reducing computation in our MATLAB impementations by three orders of magnitude. V. CONCLUSIONS In this paper, we presented agorithms for computing adaptive sensor management strategies for a group of sensors seeking to cassify a set of spatiay distributed objects. Our approach used a nove mode based on random set observations in terms of coections of extracted features from measured imagery, which are ange-dependent. We presented a nove approach that is scaabe and suitabe for arge numbers of objects based on off-ine computation of Chernoff coefficients between measurement ikeihoods under pairs of hypotheses, together with rea-time estimates of conditiona probabiities of the state hypotheses given past measurements. We aso proposed a new agorithm for computation of the off-ine Chernoff coefficients using a k-best assignment agorithm. Our simuations show that our offine/on-ine agorithms achieve performance comparabe to that of agorithms that use rea-time Monte Caro predictions of performance, whie reducing computation by three orders of magnitude. There are many directions in which this work can be extended. The resuts can be readiy extended to moving objects and moving sensors where sensor-object geometry woud be changing dynamicay. In addition, our simpe feature mode can be extended to add categorica feature types in addition to feature ocations. Another extension woud aow mode uncertainty, so that the tempates coud have variations over where features are ocated. These directions remain as subjects for future investigation. APPENDIX Proof of Theorem 1: Given hypotheses x {1,..., N} with prior probabiities p(x), and observations with conditiona distributions p( x), the maximum aposteriori estimate { } p( x)p(x) ˆx max x {1,...,N} p( ) and the probabiity of error in making this decision is: P err p(j)p(ˆx j j) Define A j to denote the event that the cassification decision ˆ j. This corresponds to a coection of observations for which p(x j ) p(x j ) for a j j. Then, P err p(j)p( A j x j) j j We can assume the events A j are disjoint by using a tiebreaking rue for the maximum a posteriori estimate. Thus, p( A j x j) j j j 1,j j p(a j x j) 4939

7 so we can write P err K p(j) p(j) j 1,j j j 1,j j p(a j x j) p(ˆx j x j) from the definition of A j. We can rearrange symmetric terms in the summation to obtain: P err [p(ˆx j x j)p(x j)+ p(ˆx j x j )p(x j )] We define j to denote those vaues of observation for which event A j is true, that is, the cassification decision is as ˆx j. Then, P err j p(j)p( x j)d + p(xj )p( x j )d j min { p(j)p( j), p(j )p( j ) } d j j min { p(j)p( j), p(j )p( j ) } d p(j) α p( j) α p(j ) 1 α p( j ) 1 α d where the first equaity foows because p(j)p( j) p(j )p( j ) under j and the ast inequaity hods for 0 < α < 1. This gives us the resut: P err p(j) α p(j ) 1 α p(j) α p(j ) 1 α ρ α j,j REFERENCES p( j) α p( j ) 1 α d [1] A. Hero, D. A. Castañón, D. Cochran, and K. Kastea, Foundations and Appications of Sensor Management. Springer, [2]. Li, L. W. Krakow, E. K. P. Chong, and K. N. Groom, Dynamic sensor management for mutisensor mutitarget tracking, in Proceedings of the 40th Annua Conference on Information Sciences and Systems, 2006, pp [3] H. Wang, K. ao, and D. Estrin, Information-theoretic approaches for sensor seection and pacement in sensor networks for target ocaization and tracking, Journa Of Communication and Networks, vo. 7, pp , [4] C. Kreucher, K. Kastea, and A. Hero, Sensor management using an active sensing approach, Signa Processing, vo. 3, no. 85, pp , March [5] J. L. Wiiams, J. F. III, and A. Wisky, An approximate dynamic programming approach to a communication constrained sensor management probem, Proc. Eighth Internationa Conference of Information Fusion, Juy [6] J. L. Wiiams, J. W. Fisher, and A. S. Wisky, An approximate dynamic programming approach for communication constrained inference, IEEE Transactions on Signa Processing, vo. 55, no. 8, pp , August [7] C. M. Kreucher, K. D. Kastea, and A. O. Hero III, Informationbased sensor management for mutitarget tracking, in Signa and Data Processing of Sma Targets 2003, O. E. Drummond, Ed., vo SPIE, 2003, pp [8] C. M. Kreucher, K. D. Kastea, and A. O. H. III, Muti-patform information-based sensor management, in Defense Transformation and Network-Centric Systems, R. Suresh, Ed., vo SPIE, 2005, pp [9] W. W. Schmaedeke, Information-based sensor management, in Signa Processing, Sensor Fusion, and Target Recognition II, I. Kadar and V. Libby, Eds., vo SPIE, 1993, pp [10] W. W. Schmaedeke and K. D. Kastea, Event-averaged maximum ikeihood estimation and information-based sensor management, in Signa Processing, Sensor Fusion, and Target Recognition III, I. Kadar and V. Libby, Eds., vo SPIE, 1994, pp [11] B. Grochosky, A. Makarenko, and H. Durrant-Whyte, Informationtheoretic coordinated contro of mutipe sensor patforms, in Proc. IEEE Internationa Conference on Robotics and Automation, 2003, Sep. 2003, pp [12] D. A. Castañón, Approximate dynamic programming for sensor management, in Proceedings 36th IEEE Conference on Decision and Contro, 1997, pp [13] V. Krishnamurthy and J. Evans, Optima sensor scheduing for hidden markov mode state estimation, Internationa Journa of Contro, vo. 74, no. 18, pp , Dec [14] V. Krishnamurthy, Agorithms for optima scheduing and management of hidden markov mode sensors, IEEE Transactions on Signa Processing, vo. 50, no. 6, pp , Jun [15] D. A. Castañón, Stochastic contro bounds on sensor network performance, in Proceedings 44th IEEE Conference on Decision and Contro, Dec. 2005, pp [16] J. Wintenby and V. Krishnamurthy, Hierarchica resource management in adaptive airborne surveiance radars, IEEE Transactions on Aerospace and Eectronic Systems, vo. 42, no. 2, pp , Apr [17] C. Kreucher, A. Hero, and K. Kastea, A comparison of task driven and information driven sensor management for target tracking, 44th IEEE Conference on Decision and Contro, December [18] K. Kastea, Discrimination gain to optimize detection and cassification, IEEE Transactions on Systems, Man and Cybernetics, Part A, vo. 27, no. 1, pp , Jan [19] D. C. Hitchings and D. A. Castañón, Receding horizon stochastic contro agorithms for sensor management, in Proc. American Contro Conference), Batimore, MD, June [20] K. L. Jenkins and D. A. Castañón, Adaptive sensor management for feature-based cassification, in Proc. of the Conference on Decision and Contro, December [21] W. M. Wes, Statistica approaches to feature-based object recognition, Internationa Journa of Computer Vision, vo. 21, no. 1/2, pp , [22] H. Chiang and R. L. Moses, Mode-based bayesian feature matching with appication to synthetic aperture radar target recognition, in Specia Issue on Data and Information Fusion in Image Processing and Computer Vision, 2001, pp [23] Z. ing and D. Castañón, Partiay occuded object recognition using statistica modes, Internationa Journa of Computer Vision, vo. 49, no. 1, pp , [24] J. Goutsias, R. P. Maher, and H. T. Nguyen, Random Sets: Theory and Appications, ser. IMA voumes in mathematics and its appications. Springer Verag, 1997, vo. 97. [25] H. Chiang, R. L. Moses, and L. C. Potter, Mode-based cassification of radar images, IEEE Transactions on Information Theory, vo. 46, pp , [26] R. B. Washburn, A random point process approach to mutiobject tracking, in Proc. American Contro Conference, June 1987, pp [27] R. Maher, Random-set approach to data fusion, in SPIE, vo. 2234, Juy [28] H. Chernoff, A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations, Annas of Mathematica Statistics, vo. 23, pp , [29] K. G. Murty, An agorithm for ranking a the assignments in order of increasing cost, Operations Research, vo. 16, no. 3, pp ,

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c)

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c) A Simpe Efficient Agorithm of 3-D Singe-Source Locaization with Uniform Cross Array Bing Xue a * Guangyou Fang b Yicai Ji c Key Laboratory of Eectromagnetic Radiation Sensing Technoogy, Institute of Eectronics,

More information

A Brief Introduction to Markov Chains and Hidden Markov Models

A Brief Introduction to Markov Chains and Hidden Markov Models A Brief Introduction to Markov Chains and Hidden Markov Modes Aen B MacKenzie Notes for December 1, 3, &8, 2015 Discrete-Time Markov Chains You may reca that when we first introduced random processes,

More information

Bayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with?

Bayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with? Bayesian Learning A powerfu and growing approach in machine earning We use it in our own decision making a the time You hear a which which coud equay be Thanks or Tanks, which woud you go with? Combine

More information

II. PROBLEM. A. Description. For the space of audio signals

II. PROBLEM. A. Description. For the space of audio signals CS229 - Fina Report Speech Recording based Language Recognition (Natura Language) Leopod Cambier - cambier; Matan Leibovich - matane; Cindy Orozco Bohorquez - orozcocc ABSTRACT We construct a rea time

More information

AST 418/518 Instrumentation and Statistics

AST 418/518 Instrumentation and Statistics AST 418/518 Instrumentation and Statistics Cass Website: http://ircamera.as.arizona.edu/astr_518 Cass Texts: Practica Statistics for Astronomers, J.V. Wa, and C.R. Jenkins, Second Edition. Measuring the

More information

ASummaryofGaussianProcesses Coryn A.L. Bailer-Jones

ASummaryofGaussianProcesses Coryn A.L. Bailer-Jones ASummaryofGaussianProcesses Coryn A.L. Baier-Jones Cavendish Laboratory University of Cambridge caj@mrao.cam.ac.uk Introduction A genera prediction probem can be posed as foows. We consider that the variabe

More information

A. Distribution of the test statistic

A. Distribution of the test statistic A. Distribution of the test statistic In the sequentia test, we first compute the test statistic from a mini-batch of size m. If a decision cannot be made with this statistic, we keep increasing the mini-batch

More information

Statistical Learning Theory: A Primer

Statistical Learning Theory: A Primer Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO

More information

MARKOV CHAINS AND MARKOV DECISION THEORY. Contents

MARKOV CHAINS AND MARKOV DECISION THEORY. Contents MARKOV CHAINS AND MARKOV DECISION THEORY ARINDRIMA DATTA Abstract. In this paper, we begin with a forma introduction to probabiity and expain the concept of random variabes and stochastic processes. After

More information

An Algorithm for Pruning Redundant Modules in Min-Max Modular Network

An Algorithm for Pruning Redundant Modules in Min-Max Modular Network An Agorithm for Pruning Redundant Modues in Min-Max Moduar Network Hui-Cheng Lian and Bao-Liang Lu Department of Computer Science and Engineering, Shanghai Jiao Tong University 1954 Hua Shan Rd., Shanghai

More information

Uniprocessor Feasibility of Sporadic Tasks with Constrained Deadlines is Strongly conp-complete

Uniprocessor Feasibility of Sporadic Tasks with Constrained Deadlines is Strongly conp-complete Uniprocessor Feasibiity of Sporadic Tasks with Constrained Deadines is Strongy conp-compete Pontus Ekberg and Wang Yi Uppsaa University, Sweden Emai: {pontus.ekberg yi}@it.uu.se Abstract Deciding the feasibiity

More information

CS229 Lecture notes. Andrew Ng

CS229 Lecture notes. Andrew Ng CS229 Lecture notes Andrew Ng Part IX The EM agorithm In the previous set of notes, we taked about the EM agorithm as appied to fitting a mixture of Gaussians. In this set of notes, we give a broader view

More information

A Statistical Framework for Real-time Event Detection in Power Systems

A Statistical Framework for Real-time Event Detection in Power Systems 1 A Statistica Framework for Rea-time Event Detection in Power Systems Noan Uhrich, Tim Christman, Phiip Swisher, and Xichen Jiang Abstract A quickest change detection (QCD) agorithm is appied to the probem

More information

Explicit overall risk minimization transductive bound

Explicit overall risk minimization transductive bound 1 Expicit overa risk minimization transductive bound Sergio Decherchi, Paoo Gastado, Sandro Ridea, Rodofo Zunino Dept. of Biophysica and Eectronic Engineering (DIBE), Genoa University Via Opera Pia 11a,

More information

Nonlinear Gaussian Filtering via Radial Basis Function Approximation

Nonlinear Gaussian Filtering via Radial Basis Function Approximation 51st IEEE Conference on Decision and Contro December 10-13 01 Maui Hawaii USA Noninear Gaussian Fitering via Radia Basis Function Approximation Huazhen Fang Jia Wang and Raymond A de Caafon Abstract This

More information

Target Location Estimation in Wireless Sensor Networks Using Binary Data

Target Location Estimation in Wireless Sensor Networks Using Binary Data Target Location stimation in Wireess Sensor Networks Using Binary Data Ruixin Niu and Pramod K. Varshney Department of ectrica ngineering and Computer Science Link Ha Syracuse University Syracuse, NY 344

More information

6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7

6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7 6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17 Soution 7 Probem 1: Generating Random Variabes Each part of this probem requires impementation in MATLAB. For the

More information

arxiv: v1 [cs.lg] 31 Oct 2017

arxiv: v1 [cs.lg] 31 Oct 2017 ACCELERATED SPARSE SUBSPACE CLUSTERING Abofaz Hashemi and Haris Vikao Department of Eectrica and Computer Engineering, University of Texas at Austin, Austin, TX, USA arxiv:7.26v [cs.lg] 3 Oct 27 ABSTRACT

More information

Stochastic Variational Inference with Gradient Linearization

Stochastic Variational Inference with Gradient Linearization Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,

More information

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance adar/ racing of Constant Veocity arget : Comparison of Batch (LE) and EKF Performance I. Leibowicz homson-csf Deteis/IISA La cef de Saint-Pierre 1 Bd Jean ouin 7885 Eancourt Cede France Isabee.Leibowicz

More information

The Relationship Between Discrete and Continuous Entropy in EPR-Steering Inequalities. Abstract

The Relationship Between Discrete and Continuous Entropy in EPR-Steering Inequalities. Abstract The Reationship Between Discrete and Continuous Entropy in EPR-Steering Inequaities James Schneeoch 1 1 Department of Physics and Astronomy, University of Rochester, Rochester, NY 14627 arxiv:1312.2604v1

More information

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA)

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA) 1 FRST 531 -- Mutivariate Statistics Mutivariate Discriminant Anaysis (MDA) Purpose: 1. To predict which group (Y) an observation beongs to based on the characteristics of p predictor (X) variabes, using

More information

Traffic data collection

Traffic data collection Chapter 32 Traffic data coection 32.1 Overview Unike many other discipines of the engineering, the situations that are interesting to a traffic engineer cannot be reproduced in a aboratory. Even if road

More information

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Brandon Maone Department of Computer Science University of Hesini February 18, 2014 Abstract This document derives, in excrutiating

More information

<C 2 2. λ 2 l. λ 1 l 1 < C 1

<C 2 2. λ 2 l. λ 1 l 1 < C 1 Teecommunication Network Contro and Management (EE E694) Prof. A. A. Lazar Notes for the ecture of 7/Feb/95 by Huayan Wang (this document was ast LaT E X-ed on May 9,995) Queueing Primer for Muticass Optima

More information

Optimality of Inference in Hierarchical Coding for Distributed Object-Based Representations

Optimality of Inference in Hierarchical Coding for Distributed Object-Based Representations Optimaity of Inference in Hierarchica Coding for Distributed Object-Based Representations Simon Brodeur, Jean Rouat NECOTIS, Département génie éectrique et génie informatique, Université de Sherbrooke,

More information

A Comparison Study of the Test for Right Censored and Grouped Data

A Comparison Study of the Test for Right Censored and Grouped Data Communications for Statistica Appications and Methods 2015, Vo. 22, No. 4, 313 320 DOI: http://dx.doi.org/10.5351/csam.2015.22.4.313 Print ISSN 2287-7843 / Onine ISSN 2383-4757 A Comparison Study of the

More information

Statistical Learning Theory: a Primer

Statistical Learning Theory: a Primer ??,??, 1 6 (??) c?? Kuwer Academic Pubishers, Boston. Manufactured in The Netherands. Statistica Learning Theory: a Primer THEODOROS EVGENIOU AND MASSIMILIANO PONTIL Center for Bioogica and Computationa

More information

Asynchronous Control for Coupled Markov Decision Systems

Asynchronous Control for Coupled Markov Decision Systems INFORMATION THEORY WORKSHOP (ITW) 22 Asynchronous Contro for Couped Marov Decision Systems Michae J. Neey University of Southern Caifornia Abstract This paper considers optima contro for a coection of

More information

(This is a sample cover image for this issue. The actual cover is not yet available at this time.)

(This is a sample cover image for this issue. The actual cover is not yet available at this time.) (This is a sampe cover image for this issue The actua cover is not yet avaiabe at this time) This artice appeared in a journa pubished by Esevier The attached copy is furnished to the author for interna

More information

The EM Algorithm applied to determining new limit points of Mahler measures

The EM Algorithm applied to determining new limit points of Mahler measures Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,

More information

Appendix for Stochastic Gradient Monomial Gamma Sampler

Appendix for Stochastic Gradient Monomial Gamma Sampler 3 4 5 6 7 8 9 3 4 5 6 7 8 9 3 4 5 6 7 8 9 3 3 3 33 34 35 36 37 38 39 4 4 4 43 44 45 46 47 48 49 5 5 5 53 54 Appendix for Stochastic Gradient Monomia Gamma Samper A The Main Theorem We provide the foowing

More information

Active Learning & Experimental Design

Active Learning & Experimental Design Active Learning & Experimenta Design Danie Ting Heaviy modified, of course, by Lye Ungar Origina Sides by Barbara Engehardt and Aex Shyr Lye Ungar, University of Pennsyvania Motivation u Data coection

More information

Data Mining Technology for Failure Prognostic of Avionics

Data Mining Technology for Failure Prognostic of Avionics IEEE Transactions on Aerospace and Eectronic Systems. Voume 38, #, pp.388-403, 00. Data Mining Technoogy for Faiure Prognostic of Avionics V.A. Skormin, Binghamton University, Binghamton, NY, 1390, USA

More information

AALBORG UNIVERSITY. The distribution of communication cost for a mobile service scenario. Jesper Møller and Man Lung Yiu. R June 2009

AALBORG UNIVERSITY. The distribution of communication cost for a mobile service scenario. Jesper Møller and Man Lung Yiu. R June 2009 AALBORG UNIVERSITY The distribution of communication cost for a mobie service scenario by Jesper Møer and Man Lung Yiu R-29-11 June 29 Department of Mathematica Sciences Aaborg University Fredrik Bajers

More information

Research of Data Fusion Method of Multi-Sensor Based on Correlation Coefficient of Confidence Distance

Research of Data Fusion Method of Multi-Sensor Based on Correlation Coefficient of Confidence Distance Send Orders for Reprints to reprints@benthamscience.ae 340 The Open Cybernetics & Systemics Journa, 015, 9, 340-344 Open Access Research of Data Fusion Method of Muti-Sensor Based on Correation Coefficient

More information

Paragraph Topic Classification

Paragraph Topic Classification Paragraph Topic Cassification Eugene Nho Graduate Schoo of Business Stanford University Stanford, CA 94305 enho@stanford.edu Edward Ng Department of Eectrica Engineering Stanford University Stanford, CA

More information

Appendix for Stochastic Gradient Monomial Gamma Sampler

Appendix for Stochastic Gradient Monomial Gamma Sampler Appendix for Stochastic Gradient Monomia Gamma Samper A The Main Theorem We provide the foowing theorem to characterize the stationary distribution of the stochastic process with SDEs in (3) Theorem 3

More information

Iterative Decoding Performance Bounds for LDPC Codes on Noisy Channels

Iterative Decoding Performance Bounds for LDPC Codes on Noisy Channels Iterative Decoding Performance Bounds for LDPC Codes on Noisy Channes arxiv:cs/060700v1 [cs.it] 6 Ju 006 Chun-Hao Hsu and Achieas Anastasopouos Eectrica Engineering and Computer Science Department University

More information

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION Hsiao-Chang Chen Dept. of Systems Engineering University of Pennsyvania Phiadephia, PA 904-635, U.S.A. Chun-Hung Chen

More information

Distributed average consensus: Beyond the realm of linearity

Distributed average consensus: Beyond the realm of linearity Distributed average consensus: Beyond the ream of inearity Usman A. Khan, Soummya Kar, and José M. F. Moura Department of Eectrica and Computer Engineering Carnegie Meon University 5 Forbes Ave, Pittsburgh,

More information

Automobile Prices in Market Equilibrium. Berry, Pakes and Levinsohn

Automobile Prices in Market Equilibrium. Berry, Pakes and Levinsohn Automobie Prices in Market Equiibrium Berry, Pakes and Levinsohn Empirica Anaysis of demand and suppy in a differentiated products market: equiibrium in the U.S. automobie market. Oigopoistic Differentiated

More information

Moreau-Yosida Regularization for Grouped Tree Structure Learning

Moreau-Yosida Regularization for Grouped Tree Structure Learning Moreau-Yosida Reguarization for Grouped Tree Structure Learning Jun Liu Computer Science and Engineering Arizona State University J.Liu@asu.edu Jieping Ye Computer Science and Engineering Arizona State

More information

Throughput Optimal Scheduling for Wireless Downlinks with Reconfiguration Delay

Throughput Optimal Scheduling for Wireless Downlinks with Reconfiguration Delay Throughput Optima Scheduing for Wireess Downinks with Reconfiguration Deay Vineeth Baa Sukumaran vineethbs@gmai.com Department of Avionics Indian Institute of Space Science and Technoogy. Abstract We consider

More information

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische

More information

DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM

DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM MIKAEL NILSSON, MATTIAS DAHL AND INGVAR CLAESSON Bekinge Institute of Technoogy Department of Teecommunications and Signa Processing

More information

The influence of temperature of photovoltaic modules on performance of solar power plant

The influence of temperature of photovoltaic modules on performance of solar power plant IOSR Journa of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vo. 05, Issue 04 (Apri. 2015), V1 PP 09-15 www.iosrjen.org The infuence of temperature of photovotaic modues on performance

More information

arxiv: v2 [stat.ap] 28 Mar 2016

arxiv: v2 [stat.ap] 28 Mar 2016 Bayesian modeing of networks in compex business inteigence probems Daniee Durante, Say Paganin, Bruno Scarpa and David B. Dunson arxiv:0.00v [stat.ap] Mar 0 University of Padua, Department of Statistica

More information

From Margins to Probabilities in Multiclass Learning Problems

From Margins to Probabilities in Multiclass Learning Problems From Margins to Probabiities in Muticass Learning Probems Andrea Passerini and Massimiiano Ponti 2 and Paoo Frasconi 3 Abstract. We study the probem of muticass cassification within the framework of error

More information

STA 216 Project: Spline Approach to Discrete Survival Analysis

STA 216 Project: Spline Approach to Discrete Survival Analysis : Spine Approach to Discrete Surviva Anaysis November 4, 005 1 Introduction Athough continuous surviva anaysis differs much from the discrete surviva anaysis, there is certain ink between the two modeing

More information

Fast Blind Recognition of Channel Codes

Fast Blind Recognition of Channel Codes Fast Bind Recognition of Channe Codes Reza Moosavi and Erik G. Larsson Linköping University Post Print N.B.: When citing this work, cite the origina artice. 213 IEEE. Persona use of this materia is permitted.

More information

Statistics for Applications. Chapter 7: Regression 1/43

Statistics for Applications. Chapter 7: Regression 1/43 Statistics for Appications Chapter 7: Regression 1/43 Heuristics of the inear regression (1) Consider a coud of i.i.d. random points (X i,y i ),i =1,...,n : 2/43 Heuristics of the inear regression (2)

More information

Optimal Control of Assembly Systems with Multiple Stages and Multiple Demand Classes 1

Optimal Control of Assembly Systems with Multiple Stages and Multiple Demand Classes 1 Optima Contro of Assemby Systems with Mutipe Stages and Mutipe Demand Casses Saif Benjaafar Mohsen EHafsi 2 Chung-Yee Lee 3 Weihua Zhou 3 Industria & Systems Engineering, Department of Mechanica Engineering,

More information

c 2016 Georgios Rovatsos

c 2016 Georgios Rovatsos c 2016 Georgios Rovatsos QUICKEST CHANGE DETECTION WITH APPLICATIONS TO LINE OUTAGE DETECTION BY GEORGIOS ROVATSOS THESIS Submitted in partia fufiment of the requirements for the degree of Master of Science

More information

A proposed nonparametric mixture density estimation using B-spline functions

A proposed nonparametric mixture density estimation using B-spline functions A proposed nonparametric mixture density estimation using B-spine functions Atizez Hadrich a,b, Mourad Zribi a, Afif Masmoudi b a Laboratoire d Informatique Signa et Image de a Côte d Opae (LISIC-EA 4491),

More information

BDD-Based Analysis of Gapped q-gram Filters

BDD-Based Analysis of Gapped q-gram Filters BDD-Based Anaysis of Gapped q-gram Fiters Marc Fontaine, Stefan Burkhardt 2 and Juha Kärkkäinen 2 Max-Panck-Institut für Informatik Stuhsatzenhausweg 85, 6623 Saarbrücken, Germany e-mai: stburk@mpi-sb.mpg.de

More information

Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps

Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps Efficient Visua-Inertia Navigation using a Roing-Shutter Camera with Inaccurate Timestamps Chao X. Guo, Dimitrios G. Kottas, Ryan C. DuToit Ahmed Ahmed, Ruipeng Li and Stergios I. Roumeiotis Mutipe Autonomous

More information

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization Scaabe Spectrum ocation for Large Networks ased on Sparse Optimization innan Zhuang Modem R&D Lab Samsung Semiconductor, Inc. San Diego, C Dongning Guo, Ermin Wei, and Michae L. Honig Department of Eectrica

More information

Improving the Accuracy of Boolean Tomography by Exploiting Path Congestion Degrees

Improving the Accuracy of Boolean Tomography by Exploiting Path Congestion Degrees Improving the Accuracy of Booean Tomography by Expoiting Path Congestion Degrees Zhiyong Zhang, Gaoei Fei, Fucai Yu, Guangmin Hu Schoo of Communication and Information Engineering, University of Eectronic

More information

PREDICTION OF DEFORMED AND ANNEALED MICROSTRUCTURES USING BAYESIAN NEURAL NETWORKS AND GAUSSIAN PROCESSES

PREDICTION OF DEFORMED AND ANNEALED MICROSTRUCTURES USING BAYESIAN NEURAL NETWORKS AND GAUSSIAN PROCESSES PREDICTION OF DEFORMED AND ANNEALED MICROSTRUCTURES USING BAYESIAN NEURAL NETWORKS AND GAUSSIAN PROCESSES C.A.L. Baier-Jones, T.J. Sabin, D.J.C. MacKay, P.J. Withers Department of Materias Science and

More information

THE THREE POINT STEINER PROBLEM ON THE FLAT TORUS: THE MINIMAL LUNE CASE

THE THREE POINT STEINER PROBLEM ON THE FLAT TORUS: THE MINIMAL LUNE CASE THE THREE POINT STEINER PROBLEM ON THE FLAT TORUS: THE MINIMAL LUNE CASE KATIE L. MAY AND MELISSA A. MITCHELL Abstract. We show how to identify the minima path network connecting three fixed points on

More information

Approach to Identifying Raindrop Vibration Signal Detected by Optical Fiber

Approach to Identifying Raindrop Vibration Signal Detected by Optical Fiber Sensors & Transducers, o. 6, Issue, December 3, pp. 85-9 Sensors & Transducers 3 by IFSA http://www.sensorsporta.com Approach to Identifying Raindrop ibration Signa Detected by Optica Fiber ongquan QU,

More information

Effective Appearance Model and Similarity Measure for Particle Filtering and Visual Tracking

Effective Appearance Model and Similarity Measure for Particle Filtering and Visual Tracking Effective Appearance Mode and Simiarity Measure for Partice Fitering and Visua Tracking Hanzi Wang David Suter and Konrad Schinder Institute for Vision Systems Engineering Department of Eectrica and Computer

More information

Power Control and Transmission Scheduling for Network Utility Maximization in Wireless Networks

Power Control and Transmission Scheduling for Network Utility Maximization in Wireless Networks ower Contro and Transmission Scheduing for Network Utiity Maximization in Wireess Networks Min Cao, Vivek Raghunathan, Stephen Hany, Vinod Sharma and. R. Kumar Abstract We consider a joint power contro

More information

Categories and Subject Descriptors B.7.2 [Integrated Circuits]: Design Aids Verification. General Terms Algorithms

Categories and Subject Descriptors B.7.2 [Integrated Circuits]: Design Aids Verification. General Terms Algorithms 5. oward Eicient arge-scae Perormance odeing o Integrated Circuits via uti-ode/uti-corner Sparse Regression Wangyang Zhang entor Graphics Corporation Ridder Park Drive San Jose, CA 953 wangyan@ece.cmu.edu

More information

XSAT of linear CNF formulas

XSAT of linear CNF formulas XSAT of inear CN formuas Bernd R. Schuh Dr. Bernd Schuh, D-50968 Kön, Germany; bernd.schuh@netcoogne.de eywords: compexity, XSAT, exact inear formua, -reguarity, -uniformity, NPcompeteness Abstract. Open

More information

FORECASTING TELECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODELS

FORECASTING TELECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODELS FORECASTING TEECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODES Niesh Subhash naawade a, Mrs. Meenakshi Pawar b a SVERI's Coege of Engineering, Pandharpur. nieshsubhash15@gmai.com

More information

A Solution to the 4-bit Parity Problem with a Single Quaternary Neuron

A Solution to the 4-bit Parity Problem with a Single Quaternary Neuron Neura Information Processing - Letters and Reviews Vo. 5, No. 2, November 2004 LETTER A Soution to the 4-bit Parity Probem with a Singe Quaternary Neuron Tohru Nitta Nationa Institute of Advanced Industria

More information

Uniformly Reweighted Belief Propagation: A Factor Graph Approach

Uniformly Reweighted Belief Propagation: A Factor Graph Approach Uniformy Reweighted Beief Propagation: A Factor Graph Approach Henk Wymeersch Chamers University of Technoogy Gothenburg, Sweden henkw@chamers.se Federico Penna Poitecnico di Torino Torino, Itay federico.penna@poito.it

More information

Separation of Variables and a Spherical Shell with Surface Charge

Separation of Variables and a Spherical Shell with Surface Charge Separation of Variabes and a Spherica She with Surface Charge In cass we worked out the eectrostatic potentia due to a spherica she of radius R with a surface charge density σθ = σ cos θ. This cacuation

More information

Asymptotic Properties of a Generalized Cross Entropy Optimization Algorithm

Asymptotic Properties of a Generalized Cross Entropy Optimization Algorithm 1 Asymptotic Properties of a Generaized Cross Entropy Optimization Agorithm Zijun Wu, Michae Koonko, Institute for Appied Stochastics and Operations Research, Caustha Technica University Abstract The discrete

More information

Two-Stage Least Squares as Minimum Distance

Two-Stage Least Squares as Minimum Distance Two-Stage Least Squares as Minimum Distance Frank Windmeijer Discussion Paper 17 / 683 7 June 2017 Department of Economics University of Bristo Priory Road Compex Bristo BS8 1TU United Kingdom Two-Stage

More information

A Novel Learning Method for Elman Neural Network Using Local Search

A Novel Learning Method for Elman Neural Network Using Local Search Neura Information Processing Letters and Reviews Vo. 11, No. 8, August 2007 LETTER A Nove Learning Method for Eman Neura Networ Using Loca Search Facuty of Engineering, Toyama University, Gofuu 3190 Toyama

More information

Discrete Applied Mathematics

Discrete Applied Mathematics Discrete Appied Mathematics 159 (2011) 812 825 Contents ists avaiabe at ScienceDirect Discrete Appied Mathematics journa homepage: www.esevier.com/ocate/dam A direct barter mode for course add/drop process

More information

SVM: Terminology 1(6) SVM: Terminology 2(6)

SVM: Terminology 1(6) SVM: Terminology 2(6) Andrew Kusiak Inteigent Systems Laboratory 39 Seamans Center he University of Iowa Iowa City, IA 54-57 SVM he maxima margin cassifier is simiar to the perceptron: It aso assumes that the data points are

More information

A Ridgelet Kernel Regression Model using Genetic Algorithm

A Ridgelet Kernel Regression Model using Genetic Algorithm A Ridgeet Kerne Regression Mode using Genetic Agorithm Shuyuan Yang, Min Wang, Licheng Jiao * Institute of Inteigence Information Processing, Department of Eectrica Engineering Xidian University Xi an,

More information

TRAVEL TIME ESTIMATION FOR URBAN ROAD NETWORKS USING LOW FREQUENCY PROBE VEHICLE DATA

TRAVEL TIME ESTIMATION FOR URBAN ROAD NETWORKS USING LOW FREQUENCY PROBE VEHICLE DATA TRAVEL TIME ESTIMATIO FOR URBA ROAD ETWORKS USIG LOW FREQUECY PROBE VEHICLE DATA Erik Jeneius Corresponding author KTH Roya Institute of Technoogy Department of Transport Science Emai: erik.jeneius@abe.kth.se

More information

Stochastic Surveillance Strategies for Spatial Quickest Detection

Stochastic Surveillance Strategies for Spatial Quickest Detection Stochastic Surveiance Strategies for Spatia Quickest Detection Vaibhav Srivastava Francesco Buo Abstract We present stochastic vehice routing poicies for detection of any number of anomaies in a set of

More information

An approximate method for solving the inverse scattering problem with fixed-energy data

An approximate method for solving the inverse scattering problem with fixed-energy data J. Inv. I-Posed Probems, Vo. 7, No. 6, pp. 561 571 (1999) c VSP 1999 An approximate method for soving the inverse scattering probem with fixed-energy data A. G. Ramm and W. Scheid Received May 12, 1999

More information

On the evaluation of saving-consumption plans

On the evaluation of saving-consumption plans On the evauation of saving-consumption pans Steven Vanduffe Jan Dhaene Marc Goovaerts Juy 13, 2004 Abstract Knowedge of the distribution function of the stochasticay compounded vaue of a series of future

More information

Optimization Based Bidding Strategies in the Deregulated Market

Optimization Based Bidding Strategies in the Deregulated Market Optimization ased idding Strategies in the Dereguated arket Daoyuan Zhang Ascend Communications, nc 866 North ain Street, Waingford, C 0649 Abstract With the dereguation of eectric power systems, market

More information

Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds.

Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds. Proceedings of the 2012 Winter Simuation Conference C. aroque, J. Himmespach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds. TIGHT BOUNDS FOR AMERICAN OPTIONS VIA MUTIEVE MONTE CARO Denis Beomestny Duisburg-Essen

More information

Lobontiu: System Dynamics for Engineering Students Website Chapter 3 1. z b z

Lobontiu: System Dynamics for Engineering Students Website Chapter 3 1. z b z Chapter W3 Mechanica Systems II Introduction This companion website chapter anayzes the foowing topics in connection to the printed-book Chapter 3: Lumped-parameter inertia fractions of basic compiant

More information

High Spectral Resolution Infrared Radiance Modeling Using Optimal Spectral Sampling (OSS) Method

High Spectral Resolution Infrared Radiance Modeling Using Optimal Spectral Sampling (OSS) Method High Spectra Resoution Infrared Radiance Modeing Using Optima Spectra Samping (OSS) Method J.-L. Moncet and G. Uymin Background Optima Spectra Samping (OSS) method is a fast and accurate monochromatic

More information

International Journal of Mass Spectrometry

International Journal of Mass Spectrometry Internationa Journa of Mass Spectrometry 280 (2009) 179 183 Contents ists avaiabe at ScienceDirect Internationa Journa of Mass Spectrometry journa homepage: www.esevier.com/ocate/ijms Stark mixing by ion-rydberg

More information

An Information Geometrical View of Stationary Subspace Analysis

An Information Geometrical View of Stationary Subspace Analysis An Information Geometrica View of Stationary Subspace Anaysis Motoaki Kawanabe, Wojciech Samek, Pau von Bünau, and Frank C. Meinecke Fraunhofer Institute FIRST, Kekuéstr. 7, 12489 Berin, Germany Berin

More information

MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES

MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES Separation of variabes is a method to sove certain PDEs which have a warped product structure. First, on R n, a inear PDE of order m is

More information

Maximum likelihood decoding of trellis codes in fading channels with no receiver CSI is a polynomial-complexity problem

Maximum likelihood decoding of trellis codes in fading channels with no receiver CSI is a polynomial-complexity problem 1 Maximum ikeihood decoding of treis codes in fading channes with no receiver CSI is a poynomia-compexity probem Chun-Hao Hsu and Achieas Anastasopouos Eectrica Engineering and Computer Science Department

More information

An explicit Jordan Decomposition of Companion matrices

An explicit Jordan Decomposition of Companion matrices An expicit Jordan Decomposition of Companion matrices Fermín S V Bazán Departamento de Matemática CFM UFSC 88040-900 Forianópois SC E-mai: fermin@mtmufscbr S Gratton CERFACS 42 Av Gaspard Coriois 31057

More information

Supervised i-vector Modeling - Theory and Applications

Supervised i-vector Modeling - Theory and Applications Supervised i-vector Modeing - Theory and Appications Shreyas Ramoji, Sriram Ganapathy Learning and Extraction of Acoustic Patterns LEAP) Lab, Eectrica Engineering, Indian Institute of Science, Bengauru,

More information

Lecture Note 3: Stationary Iterative Methods

Lecture Note 3: Stationary Iterative Methods MATH 5330: Computationa Methods of Linear Agebra Lecture Note 3: Stationary Iterative Methods Xianyi Zeng Department of Mathematica Sciences, UTEP Stationary Iterative Methods The Gaussian eimination (or

More information

( ) is just a function of x, with

( ) is just a function of x, with II. MULTIVARIATE CALCULUS The first ecture covered functions where a singe input goes in, and a singe output comes out. Most economic appications aren t so simpe. In most cases, a number of variabes infuence

More information

BP neural network-based sports performance prediction model applied research

BP neural network-based sports performance prediction model applied research Avaiabe onine www.jocpr.com Journa of Chemica and Pharmaceutica Research, 204, 6(7:93-936 Research Artice ISSN : 0975-7384 CODEN(USA : JCPRC5 BP neura networ-based sports performance prediction mode appied

More information

Coded Caching for Files with Distinct File Sizes

Coded Caching for Files with Distinct File Sizes Coded Caching for Fies with Distinct Fie Sizes Jinbei Zhang iaojun Lin Chih-Chun Wang inbing Wang Department of Eectronic Engineering Shanghai Jiao ong University China Schoo of Eectrica and Computer Engineering

More information

Atomic Hierarchical Routing Games in Communication Networks

Atomic Hierarchical Routing Games in Communication Networks Atomic Hierarchica Routing Games in Communication etworks Vijay Kambe, Eitan Atman, Rachid E-Azouzi Vinod Sharma Dept. of Industria Engineering Management, IIT - Kharagpur, West Benga, India Maestro group,

More information

In-plane shear stiffness of bare steel deck through shell finite element models. G. Bian, B.W. Schafer. June 2017

In-plane shear stiffness of bare steel deck through shell finite element models. G. Bian, B.W. Schafer. June 2017 In-pane shear stiffness of bare stee deck through she finite eement modes G. Bian, B.W. Schafer June 7 COLD-FORMED STEEL RESEARCH CONSORTIUM REPORT SERIES CFSRC R-7- SDII Stee Diaphragm Innovation Initiative

More information

Tight Approximation Algorithms for Maximum Separable Assignment Problems

Tight Approximation Algorithms for Maximum Separable Assignment Problems MATHEMATICS OF OPERATIONS RESEARCH Vo. 36, No. 3, August 011, pp. 416 431 issn 0364-765X eissn 156-5471 11 3603 0416 10.187/moor.1110.0499 011 INFORMS Tight Approximation Agorithms for Maximum Separabe

More information

Proceedings of Meetings on Acoustics

Proceedings of Meetings on Acoustics Proceedings of Meetings on Acoustics Voume 19, 213 http://acousticasociety.org/ ICA 213 Montrea Montrea, Canada 2-7 June 213 Underwater Acoustics Session 1pUW: Seabed Scattering: Measurements and Mechanisms

More information

12.2. Maxima and Minima. Introduction. Prerequisites. Learning Outcomes

12.2. Maxima and Minima. Introduction. Prerequisites. Learning Outcomes Maima and Minima 1. Introduction In this Section we anayse curves in the oca neighbourhood of a stationary point and, from this anaysis, deduce necessary conditions satisfied by oca maima and oca minima.

More information

Collective organization in an adaptative mixture of experts

Collective organization in an adaptative mixture of experts Coective organization in an adaptative mixture of experts Vincent Vigneron, Christine Fuchen, Jean-Marc Martinez To cite this version: Vincent Vigneron, Christine Fuchen, Jean-Marc Martinez. Coective organization

More information