Correlated Bayesian Model Fusion: Efficient Performance Modeling of Large-Scale Tunable Analog/RF Integrated Circuits

Size: px
Start display at page:

Download "Correlated Bayesian Model Fusion: Efficient Performance Modeling of Large-Scale Tunable Analog/RF Integrated Circuits"

Transcription

1 Correlated Bayesian odel Fusion: Efficient Perforance odeling of Large-Scale unable Analog/RF Integrated Circuits Fa Wang and Xin Li ECE Departent, Carnegie ellon University, Pittsburgh, PA 53 {fwang, ABSRAC unable circuit has eerged as a proising ethodology to address the grand challenge posed by process variations. Efficient high-diensional perforance odeling of tunable analog/rf circuits is an iportant yet challenging tas. In this paper, we propose a novel perforance odeling approach for tunable circuits, referred to as Correlated Bayesian odel Fusion (C- BF). he ey idea is to encode the correlation inforation for both odel teplate and coefficient agnitude aong different nob configurations by using a unified prior distribution. he prior distribution is then cobined with a few siulation saples via Bayesian inference to efficiently deterine the unnown odel coefficients. wo circuit exaples designed in a coercial 3n SOI COS process deonstrate that C-BF achieves ore than cost reduction over the traditional state-ofthe-art odeling technique without surrendering any accuracy.. INRODUCION he advent of nanoscale technology aes analog/rf integrated circuit (IC) increasingly susceptible to process variations. Process variations, including inter-die variations and local isatches, significantly ipact the paraetric yield of analog/rf circuit, and ust be properly handled at all levels of design hierarchy []-[]. raditional approaches based on overdesign [3]-[4] are not sufficient to aintain high paraetric yield [5]-[6], due to the large-scale process variations and aggressive design specifications at advanced technology nodes. In this context, tunable circuit has eerged as a proising ethodology to address the variability issue [6]-[]. It eploys a set of tuning nobs (e.g., bias current) to facilitate post-silicon tuning. In particular, a tunable circuit possesses ultiple states associated with tuning nobs that can be adaptively selected after anufacturing. For each particular process corner and/or environental condition, the tunable circuit is able to adaptively select the optial state and, hence, achieve high paraetric yield. Since tunable circuit closely interacts with process variations, the variability associated with tunable circuit ust be appropriately odeled. oward this goal, perforance odeling is an iportant tas circuit-level perforance (e.g. phase noise) is approxiated as an analytical function (e.g. polynoial) of device-level variations (e.g. ΔVH). he perforance odel, once built, can be applied to various iportant applications, such Perission to ae digital or hard copies of all or part of this wor for personal or classroo use is granted without fee provided that copies are not ade or distributed for profit or coercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for coponents of this wor owned by others than AC ust be honored. Abstracting with credit is peritted. o copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific perission and/or a fee. Request perissions fro Perissions@ac.org. DAC '6, June 5-9, 6, Austin, X, USA 6 AC. ISBN /6/6$5. DOI: as yield estiation []-[3], corner extraction [4], design optiization [5], etc. Historically, the perforance odeling proble of non-tunable circuit has been thoroughly studied [6]- [8]. For tunable circuit, however, this fundaental odeling proble can be extreely difficult with the following characteristics: High-diensional variation space: A large nuber of devicelevel rando variables ust be used to odel the process variations associated with a tunable analog/rf syste at advanced technology nodes. Large nuber of nob configurations: o axiize tuning range and resolution, a large nuber of nob configurations (i.e. states ) should be designed. his, however, significantly increases the coplexity of perforance odeling, since a unique perforance odel is required to accurately capture the variability at each state. Correlated nob configurations: Since different states are associated with the sae tunable circuit, the perforance odels of the different states are correlated. In particular, the odel teplate and odel coefficients are expected to be siilar aong these states. It is iportant to note that ost traditional approaches [6]- [] are not fully equipped for perforance odeling of tunable circuit. aing sparse regression [6]-[7] as an exaple, the sparsity of odel coefficients is explored to iprove efficiency. However, no correlation is considered between different states. In other words, perforance odeling is done for each state independently and the perforance odeling cost would quicly becoe intractable as the nuber of states increases. Several other perforance odeling ethods (e.g., siultaneous orthogonal atching pursuit [9], ulti-ode ulti-corner sparse regression [], group lasso [], etc.) have been proposed to exploit the aforeentioned correlation inforation. However, these ethods only tae into account the shared odel teplate aong different states and they ignore the correlation of coefficient agnitude. In Bayesian odel fusion (BF) [8], a prior distribution is defined to encode the prior nowledge. However, the prior distribution in [8] is not able to appropriately encode the correlation inforation for tunable circuit. In this paper, we propose a new Correlated Bayesian odel fusion (C-BF) technique to facilitate large-scale perforance odeling of tunable analog/rf circuit. he proposed C-BF ethod is otived by the fact that perforance odels associated with different states are correlated. Our ey idea is to encode the correlation inforation for both odel teplate and coefficient agnitude aong different states by using a unified prior distribution. he prior distribution is then cobined with a few siulation saples via Bayesian inference []-[3] to efficiently deterine the unnown odel coefficients. In addition, efficient and robust hyper-paraeter inference is proposed to solve a large nuber of hyper-paraeters associated with C-BF. It consists of two ajor steps: (i) estiating the hyper-paraeters to obtain an initial guess using a heuristic approach, and (ii) optiizing the

2 hyper-paraeter values using an expectation-axiization algorith []. As will be deonstrated by our nuerical exaples in Section 4, the proposed C-BF approach is able to achieve runtie speedup over the state-of-the-art odeling technique without surrendering any accuracy. he reainder of this paper is organized as follows. We briefly review the bacground of perforance odeling for tunable circuit in Section, and then describe the proposed C- BF approach in Section 3. wo circuit exaples are presented to deonstrate the efficacy of C-BF in Section 4. Finally, we conclude in Section 5.. BACKGROUND Given a tunable analog/rf circuit (e.g. a down-conversion ixer) with totally K states (i.e. nob configurations), the perforance odel of the -th state can be represented by an analytical function (e.g., polynoial) of device-level variations (e.g., ΔVH): y f( x) = α, b( x) ( =,,, K), () = {y; =,,, K} contains the perforance of interest (PoIs) associated with the K states, x is a vector representing the device-level variations, f(x) denotes the perforance odel of interest which establishes a apping fro x to y, {,; =,,..., } contains the odel coefficients of f(x), {b(x); =,,..., } contains the basis functions (e.g., linear or quadratic polynoials), and denotes the total nuber of basis functions. Without loss of generality, we assue that the sae set of basis functions {b(x); =,,..., } are shared aong all the states. In order to deterine the perforance odels in (), we need to find the odel coefficients {,; =,,, K; =,,..., }. oward this goal, the traditional least-squares fitting ethod first collects a nuber of sapling points of x and {y; =,,, K} for all K states, and then solves the odel coefficients fro the following optiization probles: in y B ( =,,, K), () () () () b( x ) b( x ) b ( x ) ( ) ( ) ( ) ( ) ( ) ( ) 3 b x b x b x B = ( =,,, K) (3) ( N) ( N) ( N) b( ) b( ) b x x ( x ) 4 = α, α, α, ( =,,, K) (4) () ( ) ( ) 5 y N = y y y ( =,,, K ). (5) In (3)-(5), x (n) is the value of x at the n-th sapling point of the - th state, y (n) is the value of y at the n-th sapling point, stands for the L-nor of a vector, and N represents the total nuber of sapling points collected for each state. o avoid overfitting, the nuber of sapling points ust be substantially greater than the nuber of unnown coefficients. o reduce the nuber of saples required for perforance odeling, the siultaneous orthogonal atching pursuit (S-OP) algorith [9] has been proposed in the literature. he ey idea of S-OP is to explore the sparse property and the correlation of odel teplate between different states. As an extension of the orthogonal atching pursuit (OP) algorith [6], S-OP naturally inherits the assuption of sparse regression. In other words, S-OP exploits the fact that only a sall nuber of basis functions in {b(x); =,,..., } are iportant and, hence, should be used to approxiate {y; =,,, K}. ore iportantly, S-OP also explores the correlation of odel teplate aong {y; =,,, K}. In particular, S-OP assues that different states possess the sae set of iportant basis functions. his is usually a valid assuption in practice, because different states are associated with the sae tunable circuit. While S-OP has been successfully applied to any practical applications (e.g. wafer spatial pattern analysis [9]), it is possible to explore other correlation inforation between states to further iprove the efficiency of perforance odeling for tunable circuits. otivated by this observation, we will propose a novel C-BF approach that taes advantage of the correlation of coefficient agnitude in Section PROPOSED APPROACH Siilar to S-OP, the proposed C-BF ethod relies on two assuptions: (i) the sparsity of odel teplate, and (ii) the correlation of odel teplate. However, unlie S-OP which ignores the correlation of coefficient agnitude aong different states, C-BF also encodes such agnitude correlation to iprove odeling accuracy. In what follows, we will discuss the atheatical forulation of C-BF in detail. 3. Prior Knowledge Definition o start with, we consider the perforance odels of K states in a tunable circuit as defined in (). We rewrite their odel coefficients in a concatenated for as: 6 =, (6) 7 = α, α, αk, ( =,, ), (7) {,; =,,..., K; =,,..., } are the odel coefficients defined in (), and is the cobined colun vector with size of K. In (6), the odel coefficients are organized such that the coefficients associated with the -th basis function are grouped together in ( =,,..., ). Since the odel coefficients in are related to the sae basis function, we assue that they are statistically correlated and define their prior distribution as: 8 pdf ( ) ~ N (, λ R) ( =,,, ). (8) In (8), {; =,,..., } are the hyper-paraeters that control the sparsity of the basis functions, and {R; =,,..., } are the positive definite atrices that quantify the correlation aong odel coefficients. Studying (8) yields several iportant observations. First, the sparse property is naturally encoded in {; =,,..., }. o understand this, we consider the -th basis function is zero. In this case, the variance of the zero-ean Gaussian distribution in (8) is also zero. As such, the coefficients can only tae zero values based on their prior distribution, thereby iplying the sparsity of. Second, the correlation of odel teplate is also encoded by the atheatical representation in (8). In particular, all the odel coefficients in share the sae sparse pattern, because their prior distribution is controlled by the sae hyper-paraeter. hird, but ost iportantly, the correlation of coefficient agnitude is also encoded by this prior definition, as long as the covariance etrics {R; =,,..., }

3 are not diagonal. In this paper, we further assue that: 9 R = R = R = R, (9) in order to reduce the nuber of hyper-paraeters and avoid overfitting. As shown in Figure, the prior nowledge of sparsity and correlation is encoded by the hyper-paraeters. o coplete the definition of prior distribution for all odel coefficients in, we further assue that i and j are statistically independent for any i j. herefore, the joint distribution can be represented as: pdf ( ) ~ N ( A, ), () λ R A =. () λ R he independence assuption in ()-() siply indicates that we do not now any correlation inforation between different basis functions as our prior nowledge. Such correlation will be learned fro sapling points, when the posterior distribution is calculated fro Bayesian inference in Section 3.. Correlation atrix: R Sparsity paraeters:,,,,,, K, K, K, Figure. he prior nowledge for odel coefficients is illustrated. Each row (shown by the red box) represents the odel coefficients of a particular state, while each colun (shown by the blue box) represents the odel coefficients associated with the sae basis function. he hyper-paraeters {; =,,..., } and R are defined to encode the sparsity and correlation respectively. 3. axiu-a-posteriori Estiation Once the prior distribution pdf() is defined in ()-(), we will cobine pdf() with a nuber of saples collected fro K states {(x (n), y (n) ); n =,,, N; =,,, K} to solve the odel coefficients by axiu-a-posteriori (AP) estiation. According to Bayes theore, the posterior distribution is proportional to the prior distribution pdf() ultiplied by the lielihood function, which can be represented as []: pdf ( y) pdf ( ) pdf ( y ). () In (), pdf(y ) is the lielihood function, () () ( ) ( ) ( N) ( N) 3 y = y yk y yk y y K (3) is a vector containing N K sapling points collected fro K states. he lielihood function pdf(y ) represents the probability of observing these saples given the odel coefficients. o derive the lielihood function, we assue that the error associated with the perforance odel f(x) follows a zero-ean Gaussian distribution. We therefore rewrite () as: 4 y = α, b( x) + ε ( =,,, K), (4) = represents the odeling error with the distribution: ε 5 pdf ( ε) = exp ~ N (, σ ). (5) π σ σ In (5) the standard deviation σ controls the agnitude of the odeling error. Cobining (4)-(5) yields the probability of observing a particular sapling point (x (n), y (n) ): ( ) ( ) ( ) 6 ( ) ( ) pdf y ~ exp n n n, y b α πσ σ x.(6) = Given that all sapling points are independently generated, the joint lielihood function pdf(y ) can be written as: 7 pdf ( y, σ) ~ N ( D, σi ), (7) D is a atrix with N K rows and K coluns. he atrix D can be obtained by peruting the rows and coluns of the following bloc diagonal atrix: B 8, (8) B K {B; =,,, K} are defined in (3). Cobining (), () and (7), the posterior distribution can be calculated as []: 9 pdf ( ) ~ N ( P, p ) ( σ ) p y, (9) = A AD I+ DAD DA () P = σ pdy. () Since the Gaussian distribution reaches its axiu at the ean value, the AP solution of the odel coefficients is: = P =σ pdy. () While the proposed Bayesian inference has been illustrated, the hyper-paraeters in the prior distribution () and the lielihood function (7) ust be appropriately deterined in order to solve the odel coefficients. In the next section, we will further discuss a statistical inference to find the optial hyperparaeter values. 3.3 Hyper-Paraeter Inference he hyper-paraeters of our proposed Bayesian inference are defined in Section 3. and Section 3.: = {,,,, R, σ}. o deterine these hyper-paraeters, one possible approach is to apply cross-validation [] which has been successfully used for various applications [6]-[8]. However, the cross-validation approach is not applicable to our Bayesian inference in this paper. It is well-nown that the coputational coplexity of crossvalidation exponentially grows with the nuber of hyperparaeters, and thus is only suitable to handle sall-size probles. In this paper, our Bayesian inference involves a large nuber of hyper-paraeters, since the nuber of basis functions (i.e., ) can easily reach several thousand due to the large nuber of device-level process paraeters at an advanced technology node. Hence, an alternative approach ust be developed to efficiently deterine these hyper-paraeters in. Statistically, the hyper-paraeters can be deterined by axiizing the conditional probability of observing the data set, i.e., the arginal lielihood:

4 3 ( Ω ) = ( Ω ) = (, Ω) ( Ω) l pdf y pdf y pdf d. (3) he integration in (3) indicates that the effect of odel coefficients is averaged out in the arginal lielihood. Given that the two ters in the integration depend on different sets of hyper-paraeters in, we can rewrite (3) as: 4 l ( Ω ) = pdf ( y, σ) pdf ( λ,..., λ, R) d. (4) By cobining () and (7) and taing the negative logarith for (4), we have: 5 L( ) ( ) Ω = y σ I+ DAD y + log σ I+ DAD. (5) he hyper-paraeters can be found by iniizing the cost function in (5). However, iniizing (5) is not trivial, because the cost function is not convex. In this paper, we adopt an expectation-axiization (E) algorith to address this challenge. In particular, instead of directly iniizing (5), the E algorith approaches a local optiu of (5) by iteratively perforing two operations []-[3], nown as the expectation step and the axiization step respectively. In the expectation step, we first calculate the posterior distribution pdf( y, (old) ) according to (9)-() based on (old), (old) denotes the hyper-paraeters calculated in the last iteration. Next, we define the following quantity []: 6 Q( Ω Ω ) = E, log p( y, Ω ), (6) y Ω the operator E represents the expectation of the log probability function with respect to the posterior distribution pdf( y, (old) ). Note that the expected value in (6) depends on the ean vector p and the covariance atrix p of the posterior distribution in (9). In the axiization step, we try to find such that: 7 Ω= arg ax Q Ω Ω. (7) Ω ( ) he optial solution of corresponds to: 8 Q( Ω Ω ) =. (8) Ω Cobining (6) and (8), we can find the optial solution of (7) as a function of (old), resulting in the following rule for updating [3]: r R ( + ( ) ) 9 λ p p p ( =,,, ) (9) K 3 = ( ) p + p p R ( =,,, ) (3) λ p ( p ) y D + r DD 3 σ ( =,,, ), (3) N p corresponds to the -th sub-vector in p with size of K, p corresponds to the -th diagonal bloc in p with size of K K. he expectation step (9)-() and the axiization step (9)-(3) are perfored iteratively until convergence is reached. Given that the E algorith only converges to a local optiu, the initial guess of ust be carefully chosen. Here we propose a odified S-OP algorith to achieve this goal. he ey idea of the proposed algorith is to (i) reduce the hyperparaeter space by posing additional constraints on R, (ii) apply a greedy algorith for basis function selection, and (iii) apply cross-validation to solve this siplified proble within the reduced hyper-paraeter space. Following this idea, we first consider the paraeterized covariance atrix R defined as: K r r r 3 R =, (3) r K r r r < is a non-negative hyper-paraeter. he atrix in (3) has several iplications. First, the correlation becoes sall when two states (i.e., their indexes) are substantially different. Second, the sae decaying rate r is used for all the states. his assuption often provides a good approxiation, even though it is not highly accurate. However, since our goal here is to find a good initial guess of, a reasonably accurate approxiation should suffice. As the covariance atrix R depends on a single paraeter r in (3), we can now apply cross-validation to estiate its value with low coputational cost. On the other hand, a greedy basis selection algorith based on S-OP [9] is used to infer the sparsity inforation that is encoded by the hyperparaeters {,,, }. In this way, we do not have to directly estiate {,,, }, which is coputationally expensive. At this point, the hyper-paraeter space has been reduced to three variables: r, σ and, denotes the nuber of selected basis functions. hese three hyper-paraeters can be efficiently deterined using cross-validation []. Naely, we start fro a candidate set {(r (q), σ (q), (q) ); q =,,, }, denotes the size of the set. At the q-th iteration step, we choose the hyper-paraeter values (r (q), σ (q), (q) ), estiate the odel coefficients, and evaluate the odeling error. o solve the odel coefficients with given (r (q), σ (q), (q) ), we adopt a odified S- OP algorith to iteratively identify the iportant basis functions. Siilar to S-OP [9], a single ost iportant basis function is greedily chosen at each iteration step by axiizing the correlation between the selected basis function and the odeling residual over all states. he odel coefficients are then calculated fro the Bayesian inference in (), ()-() and (3) based on r (q), σ (q) and the currently selected basis functions. Different fro the traditional S-OP ethod, we tae into account the correlation of coefficient agnitude when solving the unnown odel coefficients. he aforeentioned iteration continues until the nuber of chosen basis functions reaches (q). he odeling error can now be evaluated by cross-validation for the hyper-paraeters (r (q), σ (q), (q) ). Eventually, the optial values of (r, σ, ) are chosen to iniize the odeling error, and they are used to initialize the hyper-paraeters for the iterative E algorith. 3.4 Suary Algorith suarizes the ajor steps of the correlated Bayesian odel fusion (C-BF) algorith. It consists of two ain coponents: (i) a odified S-OP algorith fro Step to Step 7 to find the initial guess of the hyper-paraeters, and (ii) the E algorith fro Step 8 to Step to iteratively solve the optial values of the odel coefficients are updated at each iteration step. Algorith : Correlated Bayesian odel Fusion Algorith. Start fro a candidate set of hyper-paraeters {(r (q), σ (q), (q) ); q =,,, }. Partition the sapling points into C groups with the sae size for cross-validation.. Set the candidate index q =. 3. Set the cross-validation index c =. 4. Assign the c-th group as the testing set and all other groups as

5 the training set. 5. Initialize the residual Res = y, the basis vector set = {}, and the iteration index p =. 6. Calculate the inner product values {,; =,,, K; =,,, } between Res and all basis vectors b, for each state, b, represents the -th colun of B in (3). 7. Select the index s based on the following criterion: 33 s = arg ax ξ,. (33) K = 8. Update = s. 9. By considering the basis functions in and =, solve the odel coefficients {,; =,,, K; } using (), ()-() with r (q), σ (q) and R defined in (3).. Calculate the residual: 34 Res = y α, B, ( =,,, K ). (34) Θ. If p < (q), p = p + and go to Step 6.. Calculate the odeling error eq,c using the testing set. 3. If c < C, c = c + and go to Step Calculate eq = (eq, + eq, eq,c)/c. 5. If q <, q = q + and go to Step Find the optial r, σ, and aong the set {(r (q), σ (q), (q) ); q =,,, } such that the odeling error eq is iniized. 7. Initialize the atrix R using (3), =, and = Calculate p and p based on the expectation step in (9)-(). 9. Update {; =,,, }, R and σ based on the axiization step using (9)-(3).. If convergence is not reached, go to Step 8. Otherwise, stop iteration and calculate the odel coefficients by using (). 4. NUERICAL EXAPLES In this section, two circuit exaples designed in a coercial 3n SOI COS process are used to deonstrate the efficacy of the proposed C-BF algorith. Our objective is to build the perforance odels for tunable circuits. For testing and coparison purposes, two different odeling algoriths are ipleented: (i) S-OP [9], and (ii) C-BF. Here, S-OP is chosen for coparison, as it is one of the state-of-the-art techniques in the literature. In each exaple, a set of rando saples are generated by transistor-level onte Carlo siulations. he data set is partitioned into two groups, referred to as the training and testing sets respectively. he training set is used for coefficient fitting, while the testing set is used for odel validation. All nuerical experients are run on a.53ghz Linux server with 64GB eory. 4. Low Noise Aplifier Figure (a) shows the siplified circuit scheatic of a tunable.4ghz low noise aplifier (LNA) designed in a coercial 3n SOI COS process. In this exaple, there are totally 64 independent rando variables to odel the device-level process variations, including both the inter-die variations and the rando isatches. he LNA is designed with 3 different nob configurations (i.e., states) controlled by a tunable current source. Our goal is to odel three perforance etrics, noise figure (NF), voltage gain (VG) and third-order intercept point (IIP3), as linear functions of all rando variables for 3 states. he odeling error is estiated by using a testing set with 5 saples per state. Figure (b)-(d) show the perforance odeling error for NF, VG and IIP3 respectively. wo iportant observations can be ade here. First, for both S-OP and C-BF, the odeling error decreases when the nuber of saples increases. Second, with the sae nuber of saples, C-BF achieves significantly higher accuracy than S-OP, because C-BF taes into account the additional correlation inforation of coefficient agnitude. able further copares the perforance odeling error and cost for S-OP and C-BF. he overall odeling cost consists of two ajor coponents: (i) the circuit siulation cost for collecting training saples, and (ii) the odel fitting cost for solving all odel coefficients. As shown in able, the overall odeling cost is doinated by the siulation cost in this exaple. C-BF achieves ore than cost reduction over S-OP without surrendering any accuracy. IN VDD VDD to tunable current irror (a) (c) OU Figure. A tunable.4ghz LNA is used as an exaple for perforance odeling: (a) the siplified circuit scheatic, and (b)-(d) the perforance odeling error for NF, VG and IIP3 respectively. able. Perforance odeling error and cost for LNA S-OP C-BF Nuber of training saples 48 odeling error for NF.36%.85% odeling error for VG.577%.566% odeling error for IIP3.738%.497% Siulation cost (Hours).7.6 Fitting cost (Sec.) Overall odeling cost (Hours) Down-conversion ixer Shown in Figure 3(a) is the siplified circuit scheatic of a tunable.4ghz down-conversion ixer designed in a coercial 3n SOI COS process. In this exaple, there are totally 33 independent rando variables to odel the device-level process variations, including both the inter-die variations and the rando isatches. he ixer is designed with 3 different states controlled by two tunable load resistors. he perforances of interest include NF, VG, and input referred db copression point (IdBCP). he odeling error is estiated by using a test set with 5 saples per state. Figure 3(b)-(d) show the perforance odeling error for NF, VG and IdBCP respectively. Note that C-BF requires substantially less training saples than S-OP to achieve the (b) (d)

6 sae odeling accuracy. In this exaple, C-BF achieves ore than cost reduction over S-OP, as shown in able. LO+ IN+ (a) (c) VDD LO+ OU+/- LO- IN- odeling error (%) Figure 3. A tunable.4ghz down-conversion ixer is used as an exaple for perforance odeling: (a) the siplified circuit scheatic, (b)-(d) the odeling error for NF, VG and IdBCP respectively. able. Perforance odeling error and cost for ixer S-OP C-BF Nuber of saples 48 odeling error for NF.73%.66% odeling error for VG.758%.569% odeling error for IdBCP.4%.34% Siulation cost (Hours) Fitting cost (Sec.) Overall odeling cost (Hours) CONCLUSIONS In this paper, a novel C-BF algorith is proposed for efficient perforance odeling of tunable analog/rf circuits. C- BF encodes the correlation inforation for both odel teplate and coefficient agnitude aong different states by a prior distribution. Next, the prior distribution is cobined with very few siulation saples to accurately solve the odel coefficients. An efficient and robust hyper-paraeter inference is proposed to deterine the large nuber of hyper-paraeters associated with our proposed Bayesian inference. As is deonstrated by two circuit exaples designed in a coercial 3n SOI COS process, the proposed C-BF ethod achieves ore than cost reduction copared to the state-of-the-art odeling technique. Finally, it is worth entioning that C-BF assues a unified correlation odel across all states. If the states are utually different, such an assuption will no longer hold. In this case, a clustering algorith is needed to group siilar states into clusters before applying the proposed C-BF algorith. 6. ACKNOWLEDGEN his wor is sponsored in part by the DARPA HEALICS progra under Air Force Research Laboratory (AFRL) contract FA865-9-C-794 and the National Science Foundation under contract CCF he views expressed are those of the author and do not reflect the official policy or position of the (b) (d) Departent of Defense or the U.S. Governent. he authors would than B. Sadhu, J.-O. Plouchart and A. Valdes-Garcia for valuable discussions and D. Friedan for anageent support. 7. REFERENCES [] Seiconductor Industry Associate, International echnology Roadap for Seiconductors,. [] X. Li et al., Statistical Perforance odeling and Optiization, Now Publishers, 7. [3] X. Li et al., Robust analog/rf circuit design with projectionbased perforance odeling, IEEE rans. on CAD, vol. 6, no., pp. -5, Jan. 7. [4] G. Debyser et al., Efficient analog circuit synthesis with siultaneous yield and robustness optiization, IEEE ICCAD, pp. 38-3, 998. [5]. Ertur et al., Statistical variations in VCO phase noise due to upconverted OSFE /f noise, IEEE RFIC, pp , 8. [6] S. Sun et al., Indirect perforance sensing for on-chip selfhealing of analog and RF circuits, IEEE rans. on CAS-I, vol. 6, no. 8, pp. 43-5, Jul. 4. [7] C. axey et al., ixed-signal SoCs with in situ self-healing circuitry, IEEE D&., vol. 9, no. 6, pp. 7-39, Dec.. [8] S. Sen, Channel-adaptive zero-argin & process-adaptive selfhealing counication circuits/systes, IEEE ICCAD, pp. 8-85, 4. [9] D. Banerjee et al., Real-tie use-aware adaptive IO RF receiver systes for energy efficiency under BER constraints, IEEE DAC, pp. -7, 3. []. Andraud et al., One-shot calibration of RF circuits based on non-intrusive sensors, IEEE DAC, pp. -6, 4. [] J.-O. Plouchart et al., Adaptive circuit design ethodology and test applied to illieter-wave circuits, IEEE D&., vol. 3, no. 6, pp. 8-8, Jul. 4. [] X. Li et al., Asyptotic probability extraction for nonnoral perforance distributions, IEEE rans. on CAD, vol. 6, no., pp. 6-37, Jan. 7. [3] F. Gong et al., Variability-aware paraetric yield estiation for analog/ixed-signal circuits: concepts, algoriths, and challenges, IEEE Design & est of Cop., vol. 3, no. 4, pp. 6-5, Jan. 4. [4] H. Zhang et al., Efficient design-specific worst-case corner extraction for integrated circuits, IEEE DAC, pp , 9. [5] Y. Wang et al., Enabling efficient analog synthesis by coupling sparse regression and polynoial optiization, IEEE DAC, pp. -6, 4. [6] X. Li, Finding deterinistic solution fro underdeterined equation: large-scale perforance variability odeling of analog/rf circuits, IEEE rans. on CAD, vol. 9, no., pp , Nov.. [7]. cconaghy, High-diensional statistical odeling and analysis of custo integrated circuits, IEEE CICC, pp. -8,. [8] F. Wang et al., Bayesian odel fusion: large-scale perforance odeling of analog and ixed-signal circuits by reusing early-stage data, IEEE DAC, pp. -6, 3. [9] W. Zhang et al., Efficient spatial pattern analysis for variation decoposition via robust sparse regression, IEEE rans. on CAD, vol. 3, no. 7, pp. 7-85, Jul. 3. [] W. Zhang et al., oward efficient large-scale perforance odeling of integrated circuits via ulti-ode/ulti-corner sparse regression, IEEE DAC, pp ,. [] X. Liu et al., A statistical ethodology for noise sensor placeent and full-chip voltage ap generation, IEEE DAC, pp. -6, 5. [] C. Bishop, Pattern Recognition and achine Learning, Springer, 6. [3] Z. Zhang et al., Sparse signal recovery with teporally correlated source vectors using sparse Bayesian learning, IEEE JSSP, vol. 5, no. 5, pp. 9-96, Sep..

Statistical Logic Cell Delay Analysis Using a Current-based Model

Statistical Logic Cell Delay Analysis Using a Current-based Model Statistical Logic Cell Delay Analysis Using a Current-based Model Hanif Fatei Shahin Nazarian Massoud Pedra Dept. of EE-Systes, University of Southern California, Los Angeles, CA 90089 {fatei, shahin,

More information

Using EM To Estimate A Probablity Density With A Mixture Of Gaussians

Using EM To Estimate A Probablity Density With A Mixture Of Gaussians Using EM To Estiate A Probablity Density With A Mixture Of Gaussians Aaron A. D Souza adsouza@usc.edu Introduction The proble we are trying to address in this note is siple. Given a set of data points

More information

Qualitative Modelling of Time Series Using Self-Organizing Maps: Application to Animal Science

Qualitative Modelling of Time Series Using Self-Organizing Maps: Application to Animal Science Proceedings of the 6th WSEAS International Conference on Applied Coputer Science, Tenerife, Canary Islands, Spain, Deceber 16-18, 2006 183 Qualitative Modelling of Tie Series Using Self-Organizing Maps:

More information

Feature Extraction Techniques

Feature Extraction Techniques Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that

More information

Non-Parametric Non-Line-of-Sight Identification 1

Non-Parametric Non-Line-of-Sight Identification 1 Non-Paraetric Non-Line-of-Sight Identification Sinan Gezici, Hisashi Kobayashi and H. Vincent Poor Departent of Electrical Engineering School of Engineering and Applied Science Princeton University, Princeton,

More information

Identical Maximum Likelihood State Estimation Based on Incremental Finite Mixture Model in PHD Filter

Identical Maximum Likelihood State Estimation Based on Incremental Finite Mixture Model in PHD Filter Identical Maxiu Lielihood State Estiation Based on Increental Finite Mixture Model in PHD Filter Gang Wu Eail: xjtuwugang@gail.co Jing Liu Eail: elelj20080730@ail.xjtu.edu.cn Chongzhao Han Eail: czhan@ail.xjtu.edu.cn

More information

Support recovery in compressed sensing: An estimation theoretic approach

Support recovery in compressed sensing: An estimation theoretic approach Support recovery in copressed sensing: An estiation theoretic approach Ain Karbasi, Ali Horati, Soheil Mohajer, Martin Vetterli School of Coputer and Counication Sciences École Polytechnique Fédérale de

More information

Sharp Time Data Tradeoffs for Linear Inverse Problems

Sharp Time Data Tradeoffs for Linear Inverse Problems Sharp Tie Data Tradeoffs for Linear Inverse Probles Saet Oyak Benjain Recht Mahdi Soltanolkotabi January 016 Abstract In this paper we characterize sharp tie-data tradeoffs for optiization probles used

More information

Inspection; structural health monitoring; reliability; Bayesian analysis; updating; decision analysis; value of information

Inspection; structural health monitoring; reliability; Bayesian analysis; updating; decision analysis; value of information Cite as: Straub D. (2014). Value of inforation analysis with structural reliability ethods. Structural Safety, 49: 75-86. Value of Inforation Analysis with Structural Reliability Methods Daniel Straub

More information

Kernel Methods and Support Vector Machines

Kernel Methods and Support Vector Machines Intelligent Systes: Reasoning and Recognition Jaes L. Crowley ENSIAG 2 / osig 1 Second Seester 2012/2013 Lesson 20 2 ay 2013 Kernel ethods and Support Vector achines Contents Kernel Functions...2 Quadratic

More information

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization Recent Researches in Coputer Science Support Vector Machine Classification of Uncertain and Ibalanced data using Robust Optiization RAGHAV PAT, THEODORE B. TRAFALIS, KASH BARKER School of Industrial Engineering

More information

On Constant Power Water-filling

On Constant Power Water-filling On Constant Power Water-filling Wei Yu and John M. Cioffi Electrical Engineering Departent Stanford University, Stanford, CA94305, U.S.A. eails: {weiyu,cioffi}@stanford.edu Abstract This paper derives

More information

COS 424: Interacting with Data. Written Exercises

COS 424: Interacting with Data. Written Exercises COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well

More information

Experimental Design For Model Discrimination And Precise Parameter Estimation In WDS Analysis

Experimental Design For Model Discrimination And Precise Parameter Estimation In WDS Analysis City University of New York (CUNY) CUNY Acadeic Works International Conference on Hydroinforatics 8-1-2014 Experiental Design For Model Discriination And Precise Paraeter Estiation In WDS Analysis Giovanna

More information

Intelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines

Intelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines Intelligent Systes: Reasoning and Recognition Jaes L. Crowley osig 1 Winter Seester 2018 Lesson 6 27 February 2018 Outline Perceptrons and Support Vector achines Notation...2 Linear odels...3 Lines, Planes

More information

CS Lecture 13. More Maximum Likelihood

CS Lecture 13. More Maximum Likelihood CS 6347 Lecture 13 More Maxiu Likelihood Recap Last tie: Introduction to axiu likelihood estiation MLE for Bayesian networks Optial CPTs correspond to epirical counts Today: MLE for CRFs 2 Maxiu Likelihood

More information

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential

More information

Detection and Estimation Theory

Detection and Estimation Theory ESE 54 Detection and Estiation Theory Joseph A. O Sullivan Sauel C. Sachs Professor Electronic Systes and Signals Research Laboratory Electrical and Systes Engineering Washington University 11 Urbauer

More information

Fairness via priority scheduling

Fairness via priority scheduling Fairness via priority scheduling Veeraruna Kavitha, N Heachandra and Debayan Das IEOR, IIT Bobay, Mubai, 400076, India vavitha,nh,debayan}@iitbacin Abstract In the context of ulti-agent resource allocation

More information

Randomized Recovery for Boolean Compressed Sensing

Randomized Recovery for Boolean Compressed Sensing Randoized Recovery for Boolean Copressed Sensing Mitra Fatei and Martin Vetterli Laboratory of Audiovisual Counication École Polytechnique Fédéral de Lausanne (EPFL) Eail: {itra.fatei, artin.vetterli}@epfl.ch

More information

Boosting with log-loss

Boosting with log-loss Boosting with log-loss Marco Cusuano-Towner Septeber 2, 202 The proble Suppose we have data exaples {x i, y i ) i =... } for a two-class proble with y i {, }. Let F x) be the predictor function with the

More information

An Improved Particle Filter with Applications in Ballistic Target Tracking

An Improved Particle Filter with Applications in Ballistic Target Tracking Sensors & ransducers Vol. 72 Issue 6 June 204 pp. 96-20 Sensors & ransducers 204 by IFSA Publishing S. L. http://www.sensorsportal.co An Iproved Particle Filter with Applications in Ballistic arget racing

More information

e-companion ONLY AVAILABLE IN ELECTRONIC FORM

e-companion ONLY AVAILABLE IN ELECTRONIC FORM OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer

More information

A Simple Regression Problem

A Simple Regression Problem A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where

More information

Combining Classifiers

Combining Classifiers Cobining Classifiers Generic ethods of generating and cobining ultiple classifiers Bagging Boosting References: Duda, Hart & Stork, pg 475-480. Hastie, Tibsharini, Friedan, pg 246-256 and Chapter 10. http://www.boosting.org/

More information

Topic 5a Introduction to Curve Fitting & Linear Regression

Topic 5a Introduction to Curve Fitting & Linear Regression /7/08 Course Instructor Dr. Rayond C. Rup Oice: A 337 Phone: (95) 747 6958 E ail: rcrup@utep.edu opic 5a Introduction to Curve Fitting & Linear Regression EE 4386/530 Coputational ethods in EE Outline

More information

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation journal of coplexity 6, 459473 (2000) doi:0.006jco.2000.0544, available online at http:www.idealibrary.co on On the Counication Coplexity of Lipschitzian Optiization for the Coordinated Model of Coputation

More information

Block designs and statistics

Block designs and statistics Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent

More information

Recovering Data from Underdetermined Quadratic Measurements (CS 229a Project: Final Writeup)

Recovering Data from Underdetermined Quadratic Measurements (CS 229a Project: Final Writeup) Recovering Data fro Underdeterined Quadratic Measureents (CS 229a Project: Final Writeup) Mahdi Soltanolkotabi Deceber 16, 2011 1 Introduction Data that arises fro engineering applications often contains

More information

On the theoretical analysis of cross validation in compressive sensing

On the theoretical analysis of cross validation in compressive sensing MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.erl.co On the theoretical analysis of cross validation in copressive sensing Zhang, J.; Chen, L.; Boufounos, P.T.; Gu, Y. TR2014-025 May 2014 Abstract

More information

PAC-Bayes Analysis Of Maximum Entropy Learning

PAC-Bayes Analysis Of Maximum Entropy Learning PAC-Bayes Analysis Of Maxiu Entropy Learning John Shawe-Taylor and David R. Hardoon Centre for Coputational Statistics and Machine Learning Departent of Coputer Science University College London, UK, WC1E

More information

Lower Bounds for Quantized Matrix Completion

Lower Bounds for Quantized Matrix Completion Lower Bounds for Quantized Matrix Copletion Mary Wootters and Yaniv Plan Departent of Matheatics University of Michigan Ann Arbor, MI Eail: wootters, yplan}@uich.edu Mark A. Davenport School of Elec. &

More information

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay A Low-Coplexity Congestion Control and Scheduling Algorith for Multihop Wireless Networks with Order-Optial Per-Flow Delay Po-Kai Huang, Xiaojun Lin, and Chih-Chun Wang School of Electrical and Coputer

More information

Estimating Parameters for a Gaussian pdf

Estimating Parameters for a Gaussian pdf Pattern Recognition and achine Learning Jaes L. Crowley ENSIAG 3 IS First Seester 00/0 Lesson 5 7 Noveber 00 Contents Estiating Paraeters for a Gaussian pdf Notation... The Pattern Recognition Proble...3

More information

Probability Distributions

Probability Distributions Probability Distributions In Chapter, we ephasized the central role played by probability theory in the solution of pattern recognition probles. We turn now to an exploration of soe particular exaples

More information

Numerical Studies of a Nonlinear Heat Equation with Square Root Reaction Term

Numerical Studies of a Nonlinear Heat Equation with Square Root Reaction Term Nuerical Studies of a Nonlinear Heat Equation with Square Root Reaction Ter Ron Bucire, 1 Karl McMurtry, 1 Ronald E. Micens 2 1 Matheatics Departent, Occidental College, Los Angeles, California 90041 2

More information

A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine. (1900 words)

A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine. (1900 words) 1 A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine (1900 words) Contact: Jerry Farlow Dept of Matheatics Univeristy of Maine Orono, ME 04469 Tel (07) 866-3540 Eail: farlow@ath.uaine.edu

More information

Extension of CSRSM for the Parametric Study of the Face Stability of Pressurized Tunnels

Extension of CSRSM for the Parametric Study of the Face Stability of Pressurized Tunnels Extension of CSRSM for the Paraetric Study of the Face Stability of Pressurized Tunnels Guilhe Mollon 1, Daniel Dias 2, and Abdul-Haid Soubra 3, M.ASCE 1 LGCIE, INSA Lyon, Université de Lyon, Doaine scientifique

More information

arxiv: v1 [math.na] 10 Oct 2016

arxiv: v1 [math.na] 10 Oct 2016 GREEDY GAUSS-NEWTON ALGORITHM FOR FINDING SPARSE SOLUTIONS TO NONLINEAR UNDERDETERMINED SYSTEMS OF EQUATIONS MÅRTEN GULLIKSSON AND ANNA OLEYNIK arxiv:6.395v [ath.na] Oct 26 Abstract. We consider the proble

More information

Optimal Resource Allocation in Multicast Device-to-Device Communications Underlaying LTE Networks

Optimal Resource Allocation in Multicast Device-to-Device Communications Underlaying LTE Networks 1 Optial Resource Allocation in Multicast Device-to-Device Counications Underlaying LTE Networks Hadi Meshgi 1, Dongei Zhao 1 and Rong Zheng 2 1 Departent of Electrical and Coputer Engineering, McMaster

More information

Using a De-Convolution Window for Operating Modal Analysis

Using a De-Convolution Window for Operating Modal Analysis Using a De-Convolution Window for Operating Modal Analysis Brian Schwarz Vibrant Technology, Inc. Scotts Valley, CA Mark Richardson Vibrant Technology, Inc. Scotts Valley, CA Abstract Operating Modal Analysis

More information

UNIVERSITY OF TRENTO ON THE USE OF SVM FOR ELECTROMAGNETIC SUBSURFACE SENSING. A. Boni, M. Conci, A. Massa, and S. Piffer.

UNIVERSITY OF TRENTO ON THE USE OF SVM FOR ELECTROMAGNETIC SUBSURFACE SENSING. A. Boni, M. Conci, A. Massa, and S. Piffer. UIVRSITY OF TRTO DIPARTITO DI IGGRIA SCIZA DLL IFORAZIO 3823 Povo Trento (Italy) Via Soarive 4 http://www.disi.unitn.it O TH US OF SV FOR LCTROAGTIC SUBSURFAC SSIG A. Boni. Conci A. assa and S. Piffer

More information

Symbolic Analysis as Universal Tool for Deriving Properties of Non-linear Algorithms Case study of EM Algorithm

Symbolic Analysis as Universal Tool for Deriving Properties of Non-linear Algorithms Case study of EM Algorithm Acta Polytechnica Hungarica Vol., No., 04 Sybolic Analysis as Universal Tool for Deriving Properties of Non-linear Algoriths Case study of EM Algorith Vladiir Mladenović, Miroslav Lutovac, Dana Porrat

More information

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES Vol. 57, No. 3, 2009 Algoriths for parallel processor scheduling with distinct due windows and unit-tie obs A. JANIAK 1, W.A. JANIAK 2, and

More information

Sparse beamforming in peer-to-peer relay networks Yunshan Hou a, Zhijuan Qi b, Jianhua Chenc

Sparse beamforming in peer-to-peer relay networks Yunshan Hou a, Zhijuan Qi b, Jianhua Chenc 3rd International Conference on Machinery, Materials and Inforation echnology Applications (ICMMIA 015) Sparse beaforing in peer-to-peer relay networs Yunshan ou a, Zhijuan Qi b, Jianhua Chenc College

More information

Effective joint probabilistic data association using maximum a posteriori estimates of target states

Effective joint probabilistic data association using maximum a posteriori estimates of target states Effective joint probabilistic data association using axiu a posteriori estiates of target states 1 Viji Paul Panakkal, 2 Rajbabu Velurugan 1 Central Research Laboratory, Bharat Electronics Ltd., Bangalore,

More information

paper prepared for the 1996 PTRC Conference, September 2-6, Brunel University, UK ON THE CALIBRATION OF THE GRAVITY MODEL

paper prepared for the 1996 PTRC Conference, September 2-6, Brunel University, UK ON THE CALIBRATION OF THE GRAVITY MODEL paper prepared for the 1996 PTRC Conference, Septeber 2-6, Brunel University, UK ON THE CALIBRATION OF THE GRAVITY MODEL Nanne J. van der Zijpp 1 Transportation and Traffic Engineering Section Delft University

More information

Stochastic Subgradient Methods

Stochastic Subgradient Methods Stochastic Subgradient Methods Lingjie Weng Yutian Chen Bren School of Inforation and Coputer Science University of California, Irvine {wengl, yutianc}@ics.uci.edu Abstract Stochastic subgradient ethods

More information

MSEC MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL SOLUTION FOR MAINTENANCE AND PERFORMANCE

MSEC MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL SOLUTION FOR MAINTENANCE AND PERFORMANCE Proceeding of the ASME 9 International Manufacturing Science and Engineering Conference MSEC9 October 4-7, 9, West Lafayette, Indiana, USA MSEC9-8466 MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL

More information

An Adaptive UKF Algorithm for the State and Parameter Estimations of a Mobile Robot

An Adaptive UKF Algorithm for the State and Parameter Estimations of a Mobile Robot Vol. 34, No. 1 ACTA AUTOMATICA SINICA January, 2008 An Adaptive UKF Algorith for the State and Paraeter Estiations of a Mobile Robot SONG Qi 1, 2 HAN Jian-Da 1 Abstract For iproving the estiation accuracy

More information

Bayesian Approach for Fatigue Life Prediction from Field Inspection

Bayesian Approach for Fatigue Life Prediction from Field Inspection Bayesian Approach for Fatigue Life Prediction fro Field Inspection Dawn An and Jooho Choi School of Aerospace & Mechanical Engineering, Korea Aerospace University, Goyang, Seoul, Korea Srira Pattabhiraan

More information

A Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair

A Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair Proceedings of the 6th SEAS International Conference on Siulation, Modelling and Optiization, Lisbon, Portugal, Septeber -4, 006 0 A Siplified Analytical Approach for Efficiency Evaluation of the eaving

More information

An improved self-adaptive harmony search algorithm for joint replenishment problems

An improved self-adaptive harmony search algorithm for joint replenishment problems An iproved self-adaptive harony search algorith for joint replenishent probles Lin Wang School of Manageent, Huazhong University of Science & Technology zhoulearner@gail.co Xiaojian Zhou School of Manageent,

More information

Supplementary Material for Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction via Low-Rank Hankel Matrix Completion

Supplementary Material for Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction via Low-Rank Hankel Matrix Completion Suppleentary Material for Fast and Provable Algoriths for Spectrally Sparse Signal Reconstruction via Low-Ran Hanel Matrix Copletion Jian-Feng Cai Tianing Wang Ke Wei March 1, 017 Abstract We establish

More information

Interactive Markov Models of Evolutionary Algorithms

Interactive Markov Models of Evolutionary Algorithms Cleveland State University EngagedScholarship@CSU Electrical Engineering & Coputer Science Faculty Publications Electrical Engineering & Coputer Science Departent 2015 Interactive Markov Models of Evolutionary

More information

Hybrid System Identification: An SDP Approach

Hybrid System Identification: An SDP Approach 49th IEEE Conference on Decision and Control Deceber 15-17, 2010 Hilton Atlanta Hotel, Atlanta, GA, USA Hybrid Syste Identification: An SDP Approach C Feng, C M Lagoa, N Ozay and M Sznaier Abstract The

More information

Randomized Accuracy-Aware Program Transformations For Efficient Approximate Computations

Randomized Accuracy-Aware Program Transformations For Efficient Approximate Computations Randoized Accuracy-Aware Progra Transforations For Efficient Approxiate Coputations Zeyuan Allen Zhu Sasa Misailovic Jonathan A. Kelner Martin Rinard MIT CSAIL zeyuan@csail.it.edu isailo@it.edu kelner@it.edu

More information

Optimal Jamming Over Additive Noise: Vector Source-Channel Case

Optimal Jamming Over Additive Noise: Vector Source-Channel Case Fifty-first Annual Allerton Conference Allerton House, UIUC, Illinois, USA October 2-3, 2013 Optial Jaing Over Additive Noise: Vector Source-Channel Case Erah Akyol and Kenneth Rose Abstract This paper

More information

OPTIMIZATION in multi-agent networks has attracted

OPTIMIZATION in multi-agent networks has attracted Distributed constrained optiization and consensus in uncertain networks via proxial iniization Kostas Margellos, Alessandro Falsone, Sione Garatti and Maria Prandini arxiv:603.039v3 [ath.oc] 3 May 07 Abstract

More information

On Hyper-Parameter Estimation in Empirical Bayes: A Revisit of the MacKay Algorithm

On Hyper-Parameter Estimation in Empirical Bayes: A Revisit of the MacKay Algorithm On Hyper-Paraeter Estiation in Epirical Bayes: A Revisit of the MacKay Algorith Chune Li 1, Yongyi Mao, Richong Zhang 1 and Jinpeng Huai 1 1 School of Coputer Science and Engineering, Beihang University,

More information

Uniform Approximation and Bernstein Polynomials with Coefficients in the Unit Interval

Uniform Approximation and Bernstein Polynomials with Coefficients in the Unit Interval Unifor Approxiation and Bernstein Polynoials with Coefficients in the Unit Interval Weiang Qian and Marc D. Riedel Electrical and Coputer Engineering, University of Minnesota 200 Union St. S.E. Minneapolis,

More information

Bayes Decision Rule and Naïve Bayes Classifier

Bayes Decision Rule and Naïve Bayes Classifier Bayes Decision Rule and Naïve Bayes Classifier Le Song Machine Learning I CSE 6740, Fall 2013 Gaussian Mixture odel A density odel p(x) ay be ulti-odal: odel it as a ixture of uni-odal distributions (e.g.

More information

SPECTRUM sensing is a core concept of cognitive radio

SPECTRUM sensing is a core concept of cognitive radio World Acadey of Science, Engineering and Technology International Journal of Electronics and Counication Engineering Vol:6, o:2, 202 Efficient Detection Using Sequential Probability Ratio Test in Mobile

More information

ASSUME a source over an alphabet size m, from which a sequence of n independent samples are drawn. The classical

ASSUME a source over an alphabet size m, from which a sequence of n independent samples are drawn. The classical IEEE TRANSACTIONS ON INFORMATION THEORY Large Alphabet Source Coding using Independent Coponent Analysis Aichai Painsky, Meber, IEEE, Saharon Rosset and Meir Feder, Fellow, IEEE arxiv:67.7v [cs.it] Jul

More information

Pattern Recognition and Machine Learning. Artificial Neural networks

Pattern Recognition and Machine Learning. Artificial Neural networks Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2016 Lessons 7 14 Dec 2016 Outline Artificial Neural networks Notation...2 1. Introduction...3... 3 The Artificial

More information

RANDOM GRADIENT EXTRAPOLATION FOR DISTRIBUTED AND STOCHASTIC OPTIMIZATION

RANDOM GRADIENT EXTRAPOLATION FOR DISTRIBUTED AND STOCHASTIC OPTIMIZATION RANDOM GRADIENT EXTRAPOLATION FOR DISTRIBUTED AND STOCHASTIC OPTIMIZATION GUANGHUI LAN AND YI ZHOU Abstract. In this paper, we consider a class of finite-su convex optiization probles defined over a distributed

More information

Ch 12: Variations on Backpropagation

Ch 12: Variations on Backpropagation Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith

More information

Multivariate Methods. Matlab Example. Principal Components Analysis -- PCA

Multivariate Methods. Matlab Example. Principal Components Analysis -- PCA Multivariate Methos Xiaoun Qi Principal Coponents Analysis -- PCA he PCA etho generates a new set of variables, calle principal coponents Each principal coponent is a linear cobination of the original

More information

A note on the multiplication of sparse matrices

A note on the multiplication of sparse matrices Cent. Eur. J. Cop. Sci. 41) 2014 1-11 DOI: 10.2478/s13537-014-0201-x Central European Journal of Coputer Science A note on the ultiplication of sparse atrices Research Article Keivan Borna 12, Sohrab Aboozarkhani

More information

ANALYTICAL INVESTIGATION AND PARAMETRIC STUDY OF LATERAL IMPACT BEHAVIOR OF PRESSURIZED PIPELINES AND INFLUENCE OF INTERNAL PRESSURE

ANALYTICAL INVESTIGATION AND PARAMETRIC STUDY OF LATERAL IMPACT BEHAVIOR OF PRESSURIZED PIPELINES AND INFLUENCE OF INTERNAL PRESSURE DRAFT Proceedings of the ASME 014 International Mechanical Engineering Congress & Exposition IMECE014 Noveber 14-0, 014, Montreal, Quebec, Canada IMECE014-36371 ANALYTICAL INVESTIGATION AND PARAMETRIC

More information

Support Vector Machines. Machine Learning Series Jerry Jeychandra Blohm Lab

Support Vector Machines. Machine Learning Series Jerry Jeychandra Blohm Lab Support Vector Machines Machine Learning Series Jerry Jeychandra Bloh Lab Outline Main goal: To understand how support vector achines (SVMs) perfor optial classification for labelled data sets, also a

More information

ESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS. A Thesis. Presented to. The Faculty of the Department of Mathematics

ESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS. A Thesis. Presented to. The Faculty of the Department of Mathematics ESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS A Thesis Presented to The Faculty of the Departent of Matheatics San Jose State University In Partial Fulfillent of the Requireents

More information

REDUCTION OF FINITE ELEMENT MODELS BY PARAMETER IDENTIFICATION

REDUCTION OF FINITE ELEMENT MODELS BY PARAMETER IDENTIFICATION ISSN 139 14X INFORMATION TECHNOLOGY AND CONTROL, 008, Vol.37, No.3 REDUCTION OF FINITE ELEMENT MODELS BY PARAMETER IDENTIFICATION Riantas Barauskas, Vidantas Riavičius Departent of Syste Analysis, Kaunas

More information

EMPIRICAL COMPLEXITY ANALYSIS OF A MILP-APPROACH FOR OPTIMIZATION OF HYBRID SYSTEMS

EMPIRICAL COMPLEXITY ANALYSIS OF A MILP-APPROACH FOR OPTIMIZATION OF HYBRID SYSTEMS EMPIRICAL COMPLEXITY ANALYSIS OF A MILP-APPROACH FOR OPTIMIZATION OF HYBRID SYSTEMS Jochen Till, Sebastian Engell, Sebastian Panek, and Olaf Stursberg Process Control Lab (CT-AST), University of Dortund,

More information

An Inverse Interpolation Method Utilizing In-Flight Strain Measurements for Determining Loads and Structural Response of Aerospace Vehicles

An Inverse Interpolation Method Utilizing In-Flight Strain Measurements for Determining Loads and Structural Response of Aerospace Vehicles An Inverse Interpolation Method Utilizing In-Flight Strain Measureents for Deterining Loads and Structural Response of Aerospace Vehicles S. Shkarayev and R. Krashantisa University of Arizona, Tucson,

More information

Design of Spatially Coupled LDPC Codes over GF(q) for Windowed Decoding

Design of Spatially Coupled LDPC Codes over GF(q) for Windowed Decoding IEEE TRANSACTIONS ON INFORMATION THEORY (SUBMITTED PAPER) 1 Design of Spatially Coupled LDPC Codes over GF(q) for Windowed Decoding Lai Wei, Student Meber, IEEE, David G. M. Mitchell, Meber, IEEE, Thoas

More information

Machine Learning Basics: Estimators, Bias and Variance

Machine Learning Basics: Estimators, Bias and Variance Machine Learning Basics: Estiators, Bias and Variance Sargur N. srihari@cedar.buffalo.edu This is part of lecture slides on Deep Learning: http://www.cedar.buffalo.edu/~srihari/cse676 1 Topics in Basics

More information

On the Use of A Priori Information for Sparse Signal Approximations

On the Use of A Priori Information for Sparse Signal Approximations ITS TECHNICAL REPORT NO. 3/4 On the Use of A Priori Inforation for Sparse Signal Approxiations Oscar Divorra Escoda, Lorenzo Granai and Pierre Vandergheynst Signal Processing Institute ITS) Ecole Polytechnique

More information

Asynchronous Gossip Algorithms for Stochastic Optimization

Asynchronous Gossip Algorithms for Stochastic Optimization Asynchronous Gossip Algoriths for Stochastic Optiization S. Sundhar Ra ECE Dept. University of Illinois Urbana, IL 680 ssrini@illinois.edu A. Nedić IESE Dept. University of Illinois Urbana, IL 680 angelia@illinois.edu

More information

Department of Electronic and Optical Engineering, Ordnance Engineering College, Shijiazhuang, , China

Department of Electronic and Optical Engineering, Ordnance Engineering College, Shijiazhuang, , China 6th International Conference on Machinery, Materials, Environent, Biotechnology and Coputer (MMEBC 06) Solving Multi-Sensor Multi-Target Assignent Proble Based on Copositive Cobat Efficiency and QPSO Algorith

More information

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t.

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t. CS 493: Algoriths for Massive Data Sets Feb 2, 2002 Local Models, Bloo Filter Scribe: Qin Lv Local Models In global odels, every inverted file entry is copressed with the sae odel. This work wells when

More information

Multi-Scale/Multi-Resolution: Wavelet Transform

Multi-Scale/Multi-Resolution: Wavelet Transform Multi-Scale/Multi-Resolution: Wavelet Transfor Proble with Fourier Fourier analysis -- breaks down a signal into constituent sinusoids of different frequencies. A serious drawback in transforing to the

More information

1 Bounding the Margin

1 Bounding the Margin COS 511: Theoretical Machine Learning Lecturer: Rob Schapire Lecture #12 Scribe: Jian Min Si March 14, 2013 1 Bounding the Margin We are continuing the proof of a bound on the generalization error of AdaBoost

More information

STOPPING SIMULATED PATHS EARLY

STOPPING SIMULATED PATHS EARLY Proceedings of the 2 Winter Siulation Conference B.A.Peters,J.S.Sith,D.J.Medeiros,andM.W.Rohrer,eds. STOPPING SIMULATED PATHS EARLY Paul Glasseran Graduate School of Business Colubia University New Yor,

More information

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis E0 370 tatistical Learning Theory Lecture 6 (Aug 30, 20) Margin Analysis Lecturer: hivani Agarwal cribe: Narasihan R Introduction In the last few lectures we have seen how to obtain high confidence bounds

More information

Envelope frequency Response Function Analysis of Mechanical Structures with Uncertain Modal Damping Characteristics

Envelope frequency Response Function Analysis of Mechanical Structures with Uncertain Modal Damping Characteristics Copyright c 2007 Tech Science Press CMES, vol.22, no.2, pp.129-149, 2007 Envelope frequency Response Function Analysis of Mechanical Structures with Uncertain Modal Daping Characteristics D. Moens 1, M.

More information

arxiv: v1 [cs.ds] 17 Mar 2016

arxiv: v1 [cs.ds] 17 Mar 2016 Tight Bounds for Single-Pass Streaing Coplexity of the Set Cover Proble Sepehr Assadi Sanjeev Khanna Yang Li Abstract arxiv:1603.05715v1 [cs.ds] 17 Mar 2016 We resolve the space coplexity of single-pass

More information

4920 IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 63, NO. 12, DECEMBER 2015

4920 IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 63, NO. 12, DECEMBER 2015 4920 IEEE TRASACTIOS O COMMUICATIOS, VOL. 63, O. 12, DECEMBER 2015 Energy Efficient Coordinated Beaforing for Multicell Syste: Duality-Based Algorith Design and Massive MIMO Transition Shiwen He, Meber,

More information

A remark on a success rate model for DPA and CPA

A remark on a success rate model for DPA and CPA A reark on a success rate odel for DPA and CPA A. Wieers, BSI Version 0.5 andreas.wieers@bsi.bund.de Septeber 5, 2018 Abstract The success rate is the ost coon evaluation etric for easuring the perforance

More information

Convolutional Codes. Lecture Notes 8: Trellis Codes. Example: K=3,M=2, rate 1/2 code. Figure 95: Convolutional Encoder

Convolutional Codes. Lecture Notes 8: Trellis Codes. Example: K=3,M=2, rate 1/2 code. Figure 95: Convolutional Encoder Convolutional Codes Lecture Notes 8: Trellis Codes In this lecture we discuss construction of signals via a trellis. That is, signals are constructed by labeling the branches of an infinite trellis with

More information

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices CS71 Randoness & Coputation Spring 018 Instructor: Alistair Sinclair Lecture 13: February 7 Disclaier: These notes have not been subjected to the usual scrutiny accorded to foral publications. They ay

More information

Quantile Search: A Distance-Penalized Active Learning Algorithm for Spatial Sampling

Quantile Search: A Distance-Penalized Active Learning Algorithm for Spatial Sampling Quantile Search: A Distance-Penalized Active Learning Algorith for Spatial Sapling John Lipor 1, Laura Balzano 1, Branko Kerkez 2, and Don Scavia 3 1 Departent of Electrical and Coputer Engineering, 2

More information

Finding Rightmost Eigenvalues of Large Sparse. Non-symmetric Parameterized Eigenvalue Problems. Abstract. Introduction

Finding Rightmost Eigenvalues of Large Sparse. Non-symmetric Parameterized Eigenvalue Problems. Abstract. Introduction Finding Rightost Eigenvalues of Large Sparse Non-syetric Paraeterized Eigenvalue Probles Applied Matheatics and Scientific Coputation Progra Departent of Matheatics University of Maryland, College Par,

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE227C (Spring 2018): Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee227c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee227c@berkeley.edu October

More information

Support Vector Machines. Goals for the lecture

Support Vector Machines. Goals for the lecture Support Vector Machines Mark Craven and David Page Coputer Sciences 760 Spring 2018 www.biostat.wisc.edu/~craven/cs760/ Soe of the slides in these lectures have been adapted/borrowed fro aterials developed

More information

Distributed Subgradient Methods for Multi-agent Optimization

Distributed Subgradient Methods for Multi-agent Optimization 1 Distributed Subgradient Methods for Multi-agent Optiization Angelia Nedić and Asuan Ozdaglar October 29, 2007 Abstract We study a distributed coputation odel for optiizing a su of convex objective functions

More information

Reducing Vibration and Providing Robustness with Multi-Input Shapers

Reducing Vibration and Providing Robustness with Multi-Input Shapers 29 Aerican Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June -2, 29 WeA6.4 Reducing Vibration and Providing Robustness with Multi-Input Shapers Joshua Vaughan and Willia Singhose Abstract

More information

Figure 1: Equivalent electric (RC) circuit of a neurons membrane

Figure 1: Equivalent electric (RC) circuit of a neurons membrane Exercise: Leaky integrate and fire odel of neural spike generation This exercise investigates a siplified odel of how neurons spike in response to current inputs, one of the ost fundaental properties of

More information

DISSIMILARITY MEASURES FOR ICA-BASED SOURCE NUMBER ESTIMATION. Seungchul Lee 2 2. University of Michigan. Ann Arbor, MI, USA.

DISSIMILARITY MEASURES FOR ICA-BASED SOURCE NUMBER ESTIMATION. Seungchul Lee 2 2. University of Michigan. Ann Arbor, MI, USA. Proceedings of the ASME International Manufacturing Science and Engineering Conference MSEC June -8,, Notre Dae, Indiana, USA MSEC-7 DISSIMILARIY MEASURES FOR ICA-BASED SOURCE NUMBER ESIMAION Wei Cheng,

More information

Supplementary to Learning Discriminative Bayesian Networks from High-dimensional Continuous Neuroimaging Data

Supplementary to Learning Discriminative Bayesian Networks from High-dimensional Continuous Neuroimaging Data Suppleentary to Learning Discriinative Bayesian Networks fro High-diensional Continuous Neuroiaging Data Luping Zhou, Lei Wang, Lingqiao Liu, Philip Ogunbona, and Dinggang Shen Proposition. Given a sparse

More information