Upsetting the contingency table: Causal induction over sequences of point events

Size: px
Start display at page:

Download "Upsetting the contingency table: Causal induction over sequences of point events"

Transcription

1 Upsetting the contingency table: Causal inuction over sequences of point events Michael D. Pacer Thomas L. Griffiths (tom Department of Psychology, 321 Tolman Hall Berkeley, CA 9472 USA Abstract Data continuously stream into our mins, guiing our learning an inference with no trial elimiters to parse our experience. These ata can take on a variety of forms, but research on causal learning has emphasize iscrete contingency ata over continuous sequences of events. We present a formal framework for moeling causal inferences about sequences of point events, base on Bayesian inference over nonhomogeneous Poisson processes (NHPPs). We show how to apply this framework to successfully moel ata from an experiment by Lagnao an Speekenbrink (21) which examine human learning from sequences of point events. Keywors: causal inference; continuous time; stochastic processes; Bayesian moels Introuction Only a single bullet is neee to en a life. One momentary event quickly ruptures a slew of causal mechanisms, having effects that persist long after the trigger was pulle. We unerstan this causal inference easily enough, but how o we manage to arrive at that inference? More precisely, what formal tools can characterize events that last an instant but leave profoun consequences in their wake? Learning from instantaneous events is one of the most important forms of causal inuction in the real worl, but is not the case consiere in most moels of human causal reasoning. More commonly, these moels rely on the existence of aggregate statistics often in the form of a contingency table escribing the frequencies with which ifferent combinations of events occur (Griffiths & Tenenbaum, 29). The most traitional case is the 2 2 contingency table that escribes two variables that are either present or not. It is out of this statistical paraigm that many of the moels of human causal inference an learning have arisen (Gopnik et al., 24). The worl offers more than contingency tables an frequency counts. Different kins of ata warrant ifferent kins of inferences. For example, when Greville an Buehner (21) coerce events embee in continuous-time into contingency tables, they are challenge with ientifying an (assume) unerlying trial structure. To fill a 2 2 table of event pairs, one nees to slice the continuum into trials; a variable is counte if an event occurre in the slice an not if it i not. But ifferent slicing regimens can warrant ifferent inferences about the same ata. This arises because of a funamental asymmetry between the times at which events occur an when then o not occur. In a contingency table both X an X are treate as the same kin of entity, but instantaneous events can be counte while the the continuous expanse of nothingness in which events are embee by efinition cannot be counte, only measure. But there is another way to moel sequences of point events occurring in continuous-time. Here, we buil a moel of causal inuction on the framework escribe in Pacer an Griffiths (212), which uses a moel of events embee in continuous-time. It computes probabilities not in terms of the frequency with which events co-occur, but irectly from the temporal istances between cause an effect events. Importantly, we accomplish this without neeing to uniquely match iniviual cause events with iniviual effect events. We rely on probabilistic graphical moels to escribe the structure of causal relations. We use Poisson processes an operations over these processes to escribe the functional relationships between variables, which provie the structure by which we ientify an organize kins of events. Our focus in this paper is on causal inuction from sequential point processes sequences of events that are transient moments in continuous time. This is an important case for moeling causal inuction, escribing a wie range of real-worl settings in which people perform causal inuction such as trying to infer which particular interaction with which particular other person le to coming own with the flu. Bramley, Gerstenberg, an Lagnao (214) raise a concern that these cases present a challenge for the continuoustime causal network approach presente by Pacer an Griffiths (212). The paper will procee as follows. We review Poisson processes, which form the founation for the rest of the paper. We introuce a physical analogue of these formal structures to provie intuition to the unerlying mathematics of nonhomogeneous Poisson processes. These processes form the basis of our framework when combine with probabilistic graphical causal moels. We then successfully apply the framework to Experiment 2 from Lagnao an Speekenbrink (21) a paraigm for human jugments of causal structure from sequences of point events. We then iscuss the implications of this work for statistical an mechanistic theories of human causal reasoning. Formal Founations In this section we escribe formal founations for our framework (cf., Pacer & Griffiths, 212). We explain a class of point-process moels (processes that escribe the occurrence of point-events which have a location, but no measurable uration) calle Poisson processes that are efine in terms of a space an a positive rate function that gives the expecte number of events to be foun in any subspace. This ratefunction will epen upon the ientity an time of events that occur uring the course of the processes activity (cf.,

2 Simma & Joran, 21; Blunell, Beck, & Heller, 212). To accommoate this kin of conitional intensity function we use nonhomogeneous Poisson processes (NHPPs), whose rate functions are not constant. We will first escribe two ways of looking at homogeneous Poisson processes: arrivals an rates. After eveloping an intuition for Poisson processes with constant rate functions, we will then consier the general case of NHPPs an how to moel sequences of point events in terms of a generative moel that iteratively analyzes iniviual arrivals relative to the rates inuce by previous arrivals. Poisson Processes: Arrivals an Rates Poisson processes can be interprete in a number of ways that len themselves more or less easily to ifferent applications. We will escribe Poisson processes in two senses: the arrival process sense an the rate-of-events sense. 1 Sequences of point events can be escribe sequences of successive arrivals, making the arrival perspective convenient for computing point event likelihoos. But it is easiest to conceive of the causal effects of point events in terms of their altering event rates. Both perspectives prove useful. Arrivals The arrival sense can be unerstoo by anyone who has ever waite in a queue. You will have to wait some amount of time before your turn, an we can assign a probability that you will be serve by time t. If you were next in the queue an it were governe by a homogeneous Poisson Process with rate λ, the waiting time istribution of being serve by time t woul be an exponential istribution with mean 1 λ (t Exp( 1 λ ) p(t) = λe λt ). Interestingly, this istribution is memoryless, such that, regarless of how long we have waite, we still expect to wait the exact same amount of time it has no memory of how long it has been since the last event. This memorylessness property oes not hol for the general class of NHPPs. Rates Equivalently, we can count the number of events that occur in a measurable time-perio, rather than looking at the elays between each event. Poisson processes efine a rate of events, which escribes the expecte count of events to occur in any interval. A homogeneous Poisson process has a constant rate, λ, an for a time interval with length τ we can expect to see event-count istribution governe by a Poisson ranom variable, with mean (λ τ ). In the case of nonhomogeneous Poisson processes, we will have a rate-function efine over time λ(t). Integrating this function over some time-interval efines how many events are expecte to occur (i.e., for τ [a,b) the expecte event count is τ[a,b) λ(s)s). 1 Poisson processes can be efine over higher imensional spaces (e.g., R 3 ) than the real line. This complicates the arrival perspective, which implicitly relies on the orer that events arrive. The event-rate perspective is unchange in higher imensions; in that sense it coul be sai to be more funamental than the arrival perspective. In this paper, for simplicity we focus on processes efine over time ([, )). Combining Perspectives The arrival perspective gives us a probability istribution over intervals of time (i.e., intervals efine from now until the next event arrives), while the rateof-events perspective gives us an instantaneous measure of event likelihoo which is comprehensible only in terms its integration over intervals of time. The former is more useful in cases where events are analyze one at a time. For example, when simulating epenent event sequences or calculating the probabilities of event sequences in terms of the likelihoo of each event s occurrence given the previous relevant occurrences. In our moel of Lagnao an Speekenbrink (21), we will use this perspective to efine the likelihoo of each inter-arrival perio conitional on the previous events. The rate-of-events perspective is useful when simulating many events when the rate is inepenent of the particular occurrence of the events. The rate perspective is also useful for calculating event likelihoos, when the interval uring when the events occurre is known, but the exact occurrence times are unknown. Pacer an Griffiths (212) use this technique to analyze the ata given to participants in Greville an Buehner (27) in which ata were presente in a tabular form that escribe the ay uring which bacteria ie but not the exact timing of the events. This property allows us to recover a trial structure from continuous-time by integrating over intervals of time an treating occurrences within those intervals as events that occurre in those trials. Most importantly for our uses, it is most straightforwar to see causes as altering the rate-of-events an then computing an expecte wait-time istribution base on those altere event rates. Describing effects in terms of rate changes will be the key to the causal aspect of our framework. Fortunately, Poisson processes have two closure properties, superposition an thinning, that allow us to create continuous time analogs of noisy-or an noisy-andnot (for more etails, see Pacer & Griffiths, 212). Superposition an Thinning in Poisson Processes This section will evelop a rough physical moel to ai in thinking about NHPPs as forme by functions on homogeneous Poisson processes. Namely, we aim to provie an intuition for the superposition an thinning closure-properties of homogeneous Poisson processes from the rate-of-events perspective. We o so by sketching a mechanistic picture of a particle emission system that exhibits these properties. First, consier a ecaying raioactive material which releases particles at a constant rate, λ. With a particle etector aroun the material you recor the time-stamp at which particles hit the etector. A particle is expecte to hit the etector, on average, every 1 λs. This etector will then be recoring a homogeneous Poisson process with rate λ. Suppose you were to place a barrier to block some of the paths leaing from materials to the etector (call the proportion blocke π π 1, as in the parameter associate with the orange filter in Figure 1). From the etector s perspective, events associate with particles blocke by a filter are events that never occurre. This process is known as filtering

3 particle paths in transit etecte filtere raioactive materials particle etector filter (π) Figure 1: Particle emission etector moel for visualizing superpositioning an filtering Poisson processes. Color istinguishes particle origins prior to etection, with color lost in etection. Filtere events are never etecte. the Poisson process, an if π is inepenent of the generating process, filtering gives a Poisson process with rate (1 π)λ. Suppose you were to place another raioactive material in the etector, of a ifferent kin than the original, but which i not interact with the original raioactive material (see the blue an green materials in Figure 1). From the perspective of the etector, there is no ifference between the particles hitting it from ifferent materials it only knows that a particle hits it an when it hits it. If we suppose the rate of this new material s emitting particles is constant at λ 1, then the total set of events woul be a Poisson process with rate λ + λ 1. This is the superposition property of Poisson processes: if jointly inepenent, the union of the events from two Poisson processes will be a Poisson process whose rate is their sum. Superposition an thinning allow us to see how the rates of Poisson processes can change without altering their unerlying structure. We can apply these transformations at particular times or intervals of time, thereby proucing an increase (via superposition) or a ecrease (via thinning) in the rate of events while at all times maintaining its ientity as a Poisson process. Applying superposition or thinning as timeepenent functions thus allows one way to create NHPPs that nonetheless can be unerstoo in terms of component processes an their transformations. Causal Graphs an Sequential Point Processes With superposition an thinning in our tool belts, we can iscuss causal point processes feeing back into themselves. By applying thinning an superposition epenent on time we can buil NHPPs from component processes. If we apply superposition an thinning functions relative to the occurrence of events at particular times (e.g., by scaling their effects relative to the istance from the events occurrence time), then we can efine NHPPs relative to the occurrence of particular events. If we then efine the set of events capable of evoking changes in the Poisson process as themselves being the outcome of Poisson processes (see also Blunell et al., 212), then we have successfully manage to create a system of causal relations in terms of Poisson processes. It is worth noting that if we want to escribe the causal effects of point events at all, we will nee some form of influence function that lasts beyon the occurrence of the point event. Because point events are instantaneous, if a cause s effects last while cause persists the effects woul have to occur at that same instant. But we are seeking to moel causal relations that are not only embee in a moment in time, but across time. We nee to consier how events that occur at one point an time can influence events or, more precisely, the unerlying rate of events at later time points an intervals. We nee a way to escribe what kins of things exist which things are relate to one another an in what ways they are relate i.e., we nee an ontology, plausible relations, an functional forms (Griffiths & Tenenbaum, 29). Probabilistic graphical moels are formal structures for expressing stochastic epenencies between variables. But are our events vali variables? To efine a set of possible graphs over variables, we usually nee to know what those variables are. Given that we o not know when events will occur events woul make events a ba caniate for graphical noes. Furthermore, there s no obvious way to say whether event at time t counts as the same event (or even kin of event) as that which happens at t 1. Without some other information we woul be left with a proliferation of variables equal to the number of events we observe. Instea, we will consier the case where events have signature ientities that ientify which sequence of events each event belongs to. These sequences will be our variables. Both events an variables feature in our ontology, but the graphs will be efine over potential relations between variables which will be associate with sequences of point events. Events will be the components through which variables actually affect one another. As in Griffiths an Tenenbaum (29), to compute posteriors over graphs, we will nee a prior over the possible relations between variables. Often this will be mae easier by knowing (from our ontology) which things are potential causes of which effects. When all possible binary relations coul be graphs it is a challenge not because it is ifficult to impose a prior per se, but because of how rapily the number of graphs grows in terms of the number of variables. This is especially pernicious because by using continuous-time causal networks, we can represent irecte cycles as easily as any other relationship, which allows even more graphs than in the traitional causal Bayes nets framework. For each of these relationships, we will express a functional form efining how variables relate to one another. In particular, we nee to relate the kin of relationship between variables (e.g., generative, preventative) to the how the influence of particular events associate with those variables changes over time. Our approach is to see an event(t ) in the cause-variable s event set as inucing a NHPP on the variable s chil noes. For generative causes, the NHPP starts with a maximum rate(ψ) immeiately when it is triggere

4 with the rate ecaying exponentially accoring to a ecay rate(ϕ) scale istance from the cause event ((t t )). This prouces a NHPP with rate function λ(t) = ψe ϕ(t t ). We compute likelihoos for events sequences as follows. We compute a likelihoo for an event using the rate function of its associate variable uring its wait-time interval. We then upate the rate functions for variables that are effects of the variable associate with the event, an iterate this process until we exhaust the event sequence. The waiting-time likelihoo for each event can be further broken own into waitingtime likelihoos for the Poisson process composing its variable s rate function at the instant the event occurs. Note that from the superposition perspective an event s waiting-time implies that none of the variable s processes prouce events until the point when the event in question occurs. The general form of the cf (cumulative ensity function) of the waiting time istribution until the first event of a NHPP with time-epenent rate function λ( ), is: F(T t) = F(t) = 1 exp( λ(s)s). This can be converte to a pf by taking the erivative accoring to t, which (assuming that the erivative exists) becomes, p(t) = λ(t)exp( λ(s)s). Moeling Continuous Event Streams: Lagnao & Speekenbrink, 21 In this section we will moel Experiment 2 from Lagnao an Speekenbrink (21) using the formal elements escribe in Pacer an Griffiths (212) an above. As mentione, Bramley et al. (214) raise a concern that the framework escribe in Pacer an Griffiths (212) oes not aress sequences of point events. Here, we apply this framework to moeling ata from real-time event streams, characterizing sequences of point events an using them for computing the same inferences Lagnao an Speekenbrink (21) aske of their participants. Moreover, our moels jugments closely match average human responses, which suggests the framework succees both at characterizing the sequences of point events an at proucing moels capable of causal inference that comparable to that of human beings facing the same problems. Experiment Description Experiment 2 of Lagnao an Speekenbrink (21) has the form of participants observing a continuous sequence of events (as a vieo) that represent the time-course of various kins of seismic activity, specifically three kins of seismic waves (which we shall refer to as A, B, C) an earthquakes (E). The goal of the participants was to infer which (if any) of the seismic waves were the cause of the earthquakes. Earlier work suggests people will lessen their jugments of causal attribution between two variables if there is a longer(or more variable) elay between the occurrence of two events. t t However, this coul either be because there is something specific about long elays between causes an effects, or that longer elays allow more opportunities uring which other events coul occur that are not causally relate, thus weakening the connection between the original two variables of interest. 2 Accoring to the esign of the experiment unknown to the participant only one of the types of wave(a) was a cause of earthquakes, but sometimes non-causal waves woul occur in the interval of time between the cause an its effects. This allows us to isentangle the two explanations for reuce causal strength ue to longer elays. The length of time between the cause an its effect an the commonness of mi-interval events sometimes were the primary ifferences between the experimental conitions. The experiment ha a 2 2 structure. DELAY-LENGTH coul be LONG (mean elay between cause an effect = 6s) or SHORT (mean elay between cause an effect = 3s) in both the stanar-eviation is.1s. The probability a non-cause event occurre between the cause an the effect was LOW ( 35% of the time a non-cause event woul occur between a cause an its effect) or HIGH ( 65%). These probabilities are approximate because the event sequences were ranomly sample an so cannot be expecte to exactly match expecte percentages. The authors chose elay istributions between the occurrence of cause an lure events to prouce these probabilities in aggregate across samples. They generate sixty atasets per conition that represente the time-stamps an ientities of events that occurre in the movie. Of these, the first twenty atasets were use, with each of twenty participants participating in all four conitions exactly once. They were tol that each animation woul last no more than 1 minutes. 3 After each vieo participants were aske to provie jugments about the seismic waves that they ha just observe. Participants were first aske to rate the extent to which each wave was a cause of earthquakes on a scale of (oes not cause the effect) to 1 (completely causes the effect). This provies an absolute jugment of each wave s causal properties since the rating provie for one of the waves i not constrain the rating provie for the other waves. Participants were then aske for comparative ratings, in which they ivie 1 points amongst the three types of cause. Builing the Moel We treate the problem as one of structure inuction. That is, given the knowlege that there are three possible cause variables ({A,B,C}) of the effect in question (E) an the ata D, we want to infer a posterior over the possible graphs linking 2 We shoul note that more opportunities is actually somewhat misleaing as opportunities in plural form suggests that there woul be a countable number of opportunities uring which these events coul intervene. It is more accurate to say that long elays allow for a larger, continuous amount of opportunity (a mass noun). 3 Though participants i see multiple conitions, we treat each trial inepenently rather than attempting to etect orer effects. While we acknowlege its potential usefulness, aressing this is outsie the scope of our analysis.

5 the causes to the effects. Then we will use this posterior to compute measures analogous to those given by participants. Graphs an Parameterization We consiere graphs with any subset of three potential inepenent causes {A, B,C}. All causal links were generative an non-interacting with the other causal links. Thus the total rate of effects uner a graph woul be the superposition of all Poisson processes inuce by the activity of cause-events accoring to the graph. As escribe in Pacer an Griffiths (212) this is the continuoustime analog to the Noisy-OR parameterization of a causal graph. Because causes were inepenent accoring to all graphs, the likelihoo of their occurrences can be remove from our likelihoo calculations. In aition to a base-rate process PP λ, which we assume was a homogeneous Poisson process with rate λ, we allowe each cause-event (t [X] ) to initiate a NHPP with maximum rate (ψ X ) that ecays exponentially(ϕ X ) relative to the the istance from the cause event( t t [X] ). We sample these parameters in a similar manner to Pacer an Griffiths (212). We use uniform ranom variables (u U( 1.5,1.5 )) uner a transformation (λ = e u ) to etermine our initial timescale (in secons), which acts as our base-rate PP. This creates a approximate scale-free baseline parameter(λ 1 λ ) from which other parameters can be sample. We sample ψ X Γ(λ,1) (the maximum rate inuce by a single event of type X occurring) an ϕ X Γ(λ,1) (the rate at which the intensity ecays accoring to the istance in time from that instance) associate with each potential cause X {A,B,C}. Each cause instance(t [X] ) prouces a NHPP with rate function ψexp( ϕ(t t [X] )). Because the baseline istribution is scale-free an efines other scales, these parameters are not fit to the ata. A misfit baseline scale prouces overflow, unerflow or other numerical an computational issues that result in moel failure. But, any success can only stem from the moel s structural commitments an the relation to the moele ata. Data The ata use to generate stimuli in Lagnao an Speekenbrink (21) are organize by the time-step (in millisecons) that an event occurre an the ientity of the kin of event (i.e., A,B,C or E). Though there were sixty generate sequences consistent with the esign principles of their experiment, we use only the first twenty which correspone with the conitions that they ran in their stuy. Structure Inference For each graph (G α G) an ataset (D) we take our sample parameters({θ} m {1,...,M} ; for us, M = 1) an compute: L(D G α ) 1 M M m=1 exp(l(d G α,θ m )) We compute log-likelihoos (l( )) uner G α an Θ m as follows. For computational efficiency, we eliminate events o not alter other events (e.g., uner graph B E, we consier Human: Absolute Moel: Absolute Cause A Cause B Cause C r.9466, p <1 5 Figure 2: Top: Mean absolute jugments, Experiment 2 of Lagnao an Speekenbrink (21). Bottom: m abs moel. likelihoos of E- an B-events but eliminate A- an C-events). Using the reuce event set ({,t 1,...,t i,...,t n }), we can partition the observation interval an consiering each interval event-ientity pair τ t j,t j+1 (X j,x j+1 ) τ j conitione on previous events associate with cause X (t [X] j) we can calculate the log-likelihoo. The total log-likelihoo: l(d G α,θ) = Λ (t,t n ) +λ {t} n, where Λ (,tn ) is the log-likelihoo component of the intervals, Λ (,tn )=λ (t n t )+ [ [ ψ X τ j D X, X E G α ϕ X (e ϕ Xt j e ϕ Xt j+1 ) t [X] t j [e ϕ Xt [X] ]]], an λ {t} n is the log-likelihoo component of the point events, λ {t} n = [log(λ + t j t [E] X, j X E G α [ψ X (e ϕ Xt j ) [e ϕxt [X] t [X] t j ]])]. Using the likelihoo estimate(l) plus the prior for each graph (in our case, uniform over graphs p(g α ) 1, α), we can then compute the posteriors for all graphs. L(D G α ) p(g α ) p(g α D) = Gα G (L(D G α ) p(g α )) Comparison to Human Responses People juge causes, not graphs; we nee a way to map posterior probabilities p(g α D) to causal jugments. Lagnao an Speekenbrink (21) aske participants for absolute measures (assign each potential cause a value on scale from to 11) an comparative measures (assign a total of 1 points to the three causes). We will moel jugments as statements about structure inferences (not strength estimations). We interpret the absolute score in terms of a probability that a particular variable is thought to be present by marginalizing over the probabilities given to the graphs that inclue that variable is a cause. I.e., m abs (X N; p(g D)) = p(g α D) G α (X E) G α

6 Note if the complete graph were to receive all the probability measure, then m abs (A), m abs (B), an m abs (C) woul each equal 1, an so their sum woul equal 3. Thus, this is not a probability measure in the usual sense because we have not efine probabilities over causes, but over graphs. However, by normalizing by the sum of these measures over all noes, we can aapt the absolute measure to saying something about the comparative importance of the ifferent noes in proucing the effect. This will sum to 1, but still shoul not be interprete as anything like a irect probability of the cause being present. Gα (X E) G m comp (X N; p(g D)) = α p(g α D) x N Gα (x E) G α p(g α D) Finally, we coul consier the comparative prompt as implying that there is only one cause, an so we shoul only consier those graphs which attribute a single cause for proucing the effect in question. In fact we can say that uner the restriction that only one cause may exist the graph incluing X as its sole cause is the measure of the comparative importance of X (since it is the only graph with that cause). Results m unique (X N; p(g D)) = p(x E D) X {A,B,C} p(x E D) We fin an excellent fit between our moels preicte values an average human jugments for both absolute (r.94, p < 1 5, see Figure 2) an comparative jugments(m comp r.98, p < 1 7 ; m unique r.98, p < 1 7, see Figure 3) of the ifferent kins of waves causal importance. Discussion Learning from streams of events unfoling in continuous time is an important case to consier in stuying human causal inuction. We have shown how this case can be accommoate within the framework of Pacer an Griffiths (212), successfully preicting mean human jugments of real-time event streams use in Lagnao an Speekenbrink (21). We know of no other framework that has been brought to bear on realtime event streams. Often, statistical frameworks of theories of human causal inference are contraste with mechanistic theories. The kins of arguments use against statistics are that they neglect to inclue information about temporal an spatial characteristics of the moele processes. We have seen success in moeling causal inuction that relies explicitly on the temporal aspects of events. We see this as a step towars reconciling mechanism an statistics. More sophisticate graphical moels can be built that articulate complex causal mechanisms that are sensitive to particular temporal an spatial properties. This gives a hope for issolving statistical-mechanistic ivie an the birth of a new synthesis with statistical inferences compute over mechanistic theories. Human: Comparative Moel: Comparative Moel: Unique Cause A Cause B Cause C r.9777, p <1 7 r.9766, p <1 7 Figure 3: Top: Mean human comparative jugments from Lagnao an Speekenbrink (21). Mile: m comp moel. Bottom: m unique moel. Acknowlegments. We thank Maarten Speekenbrink an Davi Lagnao for proviing their stimuli an results. Support for this work was provie by the National Defense Science & Engineering Grauate Fellowship (NDSEG) Program aware to MP an grant FA from the Air Force Office of Scientific Research aware to TG. References Blunell, C., Beck, J., & Heller, K. A. (212). Moelling reciprocating relationships with Hawkes processes. In Avances in Neural Information Processing Systems (pp ). Bramley, N. R., Gerstenberg, T., & Lagnao, D. A. (214). The orer of things: Inferring causal structure from temporal patterns. In Proceeings of the 36 th Annual Conf. of the Cognitive Science Society. Gopnik, A., Glymour, C., Sobel, D., Schulz, L., Kushnir, T., & Danks, D. (24). A theory of causal learning in chilren: Causal maps an Bayes nets. Psychological Review, 111, Greville, W., & Buehner, M. (27). The influence of temporal istributions on causal inuction from tabular ata. Memory & Cognition, 35, Greville, W., & Buehner, M. (21). Temporal preictability facilitates causal learning. Journal of Experimental Psychology: General, 139(4), 756. Griffiths, T. L., & Tenenbaum, J. B. (29). Theory-base causal inuction. Psychological review, 116(4), 661. Lagnao, D. A., & Speekenbrink, M. (21). The influence of elays in real-time causal learning. The Open Psychology Journal, 3(2), Pacer, M., & Griffiths, T. (212). Elements of a rational framework for continuous-time causal inuction. In Proc. of the 34th Conf. of the CogSci Society. Simma, A., & Joran, M. (21). Moeling events with cascaes of poisson processes. In International conference on uncertainty in artificial intelligence.

Schrödinger s equation.

Schrödinger s equation. Physics 342 Lecture 5 Schröinger s Equation Lecture 5 Physics 342 Quantum Mechanics I Wenesay, February 3r, 2010 Toay we iscuss Schröinger s equation an show that it supports the basic interpretation of

More information

Separation of Variables

Separation of Variables Physics 342 Lecture 1 Separation of Variables Lecture 1 Physics 342 Quantum Mechanics I Monay, January 25th, 2010 There are three basic mathematical tools we nee, an then we can begin working on the physical

More information

Survey Sampling. 1 Design-based Inference. Kosuke Imai Department of Politics, Princeton University. February 19, 2013

Survey Sampling. 1 Design-based Inference. Kosuke Imai Department of Politics, Princeton University. February 19, 2013 Survey Sampling Kosuke Imai Department of Politics, Princeton University February 19, 2013 Survey sampling is one of the most commonly use ata collection methos for social scientists. We begin by escribing

More information

Time-of-Arrival Estimation in Non-Line-Of-Sight Environments

Time-of-Arrival Estimation in Non-Line-Of-Sight Environments 2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor

More information

Math Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors

Math Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors Math 18.02 Notes on ifferentials, the Chain Rule, graients, irectional erivative, an normal vectors Tangent plane an linear approximation We efine the partial erivatives of f( xy, ) as follows: f f( x+

More information

Role of parameters in the stochastic dynamics of a stick-slip oscillator

Role of parameters in the stochastic dynamics of a stick-slip oscillator Proceeing Series of the Brazilian Society of Applie an Computational Mathematics, v. 6, n. 1, 218. Trabalho apresentao no XXXVII CNMAC, S.J. os Campos - SP, 217. Proceeing Series of the Brazilian Society

More information

inflow outflow Part I. Regular tasks for MAE598/494 Task 1

inflow outflow Part I. Regular tasks for MAE598/494 Task 1 MAE 494/598, Fall 2016 Project #1 (Regular tasks = 20 points) Har copy of report is ue at the start of class on the ue ate. The rules on collaboration will be release separately. Please always follow the

More information

ensembles When working with density operators, we can use this connection to define a generalized Bloch vector: v x Tr x, v y Tr y

ensembles When working with density operators, we can use this connection to define a generalized Bloch vector: v x Tr x, v y Tr y Ph195a lecture notes, 1/3/01 Density operators for spin- 1 ensembles So far in our iscussion of spin- 1 systems, we have restricte our attention to the case of pure states an Hamiltonian evolution. Toay

More information

Linear First-Order Equations

Linear First-Order Equations 5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)

More information

The Principle of Least Action

The Principle of Least Action Chapter 7. The Principle of Least Action 7.1 Force Methos vs. Energy Methos We have so far stuie two istinct ways of analyzing physics problems: force methos, basically consisting of the application of

More information

SYNCHRONOUS SEQUENTIAL CIRCUITS

SYNCHRONOUS SEQUENTIAL CIRCUITS CHAPTER SYNCHRONOUS SEUENTIAL CIRCUITS Registers an counters, two very common synchronous sequential circuits, are introuce in this chapter. Register is a igital circuit for storing information. Contents

More information

Calculus of Variations

Calculus of Variations 16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t

More information

6 General properties of an autonomous system of two first order ODE

6 General properties of an autonomous system of two first order ODE 6 General properties of an autonomous system of two first orer ODE Here we embark on stuying the autonomous system of two first orer ifferential equations of the form ẋ 1 = f 1 (, x 2 ), ẋ 2 = f 2 (, x

More information

A Review of Multiple Try MCMC algorithms for Signal Processing

A Review of Multiple Try MCMC algorithms for Signal Processing A Review of Multiple Try MCMC algorithms for Signal Processing Luca Martino Image Processing Lab., Universitat e València (Spain) Universia Carlos III e Mari, Leganes (Spain) Abstract Many applications

More information

Non-Linear Bayesian CBRN Source Term Estimation

Non-Linear Bayesian CBRN Source Term Estimation Non-Linear Bayesian CBRN Source Term Estimation Peter Robins Hazar Assessment, Simulation an Preiction Group Dstl Porton Down, UK. probins@stl.gov.uk Paul Thomas Hazar Assessment, Simulation an Preiction

More information

Chapter 6: Energy-Momentum Tensors

Chapter 6: Energy-Momentum Tensors 49 Chapter 6: Energy-Momentum Tensors This chapter outlines the general theory of energy an momentum conservation in terms of energy-momentum tensors, then applies these ieas to the case of Bohm's moel.

More information

The total derivative. Chapter Lagrangian and Eulerian approaches

The total derivative. Chapter Lagrangian and Eulerian approaches Chapter 5 The total erivative 51 Lagrangian an Eulerian approaches The representation of a flui through scalar or vector fiels means that each physical quantity uner consieration is escribe as a function

More information

A note on asymptotic formulae for one-dimensional network flow problems Carlos F. Daganzo and Karen R. Smilowitz

A note on asymptotic formulae for one-dimensional network flow problems Carlos F. Daganzo and Karen R. Smilowitz A note on asymptotic formulae for one-imensional network flow problems Carlos F. Daganzo an Karen R. Smilowitz (to appear in Annals of Operations Research) Abstract This note evelops asymptotic formulae

More information

ELECTRON DIFFRACTION

ELECTRON DIFFRACTION ELECTRON DIFFRACTION Electrons : wave or quanta? Measurement of wavelength an momentum of electrons. Introuction Electrons isplay both wave an particle properties. What is the relationship between the

More information

Computing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions

Computing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5

More information

Thermal conductivity of graded composites: Numerical simulations and an effective medium approximation

Thermal conductivity of graded composites: Numerical simulations and an effective medium approximation JOURNAL OF MATERIALS SCIENCE 34 (999)5497 5503 Thermal conuctivity of grae composites: Numerical simulations an an effective meium approximation P. M. HUI Department of Physics, The Chinese University

More information

A Course in Machine Learning

A Course in Machine Learning A Course in Machine Learning Hal Daumé III 12 EFFICIENT LEARNING So far, our focus has been on moels of learning an basic algorithms for those moels. We have not place much emphasis on how to learn quickly.

More information

Estimating Causal Direction and Confounding Of Two Discrete Variables

Estimating Causal Direction and Confounding Of Two Discrete Variables Estimating Causal Direction an Confouning Of Two Discrete Variables This inspire further work on the so calle aitive noise moels. Hoyer et al. (2009) extene Shimizu s ientifiaarxiv:1611.01504v1 [stat.ml]

More information

JUST THE MATHS UNIT NUMBER DIFFERENTIATION 2 (Rates of change) A.J.Hobson

JUST THE MATHS UNIT NUMBER DIFFERENTIATION 2 (Rates of change) A.J.Hobson JUST THE MATHS UNIT NUMBER 10.2 DIFFERENTIATION 2 (Rates of change) by A.J.Hobson 10.2.1 Introuction 10.2.2 Average rates of change 10.2.3 Instantaneous rates of change 10.2.4 Derivatives 10.2.5 Exercises

More information

NOTES ON EULER-BOOLE SUMMATION (1) f (l 1) (n) f (l 1) (m) + ( 1)k 1 k! B k (y) f (k) (y) dy,

NOTES ON EULER-BOOLE SUMMATION (1) f (l 1) (n) f (l 1) (m) + ( 1)k 1 k! B k (y) f (k) (y) dy, NOTES ON EULER-BOOLE SUMMATION JONATHAN M BORWEIN, NEIL J CALKIN, AND DANTE MANNA Abstract We stuy a connection between Euler-MacLaurin Summation an Boole Summation suggeste in an AMM note from 196, which

More information

Equilibrium in Queues Under Unknown Service Times and Service Value

Equilibrium in Queues Under Unknown Service Times and Service Value University of Pennsylvania ScholarlyCommons Finance Papers Wharton Faculty Research 1-2014 Equilibrium in Queues Uner Unknown Service Times an Service Value Laurens Debo Senthil K. Veeraraghavan University

More information

ELEC3114 Control Systems 1

ELEC3114 Control Systems 1 ELEC34 Control Systems Linear Systems - Moelling - Some Issues Session 2, 2007 Introuction Linear systems may be represente in a number of ifferent ways. Figure shows the relationship between various representations.

More information

The Exact Form and General Integrating Factors

The Exact Form and General Integrating Factors 7 The Exact Form an General Integrating Factors In the previous chapters, we ve seen how separable an linear ifferential equations can be solve using methos for converting them to forms that can be easily

More information

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x) Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)

More information

A Sketch of Menshikov s Theorem

A Sketch of Menshikov s Theorem A Sketch of Menshikov s Theorem Thomas Bao March 14, 2010 Abstract Let Λ be an infinite, locally finite oriente multi-graph with C Λ finite an strongly connecte, an let p

More information

TMA 4195 Matematisk modellering Exam Tuesday December 16, :00 13:00 Problems and solution with additional comments

TMA 4195 Matematisk modellering Exam Tuesday December 16, :00 13:00 Problems and solution with additional comments Problem F U L W D g m 3 2 s 2 0 0 0 0 2 kg 0 0 0 0 0 0 Table : Dimension matrix TMA 495 Matematisk moellering Exam Tuesay December 6, 2008 09:00 3:00 Problems an solution with aitional comments The necessary

More information

Construction of the Electronic Radial Wave Functions and Probability Distributions of Hydrogen-like Systems

Construction of the Electronic Radial Wave Functions and Probability Distributions of Hydrogen-like Systems Construction of the Electronic Raial Wave Functions an Probability Distributions of Hyrogen-like Systems Thomas S. Kuntzleman, Department of Chemistry Spring Arbor University, Spring Arbor MI 498 tkuntzle@arbor.eu

More information

. Using a multinomial model gives us the following equation for P d. , with respect to same length term sequences.

. Using a multinomial model gives us the following equation for P d. , with respect to same length term sequences. S 63 Lecture 8 2/2/26 Lecturer Lillian Lee Scribes Peter Babinski, Davi Lin Basic Language Moeling Approach I. Special ase of LM-base Approach a. Recap of Formulas an Terms b. Fixing θ? c. About that Multinomial

More information

Diophantine Approximations: Examining the Farey Process and its Method on Producing Best Approximations

Diophantine Approximations: Examining the Farey Process and its Method on Producing Best Approximations Diophantine Approximations: Examining the Farey Process an its Metho on Proucing Best Approximations Kelly Bowen Introuction When a person hears the phrase irrational number, one oes not think of anything

More information

Transmission Line Matrix (TLM) network analogues of reversible trapping processes Part B: scaling and consistency

Transmission Line Matrix (TLM) network analogues of reversible trapping processes Part B: scaling and consistency Transmission Line Matrix (TLM network analogues of reversible trapping processes Part B: scaling an consistency Donar e Cogan * ANC Eucation, 308-310.A. De Mel Mawatha, Colombo 3, Sri Lanka * onarecogan@gmail.com

More information

Integration Review. May 11, 2013

Integration Review. May 11, 2013 Integration Review May 11, 2013 Goals: Review the funamental theorem of calculus. Review u-substitution. Review integration by parts. Do lots of integration eamples. 1 Funamental Theorem of Calculus In

More information

CONTROL CHARTS FOR VARIABLES

CONTROL CHARTS FOR VARIABLES UNIT CONTOL CHATS FO VAIABLES Structure.1 Introuction Objectives. Control Chart Technique.3 Control Charts for Variables.4 Control Chart for Mean(-Chart).5 ange Chart (-Chart).6 Stanar Deviation Chart

More information

Computing Derivatives

Computing Derivatives Chapter 2 Computing Derivatives 2.1 Elementary erivative rules Motivating Questions In this section, we strive to unerstan the ieas generate by the following important questions: What are alternate notations

More information

Lectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs

Lectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent

More information

Introduction to Markov Processes

Introduction to Markov Processes Introuction to Markov Processes Connexions moule m44014 Zzis law Gustav) Meglicki, Jr Office of the VP for Information Technology Iniana University RCS: Section-2.tex,v 1.24 2012/12/21 18:03:08 gustav

More information

Implicit Differentiation

Implicit Differentiation Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,

More information

Math 342 Partial Differential Equations «Viktor Grigoryan

Math 342 Partial Differential Equations «Viktor Grigoryan Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite

More information

Parameter estimation: A new approach to weighting a priori information

Parameter estimation: A new approach to weighting a priori information Parameter estimation: A new approach to weighting a priori information J.L. Mea Department of Mathematics, Boise State University, Boise, ID 83725-555 E-mail: jmea@boisestate.eu Abstract. We propose a

More information

Generalizing Kronecker Graphs in order to Model Searchable Networks

Generalizing Kronecker Graphs in order to Model Searchable Networks Generalizing Kronecker Graphs in orer to Moel Searchable Networks Elizabeth Boine, Babak Hassibi, Aam Wierman California Institute of Technology Pasaena, CA 925 Email: {eaboine, hassibi, aamw}@caltecheu

More information

Introduction to the Vlasov-Poisson system

Introduction to the Vlasov-Poisson system Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its

More information

Quantum mechanical approaches to the virial

Quantum mechanical approaches to the virial Quantum mechanical approaches to the virial S.LeBohec Department of Physics an Astronomy, University of Utah, Salt Lae City, UT 84112, USA Date: June 30 th 2015 In this note, we approach the virial from

More information

IPA Derivatives for Make-to-Stock Production-Inventory Systems With Backorders Under the (R,r) Policy

IPA Derivatives for Make-to-Stock Production-Inventory Systems With Backorders Under the (R,r) Policy IPA Derivatives for Make-to-Stock Prouction-Inventory Systems With Backorers Uner the (Rr) Policy Yihong Fan a Benamin Melame b Yao Zhao c Yorai Wari Abstract This paper aresses Infinitesimal Perturbation

More information

Cascaded redundancy reduction

Cascaded redundancy reduction Network: Comput. Neural Syst. 9 (1998) 73 84. Printe in the UK PII: S0954-898X(98)88342-5 Cascae reunancy reuction Virginia R e Sa an Geoffrey E Hinton Department of Computer Science, University of Toronto,

More information

How to Minimize Maximum Regret in Repeated Decision-Making

How to Minimize Maximum Regret in Repeated Decision-Making How to Minimize Maximum Regret in Repeate Decision-Making Karl H. Schlag July 3 2003 Economics Department, European University Institute, Via ella Piazzuola 43, 033 Florence, Italy, Tel: 0039-0-4689, email:

More information

Number of wireless sensors needed to detect a wildfire

Number of wireless sensors needed to detect a wildfire Number of wireless sensors neee to etect a wilfire Pablo I. Fierens Instituto Tecnológico e Buenos Aires (ITBA) Physics an Mathematics Department Av. Maero 399, Buenos Aires, (C1106ACD) Argentina pfierens@itba.eu.ar

More information

Improved Rate-Based Pull and Push Strategies in Large Distributed Networks

Improved Rate-Based Pull and Push Strategies in Large Distributed Networks Improve Rate-Base Pull an Push Strategies in Large Distribute Networks Wouter Minnebo an Benny Van Hout Department of Mathematics an Computer Science University of Antwerp - imins Mielheimlaan, B-00 Antwerp,

More information

Event based Kalman filter observer for rotary high speed on/off valve

Event based Kalman filter observer for rotary high speed on/off valve 28 American Control Conference Westin Seattle Hotel, Seattle, Washington, USA June 11-13, 28 WeC9.6 Event base Kalman filter observer for rotary high spee on/off valve Meng Wang, Perry Y. Li ERC for Compact

More information

Slide10 Haykin Chapter 14: Neurodynamics (3rd Ed. Chapter 13)

Slide10 Haykin Chapter 14: Neurodynamics (3rd Ed. Chapter 13) Slie10 Haykin Chapter 14: Neuroynamics (3r E. Chapter 13) CPSC 636-600 Instructor: Yoonsuck Choe Spring 2012 Neural Networks with Temporal Behavior Inclusion of feeback gives temporal characteristics to

More information

Differentiability, Computing Derivatives, Trig Review. Goals:

Differentiability, Computing Derivatives, Trig Review. Goals: Secants vs. Derivatives - Unit #3 : Goals: Differentiability, Computing Derivatives, Trig Review Determine when a function is ifferentiable at a point Relate the erivative graph to the the graph of an

More information

Math 1271 Solutions for Fall 2005 Final Exam

Math 1271 Solutions for Fall 2005 Final Exam Math 7 Solutions for Fall 5 Final Eam ) Since the equation + y = e y cannot be rearrange algebraically in orer to write y as an eplicit function of, we must instea ifferentiate this relation implicitly

More information

DEGREE DISTRIBUTION OF SHORTEST PATH TREES AND BIAS OF NETWORK SAMPLING ALGORITHMS

DEGREE DISTRIBUTION OF SHORTEST PATH TREES AND BIAS OF NETWORK SAMPLING ALGORITHMS DEGREE DISTRIBUTION OF SHORTEST PATH TREES AND BIAS OF NETWORK SAMPLING ALGORITHMS SHANKAR BHAMIDI 1, JESSE GOODMAN 2, REMCO VAN DER HOFSTAD 3, AND JÚLIA KOMJÁTHY3 Abstract. In this article, we explicitly

More information

Math 1B, lecture 8: Integration by parts

Math 1B, lecture 8: Integration by parts Math B, lecture 8: Integration by parts Nathan Pflueger 23 September 2 Introuction Integration by parts, similarly to integration by substitution, reverses a well-known technique of ifferentiation an explores

More information

A simple model for the small-strain behaviour of soils

A simple model for the small-strain behaviour of soils A simple moel for the small-strain behaviour of soils José Jorge Naer Department of Structural an Geotechnical ngineering, Polytechnic School, University of São Paulo 05508-900, São Paulo, Brazil, e-mail:

More information

Some Examples. Uniform motion. Poisson processes on the real line

Some Examples. Uniform motion. Poisson processes on the real line Some Examples Our immeiate goal is to see some examples of Lévy processes, an/or infinitely-ivisible laws on. Uniform motion Choose an fix a nonranom an efine X := for all (1) Then, {X } is a [nonranom]

More information

MA 2232 Lecture 08 - Review of Log and Exponential Functions and Exponential Growth

MA 2232 Lecture 08 - Review of Log and Exponential Functions and Exponential Growth MA 2232 Lecture 08 - Review of Log an Exponential Functions an Exponential Growth Friay, February 2, 2018. Objectives: Review log an exponential functions, their erivative an integration formulas. Exponential

More information

Research Article When Inflation Causes No Increase in Claim Amounts

Research Article When Inflation Causes No Increase in Claim Amounts Probability an Statistics Volume 2009, Article ID 943926, 10 pages oi:10.1155/2009/943926 Research Article When Inflation Causes No Increase in Claim Amounts Vytaras Brazauskas, 1 Bruce L. Jones, 2 an

More information

Necessary and Sufficient Conditions for Sketched Subspace Clustering

Necessary and Sufficient Conditions for Sketched Subspace Clustering Necessary an Sufficient Conitions for Sketche Subspace Clustering Daniel Pimentel-Alarcón, Laura Balzano 2, Robert Nowak University of Wisconsin-Maison, 2 University of Michigan-Ann Arbor Abstract This

More information

TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS

TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS MISN-0-4 TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS f(x ± ) = f(x) ± f ' (x) + f '' (x) 2 ±... 1! 2! = 1.000 ± 0.100 + 0.005 ±... TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS by Peter Signell 1.

More information

1 dx. where is a large constant, i.e., 1, (7.6) and Px is of the order of unity. Indeed, if px is given by (7.5), the inequality (7.

1 dx. where is a large constant, i.e., 1, (7.6) and Px is of the order of unity. Indeed, if px is given by (7.5), the inequality (7. Lectures Nine an Ten The WKB Approximation The WKB metho is a powerful tool to obtain solutions for many physical problems It is generally applicable to problems of wave propagation in which the frequency

More information

Table of Common Derivatives By David Abraham

Table of Common Derivatives By David Abraham Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec

More information

Experiment 2, Physics 2BL

Experiment 2, Physics 2BL Experiment 2, Physics 2BL Deuction of Mass Distributions. Last Upate: 2009-05-03 Preparation Before this experiment, we recommen you review or familiarize yourself with the following: Chapters 4-6 in Taylor

More information

MATH , 06 Differential Equations Section 03: MWF 1:00pm-1:50pm McLaury 306 Section 06: MWF 3:00pm-3:50pm EEP 208

MATH , 06 Differential Equations Section 03: MWF 1:00pm-1:50pm McLaury 306 Section 06: MWF 3:00pm-3:50pm EEP 208 MATH 321-03, 06 Differential Equations Section 03: MWF 1:00pm-1:50pm McLaury 306 Section 06: MWF 3:00pm-3:50pm EEP 208 Instructor: Brent Deschamp Email: brent.eschamp@ssmt.eu Office: McLaury 316B Phone:

More information

Perturbation Analysis and Optimization of Stochastic Flow Networks

Perturbation Analysis and Optimization of Stochastic Flow Networks IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. XX, NO. Y, MMM 2004 1 Perturbation Analysis an Optimization of Stochastic Flow Networks Gang Sun, Christos G. Cassanras, Yorai Wari, Christos G. Panayiotou,

More information

Calculus Class Notes for the Combined Calculus and Physics Course Semester I

Calculus Class Notes for the Combined Calculus and Physics Course Semester I Calculus Class Notes for the Combine Calculus an Physics Course Semester I Kelly Black December 14, 2001 Support provie by the National Science Founation - NSF-DUE-9752485 1 Section 0 2 Contents 1 Average

More information

II. First variation of functionals

II. First variation of functionals II. First variation of functionals The erivative of a function being zero is a necessary conition for the etremum of that function in orinary calculus. Let us now tackle the question of the equivalent

More information

Quantum Search on the Spatial Grid

Quantum Search on the Spatial Grid Quantum Search on the Spatial Gri Matthew D. Falk MIT 2012, 550 Memorial Drive, Cambrige, MA 02139 (Date: December 11, 2012) This paper explores Quantum Search on the two imensional spatial gri. Recent

More information

Perfect Matchings in Õ(n1.5 ) Time in Regular Bipartite Graphs

Perfect Matchings in Õ(n1.5 ) Time in Regular Bipartite Graphs Perfect Matchings in Õ(n1.5 ) Time in Regular Bipartite Graphs Ashish Goel Michael Kapralov Sanjeev Khanna Abstract We consier the well-stuie problem of fining a perfect matching in -regular bipartite

More information

Non-deterministic Social Laws

Non-deterministic Social Laws Non-eterministic Social Laws Michael H. Coen MIT Artificial Intelligence Lab 55 Technology Square Cambrige, MA 09 mhcoen@ai.mit.eu Abstract The paper generalizes the notion of a social law, the founation

More information

Level Construction of Decision Trees in a Partition-based Framework for Classification

Level Construction of Decision Trees in a Partition-based Framework for Classification Level Construction of Decision Trees in a Partition-base Framework for Classification Y.Y. Yao, Y. Zhao an J.T. Yao Department of Computer Science, University of Regina Regina, Saskatchewan, Canaa S4S

More information

3.2 Shot peening - modeling 3 PROCEEDINGS

3.2 Shot peening - modeling 3 PROCEEDINGS 3.2 Shot peening - moeling 3 PROCEEDINGS Computer assiste coverage simulation François-Xavier Abaie a, b a FROHN, Germany, fx.abaie@frohn.com. b PEENING ACCESSORIES, Switzerlan, info@peening.ch Keywors:

More information

Least-Squares Regression on Sparse Spaces

Least-Squares Regression on Sparse Spaces Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction

More information

Multi-View Clustering via Canonical Correlation Analysis

Multi-View Clustering via Canonical Correlation Analysis Technical Report TTI-TR-2008-5 Multi-View Clustering via Canonical Correlation Analysis Kamalika Chauhuri UC San Diego Sham M. Kakae Toyota Technological Institute at Chicago ABSTRACT Clustering ata in

More information

19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control

19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control 19 Eigenvalues, Eigenvectors, Orinary Differential Equations, an Control This section introuces eigenvalues an eigenvectors of a matrix, an iscusses the role of the eigenvalues in etermining the behavior

More information

LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION

LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische

More information

THE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE

THE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE Journal of Soun an Vibration (1996) 191(3), 397 414 THE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE E. M. WEINSTEIN Galaxy Scientific Corporation, 2500 English Creek

More information

Optimization of Geometries by Energy Minimization

Optimization of Geometries by Energy Minimization Optimization of Geometries by Energy Minimization by Tracy P. Hamilton Department of Chemistry University of Alabama at Birmingham Birmingham, AL 3594-140 hamilton@uab.eu Copyright Tracy P. Hamilton, 1997.

More information

State observers and recursive filters in classical feedback control theory

State observers and recursive filters in classical feedback control theory State observers an recursive filters in classical feeback control theory State-feeback control example: secon-orer system Consier the riven secon-orer system q q q u x q x q x x x x Here u coul represent

More information

A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks

A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks A PAC-Bayesian Approach to Spectrally-Normalize Margin Bouns for Neural Networks Behnam Neyshabur, Srinah Bhojanapalli, Davi McAllester, Nathan Srebro Toyota Technological Institute at Chicago {bneyshabur,

More information

Lecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012

Lecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012 CS-6 Theory Gems November 8, 0 Lecture Lecturer: Alesaner Mąry Scribes: Alhussein Fawzi, Dorina Thanou Introuction Toay, we will briefly iscuss an important technique in probability theory measure concentration

More information

Lower Bounds for the Smoothed Number of Pareto optimal Solutions

Lower Bounds for the Smoothed Number of Pareto optimal Solutions Lower Bouns for the Smoothe Number of Pareto optimal Solutions Tobias Brunsch an Heiko Röglin Department of Computer Science, University of Bonn, Germany brunsch@cs.uni-bonn.e, heiko@roeglin.org Abstract.

More information

Examining Geometric Integration for Propagating Orbit Trajectories with Non-Conservative Forcing

Examining Geometric Integration for Propagating Orbit Trajectories with Non-Conservative Forcing Examining Geometric Integration for Propagating Orbit Trajectories with Non-Conservative Forcing Course Project for CDS 05 - Geometric Mechanics John M. Carson III California Institute of Technology June

More information

Text S1: Simulation models and detailed method for early warning signal calculation

Text S1: Simulation models and detailed method for early warning signal calculation 1 Text S1: Simulation moels an etaile metho for early warning signal calculation Steven J. Lae, Thilo Gross Max Planck Institute for the Physics of Complex Systems, Nöthnitzer Str. 38, 01187 Dresen, Germany

More information

arxiv:physics/ v2 [physics.ed-ph] 23 Sep 2003

arxiv:physics/ v2 [physics.ed-ph] 23 Sep 2003 Mass reistribution in variable mass systems Célia A. e Sousa an Vítor H. Rorigues Departamento e Física a Universiae e Coimbra, P-3004-516 Coimbra, Portugal arxiv:physics/0211075v2 [physics.e-ph] 23 Sep

More information

Image Based Monitoring for Combustion Systems

Image Based Monitoring for Combustion Systems Image Base onitoring for Combustion Systems J. Chen, ember, IAENG an.-y. Hsu Abstract A novel metho of on-line flame etection in vieo is propose. It aims to early etect the current state of the combustion

More information

The new concepts of measurement error s regularities and effect characteristics

The new concepts of measurement error s regularities and effect characteristics The new concepts of measurement error s regularities an effect characteristics Ye Xiaoming[1,] Liu Haibo [3,,] Ling Mo[3] Xiao Xuebin [5] [1] School of Geoesy an Geomatics, Wuhan University, Wuhan, Hubei,

More information

PRACTICE 4. CHARGING AND DISCHARGING A CAPACITOR

PRACTICE 4. CHARGING AND DISCHARGING A CAPACITOR PRACTICE 4. CHARGING AND DISCHARGING A CAPACITOR. THE PARALLEL-PLATE CAPACITOR. The Parallel plate capacitor is a evice mae up by two conuctor parallel plates with total influence between them (the surface

More information

Closed and Open Loop Optimal Control of Buffer and Energy of a Wireless Device

Closed and Open Loop Optimal Control of Buffer and Energy of a Wireless Device Close an Open Loop Optimal Control of Buffer an Energy of a Wireless Device V. S. Borkar School of Technology an Computer Science TIFR, umbai, Inia. borkar@tifr.res.in A. A. Kherani B. J. Prabhu INRIA

More information

Lecture Note 2. 1 Bonferroni Principle. 1.1 Idea. 1.2 Want. Material covered today is from Chapter 1 and chapter 4

Lecture Note 2. 1 Bonferroni Principle. 1.1 Idea. 1.2 Want. Material covered today is from Chapter 1 and chapter 4 Lecture Note 2 Material covere toay is from Chapter an chapter 4 Bonferroni Principle. Iea Get an iea the frequency of events when things are ranom billion = 0 9 Each person has a % chance to stay in a

More information

KNN Particle Filters for Dynamic Hybrid Bayesian Networks

KNN Particle Filters for Dynamic Hybrid Bayesian Networks KNN Particle Filters for Dynamic Hybri Bayesian Networs H. D. Chen an K. C. Chang Dept. of Systems Engineering an Operations Research George Mason University MS 4A6, 4400 University Dr. Fairfax, VA 22030

More information

arxiv:hep-th/ v1 3 Feb 1993

arxiv:hep-th/ v1 3 Feb 1993 NBI-HE-9-89 PAR LPTHE 9-49 FTUAM 9-44 November 99 Matrix moel calculations beyon the spherical limit arxiv:hep-th/93004v 3 Feb 993 J. Ambjørn The Niels Bohr Institute Blegamsvej 7, DK-00 Copenhagen Ø,

More information

2.5 SOME APPLICATIONS OF THE CHAIN RULE

2.5 SOME APPLICATIONS OF THE CHAIN RULE 2.5 SOME APPLICATIONS OF THE CHAIN RULE The Chain Rule will help us etermine the erivatives of logarithms an exponential functions a x. We will also use it to answer some applie questions an to fin slopes

More information

APPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France

APPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France APPROXIMAE SOLUION FOR RANSIEN HEA RANSFER IN SAIC URBULEN HE II B. Bauouy CEA/Saclay, DSM/DAPNIA/SCM 91191 Gif-sur-Yvette Ceex, France ABSRAC Analytical solution in one imension of the heat iffusion equation

More information

Chapter 4. Electrostatics of Macroscopic Media

Chapter 4. Electrostatics of Macroscopic Media Chapter 4. Electrostatics of Macroscopic Meia 4.1 Multipole Expansion Approximate potentials at large istances 3 x' x' (x') x x' x x Fig 4.1 We consier the potential in the far-fiel region (see Fig. 4.1

More information

4. Important theorems in quantum mechanics

4. Important theorems in quantum mechanics TFY4215 Kjemisk fysikk og kvantemekanikk - Tillegg 4 1 TILLEGG 4 4. Important theorems in quantum mechanics Before attacking three-imensional potentials in the next chapter, we shall in chapter 4 of this

More information

Markov Chains in Continuous Time

Markov Chains in Continuous Time Chapter 23 Markov Chains in Continuous Time Previously we looke at Markov chains, where the transitions betweenstatesoccurreatspecifietime- steps. That it, we mae time (a continuous variable) avance in

More information