arxiv: v2 [q-bio.mn] 12 Sep 2011

Transcription

1 1 arxiv: v2 [q-bio.mn] 12 Sep 2011 The role of incoherent microrna-mediated feedforward loops in noise buffering Matteo Osella 1,2,,, Carla Bosia 1,2,, Davide Corá 2,3, Michele Caselle 1,2 1 Dipartimento di Fisica Teorica and INFN University of Torino, V. Pietro Giuria 1, I Torino Italy. 2 Center for Complex Systems in Molecular Biology and Medicine, University of Torino, V. Accademia Albertina 13, I Torino, Italy. 3 Systems Biology Lab, Institute for Cancer Research and Treatment (IRCC), School of Medicine, University of Torino, Str. Prov. 142, Km. 3.95, Candiolo I Torino, Italy These authors contributed equally to this work. mosella@to.infn.it Abstract MicroRNAs are endogenous non-coding RNAs which negatively regulate the expression of protein-coding genes in plants and animals. They are known to play an important role in several biological processes and, together with transcription factors, form a complex and highly interconnected regulatory network. Looking at the structure of this network it is possible to recognize a few overrepresented motifs which are expected to perform important elementary regulatory functions. Among them a special role is played by the microrna-mediated feedforward loop in which a master transcription factor regulates a microrna and, together with it, a set of target genes. In this paper we show analytically and through simulations that the incoherent version of this motif can couple the fine-tuning of a target protein level with an efficient noise control, thus conferring precision and stability to the overall gene expression program, especially in the presence of fluctuations in upstream regulators. Among the other results, a nontrivial prediction of our model is that the optimal attenuation of fluctuations coincides with a modest repression of the target expression. This feature is coherent with the expected fine-tuning function and in agreement with experimental observations of the actual impact of a wide class of micrornas on the protein output of their targets. Finally we describe the impact on noise-buffering efficiency of the cross-talk between microrna targets that can naturally arise if the microrna-mediated circuit is not considered as isolated, but embedded in a larger network of regulations. Author Summary The expression of protein-coding genes is controlled by a complex network of regulatory interactions. It is becoming increasingly appreciated that the post-transcriptional repression by micrornas, a class of small non-coding RNAs, is a key layer of regulation in several biological processes. Since gene expression is a fundamentally stochastic process, the mixed network (comprising transcriptional and micrornamediated regulations) has to reliably perform its functions in the presence of noise. In this paper we investigate the function of one of the recurrent architectures of this network, the microrna-mediated feedforward loops, using a detailed analytical model and simulations. With this approach we show that these regulatory circuits are appropriately designed so as to control noise, giving a rigorous mathematical proof of a previously proposed biological intuition. Moreover the theoretical framework introduced in this paper allows us to make nontrivial predictions that are presently in agreement with observed features of microrna regulation and that could be more specifically tested experimentally in the future.

2 2 Introduction MicroRNAs (mirnas) are endogenous small non-coding RNAs which negatively regulate the protein production of their targets in metazoans and plants. They are expected to target a substantial portion of the human genome [1] and have been shown to play key roles in several biological processes ranging from development and metabolism to apoptosis and signaling pathways [2 6]. Moreover their profiles are altered in several human diseases [7, 8], making mirnas a major focus of research in nowadays molecular biology. Recent work, reviewed in [9], has shown that the actions of mirnas and transcription factors (TFs) are often highly coordinated, suggesting that the transcriptional and post-transcriptional layers of regulation are strongly correlated and that mirna functions can be fully understood only by addressing TF and mirna regulatory interactions together in a single mixed network. As in the case of purely transcriptional networks [10], in this mixed network several recurrent wiring patterns can be detected, called network motifs [11 14]. The common lore is that network motifs were selected by evolution (and are thus overrepresented in the network) to perform elementary regulatory functions. Among these motifs one of the most interesting is the mirna-mediated feedforward loop (FFL) in which a master TF regulates a mirna and, together with it, a set of target genes (see Figure 1). This motif, which shall be the main interest of our paper, was recently discussed in [11 13]. In all these papers, despite the fact that the authors used very different computational approaches, the FFL was shown to be remarkably overrepresented in the network, thus supporting the idea that it should play an important regulatory role. Depending on the sign of the transcriptional regulations, FFLs can be divided into two classes: coherent and incoherent [11,13,15]. In the coherent FFLs both pathways from the TF to the target have the same effect (both repressing or activating target expression), while in the incoherent ones the two pathways have opposite effects. Correspondingly one finds different expression patterns in the two cases: coexpression of mirna and its target for incoherent FFLs and mutually exclusive expression for the coherent ones (Figure 1). This dual picture allows to better understand the complex patterns of correlated expression of mirnas and their targets observed in experiments [1, 13, 16]. In many cases the targets show low expression in mirna-expressing cells, suggesting coherent regulation. On the other hand, several other cases present an opposite trend, showing that mirna repression can act in opposition to transcriptional regulation. Indeed, different degrees of expression overlap, due to different regulatory circuitries, have been related to different mirna functions in several recent papers [1, 3, 4, 15, 17]. For example, in a coherent FFL as the one in Figure 1D, the mirna expression is induced by an upstream TF that at the same time represses the target transcription, with the effect of enforcing mutually exclusive domains of expression as the ones observed in the fruit fly [18] or for mir-196 and its target Hoxb8 in mouse [19] and chicken [20]. In this cases the mirna can help the transcriptional repression of a target protein that should not be expressed in a particular cell type, acting as a post-transcriptional failsafe control. Instead, an incoherent FFL (Figure 1C) can promote high target expression in mirna-expressing cells, suggesting that mirnas may have in this case a fine-tuning function, keeping the protein level in the correct functional range. A typical example is the regulation of the atrophin gene by the mirna mir-8 in Drosophila. It was shown [21] that both a too high and a too low level of expression of the atrophin gene could be detrimental for the organism and that mir-8 is mandatory to keep the expression level exactly in the correct range. It is by now well understood that gene espression is inherently a stochastic process [22 24]. This has particularly relevant effects when the number of proteins and/or messenger RNAs (mrnas) involved is small and stochastic fluctuations may give sizeable deviations from the mean value of the final protein product. Thus, the question that naturally arises is how the cell can reconcile the fine-tuning function described above with these fluctuations. If there is only a relatively narrow protein level which is optimal, the tuning regulation must also prevent protein fluctuations outside the functional range. In fact, it has been conjectured that the incoherent FFLs that enable tuning interaction, can also have a role in buffering noise in the target expression [13, 15, 25].

3 3 The main goal of our paper is to introduce and solve analytically a stochastic model describing these incoherent FFLs in order to give a proof to this conjecture. Our results show that with respect to the simple gene activation by a TF, the introduction of a mirna-mediated repressing pathway can significantly dampen fluctuations in the target protein output for essentially all the choices of input parameters and initial conditions. As a test of our analysis we also performed extensive numerical simulations which nicely agree with our analytical results. It is important to stress (and we shall discuss this issue in detail in the following) that this noise buffering function is actually a precise consequence of the peculiar topolgy of the FFL. In fact, in order to fine-tune the level of a target protein one would not necessarily need a FFL topology. The same result could well be obtained with an independent mirna (not under the control of the master TF which activates the target), but this choice would lead to strong fluctuations in the target expression. In the same theoretical framework we can show that the construction of an optimal noise filter does not necessarily imply a strong repression, in agreement with the observation that the mirna down-regulation of a target is often modest [26, 27]. Results The theoretical framework Here we focus on the incoherent FFL in Figure 2A to present our modeling strategy. For each gene in the circuit we take into account the essential features of transcription, translation, degradation and interactions between genes in the regulatory network (detailed scheme in Figure 2A ). Accordingly, the state of the system is described by five variables (w, q, s, r, p) representing: w the number of mrnas transcribed from the TF gene, q the number of TF molecules, s the number of mirnas, r the number of mrnas transcribed from the target gene and p the number of target proteins. We want to explore the mean (< x i >) and the standard deviation ( σ xi ) of each molecular species x i (w, q, s, r, p) and we will show that these quantities can be obtained analitically at the steady-state. The noise strength of the species x i will be expressed by the coefficient of variation defined as CV xi = σ xi / < x i >. As usual in this type of models, transcriptional activation is introduced by choosing the rate of transcription of the regulated gene (k s (q), k r (q) in our case) as a nonlinear increasing function of the number of TFs (q) present in the cell [28 31]: k r (q) = k s (q) = k r q c h c r + q c k s q c h c s + q c, (1) where h r and h s are dissociation constants, specifying the amount of TFs at which the transcription rate is half of its maximum value (k r and k s respectively). c is the Hill coefficient and fixes the steepness of the activation curve. The mirna action can direct translational repression or destabilization of target mrnas [32], i.e. it decreases the rate of translation or increases the rate of degradation of target mrnas. We choose to model the effect of mirna regulation by taking the translation rate of the target (k p (s)) to be a repressive Hill function of the number of mirnas (s): k p k p (s) = 1 + ( s. (2) h )c The parameter h specifies the quantity of mirnas that determines a rate of translation k p /2, and c is again the Hill coefficient. For simplicity we use the same Hill coefficient c for each Hill function, but the analysis can be straigthforwardly generalized to the case of different steepnesses.

4 4 The alternative choice of a degradation rate of mrnas as a function of mirna concentration does not yield significantly different results, as reported in Text S1. The use of Hill functions to model regulations by mirnas is coherent with their established catalytic action in animals [33]. A stoichiometric model has been studied in the context of srna regulation in bacteria [34 36], in which each srna can pair with one messenger and drive its sequestration or degradation in an irreversible fashion. A comparison with a possible stoichiometric action is shown in Text S1. The probability of finding in our cell exactly (w, q, s, r, p) molecules at time t satisfies the master equation: t P w,q,s,r,p = k w (P w 1,q,s,r,p P w,q,s,r,p ) + k q w(p w,q 1,s,r,p P w,q,s,r,p ) +k r (q)(p w,q,s,r 1,p P w,q,s,r,p ) + k s (q)(p w,q,s 1,r,p P w,q,s,r,p ) +k p (s)r(p w,q,s,r,p 1 P w,q,s,r,p ) + g w [ (w + 1)P w+1,q,s,r,p wp w,q,s,r,p ] +g q [ (q + 1)P w,q+1,s,r,p qp w,q,s,r,p ] + g r [ (r + 1)P w,q,s,r+1,p rp w,q,s,r,p ] +g s [ (s + 1)P w,q,s+1,r,p sp w,q,s,r,p ] + g p [ (p + 1)P w,q,s,r,p+1 pp w,q,s,r,p ], (3) where k w, k r (q), k s (q) are transcription rates, k q, k p (s) are translation rates, and g xi represents the degradation rate of the species x i. In order to solve the master equation for < x i > and σ xi for all x i (w, q, s, r, p) at the steady state we have to linearize Hill functions. This is by now a standard procedure [29, 30]. The idea is that at the steady state the distributions of regulators (TFs or mirnas) have a finite wih and sample only small regions of the domains of the corresponding Hill functions. We may therefore approximate Hill functions by their linearizations around the mean values of the regulators q or s (see Text S1 for details of the linearization), ending up with: k r (q) k 0 r + k 1 rq k s (q) k 0 s + k 1 sq k p (s) k 0 p k 1 ps. (4) We would like to emphasize that linearizing the Hill functions does not mean to linearize the model. In fact, even with a linearized dependence on the mirna copy number, our model keeps a nonlinear contribution in the term encoding the target translation (due to the fact that it depends on both the number of mirnas and mrnas). As we will see later, this nonlinearity leads to non trivial consequences. Despite this nonlinearity, the moment generating function approach [29, 30, 37] can be succesfully used. By defining the generating function: F (z 1, z 2, z 3, z 4, z 5 ) = z1 w z q 2 zs 3 z4 r z p 5 P w,q,s,r,p, (5) w,q,s,r,p and using the linearization in equation 4 we can convert equation 3 into a second-order partial differential equation: t F = k w (z 1 F F ) + k q z 1 (z 2 z1 F z1 F ) + kr(z 0 4 F F ) +krz 1 2 (z 4 z2 F z2 F ) + ks(z 0 3 F F ) + ksz 1 2 (z 3 z2 F z2 F ) +kpz 0 4 (z 5 z4 F z4 F ) kpz 1 3 z 4 (z 5 z3,z 4 F z3,z 4 F ) +g w ( z1 F z 1 z1 F ) + g q ( z2 F z 2 z2 F ) + g s ( z3 F z 3 z3 F ) +g r ( z4 F z 4 z4 F ) + g p ( z5 F z 5 z5 F ). (6)

5 5 We now use the following properties of the moment generating function: F 1 = 1; zi F =< x i >; z 2 i F =< x 2 i > < x i > where 1 means evaluation of F at x i = 1 for all i. At the steady state ( t F = 0) differentiation of equation 6 generates equations for successively higher moments. In particular, we are interested in < p > and σ p and differentiating up to the fourth moments leads to their analytical expressions (see Text S1 for details of the calculation). Noise in protein expression is originated by the combination of two types of fluctuations: intrinsic and extrinsic ones. Intrinsic fluctuations are essentially due to the stochasticity of the gene expression process. Extrinsic ones, instead, are due to the environment. In the latter case a prominent role is played by the noise transmitted by upstream genes [38,39]. As a matter of fact there is a certain degree of arbitrariness in the definition of extrinsic and intrinsic noise [40]. Since we focus on the target production we define intrinsic the noise derived from the stochastic steps of its expression (transcription, translation and degradation) and extrinsic the noise propagating from its regulators (s, q) that makes the parameters (k r (q), k p (s)) fluctuate through the Hill functions. Therefore in our model we do not have to include extrinsic noise with an arbitrary distribution as it naturally arises from the stochastic steps of production of regulators and propagates to the target gene. Comparison with a TF transcriptional control To show the noise buffering role of the mirna-mediated incoherent FFL (Figure 2A) we first compare it to a simpler process: a gene activated by a TF (Figure 2B), without any post-transcriptional regulation. The strategy used to model this linear network is equivalent to the one explained in the previous section for the FFL (see Text S1 for more details) and it is presented schematically in Figure 2B. Starting from a gene activated by a TF, in principle the gain of a new regulator implies also a new source of extrinsic noise for the target, given that the fluctuations in the number of regulators propagate to downstream genes and, as discussed in [41], the addition of extrinsic fluctuations generally increases the noise of a system. However, the peculiar structure of the FFL can overcome this problem, actually reducing noise, as was previously shown in the case of negative transcriptional auto-regulation [42]. Given that the two circuits lead to different mean values, the comparison of noise strengths in target protein will be done in terms of the coefficient of variation (CV p = σ p / < p >). With the parameter choice explained in the caption of Figure 3, the predicted CV p are and 0.1 for the TF-gene cascade and the FFL respectively. Therefore the introduction of the mirna pathway not only controls the mean value but also reduces the relative fluctuations. This effect can be clearly seen looking at the shape of the probability distributions in Figure 3C. It is rather easy to understand the origin of this noise buffering effect: any fluctuation in the concentration of TFs affects the rate of mrna transcription, driving consequently the target protein away from its steady state, but mrna and mirna concentrations tend to vary in the same direction in the FFL. In this way, mirnas can always tune the protein production against TF fluctuations. As can be seen in Figure 3A and B, there is a certain degree of correlation in the time evolution of q, r, p due to noise propagation, despite the overimposed higher-frequency intrinsic noise of each molecular species, but in the case of the FFL the p trajectory is less sensitive to q fluctuations thanks to the action of mirnas (s). It is important to stress that this result is not affected by the Hill function linearization discussed above. In fact, the predictions of the model are in good agreement with Gillespie simulations (which keep into account the full nonlinear repressing and activating Hill functions). Moreover our results turn out to be robust with respect to parameter choice, showing a rather stable noise reduction essentially for any choice of expression and degradation constants (see Text S1 for details). Comparison with an open regulatory circuit The same fine-tuning of the mean target concentration achieved with a FFL could be equally obtained with an open circuit like the one in Figure 2C, where the mirna gene is controlled by an independent TF. If the two TFs, activating the mirna and target gene expression, have the same rate of transcription,

6 6 translation and degradation of the single master TF in the FFL -as well as the other model parameters as in Figure 2A and C - the stationary mean levels of the various molecular species are the same in both circuits. In particular, the mean concentration of the target protein can be fine-tuned to the same desired value by both circuits. However, while the deterministic description at the steady state is the same in the two cases (see Text S1 for details) the behaviour of fluctuations is completely different. As we shall see below, the open circuit leads to much larger fluctuations in the final product than the FFL. It is well possible that this is the reason for which FFLs have been positively selected by evolution and are presently overrepresented in the mixed TF-miRNA regulatory network. In fact, fine-tuning can be implemented advantageously only together with a fluctuation control: a precise setting of the mean value of a target protein is useless without a simultaneous damping of the stochastic fluctuations. To assess this result we used the same strategy discussed above: we solved analitically for both circuits the master equation and tested our results with a set of Gillespie simulations. Our results are shown in Figure 4: the lack of correlation between the mirna and mrna trajectories in the open circuit (Figure 4B) leads to much larger deviations from the mean number of proteins with respect to the FFL case. Using the same parameter values of Figure 3, the predicted CV p for the open circuit is CV p = 0.175, to be compared with the value CV p = 0.1 of the FFL. Different cell-to-cell variability can be clearly seen comparing the distributions of the number of target proteins for the two circuits (Figure 4C). Note that a target embedded in an open circuit has an even more noisy expression than a gene simply regulated by a TF, for which CV p = Deviant effects Stochastic equations are the natural formalism to describe a set of biochemical reactions when the number of molecules involved is small and thus fluctuations are important. As the number of molecules increases, the stochastic description smoothly converges, at least for linear systems, toward a deterministic one and stochastic equations can be substituited by ordinary differential equations (ODE). It is usually expected that even in the regime in which fluctuations cannot be neglected one could use ODE if interested only in the time evolution of the mean values. This approximation can be thought as a sort of mean field approach (by analogy with statistical mechanics where the mean field approximation is implemented by neglecting fluctuations). However, similarly to what happens in statistical mechanics in the proximity of a critical point, it may happen that, even at the level of mean values, the ODE description does not coincide with the (more rigorous) stochastic one. These breakdowns between the two descriptions are known as deviant effects [43] and are typically a consequence of nonlinear terms in the equations or of strong extrinsic fluctuations [41, 44]. In some cases these deviant effects can have relevant phenomenological consequences. This is the case of our system: although the FFL (Figure 2A,A ) and the open circuit (Figure 2C,C ) have the same deterministic description at the steady state (see Text S1 for details), the master equation approach gives a mean value of the target protein systematically lower in the FFL circuit, with respect to the same quantity in the open circuit. This is a non trivial consequence of the correlated fluctuations in the number of mrnas and mirnas in the FFL. This correlation between fluctuations obviously cannot be taken into account in the deterministic description and as a consequence the ODE analysis correctly describes the steady state mean number of target proteins only for the open circuit. This result can be understood by looking at the analytical expression of the mean value of p: < p >= k 0 p < r > k 1 p < rs >. (7) In a FFL, fluctuations of r and s are highly correlated (Figure 3A), because the transcription rates of messengers and mirnas depend on a shared TF. The result is that in this case < rs > > < r >< s >. On the other hand, the production of s and r is independently regulated in an open circuit, implying that < rs > < r >< s >. A deterministic description does not take into account fluctuations so correctly describes < p > only when uncorrelated noise is averaged out without affecting mean values. In conclusion, the correlation in fluctuations introduced by the FFL topology affects the target protein

7 7 mean value, establishing a systematic decrease with respect to the deterministic description. This deviant effect can be substantial and underlines the necessity of a stochastic nonlinear modeling. A fully linearized description, as for example the one proposed by [29] for post-transcriptional regulation, would not be able to show this type of effects. The incoherent feedforward loop is effective in reducing extrinsic fluctuations In the previous sections we compared different regulatory circuits keeping the same amount of input noise, i.e. the same amount of fluctuations in the copy number of master TFs. Since the topology of a regulatory motif can have stronger effects on extrinsic rather than intrinsic noise [41], it would be very interesting to study how the mixed incoherent FFL behaves as a function of such extrinsic noise. As a matter of fact extrinsic and intrinsic fluctuations are generally coupled in a non-trivial way in biochemical networks [45], but we developed a strategy to control fluctuations in upstream TF expression, known to be one of the major sources of extrinsic noise in eukaryotes [39], without affecting the copy number of the molecular species in the circuit. From equation 6 we can calculate < q > (which denotes the mean number of TFs) and its noise strength CV q : < q > = k qk w g q g w CV q = 1 < q > < q > g q + g w + k q g q + g w, (8) where, as above, the parameters k w and k q denote the rate of transcription and translation of the TF respectively, and g w and g q the corresponding degradation constants. Setting the rates of degradation (k q and k w ) and the product k w k q to constant values, we end up with: < q > constant and CV q k q. This is a well known result: fluctuations in the protein level are stronger when the rate of translation is higher [23] and can be tuned (while keeping the mean value < q > fixed) by changing the ratio k w /k q with k w k q = constant. This represents a perfect theoretical setting to test the dependence of the target noise CV p on the input noise CV q, while maintaining unchanged the mean value of all the molecular species involved in the circuit. We report in Figure 5 the results of such analysis for the three circuits discussed in the previous sections. While extrinsic fluctuations increase, so does the FFL s performance in filtering out noise, compared to the other circuits. Once again it is easy to understand the reason of this behaviour: the FFL architecture channels fluctuations of an upstream factor into parameters with opposite effect on the target protein, forcing them to combine destructively. Therefore the specific FFL topology seems effective in the maintenance of gene expression robustness despite noisy upstream regulators. The introduction of a mirna pathway, building a FFL from a TF-gene cascade, really makes the difference in situations of strong upstream noise. This feature can explain why mirnas can often be deleted without observable consequences [25], since experiments usually do not measure fluctuations and are typically performed in controlled environments, where noise is kept at minimal levels. Noise filtering optimization The efficiency of the FFL in controlling the fluctuations of the target protein is a function of three main parameters: the number of master TFs (which in turn is a function of k w and k q ), the number of mirna copies (function of k s and h s ) and the strength of mirna repression (defined as 1/h). In this section we shall study the efficiency of the FFL in buffering noise as a function of each one of these three quantities, changing a corresponding parameter while keeping fixed all others. As we shall see, in all three cases

8 8 the noise reduction with respect to a simple TF-target interaction (i.e. without the mirna) shows a U- shaped profile with a well defined minimum which allows us to identify the values of the parameters which optimize the noise reduction property of the FFL. This pattern is rather robust, and only marginally depends on the way the variable of interest is tuned (for instance, by changing k s or h s in the case of mirna concentration). It is important to stress that in all three cases optimal noise filtering does not imply strong repression, a result which well agrees with the observation that mirnas embedded in an incoherent FFL usually have a fine-tuning effect on the targets instead of switching them off completely. It is exactly in the intermediate region of the parameters, in which fine-tuning occurs, that we also have optimal noise reduction. Optimal repression strength The repression strength is defined as 1/h (inverse of the dissociation constant in the Hill function of equation 2). As it can be seen in Figure 6A, the FFL exhibits a noise profile with a typical U-shape and reaches an optimal value of noise reduction (measured as the difference in the noise strength CV p with respect to the simple TF-gene circuit) for intermediate values of repression strength. The open circuit, constrained to give the same mean value < p >, always introduces larger target fluctuations. As mentioned above, optimal noise filtering is reached for intermediate values of the repression strength and does not require strong target repression. For instance with the choice of parameter values of Figure 6, optimal noise reduction is obtained for a mean value of the target protein which is about 66% of the value obtained without the mirna, i.e. with a simple TF-target interaction. This prediction could be experimentally tested via manipulation of the repression strength, in analogy to the work of [46] on the transcriptional autoregulatory motif. It is instructive to notice the analogies between the behaviour of the mixed FFL and that of the negative transcriptional autoregulation loop. This purely transcriptional network motif occurs ubiquitously in transcriptional regulatory networks and was recently studied in great detail [41, 47]. Also in this case, optimal noise filtering is obtained for a well defined value of the repression stength. It is easy to understand the reason of this behaviour. In a negative transcriptional autoregulation, the protein expressed from a gene inhibits its own transcription by increasing expression when protein numbers are low, while decreasing expression when protein numbers are high. Increasing the repression strength improves the circuit potential to reduce stochasticity, but at the same time decreases the copy number of mrnas and proteins, with a rise in intrinsic fluctuations that can overcome any attenuation. Consistently, experiments show a well defined range of repression strength for which noise minimization is optimal [46]. Optimal mirna concentration Another variable which can be tuned in order to achieve optimal noise reduction is the mirna concentration. If we keep the number of TFs constant then the mirna concentration < s > can only depend on the maximum rate of transcription of the mirna gene (k s ) and on the affinity of its promoter to the TF (proportional to 1/h s, where h s is the dissociation constant in equation 1). In Figures 6B and 6C we analyze the noise strength CV p of the target protein in the FFL for different mirna concentrations and compare it to the CV p obtained with the simple TF-gene interaction and with the open circuit. Changing the mirna concentration by varying k s (Figure 6B) or h s (Figure 6C) we find very similar U-shaped profiles for CV p. As for the previous analysis, also in this case it is possible to find an optimal mirna concentration, and again it is such that the effect on the protein target is only a modest reduction (in this case 60% of the value obtained without the mirna). Apart from the conserved U-shaped profile, there are rather deep differences in the noise behaviour depending on the choice of the tuning parameter. In fact, while an increase of k s always induces an increase of < s >, this quantity becomes insensitive to h s above a certain threshold. Since the number of TFs is constant in this analysis, it is clear that increasing 1/h s (Figure 6C) the system can reach at best the value of < s > consistent with the maxi-

9 9 mum rate of transcription. At the same time a large value of 1/h s means that very few TFs are enough to support the maximum transcription rate for the mirna gene, so fluctuations in the number of TFs become irrelevant despite the topology of the circuit. As a consequence the CV p curves for the FFL and the open circuit converge to a commom value (Figure 6C). A refined experimental control of mirna concentration through graded mirna overexpression or silencing would permit a test of the U-shaped profile of CV p in a FFL. Optimal TF concentration The last case that we consider in this section is the effect of different TF concentrations on the noise buffering properties of the FFL. It is expected that for high TF concentrations (i.e. high values of < q >) the activation functions in equations 1 reach the saturation point, making the system insensitive to variations in TF concentration. As long as the number of TFs does not fluctuates below the saturation point, the mirna and the target gene are maximally transcribed, with no reference to the exact number of TFs. Accordingly, CV p becomes asymptotically constant for large < q > for each circuit topology (Figure 6D). The gap between the asymptotic values of the direct TF regulation and the two other circuits is due to the fact that the former does not suffer for the additional external noise due to the fluctuations in the mirna number. On the other hand, for small values of < q > also the number of target proteins is very small as its expression is hardly activated regardless of the circuit type, with a consequent increase of the noise strength (Figure 6D). The central region is the most interesting one: this is the region in which the system is maximally sensitive to changes in TF concentration. In this regime the FFL outperforms both the simple direct regulation and the open circuit in buffering noise. Also in this case the optimal TF concentration is placed in a region corresponding to a modest reduction of < p >, despite the mirna repression. Exploring the parameter space To give a more comprehensive insight into the relation between noise control and target repression, we finally evaluate the buffering of fluctuations ( CV p /CV p0 ) for each average number of TFs < q > and each degree of target suppression (< p > / < p 0 >), where < p 0 > and CV p0 represent here the constitutive mean expression and fluctuations in absence of mirna regulation. Results of this analysis are reported in Figure 7A. As discussed above, noise reduction can be implemented successfully in the parameter region where the target activation function (in Figure 7B) is not saturated, since this is the region where the target is sensitive to changes in TF concentration and therefore also to its fluctuations, regardless of the presence or absence of mirna regulation. It is exactly in this region that noise buffering can be observed (compare Figures 7A and B). In particular, for each TF concentration the best noise reduction appears for a target level around 60% of its constitutive expression. In the optimal setting, noise can be remarkably reduced to about one half of its constitutive value, but the reduction remains substantial also for weaker repressions, further confirming that a strong mirna repression is not required for noise control. We consider the characterization of the optimal setting of mirna-mediated incoherent FFLs for noise buffering, and the resulting U-shaped profile predicted for the noise reduction factor, as one of the major results of our analysis which, we expect, should be amenable of direct experimental validation. The fact that an optimal noise filtering is obtained with a rather modest reduction in the amount of the target protein also agrees with the recent experimental observation that mirna down-regulation of targets is often modest [26, 27] and apparently dispensable from a functional point of view. In this respect it is tempting to conjecture that, at least for some targets of incoherent FFLs, the down-regulation could only be the side effect of an evolutionary design aiming instead to optimize noise reduction.

10 10 Comparison with purely transcriptional incoherent feedforward loops The capability of incoherent FFLs to reduce fluctuations was previously studied with simulations in the contest of purely transcriptional networks [41]. In this section we present a comparison of the noise properties of microrna-mediated FFLs (scheme in Figure 1A ) and purely transcriptional ones (detailed scheme of reactions in Figure 8A), where the mirna is replaced by a protein that inhibits transcription (rather than translation, as mirnas do). The transcriptional FFL can be modeled with the same strategy explained previously for the mirna-mediated version and analogously mean values and standard deviations of the various molecular species can be calculated analytically with the moment generating function method (see Text S1 for more details on calculations and model assumptions). In order to make an unbiased comparison of the noise properties of these two circuits, the corresponding models must be constrained to produce the same amount of target proteins. Although there is no unambiguous way to put this constraint, due to the presence of more free parameters (k j and g j ) in the purely transcriptional case, a reasonable choice is to keep the shared parameters to same values (i.e repression/activation efficiencies and production/degradation rates) and choose the two additional ones to make the amount of repressor proteins j in the transcriptional case equal to the amount of mirnas s in the mixed circuit. With this choice we can evaluate the target noise CV p as a function of the repression strength (1/h) for both circuits (Figure 8B). Even though the transcriptional version can potentially reduce target fluctutions, buffering efficiency appears clearly increased by the use of mirnas as regulators. Furthermore, a comparison of Figure 8C and Figure 7B points out that a mirna-mediated FFL can buffer fluctuations over a wider range of conditions as well as to a greater extent. This is mainly due to the additional step of translation required for the production of proteins j which unavoidably adds noise to the system. We would like to emphasize that the shown efficiency in noise reduction, achieved with the transcriptional FFL, should be considered as an upper bound. In fact, the constraints imposed on k j and g j limit the translational burst size, i.e. the average number of proteins produced from a single mrna, and this parameter crucially influences the intrinsic fluctuation amplitude of proteins j [22] (see Text S1 for details on parameter constraints). With the parameter values used in Figure 8, the translational burst size is 0.3, while in eukaryotes it is expected to be larger (certainly larger than one) because of the long average half-life of messenger RNAs compared to the time required for one translation round [48]. Therefore the noise added by the step of translation of proteins j should realistically be more substantial than reported for this model setting, with harmful consequences on the noise buffering efficiency of the purely transcriptional circuit. Moreover some peculiarities (not currently included in our model) of the mixed-motif can further explain why it can be better suited for noise buffering. Firstly, fluctuations in RNA polymerase and ribosome abundance are possible sources of extrinsic noise in gene expression [49]. These fluctuations are expected to influence unspecifically the rate of transcription and translation respectively of each gene. In a mirnamediated FFL the correlation between target mrna and mirna production, which is crucial for noise reduction, is robust to these additional sources of noise as mrnas and mirnas are identically affected only by global RNA polymerase fluctuations. On the other hand, in purely transcriptional FFLs the number of repressor proteins j is exposed to the independent fluctuations in ribosome concentration, so the regulator-regulated correlation can be compromised with potentially negative consequences on the circuit s noise reduction efficiency. Secondly, delays in the action of regulators (mirna or proteins) in the indirect pathway from the master TF to the target can damage the noise buffering function (see Text S1 for a more detailed study of the impact of time delays on noise control). However, the biogenesis of mirnas is thougth to be faster than the one of proteins, and thus mirnas may affect the target expression with a shorter delay with respect to factors regulating nuclear events like a TF [50]. This feature should enable mirnas to produce rapid responses, as required to counteract fluctuations. Finally, the presence of a nucleus makes the eukaryotic cell a two-compartment system with stochastic transport channels, with consequences on gene expression noise [51]. In fact, transcriptional regulation

11 11 requires an additional transport step with respect to the post-transcriptional one. In a transcriptional FFL, the repressor protein (replacing the mirna) must return into the nucleus to act on the target. This again potentially reduces the correlation of its fluctuations with the target ones, affecting the noise buffering ability. Cross-talk between microrna targets A recent study pointed out that the action of a mirna on a specific target gene expression is affected by the total number of mirna targets and their mrna abundance [52], a phenomenon called dilution effect. This is presumably a consequence of target competition for a finite intracellular pool of mirnas. In particular, the degree of downregulation of an individual target expression is generally reduced by the presence of other transcribed target genes. A similar cross-talk between targets has been previously shown for srna regulation in bacteria [34] both theoretically and experimentally. Therefore, the functionality of a genetic circuit that involves mirna regulations, as the one studied in this paper, can be influenced by the expression level of mirna targets not embedded in the circuit. To address this issue we evaluate in this section the impact of an additional mirna target independently transcribed (a situation depicted in Figure 9A) on the circuit ability in noise buffering. Stoichiometric versus catalytic models of mirna action The model used so far for mirna regulation was based on the hypothesis of perfectly catalytic action. The rate of translation of target mrnas was assumed to be a nonlinear decreasing function of mirna concentration, neglecting the details of mrna-mirna physical coupling with the implicit assumption that the downregulation process does not affect the available mirna pool. A perfectly catalytic action does not predict any competition effect among multiple targets at equilibrium, since each target can only sense the available number of mirnas without altering it. On the other hand, a stoichiometric model has been proposed in the context of srna regulation in bacteria [34 36], in which each srna can pair with one messenger leading to mutual degradation. In this latter case the expression of a secondary target can capture a significant portion of the srnas, with a resulting decrease in the average repression acting on the first target. The nature of mirna regulation is presumably somewhere in between these two extreme possibilities, although usually generically referred to as catalytic. In this view, in order to address the effect of target cross-talk on mirna-mediated FFLs, we consider a deterministic model (introduced previously in [34]) that explicitely takes into account the physical coupling of mirnas and target mrnas and the catalytic/stoichiometric nature of this coupling. While the full detailed model is presented in Text S1, the effective equations describing the dynamics of the mean number of mirnas < s >, mrnas < r > of the target in the FFL and mrnas < r 2 > of the secondary mirna target are: d< s > d< r > d< r 2 > = k s (< q >) g s < s > α (γ 1 < r >< s > + γ 2 < r 2 >< s >) = k r (< q >) g r < r > γ 1 < r >< s > = k r2 g r2 < r 2 > γ 2 < r 2 >< s >, (9) where γ 1 and γ 2 describe the probability of mirna-mrna coupling for the target in the FFL and the secondary target respectively, while α is the probability (assumed equal for both targets) that a degradation event of a mrna, induced by a mirna, is accompained by the degradation of the mirna itself. The limit α = 1 describes a stoichiometric mode of action, while the opposite situation of α = 0 represents a perfectly catalytic mode in which the rate of mrna degradation is a linear function of the number of mirnas.

12 12 The corresponding stochastic model, of which equations 9 describe the mean-field limit, cannot be solved analytically starting from the master equation, therefore noise properties will be examined in the following with simulations only. Dilution effect In the first place we evaluate the dependence of the target protein downregulation on the expression rate of the secondary target, starting from the model described by Equations 9. The dilution effect is shown in Figure 9B for different values of α: the downregulation exerted on the FFL target depends on the rate of expression of the secondary target, in line with the observed inverse correlation between target abundance and mean downregulation in higher eukaryotes [52] and in bacteria [34]. Similar results can be obtained by varying the coupling constant γ 2 with respect to γ 1 (as reported in [34]). Therefore, the noise buffering function and the optimality criteria discussed in previous sections could be compromised in the presence of many or highly transcribed independent mirna targets. This issue will be addressed in details in the following section. As expected, a perfectly catalytic mode does not feel the effect of secondary mrna targets (red line in Figure 9B), while the stoichiometric mechanism is the most sensitive (green line in Figure 9B). This result suggests that a catalytic mode (at least approximately), like the mirna one, can allow a larger proliferation of the number of targets while limiting the effects of their cross-talk. Consequences of dilution effect and secondary target fluctuations on noise buffering Since a high level of expression of secondary targets can determine a decrease of the average downregulation, it can potentially reduce the FFL ability in filtering out target fluctuations. In fact, also the noise reduction CV p /CV p0 (where CV p0 is the constitutive noise in absence of mirna) is a function of the additional target expression, as shown in Figure 9C. As the expression of the out-of-circuit target increases, its messengers are able to capture more and more mirnas and the efficiency in noise reduction is gradually compromised. Finally the FFL target fluctuations CV p approach the constitutive ones CV p0 when the messengers of the FFL target become a small fraction of the total mirna targets. The robustness of the circuit functioning with respect to the dilution effect is again dependent on the repression mode (that changes with α). Moreover, as discussed in Text S1, different modes (stoichiometric/catalytic) of mirna action have a different potential in reducing fluctuations: even in absence of secondary targets, where models with different α have been constrained to produce the same amount of target protein, the noise buffering efficiency decreases with α (Figure 9C). This observation highlights that the level of mirna ability to avoid mutual degradation while targeting a mrna can play a role in the optimization of fluctuation counteracting, besides conferring stability with respect to target cross-talk. While the corruption of the noise-buffering ability seems mainly due to the increase in the mean level of secondary messengers, there is another more subtle cause that gives a contribution: the uncorrelated fluctuations of secondary messengers. Since the secondary target is independently transcribed (not under the control of the master TF activating the mirna gene) its fluctuations are expected to be completely uncorrelated with the mirna ones, implying a random sequestration of mirnas. To disentagle this contribution from the dilution effect, we studied the case of a secondary target transcribed at the same effective rate of the FFL target, but with different levels of fluctuations (see Figure 9D). In the case of equal transcription rates the dilution effect has a negligible impact on the noise buffering activity of the circuit (see Figure 9C), nevertheless the level of noise reduction (CV p /CV p0 ) is progressively reduced as the second target concentration becomes more and more noisy, as reported in Figure 9D. This effect seems especially relevant for a hypothetically stoichiometric mirna repression. Therefore, the noise level of additional targets is a variable that must be taken into account in evaluating the cross-talk effect on the noise-buffering efficiency of the circuit. Although the FFLs are overrepresented in the mixed network [11 14], a single micrornas can downregulate hundreds of target genes and consequently not every

13 13 target is expected to be under the control of the same TF regulating the mirna gene (see Text S1 for a more detailed discussion). Therefore, even though most motif function analysis are carried out looking at the motif operating in isolation, we have shown that the presence of additional mirna targets in the network can alter the functioning of a mirna-mediated motif. In fact, the efficiency of mirna-mediated FFLs as noise controllers should be considered contest-dependent. While this circuit seems properly designed to filter out fluctuations when the mirna-target interaction is specific or secondary targets are poorly transcribed, cell types or conditions that require a high expression of out-of-circuit mirna targets can significantly corrupt this circuit property. Besides the understanding of the function of endogenous mirna-mediated FFLs, this analysis of target cross-talk effects can be a useful warning for the growing field of synthetic biology [53]: the implementation of genetic circuits incorporating small RNA regulations for specific scopes must take into account the srna specificity and the level of expression (and fluctuations) of eventual other targets. Discussion Experimental and bioinformatic evidences of the relevance of mirna mediated FFLs in gene regulation. Few cases of incoherent mirna-mediated FFLs have been experimentally verified until now: a case involving c-myc/e2f1 regulation [54] and more recently a mir-7 mediated FFL in Drosophila [50]. As a matter of fact, mir-7 has indeed been found to be essential to buffer external fluctuations, providing robustness to the eye developmental program. The fact that mir-7 is interlocked in an incoherent FFL provides a first hint that our model can be biologically relevant. On the purely computational side, it is interesting to notice that in [11] it was shown that the typical targets of these FFLs are not randomly distributed but are instead remarkably enriched in TFs. These are the typical genes for which a control of stochastic fluctuations should be expected: the noise in a regulator expression propagates to all its targets, affecting the reliability of signal transmission in the downstream network. Finally, a significant enrichment in oncogenes within the components of the FFLs was also observed [11]. The mentioned FFL containing c-myc/e2f1 is just an example [8]. In view of the emerging idea that non-genetic heterogenetity, due to stochastic noise, contributes to tumor progression [55] and affects apoptotic signal response [56], the role of mirna-mediated FFLs in reducing fluctuations can explain why they are often involved in cancer-related pathways. Concluding remarks The type of regulatory action which a mirna exerts on its targets can be rather well understood looking at the degree of coexpression with the targets [1, 3, 4, 15, 17]. In particular, an incoherent mixed-ffl implies a high level of mirna-target coexpression, so it is suitable to implement a fine-tuning interaction. The target is not switched off by mirna repression, rather its mean level is adjusted post-transcriptionally to the desired value. However, many cells can have a protein concentration far from the finely controlled mean value, if strong fluctuations are allowed. Hence, a noise buffering mechanism can be crucial at the level of single cells, and a fine-tuning interaction will be effective for a large part of the cell population only if coupled with a noise control. Some authors proposed the conjecture that the incoherent mixed- FFL can actually have a role in noise buffering [13, 15, 25] and biological evidences that mirnas can effectively be used as expression-buffers have been recently found [25, 50]. From this point of view the mirna-target interactions classified as neutral [17], as the mean level of the target only changes inside its functional range by the presence/absence of mirnas, actually could have been selected by evolution to prevent potentially harmful fluctuations. In this paper we demonstrated, through stochastic modeling and

14 14 simulations, that the incoherent mixed-ffl has the right characteristics to reduce fluctuations, giving a proof to the previously proposed intuitive conjecture and supplying the lacking quantitative description. In particular, we showed that this circuit filters out the noise that is propagating from the master TF, giving robustness to the target gene expression in presence of noisy upstream factors. Furthermore, our theoretical description led to the prediction that there is a value of the mirna repression strength for which the noise filtering is optimal. A maximum of target-noise attenuation appears likewise varying the mirna concentration or the TF concentration and this robust prediction could be tested experimentally. In all cases the implementation of the best noise filter does not imply a strong suppression of the target protein expression, coherently with a fine-tuning function and in agreement with the observation that the mirna down-regulation of a target is often modest [26, 27]. Our paper presents the first model explicitly built on the mixed version of the FFL. From a theoretical point of view, we addressed the detailed master equation describing the system (without neglecting the dynamics of mrna), instead of the approximate Langevin description, and we were able to apply the moment generating function approach despite the presence of nonlinear terms that can give rise to deviant effects. This approach allowed us to take into account extrinsic fluctuations as the noise propagating from upstream genes, without an arbitrary definition of the extrinsic noise distribution. This strategy can be naturally extended to other circuits in the mixed network to test their potential role in the control of stochasticity. Furthermore, we compared, in terms of noise buffering ability, mirna-mediated FFLs with their purely transcriptional counterparts, where the mirna is replaced by a protein that inhibits transcription rather than translation. This comparison shows that a mirna regulator can be better suited for the noise buffering purpose. Finally, we tryed to overcome the limitations in the analysis that can arise from considering a genetic circuit as operating in isolation. In this perspective, we evaluated the impact that the recently discovered dilution effect [34, 52] can have on the noise buffering function of mirna-mediated incoherent FFLs. More specifically, we showed than an efficient noise control requires the minimization of the number of mirna target sites on out-of-circuit genes, especially if highly expressed or strongly fluctuating in the mrna level. The hypothesis of a role of mirnas in noise buffering can shed new light on peculiar characteristics of mirna regulation. As discussed in [25] and [50], it can explain why mirnas are often highly conserved, controlling key steps in development, but in many cases they can be deleted with little phenotypic consequences. On the evolutionary side, the origin of vertebrate complexity seems to correspond to the huge expansion of non-coding RNA inventory (including mirnas) [57]. This can suggest a further reasoning: the morphological complexity requires a high degree of signaling precision, with a strict control of stochasticity, and mirna regulation can satisfy these requirements if embedded in an appropriate circuit, as we showed for the ubiquitous mirna-mediated FFL. Methods Simulations were implemented by using Gillespie s first reaction algorithm [58]. The reactions simulated were those presented in schemes 2A,B,C and 8A. Reactions that depend on a regulator were allowed to have as rates the corresponding full nonlinear Hill functions. All the results are at steady state, which is assumed to be reached when the deterministic evolution of the system in analysis is at a distance from the steady state (its asymptotic value) smaller than its 0.05% (see Text S1 for details). For the parameter set used for Figures 3-9 the steady state was assumed at 5000 seconds, around 14 times the protein half-life. Each data point or histogram is the result of trials.

15 15 Acknowledgments We would like to thank Mariama El Baroudi and Antonio Celani for useful discussions. References 1. Flynt AS and Lai EC (2008) Biological principles of microrna-mediated regulation: shared themes amid diversity. Nat Rev Genet 9: Ambros V (2004) The functions of animal micrornas. Nature 431: Bartel DP (2004) MicroRNAs: genomics, biogenesis, mechanism, and function. Cell 116: Bushati N and Cohen SN (2007) microrna functions. Annu Rev Cell Dev Biol 23: Pillai RS, Bhattacharyya SN and Filipowicz W (2007) Repression of protein synthesis by mirnas: how many mechanisms? Trends Cell Biol 17: Stefani G and Slack FJ (2008) Small non-coding RNAs in animal development. Nat Rev Mol Cell Biol 9: Alvarez-Garcia I and Miska E (2005) MicroRNA function in animal development and human disease. Development 132: Esquela-Kerscher A, Slack FJ (2006) Oncomirs- micrornas with a role in cancer. Nat Rev Cancer 6: Martinez NJ and Walhout AJM (2009) The interplay between transcripton factors and micrornas in genome-scale regulatory networks. BioEssays 31: Milo R, Shen-Orr S, Itzkovitz S, Kashtan N, Chklovskii D et al. (2002) Network motifs: simple building blocks of complex networks. Science 303: Re A, Corá D, Taverna D and Caselle M (2009) Genome-wide survey of microrna-transcription factor feed-forward regulatory circuits in human. Mol BioSyst 5: Shalgi R, Lieber D, Oren M and Pilpel Y (2007) Global and local architecture of the mammalian microrna-transcription factor regulatory network. PLoS Comput Biol 3(7): e Tsang J, Zhu J and van Oudenaarden A (2007) MicroRNA-mediated feedback and feedforward loops are recurrent network motifs in mammals. Mol Cell 26: Yu X, lin J, Zack DJ, Mendell JT and Qian J (2008) Analysis of regulatory network topology reveals functionally distinct classes of micrornas. Nucleic Acids Res 36: Hornstein E and Shomron N (2006) Canalization of development by micrornas. Nat Genet 38: S20-S /ng Shkumatava A, Stark A, Sive H and Bartel DP (2009) Coherent but overlapping expression of micrornas and their targets during vertebrate development. GenesDev 23: Bartel DP (2009) MicroRNAs: target recognition and regulatory functions. Cell 136: Stark A, Brennecke J, Bushati N, Russell RB and Cohen SM (2005) Animal micrornas confer robustness to gene expression and have a significant impact on 3 UTR evolution. Cell 123:

16 Mansfield JH, Harfe BD, Nissen R, Obenauer J, Srineel J, et al. (2004) MicroRNA-responsive sensor transgenes uncover hox-like and other developmentally regulated patterns of vertebrate microrna expression. Nat Genet 36: Hornstein E, Mansfield JH, Yekta S, Hu JKH, Harfe BD, et al. (2005) The microrna mir-196 acts upstream of hoxb8 and shh in limb development. Nature 438: Karres JS, Hilgers V, Carrera I, Treisman J and Cohen SM (2007) The conserved microrna mir-8 tunes atrophin levels to prevent neurodegeneration in Drosophila. Cell 131: Kaern M, Elston TC, Blake WJ and Collins JJ (2005) Stochasticity in gene expression: from theories to phenotypes. Nat Rev Genet 6(6): Raj A and van Oudenaarden A (2008) Nature, nurture, or chance: stochastic gene expression and its consequences. Cell 135: Maheshri N and O Shea EK (2007) Living with noisy genes: how cells function reliably with inherent variability in gene expression. Annu Rev Biophys Biomol Struct 36: Wu C, Shen Y and Tang T (2009) Evolution under canalization and the dual roles of micrornas-a hypothesis. Genome Res 19: Baek D, Villen J, Shin C, Camargo FD, Gygi Sp et al. (2008) The impact of micrornas on protein output. Nature 455: Selbach M, Schwanhausser B, Thierfelder N, Fang Z, Khanin R et al. (2008) Widespread changes in protein synthesis induced by micrornas. Nature 455: Alon U (2006) An Introduction to Systems Biology: Design Principles of Biological Circuits. Chapman & Hall/CRC Mathematical & Computational Biology. 320 p. 29. Komorowski M, Miekisz J and Kierzek AM (2009) Translational repression contributes grater noise to gene expression than transcriptional repression. Biophys J 96(2): Thattai M and van Oudenaarden A (2001) Intrinsic noise in gene regulatory networks. Proc Natl Acad Sci USA 98: Bintu L, Buchler NE, Garcia HG, Gerland U, Hwa T et al. (2005) Transcriptional regulation by the numbers: models. Curr Opin Genet Dev 15: Valencia-Sanchez MA, Liu J, Hannon GJ and Parker R (2006) Control of translation and mrna degradation by mirnas and sirnas. Genes Dev 20: Alberts B, Johnson A, Lewis J, Raff M, Roberts K et al. (2008) Molecular Biology of the Cell 5th ed. New York: Garland Science p. 34. Levine E, Kuhlman T, Zhang Z, Hwa T (2007) Quantitative characteristics of gene regulation by small RNA. PLoS Biology 9: Metha P, Goyal S and Wingreen NS (2008) A quantitative comparison of srna-based and proteinbased gene regulation. Mol Syst Biol 4: Shimoni Y, Friedlander G, Hetzroni G, Niv G, Altuvia S et al. (2007) Regulation of gene expression by small non-coding RNAs: a quantitative view. Mol Syst Biol 3: 138.

17 Shahrezaei V and Swain PS (2008) Analytical distributions for stochastic gene expression. Proc Natl Acad Sci USA 105: Pedraza JM and van Oudenaarden A (2005) Noise propagation in gene networks. Science 307: Volfson D, Marciniak J, Blake WJ, Ostroff N, Tsimring LS et al. (2006) Origins of extrinsic variability in eukaryotic gene expression. Nature 439: Paulsson J (2005) Models of stochastic gene expression. Phys Life Rev 2: Shahrezaei V, Ollivier JF and Swain PS (2008) Colored extrinsic fluctuations and stochastic gene expression. Mol Syst Biol 4: Becksei A and Serrano L (2000) Engineering stability in gene networks by autoregulation. Nature 405: Samoilov MS and Arkin AP (2006) Deviant effects in molecular reaction pathways. Nat Biotechnol 24: Shahrezaei V and Swain PS (2008) The stochastic nature of biochemical networks. Curr Opin Biotechnol 19: Tanase-Nicola S, Warren PB and ten Wolde PR (2005) Signal detection, modularity, and the correlation between extrinsic and intrinsic noise in biochemical networks. Phys Rev Lett 97: Dublanche Y, Michalodimitralis K, Kummerer N, Foglierini M, Serrano L (2006) Noise in transcription negative feedback loops: simulation and experimental analysis. Mol Syst biol 2: Singh A and Hespanha JP (2009) Optimal feedback strength for noise suppression in autoregulatory gene networks. Biophys J 96: Larson DR, Singer RH, Zenklusen D (2009) A single molecule view of gene expression. Trends Cell Biol 19: Swain PS, Elowitz MB, Siggia ED (2002) Intrinsic and extrinsic contributions to stochasticity in gene expression. Proc Natl Acad Sci U S A 99: Li X, Cassidy JJ, Reinke CA, Fischboeck S and Carthew RW (2009) A microrna imparts robustness against environmental fluctuation during development. Cell 137: Xiong L, Ma Y and Tang L (2010) Attenuation of transcriptional bursting in mrna transport. Phys Biol 7: Arvey A, Larsson E, Sander C, Leslie CS and Marks DS (2010) Target mrna abundance dilutes microrna and sirna activity. Mol Syst Biol 6: Mukherji S and van Oudenaarden (2009) A Synthetic biology: understanding biological design from synthetic circuits. Nat Rev Genet 10: O Donnell KA, Wentzel EA, Zeller KI, Dang CV and Mendell JT (2005) c-myc-regulated micror- NAs modulate E2F1 expression. Nature 435: Brock A, Chang H and Huang S (2009) Non-genetic heterogeneity a mutation-independent driving force for the somatic evolution of tumours. Nature Rev Genet 10:

18 Spencer SL, Gaudet S, Albeck JG, Burke JM and Sorger PK (2009) Non-genetic origins of cell-tocell variability in TRAIL-induced apoptosis. Nature 459: Heimberg AM, Sempere LF, Moy VN, Donoghue PCJ and Peterson KJ (2008) MicroRNAs and the advent of vertebrate morphological complexity. Proc Natl Acad Sci USA 105: Gillespie DT (1976) A general method for numerically simulating the stochastic time evolution of coupled chemmical reactions. J Comput Phys 22:

19 19 Figures Figure 1. Overview of the connections between mirna-target expression, mirna function and regulatory circuitry. (A) MiRNAs and corresponding targets can present different degrees of coexpression between the two extremes of concurrent expression (high correlation) and exclusive domains (high anticorrelation). These two opposite situations are expected to correspond to different functional roles (B) for the mirna repression. A peculiar expression pattern, evidence of a functional aim, is a consequence of the network structure in which mirnas are embedded. A high mirna-target correlation can be achieved through the incoherent FFL (C), where the mirna repression is opposite to the TF action. Whereas a failsafe control can be performed by a coherent FFL (D), in which the mirna reinforces the TF action leading to mutually exclusive domains of mirna-target expression.

20 Figure 2. Representation of the incoherent FFL and the two circuits used for comparison. (A) A mirna-mediated incoherent FFL that can be responsible for mirna-target coexpression; (B) a gene activated by a TF; (C) an open circuit that leads to the same mean concentrations of the molecular species of the FFL in scheme A. (A )(B )(C ) Detailed representation of the modelization of the corresponding circuits. Rectangles represent DNA-genes, from which RNAs (w, s, r) are transcribed and eventually degraded (broken lines). RNAs can be translated into proteins (q is the TF while p is the target protein) symbolized by circles, and proteins can be degraded (broken circles). Rates of each process (transcription, translation or degradation) are depicted along the corresponding black arrows. Regulations are represented in red, with arrows in the case of activation by TFs while rounded end lines in the case of mirna repression. TF regulations act on rates of transcription that become functions of the amount of regulators. MiRNA regulation makes the rate of translation of the target a function of mirna concentration. 20

21 21 Figure 3. Noise properties of the FFL compared with a TF-gene linear circuit. (A) An example of simulation results for the FFL (scheme on the right or more detailed in Figure 2A ). The normalized trajectory of each molecular species is shown as a function of time after reaching the steady state. The rate of transcription of the TF is k w = 0.06 s 1 and of translation k q = 0.04 s 1. Proteins degrade with a rate g q = g p = s 1, while mrnas and mirnas with g w = g r = g s = s 1. The parameters in the Hill functions of regulation (equations 1,2) are the following: the maximum rate of transcription for mrnas is k r = 0.8 s 1, while for mirnas is k s = 0.5 s 1 ; the maximum rate of translation of the target is k p = 0.04 s 1 ; dissociation constants are h s = 200, h r = 200, h = 60; Hill coefficients are all c = 2, as typical biological values range from 1 (hyperbolic control) to 30 (sharp switching) [30]. (B) Time evolution in a simulation for the molecular players in the linear TF-gene cascade (scheme on the right or more detailed in Figure 2B ). Compared to the FFL case, the p evolution is more sensitive to TF fluctuations. (C) The probability distribution of protein number for the two circuits. Histograms are the result of Gillespie simulations while continuous lines are empirical distributions (gaussian for the FFL and gamma for the TF-gene) with mean and variance predicted by the analytical model.

22 Figure 4. Noise properties of the FFL compared with an analogous open circuit. (A) An example of simulation results for the FFL (scheme on the right or more detailed in Figure 2A ). The parameter values are the same of Figure 3.(B) Time evolution in a simulation for the molecular players in the open circuit (scheme on the right or more detailed in Figure 2C ). The correlation between the s and r trajectories that is present in the FFL (A) is completely lost in the open circuit. As a consequence while the mean value of p is approximately the same, its fluctuations are appreciably greater in the open circuit case.(c) The probability distribution of protein number for the two circuits. Histograms are the result of Gillespie simulations while continuous lines are empirical distributions (gaussian for the FFL and gamma for the open circuit) with mean and variance predicted by the analytical model. 22

23 Figure 5. The effect of fluctuations in an upstream TF. We maintain constant the number of TFs < q >, while we vary its relative fluctuations CV q, tuning the relative contribution of transcription (rate k w ) and translation (rate k q ). All the other parameters have the values reported in caption of Figure 3. The incoherent FFL makes the target less sensitive to fluctuations in the upstream TF. The extent of the noise reduction, with respect to the other circuits, depends on the magnitude of the TF noise, pointing out that the FFL topology is particularly effective in filtering out extrinsic fluctuations. Dots are the result of Gillespie simulations with the full nonlinear dynamics while continuous lines are analytical predictions. 23

24 Figure 6. How an optimal noise filter can be built. (A) The coefficient of variation of the target protein CV p as a function of the repression strength 1/h. The Figure shows the presence of an optimal repression strength for which the introduction of a mirna regulation in a FFL minimizes noise. (B) CV p as a function of the mean number of mirnas < s >. In this case < s > is changed through the maximum rate of transcription k s (see equation 1). (C) CV p as a function of < s >, varying the dissociation constant h s. In both cases (B and C) is evident a U-shaped profile, implying an optimal noise buffering for intermediate mirna concentrations. (D) CV p as a function of the mean number of TFs < q >. The number of TFs depends on the rate of their transcription k w and of their translation k q. The Figure is obtained manipulating k q, but the alternative choice of k w leads to equivalent results (see Text S1). For intermediate concentration of the TF, the noise control by the FFL outperforms the one of the other circuits. In each plot, dots are the result of Gillespie simulations while continuous lines are analytical predictions. The values of parameters kept constant are the same of Figure 3, however the results are quite robust with respect to their choice (see Text S1 for details). 24

25 25 Figure 7. Exploring the parameter space. (A) The target noise CV p, achieved with the FFL, is evaluated with respect to noise deriving from constitutive expression CV p0 (i.e. in absence of mirna regulation) for different mean levels of the TF < q > and different degrees of reduction of the target protein level < p > / < p 0 > (where < p 0 > is the mean constitutive expression). The TF level is changed through its rate of translation k q (equivalent results can be obtained changing the rate of transcription k w ), while the target level is tuned varying the repression strength. All the other parameters have the values reported in caption of Figure 3 except k w = (lower than in Figure 3 to explore a more noisy situation). The region where mirna repression leads to larger fluctuations with respect to constitutive ones is shown in white. When a noise reduction is gained the value of CV p /CV p0 is reported with the color code explained in the legend. The best noise control is achieved with a modest suppression of target expression, around the 60% of its constitutive value. (B) The rate of transcription of the target mrna as a function of the mean number of TFs. The noise reduction shown in the above plot can be obtained outside the saturation regime (where the slope of the activation curve tends to zero).

26 Figure 8. Comparison with a purely transcriptional incoherent FFL. (A) Detailed scheme of a purely transcriptional incoherent FFL. (B) The coefficient of variation of the target protein CV p as a function of the repression strength 1/h for a mirna-mediated FFL and for its transcriptional counterpart. Thanks to the constraints imposed on parameters we can directly compare their noise-buffering efficiency with respect to a gene only activated by a TF. Both circuitries lead to a CV p curve with a minimum for an intermediate repression strength, but the mirna-mediated circuit appears more efficient in filtering out fluctuations. The values of parameters kept constant are the same of Figure 3. Dots are the result of Gillespie simulations with the full nonlinear dynamics while continuous lines are analytical predictions. Also in this case, analytical solutions fit nicely with simulation results. (C) The noise reduction CV p /CV p0, achieved with a purely transcriptional incoherent FFL, evaluated for different mean levels of the TF < q > and different degrees of reduction of the target protein level < p > / < p 0 >. The parameter values and the color code are the same of Figure 7 so as to allow a direct comparison. 26