Chapter IV: An efficient representation for statistical mechanics of multi-
A.1 Derivations for non-bursty promoter models
In this section we detail the calculation of mean mRNA levels, fold-changes in expression, and Fano factors for nonequilibrium promoter models 1 through 4 in Figure 2.1. These are the results that were quoted but not derived in Sections 2.3 and 2.4 of the main text. In each of these four models, the natural mathematicization of their cartoons is as a chemical master equation such as Eq. 2.12 for model 1.
Before jumping into the derivations of the general computation of the mean mRNA level and the Fano factor we will work through the derivation of an example master equation. In particular we will focus on model 1 from Figure 2.1(C). The general steps are applicable to all other chemical master equations in this work.
Derivation of chemical master equation
(A)
(B)
mRNA count mRNA count promoter state
promoter state
0 1 2 ... โ
0 1 2 ... โ
Figure A.1: Two-state promoter chemical master equation. (A) Schematic of the two state promoter simple repression model. Rates๐+
๐ and๐โ
๐ are the association and dissociation rates of the transcriptional repressor, respectively,๐ is the transcription initiation rate, and๐พ is the mRNA degradation rate. (B) Schematic depiction of the mRNA count state transitions. The model in (A) only allows for jumps in mRNA of size 1. The production of mRNA can only occur when the promoter is in the transcriptionally active state.
The chemical master equation describes the continuous time evolution of a contin- uous or discrete probability distribution function. In our specific case we want to describe the time evolution of the discrete mRNA distribution. What this means is that we want to compute the probability of having ๐ mRNA molecules at time ๐ก+ฮ๐ก, whereฮ๐ก is a sufficiently small time interval such that only one of the pos- sible reactions take place during that time interval. For the example that we will work out here in detail we chose the two-state stochastic simple repression model schematized in Figure A.1(A). To derive the master equation we will focus more on the representation shown in Figure A.1(B), where the transitions between different mRNA counts and promoter states is more explicitly depicted. Given that the DNA promoter can exist in one of two states โ transcriptionally active state, and with repressor bound โ we will keep track not only of the mRNA count, but on which state the promoter is. For this we will keep track of two probability distributions:
The probability of having ๐ mRNAs at time๐ก when the promoter is in the tran- scriptionally active state ๐ด, ๐๐ด(๐, ๐ก), and the equivalent probability but when the promoter is in the repressor bound state๐ , ๐๐ (๐, ๐ก).
Since mRNA production can only take place in the transcriptionally active state we will focus on this function for our derivation. The repressor bound state will have an equivalent equation without terms involving the production of mRNAs. We begin by listing the possible state transitions that can occur for a particular mRNA count with the promoter in the active state. For state changes in a small time windowฮ๐ก that โjump intoโ state๐in the transcriptionally active state we have
โข Produce an mRNA, jumping from๐โ1 to๐.
โข Degrade an mRNA, jumping from๐+1 to๐.
โข Transition from the repressor bound state๐ with๐mRNAs to the active state ๐ดwith๐ mRNAs.
Likewise, for state transitions that โjump outโ of state ๐ in the transcriptionally inactive state we have
โข Produce an mRNA, jumping from๐to๐+1.
โข Degrade an mRNA, jumping from๐to๐โ1.
โข Transition from the active state๐ดwith๐mRNAs to the repressor bound state ๐ with๐mRNAs.
The mRNA production does not depend on the current number of mRNAs, therefore these state transitions occur with probability๐ฮ๐ก. The same is true for the promoter state transitions; each occurs with probability๐ยฑ
๐ ฮ๐ก. As for the mRNA degradation events, these transitions depend on the current number of mRNA molecules since the more molecules of mRNA there are, the more will decay during a given time interval. Each molecule has a constant probability ๐พฮ๐ก of being degraded, so the total probability for an mRNA degradation event to occur is computed by multiplying this probability by the current number of mRNAs.
To see these terms in action let us compute the probability of having๐ mRNA at time๐ก+ฮ๐กin the transcriptionally active state. This takes the form
๐๐ด(๐, ๐ก +ฮ๐ก) = ๐๐ด(๐, ๐ก) +
๐โ1โ๐
z }| { (๐ฮ๐ก)๐๐ด(๐โ1, ๐ก) โ
๐โ๐+1
z }| { (๐ฮ๐ก)๐๐ด(๐, ๐ก)
+
๐+1โ๐
z }| { (๐+1) (๐พฮ๐ก)๐๐ด(๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐(๐พฮ๐ก)๐๐ด(๐, ๐ก) +
z }| {๐ โ๐ด
(๐โ
๐ ฮ๐ก)๐๐ (๐, ๐ก) โ
z }| {๐ดโ๐
(๐+
๐ ฮ๐ก)๐๐ด(๐, ๐ก),
(A.1)
where the overbrace indicates the corresponding state transitions. Notice that the second to last term on the right-hand side is multiplied by ๐๐ (๐, ๐ก) since the transition from state ๐ to state ๐ด depends on the probability of being in state ๐ to begin with. It is through this term that the dynamics of the two probability distribution functions (๐๐ (๐, ๐ก)and๐๐ด(๐, ๐ก)) are coupled. An equivalent equation can be written for the probability of having ๐ mRNA at time๐ก +ฮ๐ก while in the repressor bound state, the only difference being that the mRNA production rates are removed, and the sign for the promoter state transitions are inverted. This is
๐๐ (๐, ๐ก+ฮ๐ก) = ๐๐ (๐, ๐ก) +
๐+1โ๐
z }| { (๐+1) (๐พฮ๐ก)๐๐ (๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐(๐พฮ๐ก)๐๐ (๐, ๐ก)
โ
z }| {๐ โ๐ด
(๐โ
๐ ฮ๐ก)๐๐ (๐, ๐ก) +
z }| {๐ดโ๐
(๐+
๐ ฮ๐ก)๐๐ด(๐, ๐ก).
(A.2)
All we have to do now are simple algebraic steps in order to simplify the equations.
Let us focus on the transcriptionally active state ๐ด. First we will send the term
๐๐ด(๐, ๐ก) to the right-hand side, and then we will divide both sides of the equation byฮ๐ก. This results in
๐๐ด(๐, ๐ก+ฮ๐ก) โ ๐๐ด(๐, ๐ก) ฮ๐ก
=๐ ๐๐ด(๐โ1, ๐ก) โ๐ ๐๐ด(๐, ๐ก)
+ (๐+1)๐พ ๐๐ด(๐+1, ๐ก) โ๐ ๐พ ๐๐ด(๐, ๐ก) +๐โ
๐ ๐๐ (๐, ๐ก) โ๐+
๐ ๐๐ด(๐, ๐ก).
(A.3)
Upon taking the limit when ฮ๐ก โ 0 we can transform the left-hand side into a derivative, obtaining the chemical master equation
๐ ๐๐ด(๐, ๐ก) ๐ ๐ก
=๐ ๐๐ด(๐โ1, ๐ก) โ๐ ๐๐ด(๐, ๐ก)
+ (๐+1)๐พ ๐๐ด(๐+1, ๐ก) โ๐ ๐พ ๐๐ด(๐, ๐ก) +๐โ
๐ ๐๐ (๐, ๐ก) โ๐+
๐ ๐๐ด(๐, ๐ก).
(A.4)
Doing equivalent manipulations for the repressor bound state gives an ODE of the form
๐ ๐๐ (๐, ๐ก) ๐ ๐ก
=(๐+1)๐พ ๐๐ (๐+1, ๐ก) โ๐ ๐พ ๐๐ (๐, ๐ก)
โ๐โ
๐ ๐๐ (๐, ๐ก) +๐+
๐ ๐๐ด(๐, ๐ก).
(A.5) In the next section we will write these coupled ODEs in a more compact form using matrix notation.
Matrix form of the multi-state chemical master equation
Having derived an example chemical master equation we now focus on writing a general matrix form for the kinetic models 1-4 shown in Figure 2.1(C) in the main text. In each of these four models, the natural mathematicization of their cartoons is as a chemical master equation such as Eq. 2.12 for model 1, which for completeness we reproduce here as
๐ ๐ ๐ก
๐๐ (๐, ๐ก) =โ
๐ โ๐
z }| { ๐โ
๐ ๐๐ (๐, ๐ก) +
z ๐โ๐ }| { ๐+
๐ ๐๐(๐, ๐ก) +
๐+1โ๐
z }| { (๐+1)๐พ ๐๐ (๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐ (๐, ๐ก) ๐
๐ ๐ก
๐๐(๐, ๐ก) =
z ๐ โ๐}| { ๐โ
๐ ๐๐ (๐, ๐ก) โ
z ๐โ๐ }| { ๐+
๐ ๐๐(๐, ๐ก) +
๐โ1โ๐
z }| { ๐ ๐๐(๐โ1, ๐ก) โ
๐โ๐+1
z }| { ๐ ๐๐(๐, ๐ก)
+
๐+1โ๐
z }| { (๐+1)๐พ ๐๐(๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐(๐, ๐ก).
(A.6) Here๐๐ (๐, ๐ก)and๐๐(๐, ๐ก)are the probabilities of finding the system with๐mRNA molecules at time๐ก either in the repressor bound or unbound states, respectively. ๐
is the probability per unit time that a transcript will be initiated when the repressor is unbound, and๐พis the probability per unit time for a given mRNA to be degraded.
๐โ
๐ is the probability per unit time that a bound repressor will unbind, while๐+
๐ is the probability per unit time that an unbound operator will become bound by a repressor.
Assuming mass action kinetics,๐+
๐ is proportional to repressor copy number๐ . Next consider the cartoon for nonequilibrium model 2 in Figure 2.1(C). Now we must track probabilities ๐๐ , ๐๐, and ๐๐ธ for the repressor bound, empty, and polymerase bound states, respectively. By analogy to Eq. A.6, the master equation for model 2 can be written
๐ ๐ ๐ก
๐๐ (๐, ๐ก) =โ
๐ โ๐
z }| { ๐โ
๐ ๐๐ (๐, ๐ก) +
z ๐โ๐ }| { ๐+
๐ ๐๐ธ(๐, ๐ก) +
๐+1โ๐
z }| { (๐+1)๐พ ๐๐ (๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐ (๐, ๐ก) ๐
๐ ๐ก
๐๐ธ(๐, ๐ก) =
z ๐ โ๐}| { ๐โ
๐ ๐๐ (๐, ๐ก) โ
๐โ๐
z }| { ๐+
๐ ๐๐ธ(๐, ๐ก) +
๐+1โ๐
z }| { (๐+1)๐พ ๐๐ธ(๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐ธ(๐, ๐ก).
+
z }| {๐ดโ๐
๐โ
๐๐๐(๐, ๐ก) โ
๐โ๐ด
z }| { ๐+
๐๐๐ธ(๐, ๐ก) +
๐โ1โ๐, ๐ดโ๐
z }| { ๐ ๐๐(๐โ1, ๐ก) ๐
๐ ๐ก
๐๐(๐, ๐ก) = โ
๐ดโ๐
z }| { ๐โ
๐๐๐(๐, ๐ก) +
๐โ๐ด
z }| { ๐+
๐๐๐ธ(๐, ๐ก) +
๐+1โ๐
z }| { (๐+1)๐พ ๐๐(๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐(๐, ๐ก).
โ
๐โ๐+1, ๐ดโ๐
z }| { ๐ ๐๐(๐, ๐ก) .
(A.7) ๐+
๐ and ๐โ
๐ are defined in close analogy to ๐+
๐ and ๐โ
๐ , except for RNAP binding and unbinding instead of repressor. Similarly ๐๐(๐, ๐ก) is defined for the active (RNAP-bound) state exactly as are ๐๐ (๐, ๐ก) and ๐๐ธ(๐, ๐ก) for the repressor bound and unbound states, respectively. The new subtlety Eq. A.7 introduces compared to Eq. A.6 is that when mRNAs are produced, the promoter state also changes. This is encoded by the terms involving๐, the last term in each of the equations for ๐๐ธ and ๐๐. The former accounts for arrivals in the unbound state and the latter accounts for departures from the RNAP-bound state.
To condense and clarify the unwieldy notation of Eq. A.7, it can be rewritten in matrix form. We define the column vector ๐ยฎ(๐, ๐ก)as
ยฎ
๐(๐, ๐ก)=ยฉ
ยญ
ยญ
ยซ
๐๐ (๐, ๐ก) ๐๐ธ(๐, ๐ก) ๐๐(๐, ๐ก) ยช
ยฎ
ยฎ
ยฎ
ยฌ
(A.8)
to gather, for a given๐, the probabilities of finding the system in the three possible promoter states. Then all the transition rates may be condensed into matrices which multiply this vector. The first matrix is
K=ยฉ
ยญ
ยญ
ยซ
โ๐โ
๐ ๐+
๐ 0
๐โ
๐ โ๐+
๐ โ๐+
๐
๐โ
๐
0 ๐+
๐ โ๐โ
๐
ยช
ยฎ
ยฎ
ยฎ
ยฌ
, (A.9)
which tracks all promoter state changes in Eq. A.7 that arenot accompanied by a change in the mRNA copy number. The two terms accounting for transcription, the only transition that increases mRNA copy number, must be handled by two separate matrices given by
RA =ยฉ
ยญ
ยญ
ยซ
0 0 0 0 0 ๐ 0 0 0 ยช
ยฎ
ยฎ
ยฎ
ยฌ
, RD =ยฉ
ยญ
ยญ
ยซ
0 0 0 0 0 0 0 0 ๐ ยช
ยฎ
ยฎ
ยฎ
ยฌ
. (A.10)
RA accounts for transitions arriving in a given state while RD tracks departing transitions. With these definitions, we can condense Eq. A.7 into the single equation
๐ ๐ ๐ก
ยฎ
๐(๐, ๐ก)= (KโRDโ๐พ ๐I) ยฎ๐(๐, ๐ก) +RA๐ยฎ(๐โ1, ๐ก) +๐พ(๐+1)I๐ยฎ(๐+1, ๐ก), (A.11) which is just Eq. 2.15 in the main text. Straightforward albeit tedious algebra verifies that Eqs. A.7 and A.11 are in fact equivalent.
Although we derived Eq. A.11 for the particular case of nonequilibrium model 2 in Figure 2.1, in fact the chemical master equations for all of the nonequilibrium models in Figure 2.1 except for model 5 can be cast in this form. (We treat model 5 separately in Appendix A.2.) Model 3 introduces no new subtleties beyond model 2 and Eq. A.11 applies equally well to it, simply with different matrices of dimension four instead of three. Models 1 and 4 are both handled by Eq. 2.12 in the main text, which is just Eq. A.11 except in the special case ofRD = RA โก R, since in these two models transcription initiation events do not change promoter state.
Recalling that our goal in this section is to derive expressions for mean mRNA and Fano factor for nonequilibrium models 1 through four in Figure 2.1, and since all four of these models are described by Eq. A.11, we can save substantial effort by deriving general formulas for mean mRNA and Fano factor from Eq. A.11 once and for all. Then for each model we can simply plug in the appropriate matrices forK, RD, andRA and carry out the remaining algebra.
For our purposes it will suffice to derive the first and second moments of the mRNA distribution from this master equation, similar to the treatment in [1], but we refer the interested reader to [2] for an analogous treatment demonstrating an analytical solution for arbitrary moments.
General forms for mean mRNA and Fano factor
Our task now is to derive expressions for the first two moments of the steady-state mRNA distribution from Eq. A.11. Our treatment of this is analogous to that given in Refs. [1] and [2]. We first obtain the steady-state limit of Eq. A.11 in which the time derivative vanishes, giving
0= (KโRDโ๐พ ๐I) ยฎ๐(๐) +RA๐ยฎ(๐โ1) +๐พ(๐+1)I๐ยฎ(๐+1), (A.12) From this, we want to compute
h๐i =ร
๐
โ
ร
๐=0
๐ ๐๐(๐) (A.13)
and
h๐2i=ร
๐
โ
ร
๐=0
๐2๐๐(๐) (A.14)
which define the average values of๐ and๐2 at steady state, where the averaging is over all possible mRNA copy numbers and promoter states ๐. For example, for model 1 in Figure 2.1(C), the sum on ๐would cover repressor bound and unbound states (๐ and๐ respectively), for model 2, the sum would cover repressor bound, polymerase bound, and empty states (๐ ,๐, and๐ธ), and so on for the other models.
Along the way it will be convenient to define the followingconditionalmoments as h ยฎ๐i=
โ
ร
๐=0
๐๐ยฎ(๐), (A.15)
and
h ยฎ๐2i=
โ
ร
๐=0
๐2๐ยฎ(๐). (A.16)
These objects are vectors of the same size as ๐ยฎ(๐), and each component can be thought of as the expected value of the mRNA copy number, or copy number squared, conditional on the promoter being in a certain state. For example, for model 1 in Figure 2.1 which has repressor bound and unbound states labeled ๐ and๐, h ยฎ๐2i would be
h ยฎ๐2i= รโ
๐=0๐2๐๐ (๐) รโ
๐=0๐2๐๐(๐)
!
. (A.17)
Analogously toh ยฎ๐iandh ยฎ๐2i, it is convenient to define the vector h ยฎ๐0i=
โ
ร
๐=0
ยฎ
๐(๐), (A.18)
whose elements are simply the probabilities of finding the system in each of the possible promoter states. It will be convenient to denote byยฎ1โ a row vector of the same length as ๐ยฎwhose elements are all 1, such that, for instance, ยฎ1โ ยท h ยฎ๐0i = 1,
ยฎ1โ ยท h ยฎ๐i= h๐i, etc.
Promoter state probabilitiesh ยฎ๐0i
To begin, we will find the promoter state probabilities h ยฎ๐0i from Eq. A.12 by summing over all mRNA copy numbers๐, producing
0=
โ
ร
๐=0
[(KโRDโ๐พ ๐I) ยฎ๐(๐) +RA๐ยฎ(๐โ1) +๐พ(๐+1)I๐ยฎ(๐+1)] (A.19) Using the definitions ofh ยฎ๐0iand h ยฎ๐i, and noting the matricesK, RD, andRA are all independent of๐and can be moved outside the sum, this simplifies to
0= (KโRD) h ยฎ๐0i โ๐พh ยฎ๐i +RA
โ
ร
๐=0
ยฎ
๐(๐โ1) +๐พ
โ
ร
๐=0
(๐+1) ยฎ๐(๐+1). (A.20) The last two terms can be handled by reindexing the summations, transforming them to match the definitions ofh ยฎ๐0iandh ยฎ๐i. For the first, noting๐ยฎ(โ1) =0 since negative numbers of mRNA are nonsensical, we have
โ
ร
๐=0
ยฎ
๐(๐โ1)=
โ
ร
๐=โ1
ยฎ ๐(๐) =
โ
ร
๐=0
ยฎ
๐(๐)= h ยฎ๐0i. (A.21) Similarly for the second,
โ
ร
๐=0
(๐+1) ยฎ๐(๐+1) =
โ
ร
๐=1
๐๐ยฎ(๐) =
โ
ร
๐=0
๐๐ยฎ(๐)= h ยฎ๐i, (A.22) which holds since in extending the lower limit from๐ =1 to๐ =0, the extra term we added to the sum is zero. Substituting these back in Eq. A.20, we have
0=(KโRD) h ยฎ๐0i โ๐พh ยฎ๐i +RAh ยฎ๐0i +๐พh ยฎ๐i, (A.23) or simply
0=(KโRD+RA) h ยฎ๐0i. (A.24)
So given matrices K, RD, and RA describing a promoter, finding h ยฎ๐0i simply amounts to solving this set of linear equations, subject to the normalization con- straint1ยฎโ ยท h ยฎ๐0i=1. It will turn out to be the case that, if the matrixKโRD +RA
is๐dimensional, it will always have only๐โ1 linearly independent equations. In- cluding the normalization condition provides the๐-th linearly independent equation, ensuring a unique solution. So when using this equation to solve for h ยฎ๐0i, we may always drop one row of the matrix equation at our convenience and supplement the system with the normalization condition instead. The reader may find it illuminating to skip ahead and see Eq. A.24 in use with concrete examples, e.g., Eq. A.52 and what follows it, before continuing on through the general formulas for moments.
First momentsh ยฎ๐iandh๐i
By analogy to the above procedure for finding h ยฎ๐0i, we may find h ยฎ๐i by first multiplying Eq. A.12 by๐and then summing over๐. Carrying out this procedure we have
0=
โ
ร
๐=0
๐[(KโRDโ๐พ ๐I) ยฎ๐(๐) +RA๐ยฎ(๐โ1) +๐พ(๐+1)I๐ยฎ(๐+1)], (A.25) and now identifyingh ยฎ๐iandh ยฎ๐2igives
0=(KโRD) h ยฎ๐i โ๐พh ยฎ๐2i +RA
โ
ร
๐=0
๐๐ยฎ(๐โ1) +๐พ
โ
ร
๐=0
๐(๐+1) ยฎ๐(๐+1). (A.26) The summations in the last two terms can be reindexed just as we did forh ยฎ๐0i, freely adding or removing terms from the sum which are zero. For the first term we find
โ
ร
๐=0
๐๐ยฎ(๐โ1) =
โ
ร
๐=โ1
(๐+1) ยฎ๐(๐)=
โ
ร
๐=0
(๐+1) ยฎ๐(๐) =h ยฎ๐i + h ยฎ๐0i, (A.27) and similarly for the second,
โ
ร
๐=0
๐(๐+1) ยฎ๐(๐+1) =
โ
ร
๐=1
(๐โ1)๐๐ยฎ(๐) =
โ
ร
๐=0
(๐โ1)๐๐ยฎ(๐) =h ยฎ๐2i โ h ยฎ๐i. (A.28) Substituting back in Eq. A.26 then produces
0=(KโRD) h ยฎ๐i โ๐พh ยฎ๐2i +RA(h ยฎ๐i + h ยฎ๐0i) +๐พ(h ยฎ๐2i โ h ยฎ๐i), (A.29) or after simplifying
0= (KโRD+RAโ๐พ) h ยฎ๐i +RAh ยฎ๐0i. (A.30)
So likeh ยฎ๐0i,h ยฎ๐iis also found by simply solving a set of linear equations after first solving forh ยฎ๐0ifrom Eq. A.24.
Next we can find the mean mRNA copy numberh๐ifromh ยฎ๐iaccording to
h๐i=1ยฎโ ยท h ยฎ๐i, (A.31) where ยฎ1โ is a row vector whose elements are all 1. Eq. A.31 holds since the ๐๐ก โ element of the column vector h ยฎ๐i is the mean mRNA value conditional on the system occupying the ๐๐ก โ promoter state, so the dot product with 1ยฎโ amounts to simply summing the elements of h ยฎ๐i. Rather than solving Eq. A.30 for h ยฎ๐i and then computing1ยฎโ ยท h ยฎ๐i, we may take a shortcut by multiplying Eq. A.30 byยฎ1โ first.
The key observation that makes this useful is that
ยฎ1โ ยท (KโRD+RA) =0. (A.32) Intuitively, this equality holds because each column of this matrix represents transi- tions to and from a given promoter state. In any given column, the diagonal encodes all departing transitions and off-diagonals encode all arriving transitions. Conser- vation of probability means that each column sums to zero, and summing columns is exactly the operation that multiplying byยฎ1โ carries out.
Proceeding then in multiplying Eq. A.30 by1ยฎโ produces
0=โ๐พยฎ1โ ยท h ยฎ๐i + ยฎ1โ ยทRAh ยฎ๐0i, (A.33) or simply
h๐i= 1 ๐พ
ยฎ1โ ยทRAh ยฎ๐0i. (A.34) We note that the in equilibrium models of transcription such as in Figure 2.1, it is usually assumed that the mean mRNA level is given by the ratio of initiation rate ๐ to degradation rate ๐พ multiplied by the probability of finding the system in the RNAP-bound state. Reassuringly, we have recovered exactly this result from the master equation picture: the product1ยฎโ ยทRAh ยฎ๐0ipicks out the probability of the active promoter state fromh ยฎ๐0iand multiplies it by the initiation rate๐.
Second momenth๐2iand Fano factor๐
Continuing the pattern of the zeroth and first moments, we now find h ยฎ๐2i by multiplying Eq. A.12 by๐2and then summing over๐, which explicitly is
0=
โ
ร
๐=0
๐2[(KโRDโ๐พ ๐I) ยฎ๐(๐) +RA๐ยฎ(๐โ1) +๐พ(๐+1)I๐ยฎ(๐+1)]. (A.35)
Identifying the moments h ยฎ๐2iandh ยฎ๐3iin the first term simplifies this to 0=(KโRD) h ยฎ๐2i โ๐พh ยฎ๐3i +RA
โ
ร
๐=0
๐2๐ยฎ(๐โ1) +๐พ
โ
ร
๐=0
๐2(๐+1) ยฎ๐(๐+1). (A.36) Reindexing the sums of the last two terms proceeds just as it did for the zeroth and first moments. Explicitly, we have
โ
ร
๐=0
๐2๐ยฎ(๐โ1) =
โ
ร
๐=โ1
(๐+1)2๐ยฎ(๐) =
โ
ร
๐=0
(๐+1)2๐ยฎ(๐)= h ยฎ๐2i +2h ยฎ๐i + h ยฎ๐0i, (A.37) for the first sum and
โ
ร
๐=0
๐2(๐+1) ยฎ๐(๐+1) =
โ
ร
๐=1
(๐โ1)2๐๐ยฎ(๐)=
โ
ร
๐=0
(๐โ1)2๐๐ยฎ(๐) =h ยฎ๐3iโ2h ยฎ๐2i+h ยฎ๐i (A.38) for the second. Substituting the results of the sums back in Eq. A.36 gives
0=(KโRD) h ยฎ๐2i โ๐พh ยฎ๐3i +RA(h ยฎ๐2i +2h ยฎ๐i + h ยฎ๐0i) +๐พ(h ยฎ๐3i โ2h ยฎ๐2i + h ยฎ๐i), (A.39) and after grouping like powers of๐we have
0=(KโRD+RA โ2๐พ) h ยฎ๐2i + (2RA +๐พ) h ยฎ๐i +RAh ยฎ๐0i. (A.40) As we found when computingh๐ifromh ยฎ๐i, we can spare ourselves some algebra by multiplying Eq. A.40 by1ยฎโ , which then reduces to
0=โ2๐พh๐2i + ยฎ1โ ยท (2RA+๐พ) h ยฎ๐i + ยฎ1โ ยทRAh ยฎ๐0i, (A.41) and noting from Eq. A.34 that1ยฎโ ยทRAh ยฎ๐0i=๐พh๐i, we have the tidy result
h๐2i =h๐i + 1 ๐พ
1ยฎโ ยทRAh ยฎ๐i. (A.42)
Finally we have all the preliminary results needed to write a general expression for the Fano factor๐. The Fano factor is defined as the ratio of variance to mean, which can be written as
๐ = h๐2i โ h๐i2 h๐i =
h๐i + 1
๐พ
1ยฎโ ยทRAh ยฎ๐i โ h๐i2
h๐i (A.43)
and simplified to
๐ =1โ h๐i +
1ยฎโ ยทRAh ยฎ๐i
๐พh๐i . (A.44)
Note a subtle notational trap here: h๐i = ๐พ11ยฎโ ยทRAh ยฎ๐0irather than the by-eye similar but wrong expression h๐iโ ๐พ1ยฎ1โ ยทRAh ยฎ๐i, so the last term in Eq. A.44 is in general quite nontrivial. For a generic promoter, Eq. A.44 may be greater than, less than, or equal to one, as asserted in Section 2.4. We have not found the general form Eq. A.44 terribly intuitive and instead defer discussion to specific examples.
Summary of general results
For ease of reference, we collect and reprint here the key results derived in this section that are used in the main text and subsequent subsections. Mean mRNA copy number and Fano factor are given by Eqs. A.34 and A.44, which are
h๐i= 1 ๐พ
1ยฎโ ยทRAh ยฎ๐0i (A.45) and
๐ =1โ h๐i +
ยฎ1โ ยทRAh ยฎ๐i
๐พh๐i , (A.46)
respectively. To compute these two quantities, we need the expressions forh ยฎ๐0iand h ยฎ๐igiven by solving Eqs. A.24 and A.30, respectively, which are
(KโRD+RA) h ยฎ๐0i=0 (A.47) and
(KโRD +RAโ๐พI) h ยฎ๐i =โRAh ยฎ๐0i. (A.48) Some comments are in order before we consider particular models. First, note that to obtain h ยฎ๐i and๐, we need not bother solving for all components of the vectors h ยฎ๐0iand h ยฎ๐i, but only the components which are multiplied by nonzero elements ofRA. The only component ofh ยฎ๐0ithat ever survives is the transciptionally active state, and for the models we consider here, there is only ever one such state. This will save us some amount of algebra below.
Also note that we are computing Fano factors to verify the results of Section 2.4, concerning the constitutive promoter models in Figure 2.2 which are analogs of the simple repression models in Figure 2.1. We can translate the matrices from the sim- ple repression models to the constitutive case by simply substituting all occurrences of repressor rates by zero and removing the row and column corresponding to the repressor bound state. The results for h๐i computed in the repressed case can be easily translated to the constitutive case, rather than recalculating from scratch, by
taking the limit ๐+
๐ โ 0, since this amounts to sending repressor copy number to zero.
Finally, we point out that it would be possible to computeh ยฎ๐0imore simply using the diagram methods from King and Altman [3] (also independently discovered by Hill [4]). But to our knowledge this method cannot be applied to computeh ยฎ๐ior๐, so since we would need to resort to solving the matrix equations anyways for h ยฎ๐i, we choose not to introduce the extra conceptual burden of the diagram methods simply for computingh ยฎ๐0i.
Nonequilibrium Model One - Poisson Promoter Mean mRNA
For nonequilibrium model 1 in Figure 2.1, we have already shown the full master equation in Eq. 2.10 and Eq. A.6, but for completeness we reprint it again as
๐ ๐ ๐ก
๐๐ (๐, ๐ก) =โ
๐ โ๐
z }| { ๐โ
๐ ๐๐ (๐, ๐ก) +
๐โ๐
z }| { ๐+
๐ ๐๐(๐, ๐ก) +
๐+1โ๐
z }| { (๐+1)๐พ ๐๐ (๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐ (๐, ๐ก) ๐
๐ ๐ก
๐๐(๐, ๐ก) =
๐ โ๐
z }| { ๐โ
๐ ๐๐ (๐, ๐ก) โ
z ๐โ๐ }| { ๐+
๐ ๐๐(๐, ๐ก) +
๐โ1โ๐
z }| { ๐ ๐๐(๐โ1, ๐ก) โ
๐โ๐+1
z }| { ๐ ๐๐(๐, ๐ก)
+
๐+1โ๐
z }| { (๐+1)๐พ ๐๐(๐+1, ๐ก) โ
๐โ๐โ1
z }| { ๐พ ๐ ๐๐(๐, ๐ก).
(A.49) This is a direct transcription of the states and rates in Figure 2.1. This may be converted to the matrix form of the master equation shown in Eq. A.11 with matrices
ยฎ
๐(๐) = ๐๐ (๐) ๐๐(๐)
!
, K= โ๐โ
๐ ๐+
๐
๐โ
๐ โ๐+
๐
!
, R= 0 0 0 ๐
!
, (A.50)
whereRAandRDare equal, so we drop the subscript and denote both simply byR.
Since our interest is only in steady-state we dropped the time dependence as well.
First we needh ยฎ๐0i. Label its components as๐๐ and๐๐, the probabilities of finding the system in either promoter state, and note that only๐๐ survives multiplication by R, since
Rh ยฎ๐0i= 0 0 0 ๐
! ๐๐ ๐๐
!
= 0 ๐ ๐๐
!
, (A.51)
so we need not bother finding ๐๐ . Then we have (KโRD +RA) h ยฎ๐0i= โ๐โ
๐ ๐+
๐
๐โ
๐ โ๐+
๐
! ๐๐ ๐๐
!
=0. (A.52)
As mentioned earlier in Section A.1, the two rows are linearly dependent, so taking only the first row and using normalization to set ๐๐ =1โ ๐๐ gives
โ๐โ
๐ (1โ ๐๐) +๐+
๐ ๐๐ =0, (A.53)
which is easily solved to find
๐๐ = ๐โ
๐
๐โ
๐ +๐+
๐
. (A.54)
Substituting this into Eq. A.51, and the result of that into Eq. A.45, we have h๐i= ๐
๐พ ๐โ
๐
๐โ
๐ +๐+
๐
(A.55) as asserted in Eq. 2.13 of the main text.
Fano factor
To verify that the Fano factor for model 1 in Figure 2.2(A) is in fact 1 as claimed in the main text, note that in this limit ๐๐ =1 andh๐i =๐/๐พ. All elements ofKare zero, andRAโRD =0, so Eq. A.48 reduces to
โ๐พh ยฎ๐i =โ๐ , (A.56)
or, in other words, since there is only one promoter state,h ยฎ๐i=h๐i. Then it follows that
๐ =1โ ๐ ๐พ
+ ๐h๐i
๐พh๐i =1 (A.57)
as claimed.