Abstract
At the molecular level, the evolution of life is driven by the generation and diversification of adaptation mechanisms. A universal description of adaptation-capable chemical reaction network (CRN) structures has remained elusive until now, since currently-known criteria for adaptation apply only to a tiny subset of possible CRNs. Here we identify the definitive structural requirements that characterize all adaptation-capable collections of interacting molecules, however large or complex. We show that these network structures implement a form of integral control in which multiple independent integrals can collaborate to confer the capacity for adaptation on specific molecules. Using an algebraic algorithm informed by these findings, we demonstrate the existence of embedded integrals in a variety of biologically important CRNs that have eluded previous methods, and for which adaptation has been observed experimentally. This definitive picture of biological adaptation at the level of intermolecular interactions represents a blueprint for adaptation-capable signaling networks across all domains of life, and for the design of synthetic biosystems.
Similar content being viewed by others
Introduction
The capacity for biological systems to adapt to variable and unpredictable conditions, and to maintain certain key survival-requisite properties within tight tolerances, is fundamental to life itself. This ubiquitous property has been studied under a variety of guises, including robust homeostasis1 and absolute concentration robustness (ACR)2,3, all of which are special cases of the keystone phenomenon known as robust perfect adaptation (RPA)4. RPA encompasses two essential features: a baseline reference signal, or ‘setpoint’, established by the concentrations of one or more key molecules, and which allows the system to distinguish high/increasing signals from low/decreasing signals; and an actuator signal (the adaptation), which serves as a memory trace for the altered conditions or stimuli to which the system has been exposed over time4,5,6. RPA has been ubiquitously observed at all scales of biological organization from homeostatic control of plasma mineral concentrations7 to the regulation of cellular signal transduction networks8; from sensory adaptation9 to neuronal excitation regulation10; from the orchestration of cellular stress responses11 to the coordination of chemotaxis in single-celled organisms12,13, and is thought to play a critical role in robust patterning during organism development14,15.
Importantly, RPA corresponds to a special case of a defining problem in classical automatic control – namely, the robust asymptotic tracking of a desired trajectory (the system’s setpoint), while rejecting unwanted disturbances. In the 1970s, the landmark studies of Francis and Wonham16,17 investigated the necessary controller structures to achieve such robust tracking, and established what is now known as the internal model principle (IMP)18 (Fig. 1). In simple terms, the IMP states that a dynamical system, \(\Sigma\), regulated by some exosystem-generated stimulus or disturbance can be decomposed, via a coordinate change if necessary, into two subsystems, \({\Sigma }_{0}\) and \({\Sigma }_{{{{{{\rm{IM}}}}}}}\), where \({\Sigma }_{{{{{{\rm{IM}}}}}}}\) constitutes an output-driven internal model (Fig. 1a). Only the system output, \(O(t)\), can act as an input to this internal model \({\Sigma }_{{{{{{\rm{IM}}}}}}}\), which cannot be directly regulated by the remainder of the system \({\Sigma }_{{{{{{\rm{o}}}}}}}\), nor by the stimulus/disturbance\(,I(t)\), generated by the exosystem. In this way the IMP allows a control system to reject exogenous stimuli or disturbances by incorporating within itself a model of the dynamic structure of the stimulus or disturbance. In the face of persistent (constant) disturbances such as a mutation, an altered external environment, or a new network stimulus, the internal model must produce constant signals and is equivalent to the requirement for integral control18,19 (Fig. 1b, c). The internal model integrates the adaptation error in some distinguished output variable of the system, constraining it to asymptotically track a fixed value, or setpoint, at steady-state.
Integral control can readily be implemented in engineering design problems by incorporating special integral-computing components into feedback loops. By contrast, signaling networks that evolve in living systems are dynamically assembled via the physical interactions – involving collisions, binding events, and chemical modifications – among discrete entities, or molecules, which must constitute both the signals and their own controllers. Moreover, many collections of biochemical reactions have been identified2 which impose concentration robustness at steady-state in the absence of any feedback loops or any exosystem-driven disturbances, and in response to alterations in total molecular abundances alone. Robust asymptotic tracking of molecular setpoints in the absence of exogenous network inputs or disturbances constitutes special type of RPA generally referred to as ‘absolute concentration robustness’ (ACR), corresponding to robustness with respect to the system’s initial conditions. How can these complex self-organizing collections of chemical reactions manage to embed the integral-computing structures required for adaptation? Note, in particular, that the reaction rates selected for illustrative purposes in Fig. 1b, c cannot be induced, under the law of mass action, by any chemical reaction network (CRN)20, highlighting the challenge of identifying the general properties of RPA-capable CRN reaction structures, and universal implementations of integral control via intermolecular interactions.
Until now, integral-computing molecular interactions have only been identified in exceedingly simple chemical reaction networks (CRNs), such as the antithetic integral control motif 6,21, and highly simplified versions of bacterial metabolic circuits and phosphorelays3, where the requisite integral can be identified via linear change of coordinates. But many adaptation-capable CRNs have been identified (see, for example, Cappelletti et al.3), for which no such linear transformation can reveal an adaptation-conferring integral structure, highlighting the fact that complex nonlinear transformations may be required to detect the presence of integral control for most adaptation-capable CRNs in nature22. Although the universal topological principles required for RPA, and for the implementation of integral control, at the level of the network macroscale are now understood in complete generality4, how these principles could be realized by the intricate intermolecular interactions which comprise CRN structures at the network microscale has been entirely unclear. Previous attempts to identify RPA-capable CRNs, and in some cases, their underlying integral control strategies, have only provided partial answers for special cases2,3,18,23,24,25.
Here we identify the universal principles by which all possible instances of RPA-capable CRNs – in all living systems on Earth, as well as in synthetic biology – construct internal models16,17,18,25 of any possible stimulus or disturbance, or change in total molecular abundances, thereby allowing the CRN to implement integral control.
As we will show in the sections to follow, a mathematical transformation may always be applied to the reaction rates of any RPA-capable CRN to produce a special two-variable invariant called an ‘RPA polynomial’. This distinguished algebraic invariant encodes the robust asymptotic tracking of a molecular setpoint, no matter how complex or intricate the intermolecular interactions, nor how vast the network of interacting molecules. Unlike the nonlinear coordinate transformations invoked in the standard IMP, where a global coordinate transformation (unique to each RPA-capable network) is required to identify a single internal model, the nonlinear transformation we identify here has a special almost-linear structure (and, in special cases, exactly linear) and is decomposable into a topologically organized collection of linear integral controllers, each with its own independent internal model. In this way, we are able to identify the fundamental building blocks of all possible RPA-capable CRNs, thereby revealing definitive structural requirements that characterize all adaptation-capable collections of interacting molecules.
Importantly, these universal adaptation-promoting structural requirements lead to a definitive and well-defined algorithmic test for RPA within networks of chemical reactions. We provide code in the open-source software Singular (www.Singular.uni-kl.de) to implement this test for all examples considered here and in our Supplementary Information (SI). This code can be tailored to the study of any CRN.
Results
Structural principles for all adaptation-capable CRNs
As a prelude to presenting the universal structural principles by which any CRN can orchestrate a robustly adaptive response (see also SI Section S1), we first briefly describe two simple examples that have eluded all previous systematic methods2,3,18,23,26,27 to detect RPA, and the presence of integral control, and which exemplify the essential structural principles that are common to all RPA-capable CRNs.
First, we consider an RPA-promoting CRN (Fig. 2a) known as antithetic integral control (Fig. 2b)6,21 - a controller structure that has been identified in the form of sigma/anti-sigma factors in a range of bacterial strains, including E. coli and Salmonella21, and has also been implemented in synthetic networks6. In the simplest possible version of this control mechanism (Fig. 2b, highlighted reactions), two proteins \({X}_{1}\) and \({X}_{2}\) bind with very high affinity (i.e. irreversibly, thus annihilating each other). One of these proteins (\({X}_{1}\)) is synthesized at a rate proportional to the concentration of a transcription factor (\(R\)), while the other protein (\({X}_{2}\)) is constitutively produced at a constant rate. From the law of mass action, whereby reaction rates are proportional to the concentrations of their reactant molecules, this simple scheme produces the two reaction rates
A linear change of coordinates, \(\dot{z}={\dot{X}}_{1}-{\dot{X}}_{2}={k}_{1}R-{k}_{3}\), suffices to identify an internal model, with integral variable \(z={k}_{1}{\int }_{{t}_{0}}^{t}(R(\tau )-\frac{{k}_{1}}{{k}_{3}})d\tau\), for any possible persistent disturbance to the system, thereby establishing the capacity for RPA in the molecule \(R\) with setpoint \({k}_{1}/{k}_{3}\) (see Cappelletti et al.3). But suppose that a modification to the CRN is introduced during evolution whereby the production of \({X}_{2}\) is no longer independent of other signaling activity, but is now under the control of another network protein \({X}_{3}\), a transcription factor, as depicted in Fig. 2a, b. The reaction rate for \({X}_{2}\) now becomes
This perturbed controller structure can no longer impose RPA on \(R\) unless \({X}_{3}\) participates in additional regulatory interactions, whose structure satisfies very strict constraints (see SI Sections S1.5 and S4). In Fig. 2a, b we provide an example of a suitable auxiliary controller structure for \({X}_{3}\), which now includes an additional protein \({O}_{1}\). In Fig. 2c and SI Section S4.4.2 we demonstrate that for this expanded CRN, one internal model with integral variable \({z}_{1}={O}_{1}={k}_{7}{\int }_{{t}_{0}}^{t}{O}_{1}(\tau )({X}_{3}(\tau )-\frac{{k}_{8}}{{k}_{7}})d\tau\) imposes RPA on \({X}_{3}\), provided that \({O}_{1}\) maintains a non-zero concentration – a concept known as constrained integral control28. Having thus imposed a steady state value (setpoint) of \({k}_{8}/{k}_{7}\) on \({X}_{3}\), a second internal model, with an integral variable \({z}_{2}={{X}_{1}-{X}_{2}=k}_{1}{\int }_{{t}_{0}}^{t}(R(\tau )-(\frac{{k}_{3}+{k}_{4}{X}_{3}(\tau )}{{k}_{1}}))d\tau\), can now impose RPA on \(R\). In this way, two internal models - or polynomial invariants (see Fig. 2c) - may be defined, each obtained through (at most) a linear coordinate change. From these two separate polynomial invariants, an ‘RPA polynomial’ of the form
can now be constructed through nonlinear combination, via ‘concatenating monomials’ (Fig. 2c, and SI Sections S3 and S4), from which it is clear that the network has the capacity for RPA in \(R\) with setpoint \(({k}_{3}{k}_{7}+{k}_{4}{k}_{8})/{k}_{1}{k}_{7}\).
We demonstrate (SI Sections S2 and S4.4.2) that the CRN depicted in Fig. 2 conforms to the topological principles of an Opposer Module4, see Fig. 2d. More specifically, the controller structure of this CRN exhibits the special architecture known as a two-node opposing set (see Araujo et al.4). Each linear combination of CRN reaction rates that produces an opposer invariant, corresponding to an internal model, thereby constructs an independent opposer integral (see Fig. 2c). The two separate integrals together confer RPA on the sensor molecule R, and ultimately, the entire embedded network (SI Section S4.4.2). This special topological structure, with three feedback loops, and two independent opposer invariants, is directly constructed by the CRN’s ‘deficiency’29 of three (see SI Section S4.4.2 for a detailed analysis). Deficiency is a key integer invariant associated with a CRN29, as we discuss in greater detail in the sections to follow (see also SI Sections S1.2 and S1.3), whose fundamental consequences for the implementation of integral control in CRNs are identified in the present study.
Second, we consider a CRN for the EnvZ-OmpR osmoregulation system in E-coli (Fig. 3). A simplified model of this network with a deficiency29 of one was first analyzed by Shinar and Feinberg2, and could be shown to exhibit absolute concentration robustness (ACR) – a type of RPA (SI Section S1.4) – by the Shinar-Feinberg theorem2. Crucially, the Shinar-Feinberg theorem applies only to deficiency-one CRNs, which severely limits its ability to detect ACR (and thus RPA) in most molecular networks of biological interest, since the deficiencies of known genome-scale signaling networks (e.g. in metabolism) in even the simplest organisms frequently exceed one hundred26. In Fig. 3a, b we consider the more detailed version of the EnvZ-OmpR CRN, which eludes the Shinar-Feinberg theorem, having a deficiency of two, but which can be shown to exhibit RPA (ACR) in the phosphoform, pOmpR (Supplementary Materials of Shinar and Feinberg2).
The CRN in Fig. 3 conforms to the topological principles of an RPA-conferring Balancer Module (see SI Section S3.2), with three (incoherent) parallel pathways governing the interconversion between phosphorylated and unphosphorylated OmpR; this fundamental structure is directly controlled by the CRN’s deficiency of two (see SI Sections S3.2, S4.4.1). All Balancer modules are characterized by a collection of parallel pathways emanating from a diverter node (here, EnvZ-ATP) and culminating in a connector node (here, pOmpR)4. One or more balancer nodes (here, EnvZ-ADP) may be embedded within the parallel pathways4. In Fig. 3c we identify an integral variable \({z}_{1}={a}_{5}{\int }_{{t}_{0}}^{t}{{\mbox{EnvZ}}}-{{\mbox{ATP}}}(\tau )(\frac{{{\mbox{EnvZ}}}-{{\mbox{ATP}}}(\tau )}{{{\mbox{EnvZ}}}-{{\mbox{ATP}}}(\tau )}-\beta {K}_{m1})d\tau\) that first confers RPA on the concentration ratio EnvZ-ATP/EnvZ-ADP – a key invariant known as a balancer invariant (see Araujo et al.4). Having established a setpoint of \(\beta {K}_{m1}\) for this balancer invariant, a second integral variable, \({z}_{2}\), constructs a connector invariant that imposes RPA on pOmpR (see Fig. 3c). Crucially, both the balancer invariant and the connector invariant are obtained via linear combinations of the CRN’s mass action equations. These two polynomial invariants together produce an RPA polynomial of the form
through nonlinear combination via concatenating monomials (see Fig. 3c, and SI Section S3 and S4), thereby explicitly highlighting the CRN’s capacity for RPA in pOmpR, with setpoint \(\frac{{k}_{1}{K}_{m4}}{\gamma }\).
Our transformative step is to prove that all RPA-capable CRNs, regardless of size, complexity, or deficiency2,29, necessarily conform to the general principles encapsulated by these two illustrative examples (see SI Section S4). In fact, all RPA-capable CRNs are characterized by a topological hierarchy of polynomial invariants – a key phenomenon foreshadowed by our earlier framework4, before general principles were known as to how these invariants might be achieved by CRN graph structures. Here we show that each such subsidiary polynomial invariant is necessarily identifiable via a linear combination of the CRN’s rate equations, and corresponds directly to a topological feature (a balancer node, a connector node, or an opposer node) of the overarching network structure. We further show that the presence of these key invariants in the row span of the system (see SI Sections S3 and S4) is fundamentally controlled by the deficiency of the CRN. Moreover, CRN deficiency is generally distributed across multiple algebraically independent subnetworks, which correspond to a decomposition of the reactions into topological modules (see SI Section S4). Thus, the integral-computing properties of CRNs at the network microscale presented here, together with the topological principles that are known to hold at the network macroscale for all RPA-capable networks4, constitute definitive design criteria that unify all possible RPA-capable CRNs.
There are two distinct but interrelated components to this central result, which we delineate in turn in the sections to follow: (i) We identify the universal algebraic condition that is satisfied by all RPA-capable CRNs, and which is codified in what we call the Two-Variable Kinetic Pairing Theorem (SI Section S1.5); (ii) We show that this algebraic condition always admits a decomposition into a collection of linear problems. The discovery of this previously unrecognized fundamental structure of RPA-capable CRNs exploits the fact that CRNs reactions can generally be partitioned into algebraically independent subsets, each with its own linearly independent stoichiometric subspace (SI Section S1.2), and each with its own deficiency (SI Section S1.3) that governs the formation of RPA-promoting algebraic invariants within the associated subnetwork. Together, these two mathematical results reveal an integral control implementation that holds for all possible RPA-capable CRNs, however large, complex or nonlinear in their dynamics, and whatever their deficiency.
Adaptation relies on a CRN design strategy called Kinetic Pairing
First, we prove (see Theorem 1, SI Section S1.5) that for all RPA-capable CRNs, with interacting molecules \({x}_{1},\ldots,{x}_{n},\) and corresponding mass-action rate equations \({f}_{1},\ldots,{f}_{n}\), there always exist polynomials \({\{{h}_{1}},\ldots,{h}_{n}\}{\subset }{\mathbb{R}}[{{x}_{1}},\ldots,\,{x}_{n}]\) such that
where \(\rho=g({x}_{i},{x}_{j})({x}_{i}-c),\) in its lowest order form, is the RPA polynomial of the CRN, \({x}_{i}\) is any RPA-capable variable of the CRN, and \({x}_{j}\) is any variable that does not exhibit RPA (i.e., an actuator variable, or a molecule regulated by an actuator variable). In this context ‘variable’ has quite a specific meaning, which we define carefully in SI Section S1.5 (Definition 1). The system setpoint, \(c\), is a rational function of biochemical parameters (see also Remark 3 in SI Section S1.5).
From this new mathematical vantage point, we can now recognize that the special structure of the RPA polynomial specified by Theorem 1, being a function of exactly two variables, imposes fundamental limitations on the flow of biochemical information through RPA-capable CRNs, and encodes the cardinal principle that we call kinetic pairing (see Fig. 4 and SI Section S2). In particular, the functional form of \(\rho\) suggests two possible topological interpretations of Theorem 1, depending on whether the RPA-capable variable, \({x}_{i}\), is a regulating variable (for \({x}_{j}\)) or a regulated variable (by \({x}_{j}\)). As depicted schematically in Fig. 4a, if \({x}_{i}\) regulates \({x}_{j}\) (the non-RPA-capable variable), then the upregulating and downregulating contributions of \({x}_{j}\) to its own reaction rate must be precisely matched, or paired, via the pairing function \(g\). At steady state, this form of \(\rho\) satisfies the condition \(\frac{\partial \rho }{\partial {x}_{j}}=0\) referred to in Araujo et al.4 as opposer kinetics, and must therefore be embedded in an overarching feedback loop that gives rise to the topological structure of an Opposer module. Our previous exhaustive analysis on Opposer module topologies has established that the feedback segment of such modules may contain multiple opposer nodes, each with its own opposer kinetics, and each contributing to a collection of embedded interlinked feedback loops known as an opposing set (Fig. 4a).
If, on the other hand, \({x}_{i}\) is regulated by \({x}_{j}\), then the upregulating and downregulating contributions of \({x}_{j}\) to the reaction rate for \({x}_{i}\) must likewise be precisely paired via \(g\).
As illustrated in Fig. 4b, the pairing function naturally induces a Balancer topology4 on the CRN in this case (see SI Section S2), with \({x}_{j}\) performing a diverter function4. For this topological structure, the steady-state condition \(\frac{\partial \rho }{\partial {x}_{j}}=0\) corresponds to connector kinetics4, provided that additional constraints (referred to as balancer kinetics in Araujo et al.4) can be satisfied for the reactions embedded into any parallel pathways linking \({x}_{j}\) to \({x}_{i}\).
Theorem 1 holds for any choice of RPA-capable variable, \({x}_{i}\), and non-RPA-capable variable, \({x}_{j}\), in the CRN, even if the two variables contribute to distinct independent CRN subnetworks (SI Section S1.3) corresponding to distinct topological modules. Algorithmically, the choice of two variables within a single independent subnetwork, corresponding to a single topological module, simplifies the elimination polynomials \({h}_{1},\ldots,{h}_{n}\) in Eq. 6 (SI Section S1.6 for a fully analyzed example). In this context, we recognize that Theorem 1 identifies an independent RPA polynomial specific to the topological module in question and that there exists a natural choice of \({x}_{j}\) with respect to the topological structure of the module: a diverter variable (in the case of a Balancer module), or an opposer variable (in the case of an Opposer module). For such a judicious choice of \({x}_{j}\), the pairing function \(g\) is frequently zero-order in \({x}_{i}\), except in the special case of an autoregulatory role for \({x}_{i}\). In the case of the antithetic integral control motif21, the pairing function is zero-order in both \({x}_{i}\) and \({x}_{j}\), giving rise to unconstrained integral control3,28.
RPA-permissive topological features are encoded by CRN deficiency
Second, we consider a decomposition of the nonlinear algebraic condition for RPA (Eq. 6) into its component linear contributions, to reveal the general mechanism through which kinetic pairing is transacted in CRNs. Indeed, by identifying the connection between the deficiency of an RPA-capable CRN and the presence of feedback loops and/or feedforward segments (SI Section S1.2), we prove that the RPA polynomial of a CRN can always be decomposed into a collection of subsidiary polynomial invariants, each corresponding to a component of the CRN’s topological structure, and each residing in the rowspan of the CRN’s reaction rates (SI Sections S3, S4). In other words, each such subsidiary invariant may be obtained via a linear transformation of the system’s reaction equations, \({f}_{1},\ldots,{f}_{n}\).
The deficiency of a CRN (Fig. 5) is a non-negative integer that encapsulates the extent to which the individual reactions of the CRN are linearly independent given their distribution into linkage classes29 (see SI Sections S1.2 and S1.3 for a detailed exposition of this fundamental concept). With the exception of the trivial RPA-capable CRN consisting only of an isolated connector node, which has a deficiency of zero (see SI Section S4.4.2), all (non-trivial) RPA-capable CRNs require a deficiency of at least one. The Shinar-Feinberg Theorem2 (see Theorem 2 in SI) pertains to CRNs with a deficiency of exactly one, and states that any such CRN containing two distinct complexes that differ in a single species, \(S\), and admitting a steady-state in the positive orthant, necessarily exhibit ACR (and therefore RPA) in the species \(S\). This key theorem follows from Shinar and Feinberg’s more general result that the steady-state ratio of any two monomials associated to non-terminal complexes (see Fig. 5) is independent of the system’s initial conditions2. We show that Shinar and Feinberg’s arguments may be extended to prove even stronger results (SI Theorems 3 and 4) – namely, that all deficiency-zero and deficiency-one CRNs contain binomials in the rowspan of their reaction rates, of the form \({\alpha }_{1}{\psi }_{i}\left({{{{{\boldsymbol{x}}}}}}\right)-{\alpha }_{2}{\psi }_{j}\left({{{{{\boldsymbol{x}}}}}}\right)\), where \({\psi }_{i}\left({{{{{\boldsymbol{x}}}}}}\right)\) and \({\psi }_{j}\left({{{{{\boldsymbol{x}}}}}}\right)\) are any two mass-action monomials corresponding to non-terminal complexes (of a deficiency-one CRN), or complexes of a single terminal strong linkage class (of a deficiency-zero CRN), and where \(\left({\alpha }_{1},{\alpha }_{2}\right)\in {{\mathbb{R}}}^{2}\) is a pair of rational functions of the CRN rate constants. In other words, there exists some \(\left({h}_{1},\ldots,{h}_{n}\right)\in {{\mathbb{R}}}^{n}\) such that \({h}_{1}{f}_{1}+\ldots+{h}_{n}{f}_{n}={\alpha }_{1}{\psi }_{i}\left({{{{{\boldsymbol{x}}}}}}\right)-{\alpha }_{2}{\psi }_{j}\left({{{{{\boldsymbol{x}}}}}}\right)\).
Crucially, we extend the mathematical framework for Theorems 3 and 4 (on low-deficiency CRNs, \(\delta \le 1\)) to a general method for identifying rowspan polynomials in CRNs of arbitrary deficiency \((\delta \, > \,1)\). In fact, CRNs can generally be decomposed into a set of algebraically-independent subnetworks (SI Section S1.3), which correspond topologically to independent RPA-capable-modules, each with its own independent RPA polynomial. The deficiency that characterizes each independent subnetwork, and the associated topological module, governs how RPA-relevant subsidiary polynomial invariants are constructed within the rowspan of the CRN. In Section S4.4, we demonstrate these fundamental principles through detailed analyzes of several RPA-capable CRNs with \(\delta > 1\) for a single module (see also Fig. 6). Our method for analyzing these examples makes clear that although an RPA polynomial associated to an RPA-capable CRN generally requires a nonlinear transformation of the reaction equations (Eq. 6), there always exist linear transformations that can extract the special polynomial building blocks, each corresponding one-to-one with a topological feature of the overarching network structure, from the CRN’s reaction equations. In particular, all RPA-capable CRNs of Balancer type contain a connector polynomial, corresponding to the connector node, and one or more balancer polynomials, corresponding to balancer node(s), in their rowspans. CRNs of the Opposer type, on the other hand, contain one or more opposer polynomials (corresponding to opposer node(s)) in their rowspans.
Integral control and the ‘passing’ of invariants
Until now strategies for identifying an internal model, and an associated integral, via a nonlinear coordinate change have only been applicable to exceedingly simple CRNs18. By contrast, our approach identifies a well-defined nonlinear map between reaction rates of the model variables \({f}_{1},\ldots,{f}_{n}\), and a defining algebraic invariant, \(\rho\) (Eq. 6), which exists for all adaptation-capable CRNs. In contrast to all prior control theoretic approaches, this alternative viewpoint decomposes all RPA-capable CRNs into a constellation of linear integral control problems, each with an associated invariant (i.e. internal model). These are distributed across well-defined RPA-permissive CRN subnetworks, corresponding to RPA-permissive topological basis modules4, and construct an RPA polynomial, \(\rho\), through the process of invariant passing (Fig. 7; see also SI Sections S3 and S4).
Invariant passing describes the process by which polynomial invariants corresponding to adjacent topological features of the CRN’s overarching network structure are combined so as to systematically eliminate model variables, and ultimately obtain an RPA polynomial for each independent subnetwork, corresponding to an RPA-conferring topological module of the CRN. As illustrated schematically in Fig. 7a for CRNs of Opposer type, opposer invariants are passed from the distal opposer node to the proximal opposer node; for CRNs of Balancer type (Fig. 7b), invariants are passed from the diverter node to the sequence of balancer nodes within each parallel pathway, culminating at the connector node.
Crucially, we demonstrate that the ability or inability of these invariants to ‘pass’ within the rowspan of the system is a question of stoichiometric independence of the individual chemical reactions contributing to successive invariants. We outline the significance of this key concept through the analysis of a simple illustrative example (Fig. 8). In Fig. 8a, we depict a deficiency-one CRN comprising three interacting molecules, \(A\), \(B\) and \(C\), which exhibits RPA (and, more specifically, ACR) in the molecule \(A\). It is easy to show (SI Section S3.1) that this CRN is topologically a Balancer module, where \(A\) is the connector, \(B\) is the diverter, and \(C\) is a balancer. In Fig. 8b, we present a modified version of this CRN that preserves both its topology and its deficiency of one. Both CRNs contain an identical connector polynomial in their rowspans. In addition, both CRNs contain a balancer polynomial in their respective rowspans, as expected. In the original CRN (Fig. 8a), however, the balancer and connector polynomials are stoichiometrically independent, in the sense that the variable to be eliminated in the process of invariant passing (ie. \(C\)) derives from the reactant complex \(B+C\) in the balancer polynomial, and from the reactant complex \(C\) in the connector polynomial. Therefore, the connector polynomial must be multiplied by the concentration of molecule \(B\) (a concatenating monomial) in order for the balancer polynomial to pass to it, and thereby construct the RPA polynomial. By contrast, the single reactant complex \(C\) contributes to both subsidiary polynomials for the modified CRN (Fig. 8b), guaranteeing their stoichiometric dependence.
It is striking to note that the original form of the CRN (Fig. 8a) eludes the Shinar-Feinberg theorem, even though the CRN exhibits ACR and has a deficiency of one. It is thereby clear that, even for the special case of deficiency-one CRNs, the Shinar-Feinberg theorem cannot provide a comprehensive description of ACR (and hence RPA). By contrast, the modified form of the CRN (Fig. 8b), with stoichiometrically-dependent balancer and connector polynomials, does satisfy the Shinar-Feinberg theorem. With the stoichiometric dependence of all subsidiary polynomials now delivering the all-important RPA polynomial to the system’s rowspan, this modified CRN necessarily contains two non-terminal complexes (\(A+B\), and \(B\)) that differ in the single ACR-exhibiting molecule, \(A\) – thereby satisfying the conditions of Shinar and Feinberg’s theorem.
We illustrate the control diagram corresponding to our decomposition into a topological hierarchy of linear controllers in Fig. 9 for the particular case of a single Opposer module, since all Opposer modules necessarily incorporate an overarching feedback structure, and are thus easily described using standard control diagrams. In principle, there should always exist some single nonlinear coordinate change to extract a single output-driven internal model (Fig. 9a) from the system’s rate equations, corresponding to a single integral of the system’s tracking error (Fig. 9b)18,22,27. But in our representation, each subsidiary polynomial invariant corresponds to an independent internal model, each with its own independent setpoint. For a CRN constituting a three-node opposing set (Fig. 9c), for instance, there will exist three independent internal models and three corresponding opposer integrals, each conferring RPA on a different variable (Fig. 9d). These three independent linear control systems collaborate to confer RPA on the sensor variable of the CRN, and ultimately, the entire embedded network.
A general algorithm for adaptation detection in complex CRNs
It is clear from the illustrative example of the EnvZ-OmpR osmoregulatory motif (Fig. 3; see also additional CRN examples in SI) that even for exceedingly simple CRNs, constituting a single RPA module, the integral-computing polynomial invariants may be deeply concealed within the chemical reaction structures, and cannot generally be identified by inspection. For this, we introduce here a general algorithmic method for establishing the RPA capacity of a CRN, which can identify the subsidiary polynomial invariants automatically – even for large and/or high-deficiency CRNs, comprising multiple RPA-promoting topological modules.
Our method is a direct consequence of the fact that the RPA polynomial of any adaptation-capable CRN is a function of two variables, thereby converting the question or RPA capacity to a well-defined elimination problem. This elimination problem corresponds geometrically to the projection of the system onto just two variables (one RPA-capable, and one RPA-incapable) – a task that can accomplished via computation of the Gröbner basis of \( < {f}_{1},\ldots,{f}_{n} > =\{{h}_{1}\,{f}_{1}+\ldots+{h}_{n}\,{f}_{n}|{h}_{i}{\mathbb{\in }}{\mathbb{R}}[{x}_{1},\ldots,{x}_{n}]\}\) with suitable monomial ordering (see SI Section S5). Remarkably, although the problem of computing a Gröbner basis (e.g. by Buchberger’s algorithm30) for general systems of polynomials is well-known to be NP-Hard31, the special almost-linear structure of RPA capable CRNs (as described above, see also SI Section S4) allows any RPA-capable CRN to yield to this approach in polynomial time.
Although this method can be applied with any choice of two variables – one RPA-capable and one non-RPA-capable - we provide guidance in our SI on the decomposition of CRNs into independent subnetworks that can be analyzed individually as to their RPA-capacity, and for which particularly judicious choice of two variables can be made. In fact, analysis of deficiency in such independent subnetworks can confirm the inability of a CRN to exhibit RPA, if such is the case, since large and complex CRNs may otherwise require a long (and potentially indeterminate) timeframe for the algorithm to terminate. We provide a fully analyzed example of a non-RPA-capable CRN, to illustrate these principles, in SI Section S4.5. Moreover, the fact that the RPA polynomial is a function of (at most) two variables provides additional opportunities for computational efficiency via the choice of a fast elimination ordering on monomials – e.g. a block monomial ordering, involving two blocks (one for the two variables, and the other for the remaining variables to be eliminated). We provide full details of this method, along with code in the open-source software Singular (www.Singular.uni-kl.de) in our Supplementary Information (see SI Section S5), where we also provide a selection of fully-annotated illustrative examples. This code can readily be applied to any CRN.
Discussion
Identification of a definitive test for the capacity of a network of chemical reactions to exhibit RPA has been the subject of a long quest, and most attempts have considered only the special case of RPA known as Absolute Concentration Robustness (ACR). These diverse attempts have drawn from a range of different mathematical frameworks, which can be broadly divided into two main categories: the chemical reaction network theory (CRNT) viewpoint2,26,29, and the engineering control theory viewpoint16,17,18,19.
The pinnacle of CRNT approaches is the Shinar-Feinberg theorem2 which identifies a sufficient condition for ACR in CRNs of deficiency one2,29. It is now well known that most CRNs in nature have a deficiency much greater than one26 and the Shinar-Feinberg theorem is silent on all such CRNs. In addition, the Shinar-Feinberg theorem cannot reveal the setpoint of any ACR-exhibiting molecules as a function of system rate constants, nor how the existence of ACR corresponds to the presence of integral control. Karp et al.24, developed an alternative systematic method to identify ‘complex linear’ polynomial invariants, which require only linear combinations of the mass-action equations of a CRN. Using this method, the two subsidiary polynomial invariants given in Fig. 3c could be identified in an ad-hoc manner. But without recognizing these two invariants as a balancer invariant and a connector invariant, and the general relationship of such invariants to an RPA polynomial, this approach cannot make the crucial connection to the essential structure that characterizes all possible RPA-capable CRNs, and provides no connection to integral control in any such systems.
From the control theory viewpoint, Yi et al.19 use general linear models to demonstrate the necessity for integral control in all robust asymptotic tracking problems (such as RPA) and extract the internal model for the well-known Barkai-Leibler model of bacterial chemotaxis13 by ad-hoc (linear) algebraic manipulations. Gupta and Khammash23 provide a universal characterization, and an explicit integral control implementation, for CRNs with the special property known as maxRPA, where the system setpoint can only depend on two biochemical rate parameters. Moreover, a recent systematic algebraic method developed by Cappelletti et al.3 can now identify the capacity for RPA in any mass-action CRN for which an RPA polynomial exists in the rowspan of the system. This method explicitly identifies the presence of integral control in all such CRNs, and also reveals the system’s setpoint as a function of biochemical rate constants, but is silent on any CRN requiring a nonlinear coordinate change to reveal an internal model.
Until now, general strategies for identifying an internal model via nonlinear coordinate transformations have remained elusive, and specific nonlinear maps have been identified only for exceedingly simple RPA-capable CRNs18. Although a single nonlinear diffeomorphism that maps the original model variables to a special block form - thereby explicitly revealing a single internal model - should always exist in principle18,28, even in models for which no feedback loops are present22,27 (see Fig. 1b), the identification of such a nonlinear map in even the most complex special cases cannot, of itself, clarify the general principles that unify all possible RPA-capable chemical reaction structures.
By contrast, our approach identifies a well-defined nonlinear map – distinct from the coordinate transformations considered in previous control theoretic approaches18,19 – between the reaction rates of the individual molecules, \({f}_{1},\ldots,{f}_{n}\), and a key CRN invariant known as the RPA polynomial. This transformation holds for all RPA-capable CRNs, and constitutes a geometric projection of the full set of molecular concentrations onto a particular subset of the model variables, comprising one RPA-capable molecule and one non-RPA-capable molecule (recognizing that all RPA-capable networks require a minimum of one such variable to constitute the adaptation4). The innovative leap that we make from this mathematical cornerstone is to show that this nonlinear map can always be decomposed into a constellation of linear maps, each existing within a topological hierarchy4 associated to the CRN’s underlying flow of biochemical information, and each corresponding to an independent linear control problem. The integrals that are formulated by these independent subsidiary control systems thereby collaborate to confer RPA on one or more molecules in the CRN. Our approach unifies both the control theory and CRNT viewpoints, and extends prior results on the macroscale topologies4 of RPA-capable networks to the microscale level of intermolecular interactions within CRNs. The space of RPA-capable CRNs that we identify in this way extends our current understanding of the intricate biochemical interactions that support RPA beyond simple special cases that have been considered in previous work – deficiency-one ACR-capable CRNs2, ACR-capable CRNs with a linear constrained integral controller3, maxRPA networks23, etc. – to a truly general framework that can encompass all forms of RPA, in any CRN.
The combination of a definitive algebraic condition with the special almost-linear structure of the underlying control system provides the essential ingredients for a simple algorithmic test for RPA capacity, that is applicable even to large, high-deficiency CRNs. The only algorithmic method capable of handling CRNs of arbitrary deficiency prior to this work was the necessary condition for ACR identified by Eloundou-Mbebi et al.26 Being a necessary condition, the Eloundou-Mbebi method can identify a collection of molecules that certainly couldn’t exhibit ACR (and therefore RPA), and thereby reduces the number of molecules that must be analyzed in detail for their ACR (RPA) capacity, eg. via extensive numerical simulation. But the Eloundou-Mbebi method is unable to identify, definitively, which molecules do exhibit ACR (RPA) since it fails to capture the essential structural characteristics common to all RPA-capable networks. Indeed, the Eloundou-Mbebi method characteristically overestimates the space of molecules that could potentially exhibit ACR/RPA quite significantly26. For the deficiency-two model of the EnvZ-OmpR phosphorelay (Fig. 2), for instance, all nine species satisfy the Eloundou-Mbebi condition, even though only pOmpR can actually exhibit ACR/RPA (as we can easily prove by the method we present here). And in common with other CRNT-based approaches, the Eloundou-Mbebi condition makes no connection to integral control, and cannot identify the setpoint of any RPA-capable species as a function of biochemical parameters.
Although RPA-conferring CRN structures are known to be quite subtle32,33, the framework we present here delineates the fundamental principles fully. Only a complete and truly general picture of the integral control problem in CRNs, as we present here, can demarcate the evolutionary trajectories along which complex adaptation-capable biological networks can arise from simpler building blocks, and provide a roadmap for either preserving or disrupting the RPA property in natural, diseased or synthetic networks through design alterations or pharmacological interventions.
The quest to uncover the fundamental design principles that constrain complex signaling networks in nature to implement biologically important functions is considered to be one of the most important and far-reaching grand challenges in the life sciences34,35,36,37,38,39. On the basis of the present study, along with our earlier topological study at the network macroscale4, RPA currently stands alone as a keystone biological response for which there now exists a universal explanatory framework – one that imposes strict and inviolable design criteria on arbitrarily large and complex networks, and one that now accounts for the subtleties of intricate intermolecular interactions at the network microscale. These universal RPA-permissive design principles now represent a launching-point for future explorations of more complex phenotypes - including some classes of embryonic patterning problems, for instance, where integral control is known to play a role in promoting adaptation of segmentation boundaries to variations in organism size14,15. The identification of universal design principles for many other complex phenotypes, such as Turing patterns37,40,41 and multistability/switching-responses42,43, is likely to prove more challenging - due, in part, to the central role of equilibrium stabilities, or instabilities, in generating these responses. These grand challenges remain open, and we hope that our study will inspire bold new mathematical thinking in these vitally important directions.
Methods
For the purposes of obtaining the greatest possible generality and universality, we define RPA from the most general possible viewpoint in this study. In particular, we consider a CRN to exhibit RPA in the concentration, \(x\), of some network molecule (directly or indirectly subjected to some disturbance or perturbation) exactly when \(x\) maintains a constant steady-state value, \(c\), for all steady-states of the system. The setpoint, \(c\), is a function of some subset of CRN parameters. Moreover, the CRN exhibits RPA (in \(x\)) in response to any perturbation or disturbance that leaves the collection of setpoint parameters unaltered (see SI Section S1). We make no assumptions a priori as to which type(s) of network perturbation or disturbance might affect a particular CRN, nor do we impose any restrictions on which (or how many) parameters determine the setpoint.
In our Supplementary Information (SI), we provide full details of all mathematical theorems that support our results, along with their corresponding proofs. The central result of our study, the Two-Variable Kinetic Pairing Theorem (Theorem 1), is discussed fully, and proved, in SI Section S1, along with a full discussion of the RPA polynomial – the fundamental object at the heart of Theorem 1 – in addition to a range of other essential concepts, such as CRN deficiency, partitions of CRN reactions into algebraically independent subsets/subnetworks, matrix decomposition of CRN mass-action equations, and boundary variables. The second pivotal result of this study concerns the nature of the nonlinear transformation (of the CRN rate equations) required to yield the all-important RPA polynomial, and the fact that this transformation is always decomposable into a topological hierarchy of linear maps (and hence, linear integral controllers, and their associated internal models). Our analysis (SI Sections S2, S3, S4) highlights the crucial notion that the deficiency of the CRN fundamentally controls the formation of polynomial invariants that are obtainable through linear coordinate changes. All theorems related to these concepts are discussed in detail, along with their corresponding proofs and a set of fully-analyzed illustrative examples (SI Section S4) and annotated Singular code (SI Section S5).
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
No datasets were generated or analyzed during this study.
Code availability
All code used for the analysis of illustrative CRN examples in this study is provided in the Supplementary Information (SI) file. See SI Section S5 for fully annotated code listings, as well as complete listings of code output for all examples considered in this study. All code is written in the open-source software Singular (www.singular.uni-kl.de). Detailed guidance on running this code, and adapting the code to the analysis of any CRN, is provided in SI Section S5.
References
Tang, Z. F. & McMillen, D. R. Design principles for the analysis and construction of robustly homeostatic biological networks. J. Theor. Biol. 408, 274–289 (2016).
Shinar, G. & Feinberg, M. Structural sources of robustness in biochemical reaction networks. Science 327, 1389–1391 (2010).
Cappelletti, D., Gupta, A. & Khammash, M. A hidden integral structure endows absolute concentration robust systems with resilience to dynamical concentration disturbances. J. R. Soc. Interface 17, 20200437 (2020).
Araujo, R. P. & Liotta, L. A. The topological requirements for robust perfect adaptation in networks of any size. Nat. Commun. 9, 1757 (2018).
Araujo, R. P., Vittadello, S. T. & Stumpf, M. P. H. Bayesian and Algebraic Strategies to Design in Synthetic Biology. Proceedings of the IEEE 110, 675–687 (2022).
Aoki, S. K. et al. A universal biomolecular integral feedback controller for robust perfect adaptation. Nature 570, 533–537 (2019).
El-Samad, H., Goff, J. P. & Khammash, M. Calcium homeostasis and parturient hypocalcemia: an integral feedback perspective. J. Theor. Biol. 214, 17–29 (2002).
Ferrell, J. E. Perfect and near-perfect adaptation in cell signaling. Cell Syst. 2, 62–67 (2016).
Kaupp, U. B. Olfactory signalling in vertebrates and insects: differences and commonalities. Nat. Rev. Neurosci. 11, 188–200 (2010).
Badimon, A. et al. Negative feedback control of neuronal activity by microglia. Nature 586, 417–423 (2020).
Eisner, V., Picard, M. & Hajnóczky, G. Mitochondrial dynamics in adaptive and maladaptive cellular stress responses. Nat. Cell Biol. 20, 755–765 (2018).
Alon, U., Surette, M. G., Barkai, N. & Leibler, S. Robustness in bacterial chemotaxis. Nature 397, 168–171 (1999).
Barkai, N. & Leibler, S. Robustness in simple biochemical networks. Nature 387, 913–917 (1997).
Ben-Zvi, D. & Barkai, N. Scaling of morphogen gradients by an expansion-repression integral feedback control. Proc. Natl Acad. Sci. USA 107, 6924–6929 (2010).
Eldar, A. et al. Robustness of the BMP morphogen gradient in Drosophila embryonic patterning. Nature 419, 304–308 (2002).
Francis, B. A. & Wonham, W. M. The internal model principle of linear control theory. IFAC Proc. 8, 331–336 (1975).
Francis, B. A. & Wonham, W. M. The internal model principle of control theory. Automatica 12, 457–465 (1976).
Sontag, E. D. Adaptation and regulation with signal detection implies internal model. Syst. Control Lett. 50, 119–126 (2003).
Yi, T. M., Huang, Y., Simon, M. I. & Doyle, J. Robust perfect adaptation in bacterial chemotaxis through integral feedback control. Proc. Natl Acad. Sci. USA 97, 4649–4653 (2000).
Cox, D. A. Applications of polynomial systems. Vol. 134 (American Mathematical Soc., 2020).
Briat, C., Gupta, A. & Khammash, M. Antithetic integral feedback ensures robust perfect adaptation in noisy biomolecular networks. Cell Syst. 2, 15–26 (2016).
Shoval, O., Alon, U. & Sontag, E. Symmetry invariance for adapting biological systems. SIAM J. Appl. Dynamical Syst. 10, 857–886 (2011).
Gupta, A. & Khammash, M. Universal structural requirements for maximal robust perfect adaptation in biomolecular networks. Proceedings of the National Academy of Sciences 119, e2207802119 (2022).
Karp, R. L., Perez Millan, M., Dasgupta, T., Dickenstein, A. & Gunawardena, J. Complex-linear invariants of biochemical networks. J. Theor. Biol. 311, 130–138 (2012).
Huang, J. et al. In IEEE Conference on Decision and Control. 5370–5390.
Eloundou-Mbebi, J. M. O. et al. A network property necessary for concentration robustness. Nat. Commun. 7, 13255 (2016).
Bin, M. et al. Internal Models in Control, Bioengineering, and Neuroscience. Annu. Rev. Control, Robot., Autonomous Syst. 5, 55–79 (2022).
Xiao, F. & Doyle, J. C. In IEEE Conference on Decision and Control. 4345–4352.
Feinberg, M. Foundations of Chemical Reaction Network Theory. Vol. 202 (Springer, 2019).
Cox, D. A., Little, J. & O’Shea, D. Ideals, Varieties and Algorithms. 4th Edition edn, (Springer, 2015).
Ananth, P. V. & Dukkipati, A. Complexity of Gröbner basis detection and border basis detection. Theor. Computer Sci. 459, 1–15 (2012).
Jeynes-Smith, C. & Araujo, R. P. Ultrasensitivity and bistability in covalent-modification cycles with positive autoregulation. Proceedings of the Royal Society A 447 20210069 (2021).
Jeynes-Smith, C. & Araujo, R. P. Protein-protein complexes can undermine ultrasensitivity-dependent biological adaptation. Journal of the Royal Society Interface 20, 20220553 (2023).
Alon, U. An introduction to systems biology: design principles of biological circuits. (Chapman and Hall/CRC, 2006).
Green, S. Revisiting generality in biology: systems biology and the quest for design principles. Biol. Philos. 30, 629–652 (2015).
Novák, B. & Tyson, J. J. Design principles of biochemical oscillators. Nat. Rev. Mol. cell Biol. 9, 981–991 (2008).
Vittadello, S. T., Leyshon, T., Schnoerr, D. & Stumpf, M. P. Turing pattern design principles and their robustness. Philos. Trans. R. Soc. A 379, 20200272 (2021).
Stumpf, M. P. H. Statistical and computational challenges for whole cell modelling. Curr. Opin. Syst. Biol. 26, 58–63 (2021).
Lim, W. A., Lee, C. M. & Tang, C. Design principles of regulatory networks: searching for the molecular algorithms of the cell. Mol. cell 49, 202–212 (2013).
Lander, A. Pattern, growth, and control. Cell 144, 955–969 (2011).
Krause, A. L., Gaffney, E. A., Maini, P. K. & Klika, V. Introduction to ‘Recent progress and open frontiers in Turing’s theory of morphogenesis’. Philos. Trans. R. Soc. A 379, 20200280 (2021).
Ullner, E., Zaikin, A., Volkov, E. I. & García-Ojalvo, J. Multistability and clustering in a population of synthetic genetic oscillators via phase-repulsive cell-to-cell communication. Phys. Rev. Lett. 99, 148103 (2007).
Duddu, A. S., Sahoo, S., Hati, S., Jhunjhunwala, S. & Jolly, M. K. Multi-stability in cellular differentiation enabled by a network of three mutually repressing master regulators. J. R. Soc. Interface 17, 20200631 (2020).
Acknowledgements
R.P.A. is supported by an Australian Research Council (ARC) Future Fellowship (project no. FT190100645) from the Australian Government.
Author information
Authors and Affiliations
Contributions
R.P.A. conceived the study and secured funding, proposed all mathematical concepts and definitions, proved all theorems, undertook all analysis and wrote Singular code. R.P.A. and L.A.L. wrote the paper.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Michael Stumpf and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Araujo, R.P., Liotta, L.A. Universal structures for adaptation in biochemical reaction networks. Nat Commun 14, 2251 (2023). https://doi.org/10.1038/s41467-023-38011-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-023-38011-9