Chapter V: Data-driven Approach in the Noiseless Case
5.4 Localized data-driven System Level Synthesis
In this section we present the necessary results that allow us to recast the con- straints in (2.12) in a localized data-driven parametrization. We first provide a naive parametrization of system responses subject to locality constraints based on Lemma 13 in terms ofG. We then build on this parameterization and show that localized system responses can be characterized using only locally collected trajectories.
Locality constraints in data-driven System Level Synthesis
We start by rewriting the locality constraints using the data-driven parameterization (5.2).
Lemma 14. Consider the LTI system(2.1)with controllable(๐ด, ๐ต)matrices, where each subsystem ๐ is subject to locality constraints (2.4). Assume that there is no driving noise. Given the state and input trajectories{xห,uห}generated by the system over a horizon๐ withuPE of order at least๐+ ๐ฟ, the following parametrization overGcharacterizes all possible๐-localized system responses over a time span of ๐ฟโ1:
๐ป๐ฟ(xห,uห)G, for allGs.t.๐ป1(xห)G= ๐ผ , (5.3) ๐ป๐ฟ( [หx]๐)G๐ =0โ๐ โin๐(๐),
๐ป๐ฟ( [u]ห ๐)G๐ =0โ๐ โin๐(๐+1), for all๐ =1, . . . , ๐ .
Proof. We aim to show that
{๐ฝ: ๐๐ด ๐ต๐ฝ=๐ผ ,๐ฝโ L๐} ={๐ป๐ฟ(xห,u)Gห :Gs.t. (5.3)}.
(โ) First, suppose that ๐ฝ โ L๐ satisfies that ๐๐ด ๐ต๐ฝ = ๐ผ. From Lemma 13, we immediately have that there exists a matrixG s.t. ๐ฝ =๐ป๐ฟ(xห,uห)G. Thus, we need only verify that thisGsatisfies the linear constraint in (5.3). This follows directly from the assumption that๐ฝ โ L๐, which states that
๐ป๐ฟ( [xห]๐)G๐ =[๐ฝ๐ฅ]๐ ๐ =0โ๐ โin๐(๐), ๐ป๐ฟ( [uห]๐)G๐ = [๐ฝ๐ข]๐ ๐ =0โ๐ โin๐(๐+1). Hence,๐ฝโRHS, proving this direction.
(โ) Now suppose that there exists a G that satisfies the constraints on the RHS and let ๐ฝ = ๐ป๐ฟ(xห,u)Gห . Since ๐ป1(x)Gห = ๐ผ, from Lemma 2, we have that ๐ฝ is achievable. From the other two constraints, we have that ๐ฝ โ L๐, proving this
direction and hence the lemma. โก
It is important to note that even though Lemma 14 allows one to capture the locality constraint (2.4) by simply translating the locality constraints over๐ฝto constraints overG, it cannot be implemented with only local information exchange. In order to satisfy the constraints (5.3), each subsystem has to have access to global state and input trajectories and construct a global Hankel matrix. The PE condition of Lemma 12 further implies that the length of the trajectory that needs to be collected grows with the dimension of the global system state. In what follows we show how constraint (5.3) can further be relaxed to only require local information without introducing any additional conservatism.
Localized Data-driven System Level Synthesis
In this subsection we show that constraint (5.3) can be enforced (i) with local communication between neighbors, i.e., no constraints are imposed outside each subsystem ๐-neighborhood, and (ii) the amount of data needed, i.e., trajectory length, only scales with the size of the๐-localized neighborhood, and not the global system. We start by providing a result that allows constraint (5.3) to be satisfied with local information only.
Definition 11. Given a subsystem๐ satisfying the local dynamics [๐ฅ(๐ก+1)]๐ = โ๏ธ
๐โ{๐,๐ยฑ1}
[๐ด]๐ ๐[๐ฅ(๐ก)]๐ + [๐ต]๐๐[๐ข(๐ก)]๐+ [๐ค(๐ก)]๐, (5.4)
we define itsaugmented๐-localized subsystemas the system composed by the states [๐ฅ]in๐(๐+1)and augmented control actions[๐ขยฏ]๐ := ( [๐ข]โบ
in๐(๐+2) [๐ฅ]โบ
๐)โบ, โ๐ ๐ .๐ก .dist(๐ โ ๐) =๐+2. That is, the system given by
[๐ฅ(๐ก+1)]in๐(๐+1) = [๐ด]in๐(๐+1)[๐ฅ(๐ก)]in๐(๐+1) + [๐ตยฏ]in๐(๐+1)[๐ขยฏ(๐ก)]๐, (5.5) with๐ตยฏ := h
[๐ต]in๐(๐+2) [๐ด]๐ ๐
i
โ ๐ s.t. ๐๐ ๐ ๐ก(๐ โ๐) =๐+2.
Notice that by treating the state of the boundary subsystems as additional control inputs, we can view the augmented๐-localized system as a standalone LTI system.
Lemma 15. For ๐ = 1, . . . , ๐, let ๐ฟ๐ be an achievable system response for the augmented๐-localized subsystem(5.5)of subsystem๐. Further assume that each๐ฟ๐ satisfies constraints(5.6):
[๐ฟ๐๐ฅ]๐ =0, โ๐ s.t. ๐+1โค dist(๐ โ๐) โค ๐+2, (5.6a) [๐ฟ๐๐ข]๐ =0, โ๐ s.t. dist(๐ โ๐) =๐+2 (5.6b) for all๐. Then, the system response๐ฝdefined by(5.7)is achievable for system(??) and๐-localized.
[๐ฝ]๐ ๐ :=
๏ฃฑ๏ฃด
๏ฃด
๏ฃฒ
๏ฃด๏ฃด
๏ฃณ
[๐ฟ๐]๐, โ๐ โin๐(๐+1)
0, otherwise
(5.7) for all๐ =1, . . . , ๐ is also achievable and๐-localized.
Proof. First, from the fact that๐ฟ๐ is achievable for all ๐ = 1, . . . , ๐, we have that ฮฆ๐ฅ[0] = ๐ผ by construction. Thus, to show that๐ฝis achievable, it suffices to show that
ฮฆ๐ฅ[๐ก+1] = ๐ดฮฆ๐ฅ[๐ก] +๐ตฮฆ๐ข[๐ก], โ0โค ๐ก โค๐ โ1.
We show this block-column-wise. Specifically, we show that the block columnsฮฆ๐๐ฅ andฮฆ๐๐ขassociated with each subsystem satisfy
ฮฆ๐๐ฅ[๐ก+1] = ๐ดฮฆ๐๐ฅ[๐ก] +๐ตฮฆ๐๐ข[๐ก], โ0โค ๐ก โค๐ โ1. (5.8) We further partition the rows of these block-columns into four subsets as follows:
ฮฆ๐๐ฅ = h [ฮฆ๐๐ฅ]โบ
in๐(๐) [ฮฆ๐๐ฅ]โบ
๐+1 [ฮฆ๐๐ฅ]โบ
๐+2 [ฮฆ๐๐ฅ]โบ
ext๐(๐+2)
iโบ ,
where the notation [ฮฆ๐๐ฅ]๐ represents the entries ofฮฆ๐ฅ corresponding to subsystems ๐-hops away from the๐-th subsystem. Identical notation holds for the partition of ฮฆ๐๐ข.
Using this partition, we have the following forฮฆ๐๐ฅ andฮฆ๐๐ข[๐ก] given their definition in terms of๐ฟ:
ฮฆ๐๐ฅ[๐ก] =
๏ฃฎ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฐ
[ฮจ๐ฅ๐[๐ก]]in๐(๐) 0 0 0
๏ฃน
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃป
, ฮฆ๐๐ข[๐ก] =
๏ฃฎ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฐ
[ฮจ๐ข๐[๐ก]]in๐(๐) [ฮจ๐ข๐[๐ก]]๐+1
0 0
๏ฃน
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃป .
We also partition the dynamics matrices ๐ดand ๐ตaccordingly, where
๐ด=
๏ฃฎ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฐ ๐ดin(
๐) in(๐) ๐ดin(
๐)
๐+1 0 0
๐ด๐+1
in(๐) ๐ด๐+1
๐+1 ๐ด๐+1
๐+2 0
0 ๐ด๐+2
๐+1 ๐ด๐+2
๐+2 ๐ด๐+2
ext๐(๐+2)
0 0 ๐ดext๐(
๐+2)
๐+2 ๐ดext๐(
๐+2) ext๐(๐+2)
๏ฃน
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃป ,
๐ต=
๏ฃฎ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฏ
๏ฃฐ ๐ตin(๐)
in(๐) 0 0 0
0 ๐ต๐+1
๐+1 0 0
0 0 ๐ต๐+2
๐+2 0
0 0 0 ๐ตext๐(๐+2)
ext๐(๐+2)
๏ฃน
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃบ
๏ฃป .
Here, the superscript represents an index on the block row and the subscript repre- sents an index on the block column. The sparsity pattern of the partition follows directly from the definition of augmented๐-localized subsystems and the subsystem dynamics (5.4).
We can now show that equation (5.8) holds for each of the๐thblock-columns andฮฆ๐ is an achievable impulse response of the system. First, note that
[ฮฆ๐๐ฅ[๐ก+1]]in๐(๐) =[๐ดฮฆ๐๐ฅ[๐ก] +๐ตฮฆ๐๐ข[๐ก]]in๐(๐)
=๐ดin๐(
๐)
in๐(๐)[ฮจ๐๐ฅ[๐ก]]in
๐(๐) +๐ตin๐(
๐)
in๐(๐)[ฮจ๐๐ข[๐ก]]in
๐(๐) +๐ตin๐(
๐)
๐+1 [ฮจ๐ข๐[๐ก]]๐+1
=[ฮจ๐๐ฅ[๐ก+1]]in๐(๐),
where the second equality comes from the sparsity patterns of ๐ด, ๐ต, and ๐ฝ๐, and the third equality from the achievability of๐ฟ๐. Similarly, to show that the boundary subsystems satisfy the dynamics, we note that
[ฮฆ๐๐ฅ[๐ก+1]]๐+1= ๐ด๐+1
in๐(๐)[ฮจ๐ฅ(๐)(๐ก)]in๐(๐) +๐ต๐+1
๐+1[ฮจ๐ข(๐)(๐ก)]๐+1
= [ฮจ๐ฅ(๐)(๐ก+1)]๐+1
=0.
Lastly, from the sparsity pattern of the dynamic matrices and ฮฆ๐[๐ก], we trivially have that
[ฮฆ๐ฅ(๐)(๐ก+1)]ext๐(๐) =[๐ดฮฆ๐๐ฅ[๐ก] +๐ตฮฆ๐๐ข[๐ก]]ext๐(๐) =0,
concluding the proof for the achievability of ๐ฝ. We end by noting that ๐ฝ is ๐-
localized by construction. โก
In light of this result, locality constraints as in Definition 2, i.e., [๐ฝ๐ฅ]๐ ๐ = 0โ๐ โ out๐(๐), do not need to be imposed on every subsystem๐ โ out๐(๐). Instead, it suffices to impose this constraint only on subsystems๐at a distance๐+2 of subsystem ๐. Intuitively, this can be seen as a constraint on the propagation of a signal: if [๐ค]๐ has no effect on subsystem ๐ at distance ๐ +1 because [๐ฝ๐ฅ]๐ ๐ = 0, then the propagation of that signal is stopped and localized within that neighborhood. This idea will allow us to reformulate constraint (5.3) so that it can be imposed with only local communications.
However, despite the fact that locality constraints can now be achieved with local information exchanges, the amount of data that needs to be collected scales with the global size of the network๐because we require that the control trajectory be at least PE of order at least ๐+๐ฟ. In the following theorem, we build upon the previous results and show how this requirement can also be reduced to only depend on the size of a๐-localized neighborhood.
Theorem 4. Consider the LTI system (2.1) composed of subsystems (5.4), each with controllable ( [๐ด]in
๐(๐+2),[๐ต]in
๐(๐+2)) matrices for the augmented๐-localized subsystem ๐. Assume that there is no driving noise and that the local control trajectory at the๐-localized subsystem[uห]in๐(๐+1) is PE of order at least๐in
๐(๐)+๐ฟ, where ๐in
๐(๐) is the dimension of [xห]in๐(๐). Then, ๐ฝ is an achievable ๐-localized system response for each subsystem(5.4)if and only if it can be written as
[๐ฝ๐]in๐(๐) =๐ป๐ฟ( [x]ห in๐(๐+1),[u]ห in๐(๐+1))G๐, (5.9a) [๐ฝ๐]ext
๐(๐+1) =0, (5.9b)
whereG๐ satisfies
๐ป1( [xห]in๐(๐+1))G๐= ๐ผ๐, (5.10a) ๐ป๐ฟ( [x]ห ๐)G๐ =0โ๐, ๐ s.t. ๐+1 โค dist(๐ โ๐) โค ๐+2, (5.10b) ๐ป๐ฟ( [uห]๐)G๐ =0โ๐, ๐s.t. dist(๐ โ๐) =๐+2. (5.10c)
Proof. (โ) We first show that all๐-localized system responses๐ฝcan be parame- terized by a corresponding set of matrices {G๐}๐
๐=1. First, we note that since ๐ฝis ๐-localized, each๐-localized subsystem impulse response[๐ฝ๐]in๐(๐+1) is achievable on the augmented ๐-localized subsystem๐. Thus, from applying Corollary 3.1, we have that there existsG๐satisfying constraint (5.10a) such that
[๐ฝ๐]in๐(๐) =๐ป๐ฟ( [หx]in๐(๐),[uห]in๐(๐+1))G๐.
Since๐ฝis๐-localized, we have thatG๐satisfies both constraints (5.10b) and (5.10c), concluding the proof in this direction.
(โ) Now we show that if eachG๐satisfies the constraint (5.10) for all๐=1, . . . , ๐, then the resulting๐ฝis achievable and localized. Consider the augmented๐-localized subsystem๐and define
๐ฟ๐ =๐ป๐ฟ( [xห]in๐(๐),[uห]in๐(๐+1))G๐.
From Corollary 3.1, we have that ๐ฟ๐ is an achievable impulse response on the augmented ๐-localized subsystem ๐. Moreover, by construction it satisfies the sparsity condition in Lemma 15. Thus, constructing๐ฝusing๐ฟas in equation (5.7) we conclude that๐ฝis an achievable and๐-localized system response. โก Corollary 4.1. Consider a function๐ :๐ฝโRsuch that
๐(๐ฝ) =
๐
โ๏ธ
๐=1
๐๐( [๐ฝ๐]in๐(๐+1)). Then, solving the optimization problem
min ๐(๐ฝ) ๐ .๐ก . ๐๐ด ๐ต๐ฝ=๐ผ , ๐ฝโ L๐
is equivalent to solving min
๐
โ๏ธ
๐=1
๐๐
๐ป๐ฟ [xห]in๐(๐),[uห]in๐(๐+1) G๐
๐ .๐ก .G๐ satisfies(5.10)for all๐ =1. . . , ๐ ,
and then constructing the๐-localized system response๐ฝas per equation(5.9).
This result provides a data-driven approach in which locality constraints, as in equation (2.4), can be seamlessly considered and imposed by means of an affine subspace where only local information exchanges are necessary. Moreover, the
amount of data needed to parametrize the behavior of the system does not scale with the size of the network but rather with๐, the size of the localized region, which is usually much smaller than ๐. To the best of our knowledge, this is the first such result. As we show next, this will prove key in extending data-driven SLS to the distributed setting.