Discrete abstractions of continuous control systems Giordano Pola Center of Excellence for Research DEWS Department of Electrical and Information Engineering University of L’Aquila
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
1 / 59
Correct-by-Design Controller Synthesis
A three step approach: Computation of a symbolic abstraction of the physical system Discrete controller synthesis for the symbolic abstraction Hybrid controller synthesis via discrete controller refinement
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
2 / 59
Equivalence notions Several notions of equivalence have been introduced in computer science The work R.J. van Glabbeek The linear time-branching time spectrum CONCUR’90, 1990 enumerated a dozen of equivalence notions
A central notion in the construction of discrete abstractions is the one of bisimulation equivalence G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
3 / 59
Equivalence notions Example Consider the following finite system:
x2 u1
b
u3 x3 c
x1 a u2
x4
u1
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
- , Y , H)
u3 x3 c
x1 a u2
x4
u1
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
- , Y , H)
X0 = {x1 } u3 x3 c
x1 a u2
x4
u1
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
- , Y , H)
X0 = {x1 } u3
U = {u1 , u2 , u3 } x3 c
x1 a u2
x4
u1
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
X0 = {x1 } u3
U = {u1 , u2 , u3 } x3 c
x1 a u2
x4
- , Y , H)
1 - = {x1 ux2 , u3 u2 x2 x3 , x1 x4 , x4
u1
- x3 }
u1
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
X0 = {x1 } u3
U = {u1 , u2 , u3 } x3 c
x1 a u2
x4
- , Y , H)
u1
1 - = {x1 ux2 , u3 u2 x2 x3 , x1 x4 , x4
u1
- x3 }
Y = {a, b, c}
b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
X0 = {x1 } u3
U = {u1 , u2 , u3 } x3 c
x1 a u2
x4 b
G. Pola ( DEWS - UNIVAQ )
- , Y , H)
u1
1 - = {x1 ux2 , u3 u2 x2 x3 , x1 x4 , x4
u1
- x3 }
Y = {a, b, c} H(x1 ) = a, H(x2 ) = b, H(x3 ) = b, H(x4 ) = c
Discrete abstractions
4 / 59
Equivalence notions Example Consider the following finite system: Sa = (X , X0 , U,
X = {x1 , x2 , x3 , x4 }
x2 u1
b
X0 = {x1 } u3
U = {u1 , u2 , u3 } 1 - = {x1 ux2 , u3 u2 x2 x3 , x1 x4 , x4
x3 c
x1 a u2
x4
- , Y , H)
u1
- x3 }
Y = {a, b, c}
u1
H(x1 ) = a, H(x2 ) = b, H(x3 ) = b, H(x4 ) = c
b
System Sa is "equivalent" to system Sb described by: x5 a G. Pola ( DEWS - UNIVAQ )
u1
x6 b
Discrete abstractions
u3
x7 c 4 / 59
Equivalence notions Definition (Bisimulation Relation) Consider systems Sa and Sb with Ya = Yb . A relation R ⊆ Xa × Xb is a bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have Ha (xa ) = Hb (xb ); for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
G. Pola ( DEWS - UNIVAQ )
Sa implies the existence of xb Sb implies the existence of xa
Discrete abstractions
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
5 / 59
Equivalence notions Definition (Bisimulation Relation) Consider systems Sa and Sb with Ya = Yb . A relation R ⊆ Xa × Xb is a bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have Ha (xa ) = Hb (xb ); for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
Sa implies the existence of xb Sb implies the existence of xa
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
We say that Sa and Sb are bisimilar, denoted by Sa ∼ =S Sb , if there exists a bisimulation relation between Sa and Sb .
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
5 / 59
Equivalence notions Definition (Bisimulation Relation) Consider systems Sa and Sb with Ya = Yb . A relation R ⊆ Xa × Xb is a bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have Ha (xa ) = Hb (xb ); for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
Sa implies the existence of xb Sb implies the existence of xa
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
We say that Sa and Sb are bisimilar, denoted by Sa ∼ =S Sb , if there exists a bisimulation relation between Sa and Sb . Bisimulation equivalence is an equivalence relation on the class of systems G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
5 / 59
Equivalence notions Example
x1 a
u1
x2
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
6 / 59
Equivalence notions Example
x1 a
x2
u1
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b Systems Sa and Sb are bisimilar with bisimulation relation: R
G. Pola ( DEWS - UNIVAQ )
=
Discrete abstractions
6 / 59
Equivalence notions Example
x1 a
x2
u1
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b Systems Sa and Sb are bisimilar with bisimulation relation: R
G. Pola ( DEWS - UNIVAQ )
=
{(x1 , x5 )
Discrete abstractions
6 / 59
Equivalence notions Example
x1 a
x2
u1
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b Systems Sa and Sb are bisimilar with bisimulation relation: R
G. Pola ( DEWS - UNIVAQ )
=
{(x1 , x5 ), (x2 , x6 )
Discrete abstractions
6 / 59
Equivalence notions Example
x1 a
x2
u1
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b Systems Sa and Sb are bisimilar with bisimulation relation: R
G. Pola ( DEWS - UNIVAQ )
=
{(x1 , x5 ), (x2 , x6 ), (x3 , x7 )
Discrete abstractions
6 / 59
Equivalence notions Example
x1 a
x2
u1
x3 c
u3
b u2
u1
x5 a
u1
x6 b
u3
x7 c
x4 b Systems Sa and Sb are bisimilar with bisimulation relation: R
G. Pola ( DEWS - UNIVAQ )
=
{(x1 , x5 ), (x2 , x6 ), (x3 , x7 ), (x4 , x6 )}
Discrete abstractions
6 / 59
Equivalence notions
Bisimulation is a popular tool for complexity reduction of finite systems Consider a system S and a copy of itself The maximal bisimulation relation is a relation R ∗ ⊆ X × X so that R ⊆ R ∗ for any bisimulation relation R
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
7 / 59
Equivalence notions
Bisimulation is a popular tool for complexity reduction of finite systems Consider a system S and a copy of itself The maximal bisimulation relation is a relation R ∗ ⊆ X × X so that R ⊆ R ∗ for any bisimulation relation R R ∗ = ∪i Ri where {Ri }i is the collection of all bisimulation relations
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
7 / 59
Equivalence notions
Bisimulation is a popular tool for complexity reduction of finite systems Consider a system S and a copy of itself The maximal bisimulation relation is a relation R ∗ ⊆ X × X so that R ⊆ R ∗ for any bisimulation relation R R ∗ = ∪i Ri where {Ri }i is the collection of all bisimulation relations R ∗ is an equivalence relation on the set X of states of S
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
7 / 59
Equivalence notions
Bisimulation is a popular tool for complexity reduction of finite systems Consider a system S and a copy of itself The maximal bisimulation relation is a relation R ∗ ⊆ X × X so that R ⊆ R ∗ for any bisimulation relation R R ∗ = ∪i Ri where {Ri }i is the collection of all bisimulation relations R ∗ is an equivalence relation on the set X of states of S Not any bisimulation relation R is an equivalence relation on the set X of states of S
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
7 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
G. Pola ( DEWS - UNIVAQ )
- , Y/R , H/R )
/R
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅}
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
G. Pola ( DEWS - UNIVAQ )
u
- y with x ∈ Ci and y ∈ Cj
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
u
- y with x ∈ Ci and y ∈ Cj
Y/R = Y
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
u
- y with x ∈ Ci and y ∈ Cj
Y/R = Y H/R (Ci ) = H(x) for any x ∈ Ci
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
u
- y with x ∈ Ci and y ∈ Cj
Y/R = Y H/R (Ci ) = H(x) for any x ∈ Ci Some remarks: S∼ =S S/R
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
u
- y with x ∈ Ci and y ∈ Cj
Y/R = Y H/R (Ci ) = H(x) for any x ∈ Ci Some remarks: S∼ =S S/R ∼ =S S/R ∗
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Given a system S = (X , X0 , U, - , Y , H), an equivalence and bisimulation relation R between S and itself, induces the quotient S/R on S defined by S/R = (X/R , X0,/R , U/R ,
- , Y/R , H/R ),
/R
where: X/R is the collection of equivalence classes Ci induced by R on X , so that x, y ∈ Ci iff (x, y ) ∈ R X0,/R = {Ci ∈ X/R : Ci ∩ X0 6= ∅} U/R = U Ci
u
- Cj if there exists x
/R
u
- y with x ∈ Ci and y ∈ Cj
Y/R = Y H/R (Ci ) = H(x) for any x ∈ Ci Some remarks: S∼ =S S/R ∼ =S S/R ∗ S/R ∗ is the minimal bisimilar system of S G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
8 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R∗ =
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ),
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ), (x2 , x2 ), (x3 , x3 ), (x4 , x4 ),
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ), (x2 , x2 ), (x3 , x3 ), (x4 , x4 ), (x2 , x4 ), (x4 , x2 )}
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ), (x2 , x2 ), (x3 , x3 ), (x4 , x4 ), (x2 , x4 ), (x4 , x2 )} R ∗ is an equivalence relation on X
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ), (x2 , x2 ), (x3 , x3 ), (x4 , x4 ), (x2 , x4 ), (x4 , x2 )} R ∗ is an equivalence relation on X Equivalence classes induced by R ∗ are C1 = {x1 }, C2 = {x2 , x4 } and C3 = {x3 }
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
9 / 59
Equivalence notions Example Consider the following finite system S: x1 a
u1
x2
u3
b u2
x3 c
u1 x4 b
R ∗ = {(x1 , x1 ), (x2 , x2 ), (x3 , x3 ), (x4 , x4 ), (x2 , x4 ), (x4 , x2 )} R ∗ is an equivalence relation on X Equivalence classes induced by R ∗ are C1 = {x1 }, C2 = {x2 , x4 } and C3 = {x3 } The minimal system bisimilar to system S is the system S/R ∗ described by C1 a G. Pola ( DEWS - UNIVAQ )
u1
C2 b
Discrete abstractions
u3
C3 c 9 / 59
Discrete abstractions Efficient bisimulation algorithms have been studied for complexity reduction of large–scale finite systems Challenge: From finite systems to infinite systems!
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
10 / 59
Discrete abstractions Efficient bisimulation algorithms have been studied for complexity reduction of large–scale finite systems Challenge: From finite systems to infinite systems! Discrete abstractions of dynamical and hybrid systems: In 1992, Alur and Dill show that Timed Automata admit bisimilar symbolic models In 1993, Alur et al. and Nicollin et al. show that Multirate Automata admit bisimilar symbolic models In 1994, Puri and Varaiya, and in 1998 Henziger et al. show that Rectangular Automata admit finite quotient induced by language equivalence In 2000, Lafferriere et al. show that o-minimal hybrid systems admit bisimilar symbolic models
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
10 / 59
Discrete abstractions Discrete abstractions of control systems: X.D. Koutsoukos, P.J. Antsaklis, J.A. Stiver, and M.D. Lemmon, Supervisory control of hybrid systems, Proceedings of the IEEE, 88, 2000 T. Moor, J. Raisch, and S.D. O0 Young, Discrete supervisory control of hybrid systems based on l-complete approximations, Journal of Discrete Event and Dynamic Systems, 12, 2002 D. Forstner, M. Jung, and J. Lunze, A discrete-event model of asynchronous quantised systems, Automatica, 38, 2002 P.E. Caines and Y.J. Wei, Hierarchical hybrid control systems: A lattice-theoretic formulation, Special Issue on Hybrid Systems, IEEE Transactions on Automatic Control, 43, 1998 P. Tabuada and G.J. Pappas, Linear time logic control of discrete-time linear systems, IEEE Transactions on Automatic Control, 51, 2006 P. Tabuada, Symbolic models for control systems, Acta Informatica, 43, 2007 ...
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
11 / 59
Discrete abstractions An approximating variation of bisimulation equivalence, termed approximate bisimulation, has been introduced in Girard and Pappas, Approximation metrics for discrete and continuous systems, IEEE Transactions on Automatic Control, 52 (2007), pp. 782–798 Tabuada, An approximate simulation approach to symbolic control approaches to control, IEEE Transactions on Automatic Control, 53(6) (2008), pp. 1406–1418 Control systems admitting approximately bisimilar symbolic models at present: Incrementally–ISS stable nonlinear control systems [Pola, Girard, Tabuada, et al., Automatica, 2008] [Pola, Tabuada, SIAM Journal on Control and Optimization, 2009] Incrementally–GUAS stable nonlinear switched systems [Girard, Pola, Tabuada, IEEE Transactions on Automatic Control, 2010] Incrementally–ISS stable time–delay systems [Pola, Pepe, Di Benedetto, Tabuada, Systems & Control Letters, 2010] [Pola, Pepe, Di Benedetto, This Conference: FrC20.6] G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
12 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
13 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
14 / 59
Approximate equivalence notions
Definition (Metric system) A system S is said to be a metric system if the set of outputs Y is equipped with a metric d : Y × Y → R+ 0. Using a metric, we can generalize bisimulation to approximate bisimulation.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
15 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R;
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have d(Ha (xa ), Hb (xb )) ≤ ε;
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have d(Ha (xa ), Hb (xb )) ≤ ε; for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
G. Pola ( DEWS - UNIVAQ )
Sa implies the existence of xb Sb implies the existence of xa
Discrete abstractions
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have d(Ha (xa ), Hb (xb )) ≤ ε; for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
Sa implies the existence of xb Sb implies the existence of xa
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
We say that Sa and Sb are ε–approximately bisimilar, denoted by Sa ∼ =εS Sb , if there exists a ε–approximate bisimulation relation between Sa and Sb .
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have d(Ha (xa ), Hb (xb )) ≤ ε; for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
Sa implies the existence of xb Sb implies the existence of xa
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
We say that Sa and Sb are ε–approximately bisimilar, denoted by Sa ∼ =εS Sb , if there exists a ε–approximate bisimulation relation between Sa and Sb . What happens when ε = 0? G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions Definition (Approximate bisimulation) Consider two metric systems Sa and Sb with Ya = Yb , and let ε ∈ R+ 0 . A relation R ⊆ Xa × Xb is an ε-approximate bisimulation relation between Sa and Sb if the following three conditions are satisfied:
a) for every xa0 ∈ Xa0 , there exists xb0 ∈ Xb0 with (xa0 , xb0 ) ∈ R; b) for every xb0 ∈ Xb0 , there exists xa0 ∈ Xa0 with (xa0 , xb0 ) ∈ R; for every (xa , xb ) ∈ R we have d(Ha (xa ), Hb (xb )) ≤ ε; for every (xa , xb ) ∈ R we have that:
b)
ua
- xa0 in a (xa0 , xb0 ) ∈ R. ub xb - xb0 in b (xa0 , xb0 ) ∈ R.
a) xa
Sa implies the existence of xb Sb implies the existence of xa
ub
- x 0 in Sb satisfying b
b
ua
- xa0 in Sa satisfying
a
We say that Sa and Sb are ε–approximately bisimilar, denoted by Sa ∼ =εS Sb , if there exists a ε–approximate bisimulation relation between Sa and Sb . What happens when ε = 0? d(Ha (xa ), Hb (xb )) ≤ ε implies Ha (xa ) = Hb (xb ) G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
16 / 59
Approximate equivalence notions
Some remarks: (Reflexivity) Sa ∼ =εS Sa
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
17 / 59
Approximate equivalence notions
Some remarks: (Reflexivity) Sa ∼ =εS Sa (Symmetry) Sa ∼ =εS Sb implies Sb ∼ =εS Sa
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
17 / 59
Approximate equivalence notions
Some remarks: (Reflexivity) Sa ∼ =εS Sa (Symmetry) Sa ∼ =εS Sb implies Sb ∼ =εS Sa ∼εS Sb and Sb ∼ (Transitivity?) Sa = =εS Sc does not imply Sa ∼ =εS Sc
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
17 / 59
Approximate equivalence notions
Some remarks: (Reflexivity) Sa ∼ =εS Sa (Symmetry) Sa ∼ =εS Sb implies Sb ∼ =εS Sa ∼εS Sb and Sb ∼ (Transitivity?) Sa = =εS Sc does not imply Sa ∼ =εS Sc Hence, ε-approximate bisimulation is not an equivalence relation on the class of systems!
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
17 / 59
Approximate equivalence notions
Some remarks: (Reflexivity) Sa ∼ =εS Sa (Symmetry) Sa ∼ =εS Sb implies Sb ∼ =εS Sa ∼εS Sb and Sb ∼ (Transitivity?) Sa = =εS Sc does not imply Sa ∼ =εS Sc Hence, ε-approximate bisimulation is not an equivalence relation on the class of systems! ε ∼εab +εbc Sc ∼εbc Sc imply Sa = It is easy to see that Sa ∼ =Sab Sb and Sb = S S
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
17 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
18 / 59
Nonlinear control systems A nonlinear control system is a quintuple Σ = (X , X0 , U, U, f ),
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
19 / 59
Nonlinear control systems A nonlinear control system is a quintuple Σ = (X , X0 , U, U, f ), where: X ⊆ Rn is the state space X0 ⊆ X is the set of initial states U ⊆ Rm is the input space U is the collection of input functions u :]a, b[→ U f : Rn × U → Rn is a continuous map
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
19 / 59
Nonlinear control systems A nonlinear control system is a quintuple Σ = (X , X0 , U, U, f ), where: X ⊆ Rn is the state space X0 ⊆ X is the set of initial states U ⊆ Rm is the input space U is the collection of input functions u :]a, b[→ U f : Rn × U → Rn is a continuous map A curve ξ :]a, b[→ Rn is a trajectory of Σ if there exists u ∈ U satisfying ˙ = f (ξ(t), u(t)), ξ(t) for almost all t ∈ ]a, b[.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
19 / 59
Nonlinear control systems A nonlinear control system is a quintuple Σ = (X , X0 , U, U, f ), where: X ⊆ Rn is the state space X0 ⊆ X is the set of initial states U ⊆ Rm is the input space U is the collection of input functions u :]a, b[→ U f : Rn × U → Rn is a continuous map A curve ξ :]a, b[→ Rn is a trajectory of Σ if there exists u ∈ U satisfying ˙ = f (ξ(t), u(t)), ξ(t) for almost all t ∈ ]a, b[. The symbol ξxu (τ ) denotes the point reached at time τ under the input u from the initial condition x G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
19 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs x
u
- y if there exists τ ∈ R+ so that ξxu (τ ) = y
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs x
u
- y if there exists τ ∈ R+ so that ξxu (τ ) = y
Y = X is the output set
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs x
u
- y if there exists τ ∈ R+ so that ξxu (τ ) = y
Y = X is the output set H = 1X is the output function
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs x
u
- y if there exists τ ∈ R+ so that ξxu (τ ) = y
Y = X is the output set H = 1X is the output function System S(Σ) is: metric
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Nonlinear control systems Nonlinear control systems as systems Given a nonlinear control system Σ = (X, X0 , U, U, f) consider the following system S(Σ) = (X , X0 , U,
- , Y , H)
where: X = X is the set of states X0 = X0 is the set of initial states U = U is the set of inputs x
u
- y if there exists τ ∈ R+ so that ξxu (τ ) = y
Y = X is the output set H = 1X is the output function System S(Σ) is: metric neither countable nor symbolic
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
20 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
21 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
Does function γ(r ) = tan−1 (r ) belong to class K?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ? No, because γ(r ) → π/2 as r → ∞
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
3
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ? No, because γ(r ) → π/2 as r → ∞ Does function γ(r ) = 2r belong to class K∞ ?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
3
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ? No, because γ(r ) → π/2 as r → ∞ Does function γ(r ) = 2r belong to class K∞ ? Yes, because γ(0) = 0, γ 0 (r ) = 2 > 0 and γ(r ) → ∞ as r → ∞
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
3
4
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ? No, because γ(r ) → π/2 as r → ∞ Does function γ(r ) = 2r belong to class K∞ ? Yes, because γ(0) = 0, γ 0 (r ) = 2 > 0 and γ(r ) → ∞ as r → ∞ Does function β(r , s) = e−s r belong to class KL?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Class K, K∞ and KL functions + A continuous function γ : R+ 0 → R0 belongs to class K if it is strictly increasing and γ(0) = 0 function γ belongs to class K∞ if γ ∈ K and γ(r ) → ∞ as r → ∞ + + A continuous function β : R+ 0 × R0 → R0 belongs to class KL if
for each s, β(r , s) belongs to class K∞ with respect to r for each r , β(r , s) is decreasing wrt s and β(r , s) → 0 as s → ∞
Examples 1
2
3
4
Does function γ(r ) = tan−1 (r ) belong to class K? + 1 Yes, because γ(0) = 0 and γ 0 (r ) = 1+r 2 > 0 for any r ∈ R0 Does function γ(r ) = tan−1 (r ) belong to class K∞ ? No, because γ(r ) → π/2 as r → ∞ Does function γ(r ) = 2r belong to class K∞ ? Yes, because γ(0) = 0, γ 0 (r ) = 2 > 0 and γ(r ) → ∞ as r → ∞ Does function β(r , s) = e−s r belong to class KL? Yes
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
22 / 59
Discrete abstractions of nonlinear control systems Input–to–State Stability
Definition [Sontag, IEEE TAC 1989] A nonlinear control system Σ is Input-to-State Stable (ISS) if there exists a KL function β and a K∞ function γ so that for any initial condition x0 ∈ X , for any input u ∈ U and for any time t ∈ R+ 0 the solution ξx0 u (t) exists and kξx0 u (t)k ≤ β(kx0 k, t) + γ(kuk∞ )
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
23 / 59
Discrete abstractions of nonlinear control systems Input–to–State Stability
Definition [Sontag, IEEE TAC 1989] A nonlinear control system Σ is Input-to-State Stable (ISS) if there exists a KL function β and a K∞ function γ so that for any initial condition x0 ∈ X , for any input u ∈ U and for any time t ∈ R+ 0 the solution ξx0 u (t) exists and kξx0 u (t)k ≤ β(kx0 k, t) + γ(kuk∞ )
Some remarks: ISS is a notion of stability wrt an equilibrium point
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
23 / 59
Discrete abstractions of nonlinear control systems Input–to–State Stability
Definition [Sontag, IEEE TAC 1989] A nonlinear control system Σ is Input-to-State Stable (ISS) if there exists a KL function β and a K∞ function γ so that for any initial condition x0 ∈ X , for any input u ∈ U and for any time t ∈ R+ 0 the solution ξx0 u (t) exists and kξx0 u (t)k ≤ β(kx0 k, t) + γ(kuk∞ )
Some remarks: ISS is a notion of stability wrt an equilibrium point A linear control system is ISS if and only if it is asymptotically stable.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
23 / 59
Discrete abstractions of nonlinear control systems Input–to–State Stability
Definition [Sontag, IEEE TAC 1989] A nonlinear control system Σ is Input-to-State Stable (ISS) if there exists a KL function β and a K∞ function γ so that for any initial condition x0 ∈ X , for any input u ∈ U and for any time t ∈ R+ 0 the solution ξx0 u (t) exists and kξx0 u (t)k ≤ β(kx0 k, t) + γ(kuk∞ )
Some remarks: ISS is a notion of stability wrt an equilibrium point A linear control system is ISS if and only if it is asymptotically stable. Hence, if and only if the eigenvalues λi of the dynamical matrix A are so that Re(λi ) < 0 G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
23 / 59
Discrete abstractions of nonlinear control systems Input–to–State Stability
Definition [Sontag, IEEE TAC 1989] A nonlinear control system Σ is Input-to-State Stable (ISS) if there exists a KL function β and a K∞ function γ so that for any initial condition x0 ∈ X , for any input u ∈ U and for any time t ∈ R+ 0 the solution ξx0 u (t) exists and kξx0 u (t)k ≤ β(kx0 k, t) + γ(kuk∞ )
Some remarks: ISS is a notion of stability wrt an equilibrium point A linear control system is ISS if and only if it is asymptotically stable. Hence, if and only if the eigenvalues λi of the dynamical matrix A are so that Re(λi ) < 0 Lyapunov characterization of ISS well known in the literature G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
23 / 59
Discrete abstractions of nonlinear control systems Incremental Input–to–State Stability
Definition [Angeli, IEEE TAC 2002] A nonlinear control system Σ is Incrementally Input-to-State Stable (δ–ISS) if there exists a KL function β and a K∞ function γ so that for any pair of initial conditions x01 , x02 ∈ X , for any pair of inputs u1 , u2 ∈ U and for any time t ∈ R+ 0 the solutions ξx 1 u1 (t) and ξx 2 u2 (t) exist and 0
0
kξx 1 u1 (t) − ξx 2 u2 (t)k ≤ β(kx01 − x02 k, t) + γ(ku1 − u2 k∞ ) 0
G. Pola ( DEWS - UNIVAQ )
0
Discrete abstractions
24 / 59
Discrete abstractions of nonlinear control systems Incremental Input–to–State Stability
Definition [Angeli, IEEE TAC 2002] A nonlinear control system Σ is Incrementally Input-to-State Stable (δ–ISS) if there exists a KL function β and a K∞ function γ so that for any pair of initial conditions x01 , x02 ∈ X , for any pair of inputs u1 , u2 ∈ U and for any time t ∈ R+ 0 the solutions ξx 1 u1 (t) and ξx 2 u2 (t) exist and 0
0
kξx 1 u1 (t) − ξx 2 u2 (t)k ≤ β(kx01 − x02 k, t) + γ(ku1 − u2 k∞ ) 0
0
Some remarks: δ–ISS is a notion of stability wrt trajectories
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
24 / 59
Discrete abstractions of nonlinear control systems Incremental Input–to–State Stability
Definition [Angeli, IEEE TAC 2002] A nonlinear control system Σ is Incrementally Input-to-State Stable (δ–ISS) if there exists a KL function β and a K∞ function γ so that for any pair of initial conditions x01 , x02 ∈ X , for any pair of inputs u1 , u2 ∈ U and for any time t ∈ R+ 0 the solutions ξx 1 u1 (t) and ξx 2 u2 (t) exist and 0
0
kξx 1 u1 (t) − ξx 2 u2 (t)k ≤ β(kx01 − x02 k, t) + γ(ku1 − u2 k∞ ) 0
0
Some remarks: δ–ISS is a notion of stability wrt trajectories If f (0, 0) = 0 then δ–ISS implies ISS, while the converse is not true in general G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
24 / 59
Discrete abstractions of nonlinear control systems Incremental Input–to–State Stability
Definition [Angeli, IEEE TAC 2002] A nonlinear control system Σ is Incrementally Input-to-State Stable (δ–ISS) if there exists a KL function β and a K∞ function γ so that for any pair of initial conditions x01 , x02 ∈ X , for any pair of inputs u1 , u2 ∈ U and for any time t ∈ R+ 0 the solutions ξx 1 u1 (t) and ξx 2 u2 (t) exist and 0
0
kξx 1 u1 (t) − ξx 2 u2 (t)k ≤ β(kx01 − x02 k, t) + γ(ku1 − u2 k∞ ) 0
0
Some remarks: δ–ISS is a notion of stability wrt trajectories If f (0, 0) = 0 then δ–ISS implies ISS, while the converse is not true in general A linear control system is δ–ISS if and only if it is ISS G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
24 / 59
Discrete abstractions of nonlinear control systems
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
25 / 59
Discrete abstractions of nonlinear control systems
Digitizing a continuous signal ...
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
26 / 59
Discrete abstractions of nonlinear control systems
"Digitizing" a continuous system ...
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
27 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant }
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set Hτ = 1X is the output function
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set Hτ = 1X is the output function Some remarks: Sτ (Σ) is metric
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set Hτ = 1X is the output function Some remarks: Sτ (Σ) is metric Sτ (Σ) is neither countable nor symbolic
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set Hτ = 1X is the output function Some remarks: Sτ (Σ) is metric Sτ (Σ) is neither countable nor symbolic What are the relationships between S(Σ) and Sτ (Σ)?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Time discretization Given a nonlinear control system Σ = (X, X0 , U, U, f) and a sampling parameter τ consider the following system Sτ (Σ) = (Xτ , X0,τ , Uτ ,
- , Yτ , Hτ )
τ
where: Xτ = X is the set of states X0,τ = X0 is the set of initial states Uτ = {u ∈ U : the time-domain of u is [0, τ ] and u is constant } x
u
- y if ξxu (τ ) = y
τ
Yτ = X is the output set Hτ = 1X is the output function Some remarks: Sτ (Σ) is metric Sτ (Σ) is neither countable nor symbolic What are the relationships between S(Σ) and Sτ (Σ)? - ⊆ System Sτ (Σ) is a sub–system of S(Σ), i.e. τ G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
28 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
29 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
29 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
30 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
31 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
32 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
Yτ,η,µ = X is the output set
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
Yτ,η,µ = X is the output set Hτ,η,µ := Xτ,η,µ ,→ Yτ,η,µ is the output function
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
Yτ,η,µ = X is the output set Hτ,η,µ := Xτ,η,µ ,→ Yτ,η,µ is the output function Some remarks: Sτ,η,µ (Σ) is metric
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
Yτ,η,µ = X is the output set Hτ,η,µ := Xτ,η,µ ,→ Yτ,η,µ is the output function Some remarks: Sτ,η,µ (Σ) is metric Sτ,η,µ (Σ) is countable and becomes finite when X and U are bounded G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models Space and input quantization
Given a nonlinear control system Σ = (X, X0 , U, U, f), a state space quantization η and input space quantization µ, consider the following system Sτ,η,µ (Σ) = (Xτ,η,µ , X0,τ,η,µ , Uτ,η,µ ,
- , Yτ,η,µ , Hτ,η,µ )
τ,η,µ
where: Xτ,η,µ = ηZn ∩ X is the set of states X0,τ,η,µ = ηZn ∩ X0 is the set of initial states Uτ,η,µ = µZm ∩ Uτ is the set of inputs x
u
- y if kξxu (τ ) − y k ≤ η
τ,η,µ
Yτ,η,µ = X is the output set Hτ,η,µ := Xτ,η,µ ,→ Yτ,η,µ is the output function Some remarks: Sτ,η,µ (Σ) is metric Sτ,η,µ (Σ) is countable and becomes finite when X and U are bounded What are the relationships between Sτ,η,µ (Σ) and Sτ (Σ)? G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
33 / 59
Symbolic models What are the relationships between Sτ,η,µ (Σ) and Sτ (Σ)?
Theorem Consider a control system Σ. Suppose that Σ is δ–ISS and choose any desired precision ε ∈ R+ .
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
34 / 59
Symbolic models What are the relationships between Sτ,η,µ (Σ) and Sτ (Σ)?
Theorem Consider a control system Σ. Suppose that Σ is δ–ISS and choose any desired precision ε ∈ R+ . For any sampling time τ ∈ R+ , space quantization η ∈ R+ and input quantization µ ∈ R+ satisfying: β(ε, τ ) + γ(µ) + η ≤ ε,
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
34 / 59
Symbolic models What are the relationships between Sτ,η,µ (Σ) and Sτ (Σ)?
Theorem Consider a control system Σ. Suppose that Σ is δ–ISS and choose any desired precision ε ∈ R+ . For any sampling time τ ∈ R+ , space quantization η ∈ R+ and input quantization µ ∈ R+ satisfying: β(ε, τ ) + γ(µ) + η ≤ ε, systems Sτ,η,µ (Σ) and Sτ (Σ) are ε–approximately bisimilar.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
34 / 59
Symbolic models Sketch of the proof
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
35 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
36 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε Consider any x
u
- y in Sτ (Σ) where y = ξxu (τ ).
τ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
37 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ Uτ so that: ku − v k ≤ µ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
38 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ Consider q
v
- z in Sτ (Σ) where z = ξqv (τ ).
τ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
39 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
40 / 59
Symbolic models Sketch of the proof
Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η and q
v
- p.
τ,η,µ
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
41 / 59
Symbolic models Sketch of the proof Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η v
- p. We now show that ky − pk ≤ ε. and q τ,η,µ By δ–ISS one gets: ky − pk
G. Pola ( DEWS - UNIVAQ )
≤
ky − zk + kz − pk
Discrete abstractions
42 / 59
Symbolic models Sketch of the proof Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η v
- p. We now show that ky − pk ≤ ε. and q τ,η,µ By δ–ISS one gets: ky − pk
≤
ky − zk + kz − pk = kξxu (τ ) − ξqv (τ )k + kz − pk
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
43 / 59
Symbolic models Sketch of the proof Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η v
- p. We now show that ky − pk ≤ ε. and q τ,η,µ By δ–ISS one gets: ky − pk
≤ ≤
ky − zk + kz − pk = kξxu (τ ) − ξqv (τ )k + kz − pk β(kx − qk, τ ) + γ(ku − v k∞ ) + η
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
44 / 59
Symbolic models Sketch of the proof Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η v
- p. We now show that ky − pk ≤ ε. and q τ,η,µ By δ–ISS one gets: ky − pk
≤ ≤ ≤
ky − zk + kz − pk = kξxu (τ ) − ξqv (τ )k + kz − pk β(kx − qk, τ ) + γ(ku − v k∞ ) + η β(ε, τ ) + γ(µ) + η
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
45 / 59
Symbolic models Sketch of the proof Define R ⊆ Xτ × Xτ,η,µ so that (x, q) ∈ R if and only if kx − qk ≤ ε u
Consider any x τ- y in Sτ (Σ) where y = ξxu (τ ). Pick v ∈ U so that: ku − v k ≤ µ v
Consider q τ- z in Sτ (Σ) where z = ξqv (τ ). There exists p ∈ Xτ,η,µ so that kp − zk ≤ η v
- p. We now show that ky − pk ≤ ε. and q τ,η,µ By δ–ISS one gets: ky − pk
≤ ≤ ≤
ky − zk + kz − pk = kξxu (τ ) − ξqv (τ )k + kz − pk β(kx − qk, τ ) + γ(ku − v k∞ ) + η β(ε, τ ) + γ(µ) + η ≤ ε
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
46 / 59
Symbolic models... How much far from necessity?
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
47 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models!
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
- , R, H)
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
(1)
0
6 Choose k 0 ∈ N so that eτ k λ − ε > ε.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
(1)
0
6 Choose k 0 ∈ N so that eτ k λ − ε > ε. There exist zk 0 ∈ X so that,
(xk 0 , zk 0 ), (yk 0 , zk 0 ) ∈ R.
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
(1)
0
6 Choose k 0 ∈ N so that eτ k λ − ε > ε. There exist zk 0 ∈ X so that,
(xk 0 , zk 0 ), (yk 0 , zk 0 ) ∈ R. 7 Since (xk 0 , zk 0 ) ∈ R, kxk 0 − H(zk 0 )k ≤ ε
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
(1)
0
6 Choose k 0 ∈ N so that eτ k λ − ε > ε. There exist zk 0 ∈ X so that,
(xk 0 , zk 0 ), (yk 0 , zk 0 ) ∈ R. 7 Since (xk 0 , zk 0 ) ∈ R, kxk 0 − H(zk 0 )k ≤ ε By combining inequalities (1) and (2) and by definition of k 0 , we obtain:
(2)
0
kH(zk 0 ) − yk 0 k ≥ kxk 0 − yk 0 k − kxk 0 − H(zk 0 )k > eτ k λ − ε > ε
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Symbolic models... How much far from necessity? Unstable linear systems do not admit approximate bisimilar symbolic models! 1 Consider Σ described by x˙ = x ∈ R. System Σ is unstable and hence not δ–ISS 2 Consider any ε and any countable metric system S = (X , U,
- , R, H)
3 Suppose existence of an ε–approximate bisimulation relation R ⊆ Xτ × X 4 By countability of S, there exist z0 ∈ X and x0 , y0 ∈ Xτ = R such that x0 6= y0 ,
and (x0 , z0 ), (y0 , z0 ) ∈ R. Set xk = eτ k x0 , yk = eτ k y0 , for any k ∈ N 5 Since x0 6= y0 , by selecting λ ∈ R+ such that kx0 − y0 k > λ, we have: kxk − yk k = eτ k kx0 − y0 k > eτ k λ, ∀k ∈ N
(1)
0
6 Choose k 0 ∈ N so that eτ k λ − ε > ε. There exist zk 0 ∈ X so that,
(xk 0 , zk 0 ), (yk 0 , zk 0 ) ∈ R. 7 Since (xk 0 , zk 0 ) ∈ R, kxk 0 − H(zk 0 )k ≤ ε By combining inequalities (1) and (2) and by definition of k 0 , we obtain:
(2)
0
kH(zk 0 ) − yk 0 k ≥ kxk 0 − yk 0 k − kxk 0 − H(zk 0 )k > eτ k λ − ε > ε 8 ... a contradiction holds! G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
48 / 59
Correct-by-Design Controller Synthesis
A three step approach: Computation of a symbolic abstraction of the physical system Discrete controller synthesis for the symbolic abstraction Hybrid controller synthesis via discrete controller refinement
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
49 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
50 / 59
Discrete abstractions of nonlinear control systems Consider the following nonlinear control system describing the dynamics of a pendulum: x˙ 1 = x2 , Σ: k x2 + u, x˙ 2 = − gl sin x1 − m where: x1 is the point mass angular position x2 is the point mass velocity u is the torque g is the gravity acceleration l is the length of the rod m is the mass k is the coefficient of friction G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
51 / 59
Control design of a pendulum Symbolic model for ε = 0.25, τ = 2, η = 0.2, µ = 1.5 · 10−4
G. Pola ( DEWS - UNIVAQ )
5
10
15
20
25
4
9
14
19
24
3
8
13
18
23
2
7
12
17
22
1
6
11
16
21
Discrete abstractions
52 / 59
Control design of a pendulum
Suppose that our objective is to design a controller enforcing a specification P given by the alternation between the two periodic motions P1 and P2 : P1 requires the state to cycle between (−η, 0) and (0, 0) P2 requires the state to cycle between (−η, 0) and (η, 0) Specification P requires the execution of the sequence of periodic motions P1 , P1 , P2 , P1 , P1
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
53 / 59
Control design of a pendulum Symbolic controller solving P1 on the symbolic model is: (−η, 0)
G. Pola ( DEWS - UNIVAQ )
- (0, 0) −1.5 - (−η, 0)
1.38
Discrete abstractions
54 / 59
Control design of a pendulum Symbolic controller solving P1 on the symbolic model is: (−η, 0)
- (0, 0) −1.5 - (−η, 0)
1.38
Symbolic controller solving P2 on the symbolic model is: (−η, 0)
G. Pola ( DEWS - UNIVAQ )
- (0, η) 1.5- (η, 0) −1.5 - (0, −η) −0.71 - (−η, 0)
1.5
Discrete abstractions
54 / 59
Control design of a pendulum Symbolic controller solving P1 on the symbolic model is: (−η, 0)
- (0, 0) −1.5 - (−η, 0)
1.38
Symbolic controller solving P2 on the symbolic model is: (−η, 0)
- (0, η) 1.5- (η, 0) −1.5 - (0, −η) −0.71 - (−η, 0)
1.5
Symbolic controller enforcing P on the symbolic model is: (−η, 0)
- (0, 0) −1.5 - (−η, 0) 1.38 - (0, 0) −1.5 - (−η, 0)
1.38
- (0, η) 1.5- (η, 0) −1.5 - (0, −η) −0.71 - (−η, 0)
1.5
- (0, 0) −1.5 - (−η, 0) 1.38 - (0, 0) −1.5 - (−η, 0)
1.38
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
54 / 59
Control design of a pendulum Symbolic model for ε = 0.25, τ = 2, η = 0.2, µ = 1.5 · 10−4
G. Pola ( DEWS - UNIVAQ )
5
10
15
20
25
4
9
14
19
24
3
8
13
18
23
2
7
12
17
22
1
6
11
16
21
Discrete abstractions
55 / 59
u
x2
x1
Control design of a pendulum 0.8 0.6 0.4 0.2 0 −0.2 −0.4 −0.6 −0.8 0
2
4
6
8
10
12 t
14
16
18
20
22
24
0
2
4
6
8
10
12 t
14
16
18
20
22
24
0
2
4
6
8
10
12 t
14
16
18
20
22
24
0.8 0.6 0.4 0.2 0 −0.2 −0.4 −0.6 −0.8
1.5 1 0.5 0 −0.5 −1 −1.5
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
56 / 59
Outline
Approximate bisimulation Nonlinear control systems Incremental stability Symbolic models Control design of a pendulum Conclusion
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
57 / 59
Conclusion Recap ... Computation of a symbolic abstraction of the physical system (this talk) Discrete controller synthesis for the symbolic abstraction (previous talk) Hybrid controller synthesis via discrete controller refinement (next talk)
Some results on efficient algorithms for correct–by–design embedded control software synthesis also discussed in [This conference, WeB19.2]
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
58 / 59
Discrete abstractions of continuous control systems Giordano Pola Center of Excellence for Research DEWS Department of Electrical and Information Engineering University of L’Aquila
G. Pola ( DEWS - UNIVAQ )
Discrete abstractions
59 / 59
