IMA Journal of Mathematical Control and Information Advance Access published March 2, 2009 IMA Journal of Mathematical Control and Information Page 1 of 10 doi:10.1093/imamci/dnn001

A new algorithm for finding numerical solutions of optimal feedback control BAO -Z HU G UO† Academy of Mathematics and Systems Science, Academia Sinica, Beijing 100080, People’s Republic of China and School of Computational and Applied Mathematics, University of the Witwatersrand, Wits 2050, Johannesburg, South Africa AND

B ING S UN Department of Mathematics, Beijing Institute of Technology, Beijing 100081, People’s Republic of China and School of Computational and Applied Mathematics, University of the Witwatersrand, Wits 2050, Johannesburg, South Africa [Received on 15 March 2007; Revised on 17 October 2007] A new algorithm for finding numerical solutions of optimal feedback control based on dynamic programming is developed. The algorithm is based on two observations: (1) the value function of the optimal control problem considered is the viscosity solution of the associated Hamilton–Jacobi–Bellman (HJB) equation and (2) the appearance of the gradient of the value function in the HJB equation is in the form of directional derivative. The algorithm proposes a discretization method for seeking optimal control– trajectory pairs based on a finite-difference scheme in time through solving the HJB equation and state equation. We apply the algorithm to a simple optimal control problem, which can be solved analytically. The consistence of the numerical solution obtained to its analytical counterpart indicates the effectiveness of the algorithm. Keywords: optimal feedback control; viscosity solution; dynamic programming; numerical solution; exponential stability.

1. Introduction Determination of optimal feedback control law has been one of the main problems in modern control theory (Ho, 2005). Among the most celebrated results are the Bellman’s dynamic programming method and the Pontryagin’s maximum principle. The former can give the optimal control law in closed-loop form, but it is analytically effective only to linear systems with quadratic performances. Whereas the latter can be used to deal with non-linear systems, it provides only a necessary condition that an optimal control must satisfy. Nevertheless, it is believed that the condition is also sufficient in most practical applications in view of the existence and uniqueness of optimal control in such cases. However, there are still two important issues that hinder the application of the Pontryagin’s maximum principle to nonlinear systems. First, one has to solve a two-point boundary-value problem of a system of non-linear differential equations and second, the solution obtained is usually in open-loop form, implying that it cannot be used directly as a feedback law. † Email: [email protected] c The author 2009. Published by Oxford University Press on behalf of the Institute of Mathematics and its Applications. All rights reserved.

2 of 10

B.-Z. GUO AND B. SUN

It appears that numerical methods are the only feasible way to deal with non-linear systems when using Pontryagin’s maximum principle. Up to now both direct and indirect methods have been developed to solve optimal control problems (Pesch, 2003). The indirect method solves the two-point boundaryvalue problem using the powerful multiple shooting method. It requires a good ‘initial guess’ to start the iterative process, which is not an easy task as that means a good understanding of the physical essence of the system. On the other hand, the direct method starts with a partial or full discretization process of the system equation. The process converts the original problem into a large-scale non-linear programming problem subject to restrictions. The conversion naturally introduces the problem of reliability or accuracy of the method. Moreover, when the degrees of discretization and parameterization become high, the method becomes extremely difficult to manage (Bryson, 1996) due to the complexity of the computation involved. It is further noted that the numerical solutions offered by both methods are still in open-loop form. On the other hand, it has been realized since Pontryagin’s time that the dynamic programming method which leads to the Hamilton–Jacobi–Bellman (HJB) equation that governs the value function of optimal control problem would give the feedback law provided that the HJB equation is solvable. Thanks to the notion of viscosity solution for the HJB equation introduced in the 1980s (Crandall, 1997), it is now possible to conclude the existence and uniqueness of the HJB equations. One remarkable feature of the viscosity solution is that the value function of optimal control problem is usually also the unique viscosity solution of the associated HJB equation. While the viscosity solution associated with the HJB equation can lead to optimal control in closedloop form, it remains that one often has to find the solution numerically rather than analytically. In this paper, we develop a new algorithm for finding numerical solutions of the optimal feedback control and optimal trajectory, which is extracted from our numerical experiments for practical optimal control problems performed in Guo & Sun (2005, 2007). The algorithm is based on the HJB equation and the viscosity solution theory. It is constructive and applicable to finite-dimensional systems (Guo & Sun, 2007) as well as infinite-dimensional ones (Guo & Sun, 2005). The paper is organized as follows. Some preliminaries related to the theoretical background of the algorithm is provided in Section 2. In Section 3, the new algorithm is constructed step by step for general finite-dimensional optimal control problems. An illustrative example is provided in Section 4, which indicates the effectiveness of the new algorithm.

2. Preliminary Consider the control system of the following: (

y 0 (t) = f (y(t), u(t)),

t ∈ (0, T ], T > 0,

y(0) = z,

(2.1)

where y(∙) ∈ Rn is the state, u(∙) ∈ U [0, T ] = L ∞ ([0, T ]; U ) is the admissible control with compact set U ⊂ Rm and z is the initial value. Assume that f : Rn × U → Rn is continuous in its variables. Given a running cost L(t, y, u) and a terminal cost ψ(y), the optimal control problem for the system (2.1) is to seek an optimal control u ∗ (∙) ∈ U[0, T ], such that J (u ∗ (∙)) =

inf

u(∙)∈U [0,T ]

J (u(∙)),

(2.2)

ALGORITHM FOR FINDING OPTIMAL FEEDBACK CONTROL

where J is the cost functional given by Z J (u(∙)) =

0

3 of 10

T

L(τ, y(τ ), u(τ ))dτ + ψ(y(T )).

(2.3)

The dynamic programming principle due to Bellman is fundamental in modern optimal control theory. Instead of considering optimal control problem (2.1–2.2), the principle proposes to deal with a family of optimal control problems initiating from (2.1–2.2). That is, consider the optimal control problem for the following system for any (t, x) ∈ [0, T ) × Rn : ( 0 yt,x (s) = f (yt,x (s), u(s)), s ∈ (t, T ], (2.4) yt,x (t) = x with the cost functional Jt,x (u(∙)) =

Z

T t

L(τ, yt,x (τ ), u(τ ))dτ + ψ(yt,x (T )).

(2.5)

Define the value function V (t, x) =

inf

u(∙)∈ U [t,T ]

Jt,x (u(∙)),

∀ (t, x) ∈ [0, T ) × Rn ,

(2.6)

with the terminal value V (T, x) = ψ(x),

for all x ∈ Rn .

(2.7)

It is well known that if V is smooth enough, say V ∈ C 1 ([0, T ] × Rn ), then V satisfies the following HJB equation (Bardi & Capuzzo-Dolcetta, 1997): ( Vt (t, x) + inf { f (x, u) ∙ ∇x V (t, x) + L(t, x, u)} = 0, (t, x) ∈ [0, T ) × Rn , u∈U (2.8) V (T, x) = ψ(x), x ∈ Rn , where ∇x V (t, x) stands for the gradient of V in x. The following two propositions show the important role of the value function in characterizing the optimal feedback law (Bardi & Capuzzo-Dolcetta, 1997). P ROPOSITION 1 Let V ∈ C 1 ([0, T ] × Rn ) be the value function. Then, if there exists a control u ∗ (∙) ∈ U[0, T ] such that f (y ∗ (t), u ∗ (t)) ∙ ∇x V (t, y ∗ (t)) + L(t, y ∗ (t), u ∗ (t))

= inf { f (y ∗ (t), u) ∙ ∇x V (t, y ∗ (t)) + L(t, y ∗ (t), u)}, u∈U

(2.9)

then u ∗ (∙) is an optimal control, where y ∗ is the state corresponding to u ∗ . As usual, we denote the optimal control as (Bardi & Capuzzo-Dolcetta, 1997) u ∗ (t) ∈ arg inf { f (y ∗ (t), u) ∙ ∇x V (t, y ∗ (t)) + L(t, y ∗ (t), u)} u∈U

for almost all t ∈ [0, T ].

(2.10)

4 of 10

B.-Z. GUO AND B. SUN

P ROPOSITION 2 Let V (t, x) ∈ C 1 ([0, T ]×Rn ) be the value function. Then, (u ∗ (∙), y ∗ (∙)) is an optimal control–trajectory pair in feedback form if and only if Vt (t, y ∗ (t)) + f (y ∗ (t), u ∗ (t)) ∙ ∇x V (t, y ∗ (t)) + L(t, y ∗ (t), u ∗ (t)) = 0

(2.11)

for almost all t ∈ [0, T ). By Propositions 1 and 2, we have Theorem 1, which leads to the construction of the feedback law via the value function. T HEOREM 1 Let V (t, x) ∈ C 1 ([0, T ] × Rn ) be the value function. Suppose u(t, x) satisfies f (x, u(t, x)) ∙ ∇x V (t, x) + L(t, x, u(t, x)) = inf { f (x, u) ∙ ∇x V (t, x) + L(t, x, u)}. u∈U

Then, u ∗z (t) = u(t, yz (t)) is the feedback law of the optimal control problem (2.1–2.2), where yz (t) satisfies the following: yz0 (t) = f (yz (t), u(t, yz (t))),

yz (0) = z, t ∈ [0, T ].

We see from Theorem 1 that in order to find the feedback control law, not only the value function V itself but also its gradient ∇x V is needed. Equation (2.8) generally has no classical solution regardless of the smoothness of the functions f and L. Fortunately, under some basic assumptions on f and L, the value function V is the unique viscosity solution to (2.8). However, it is usually not possible to find analytical solution of (2.8) for general non-linear functions f and L. It therefore becomes very important to solve (2.8) numerically, particularly in applications. Actually, some difference schemes have been proposed to find the viscosity solutions (Fleming & Soner, 1993; Huang et al., 2000, 2004; Wang et al., 2003). Once a viscosity solution of (2.8) is obtained numerically, we are able to construct a numerical solution of the feedback law by Theorem 1. 3. Algorithm of finding optimal feedback law In this section, we follow Theorem 1 to construct an algorithm for finding numerical solutions of optimal feedback control and optimal trajectory pair. The algorithm consists of two steps of discretization. The first one is to discretize the HJB equation (2.8) for the feedback law and the second is to discretize the state equation (2.1) for the optimal trajectory. In the last two decades, many different approximation schemes have been developed for the numerical solution of (2.8) such as the upwind finite-difference scheme (Wang et al., 2000), the method of vanishing viscosity (Crandall & Lions, 1984) and the parallel algorithm based on the domain decomposition technique (Falcone et al., 1994), name just a few. As for numerical solution of the state equation (2.1), there are numerous classical methods available such as the Euler method, the Runge–Kutta method, the Hamming algorithm and so on (Li & Feng, 1996). Note that when we use Theorem 1 to find the optimal feedback law, it is the directional derivative ∇x V ∙ f not the gradient ∇x V itself that is needed. This fact greatly facilitates our search for numerical

5 of 10

ALGORITHM FOR FINDING OPTIMAL FEEDBACK CONTROL

solutions. The key step is to approximate ∇x V ∙ f by its natural definition as following:  ∇x V (t, x) ∙ f (x, u) = ∇x V (t, x) ∙ η ≈

 f (x, u) 1 + k f (x, u)k 1 + k f (x, u)k η

 V t, x + η 1+kf (x,u) f (x,u)k − V (t, x) η

(1 + k f (x, u)k),

(3.12)

where η > 0 is a small number and k ∙ k denotes the Euclidean norm in Rn . It is pointed out that the above approximation brings obvious advantages to our algorithm presented in this paper. If we try to work out the viscosity solution of (2.8) first, we will most likely be under ‘the curse of dimensionality’ for high-dimensional problems since we have to obtain data for all grids in the whole region. Perhaps that is why the numerical experiments about the viscosity solution of (2.8) studied in many literatures are most limited to 1D or 2D problems (e.g. Wang et al., 2000). On the other hand, since our scheme searches the optimal control only along the direction of f not in the whole region, the new algorithm involves much less data. This idea is also applicable to infinite-dimensional systems (Guo & Sun, 2005). To the best of our knowledge, there has been no effort along this direction to find optimal control by dynamic programming. Based on above discussion, we now construct the algorithm for the numerical solutions of the optimal feedback control–trajectory pairs. Step 1: Initial partition on time and space. Select two positive integers N and M. Let t j = T + j1t, j = 0, 1, . . . , N , be a backward partition of [0, T ], where 1t = −T /N . For any initial given u˜ ∈ U , let initial state x0 = z and xi = xi−1 + η

f (xi−1 , u) ˜ , 1 + k f (xi−1 , u)k ˜

i = 1, 2, . . . , M.

(3.13)

Step 2: Approximate (2.8). This is done by the finite-difference scheme in time and space mesh approximation via (3.12):  j+1 j j j  Vi+1 − Vi − Vi Vi  j j  + ∙ (1 + k f i k) + L i = 0,    1t η ( j+1 ) j+1   − V V  j+1 i i+1  u i ∙ (1 + k f (xi , u)k) + L(t j+1 , xi , u) ∈ arg inf  u∈U η j

j

(3.14)

j

j

for i = 0, 1, . . . , M and j = 0, 1, . . . , N − 1, where Vi = V (t j , xi ), f i = f (xi , u i ) and L i = j L(t j , xi , u i ). It is assumed that   |1t| j 1 + max k f i k 6 1, (3.15) i, j η which is a sufficient condition for the stability of the finite-difference scheme (Li & Feng, 1996).

6 of 10

B.-Z. GUO AND B. SUN

Step 3: Initialization of value function and control. Let Vi0 = ψ(xi ), u i0

∈ arg inf

u∈U

(

0 − V0 Vi+1 i

η

)

∙ (1 + k f (xi , u)k) + L(T, xi , u) ,

i = 0, 1, . . . , M. j

M }N Step 4: Iteration for the HJB equation. By (3.14) and Step 3, we obtain all {{Vi }i=0 j=0 and j

M }N : {{u i }i=0 j=0

   1t 1t j+1 j j j j j   V = 1 + k) Vi − (1 + k f (1 + k f i k)Vi+1 − 1t L i ,  i i  η η   ( j+1 ) j+1   − V V  j+1 i i+1 u  ∙ (1 + k f (xi , u)k) + L(t j+1 , xi , u) , ∈ arg inf  i u∈U η

(3.16)

where (u 0N , y 0 ) = (u 0N , y(0)) = (u(0), z) is the first optimal feedback control–trajectory pair. Step 5: Iteration for state equation. Solve the state equation y1 − y0 = f (y 0 , u(0)) −1T to obtain y 1 = y(t N −1 ). Replace (u, ˜ z) in Step 1 by (u(0), y 1 ) and goto Steps 1 and 3 and then Step 4 to N −1 N −1 1 obtain u 0 . Then, (u 0 , y ) = (u(t N −1 ), y(t N −1 )) is the second optimal feedback control–trajectory pair. Step 6: Continuation of iteration. Once (u(t N − j ), y j ) = (u(t N − j ), y(t N − j )) is known, solve the state equation y j+1 − y j = f (y j , u(t N − j )) −1T to obtain y j+1 = y(t N − j−1 ). Replace (u, ˜ z) in Step 1 by (u(t N − j ), y j+1 ) and goto Steps 1 and 3 and N − j−1 N − j−1 . Then, (u 0 , y j+1 ) = (u(t N − j−1 ), y(t N − j−1 )) is the ( j + 2)th optithen Step 4 to obtain u 0 mal feedback control–trajectory pair. Continue the iteration to obtain all (u(t N − j ), y(t N − j )) Nj=1 . After Steps 1–6, we finally get all the desired optimal feedback control–trajectory pairs: (u(t N − j ), y(t N − j )),

j = 0, 1, . . . , N .

It should be pointed out the above algorithm has generalization for infinite-dimensional systems (see Guo & Sun, 2005). It is worth noting that the focus of the above algorithm is not to solve the HJB equation, not even to obtain the value function itself. This is different from most literatures (e.g. see Huang et al., 2000, 2004; Wang et al., 2003) in the field, which focus on solving the HJB equations. Our ultimate aim is to find the numerical solutions of both the optimal feedback control and the corresponding optimal

ALGORITHM FOR FINDING OPTIMAL FEEDBACK CONTROL

7 of 10

trajectory. The whole algorithm consists of solving the state equation one time and the HJB equation N times. According to our numerical experiments reported in Guo & Sun (2005, 2007) and the example presented in Section 4, the mesh-point sequence in space generated by the recursive relation (3.13) does not bring oscillation of the space variable in subregions of the given space even when f changes its sign. This is because (3.12) is the more proper definition of the directional derivative, which allows us to search the optimal control along its natural direction f . If only the solution (2.8) is concerned, for instance computing the values of V Qn of the HJB equation [ai , bi ] of Rn , we have to produce the monotone mesh-point sequence in space in the polyhedral i=1 generated by the recursive relation (3.13). To this purpose, we have to change the searching direction forcefully. In this case, we suggest to use the following approximation for directional derivative instead of using the approximation of (3.12). Specifically, for every fixed (x, u), x = (x 1 , x 2 , . . . , x n ), f = ( f 1 , f 2 , . . . , f n ), ∇x V (t, x) ∙ f (x, u) =



 n  X f p (x, u)sgn( f p (x, u)) 1 + k f p (x, u)k Vx p (t, x) ∙ η 1 + k f p (x, u)k ηsgn( f p (x, u))

(3.17)

p=1

n V X p=1

  f p (x, u)sgn( f p (x, u)) t, x + η − V (t, x) I p 1 + k f p (x, u)k 1 + k f p (x, u)k , η sgn( f p (x, u))

where sgn(℘) =

(

1,

if ℘ > 0,

−1,

if ℘ < 0,

(3.18)

I p is the n-dimensional unit vector with the pth component 1 and Vx p is the partial derivative of the value function V with respect to x p . In this way, the possible oscillation caused by sign change of the function f can be avoided when we use the formula (3.13) to perform the spatial mesh partition. Accordingly, the mesh-point sequence in space generated by the recursive relation (3.13) now becomes p

p

xi = xi−1 + η

˜ f p (xi−1 , u) ˜ sgn( f p (xi−1 , u)) , p 1 + k f (xi−1 , u)k ˜

p = 1, 2, . . . , n, i = 1, 2, . . . , M,

(3.19)

where xk = (xk1 , xk2 , . . . , xkn ), k = i − 1, i. 4. An example In this section, we provide an illustrative example to show the effectiveness of our new algorithm. Both the value function and the feedback law have closed-form solutions in this example. This allows us to evaluate the numerical solutions obtained by our algorithm. Note that in this example, the value function is not the classical solution; rather it is the viscosity solution to its associated HJB equation (Yong, 1992). Consider the state equation governed by ( 0 y (t) = u(t), t ∈ (0, 1), (4.20) y(0) = z,

8 of 10

B.-Z. GUO AND B. SUN

for which the state space is R. The control constraint U = [−1, 1] and hence U [0, 1] = L ∞ ([0, 1]; U ). The cost functional is J (u(∙)) = −y 2 (1).

(4.21)

Now, we introduce the value function of the problem. For any (t, x) ∈ [0, 1) × R, consider the following system: ( 0 yt,x (s) = u(s), s ∈ [t, 1], (4.22) yt,x (t) = x. Accordingly, the cost functional is 2 Jt,x (u(∙)) = −yt,x (1).

Define the value function V (t, x) = A simple calculation gives that V (t, x) =

(

inf

u(∙)∈U [t,1]

−[x + (1 − t)]2 ,

−[x − (1 − t)]2 ,

= −[|x| + (1 − t)]2 ,

Jt,x (u(∙)).

x > 0, x 6 0,

(4.23)

t ∈ [0, 1],

x ∈ R, t ∈ [0, 1].

(4.24)

It is seen that V is continuous in its variable but is not in C 1 ([0, 1] × R). The associated HJB equation is  {Vx (t, x) ∙ u} = 0, (t, x) ∈ [0, 1) × R, Vt (t, x) + |u|inf 61 (4.25)  V (1, x) = −x 2 , x ∈ R. From Yong (1992), we know that the value function V is the unique viscosity solution to the HJB equation (4.25) and the optimal feedback control–trajectory pair is given analytically as ∗ (s)), u ∗t,x (s) = sign(yt,x

where sign(y) = and ∗ yt,x (s)

=

(

    

1,

y > 0,

{±1},

y = 0,

−1,

x + (s − t),

x − (s − t),

(4.26)

y < 0, x > 0, x 6 0.

(4.27)

We apply the algorithm in Section 3 step by step and obtain the numerical solutions of the optimal feedback control–trajectory pairs for different initial values from −1 to 1 with step size 0.2. The parameters are taken as N = M = 100 and η = 0.02. All computations are performed in Visual C++ 6.0 and numerical results are plotted by MATLAB 6.0. Figure 1 shows the obtained numerical solutions of the optimal trajectories, where the solid lines denote the analytical solutions (4.27). It is seen that the analytical solutions and numerical solutions

ALGORITHM FOR FINDING OPTIMAL FEEDBACK CONTROL

9 of 10

FIG. 1. Numerical solutions of the optimal trajectories.

FIG. 2. Numerical solutions of the optimal feedback laws.

completely coincide with each other. Figure 2 displays the computed numerical solutions of the optimal feedback laws where solid lines denote the analytical solutions (4.26). They also completely match with the analytical solutions (4.26). Acknowledgements The authors would like to thank an anonymous referee for indicating possible oscillations due to sign change of f of the mesh-point sequence in space generated by the recursive relation (3.13) in computation

10 of 10

B.-Z. GUO AND B. SUN

of the HJB equation. This prompts us to use the modified mesh-point consequence (3.19) produced by (3.17). Funding National Natural Science Foundation of China; National Research Foundation of South Africa. R EFERENCES BARDI , M. & C APUZZO -D OLCETTA , I. (1997) Optimal Control and Viscosity Solutions of Hamilton-JacobiBellman Equations. With appendices by Maurizio Falcone and Pierpaolo Soravia. Boston, MA: Birkh¨auser. B RYSON J R , A. E. (1996) Optimal control—1950 to 1985. IEEE Control Syst. Mag., 16, 26–33. C RANDALL , M. G. (1997) Viscosity solutions: a primer. Viscosity Solutions and Applications. Edited by Italo Capuzzo Dolcetta & Pierre-Louis Lions. Lecture Notes in Mathematics, vol. 1660. Berlin: Springer, pp. 1–43. C RANDALL , M. G. & L IONS , P. L. (1984) Two approximations of solutions of Hamilton-Jacobi equations. Math. Comput., 43, 1–19. FALCONE , M., L ANUCARA , P. & S EGHINI , A. (1994) A splitting algorithm for Hamilton-Jacobi-Bellman equations. Appl. Numer. Math., 15, 207–218. F LEMING , W. H. & S ONER , H. M. (1993) Controlled Markov Processes and Viscosity Solutions. New York: Springer. G UO , B. Z. & S UN , B. (2005) Numerical solution to the optimal birth feedback control of a population dynamics: a viscosity solution approach. Optim. Control Appl. Methods, 26, 229–254. G UO , B. Z. & S UN , B. (2007) Numerical solution to the optimal feedback control of continuous casting process. J. Global Optim., 39, 171–195. H O , Y. C. (2005) On centralized optimal control. IEEE Trans. Autom. Control, 50, 537–538. H UANG , C.-S., WANG , S. & T EO , K. L. (2000) Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics. Nonlinear Anal., 40, 279–293. H UANG , C.-S., WANG , S. & T EO , K. L. (2004) On application of an alternating direction method to HamiltonJacobi-Bellman equations. J. Comput. Appl. Math., 166, 153–166. L I , R. H. & F ENG , G. C. (1996) Numerical Solutions of Differential Equations. Beijing: Higher Education Press (in Chinese). P ESCH , H. J. (2003) Optimal control applications—offline and online methods—for ODE, DAE and PDE problems. Technical Report, German-Israeli Minerva School, Thurnau, 22–26 September 2003. Available at http://www.uni-bayreuth.de/departments/ingenieur mathematik/aktuelles.html. WANG , S., G AO , F. & T EO , K. L. (2000) An upwind finite-difference method for the approximation of viscosity solutions to Hamilton-Jacobi-Bellman equations. IMA J. Math. Control Inf., 17, 167–178. WANG , S., J ENNINGS , L. S. & T EO , K. L. (2003) Numerical solution of Hamilton-Jacobi-Bellman equations by an upwind finite volume method. J. Global Optim., 27, 177–192. YONG , J. M. (1992) The Method of Dynamic Programming and Hamilton-Jacobi-Bellman Equations. Shanghai: Shanghai Scientific & Technical Publishers (in Chinese).

A new algorithm for finding numerical solutions of ...

Mar 2, 2009 - Department of Mathematics, Beijing Institute of Technology, Beijing .... Given a running cost L(t, y, u) and a terminal cost ψ(y), the optimal ...

871KB Sizes 1 Downloads 304 Views

Recommend Documents

A New Algorithm for Finding Numerical Solutions of ... - IEEE Xplore
optimal control problem is the viscosity solution of its associated Hamilton-Jacobi-Bellman equation. An example that the closed form solutions of optimal ...

A Randomized Algorithm for Finding a Path ... - Semantic Scholar
Dec 24, 1998 - Integrated communication networks (e.g., ATM) o er end-to-end ... suming speci c service disciplines, they cannot be used to nd a path subject ...

A New NC-Algorithm for Finding a Perfect Matching in d-Regular ...
cubic-bipartite graphs, our algorithm as well as its analysis become much .... cycle vector in G is a big even cycle vector if it contains Ω(k) 3-vertices of G.

A faster algorithm for finding optimal semi-matching
Sep 29, 2007 - CancelAll(N2). Figure 2: Divide-and-conquer algorithm. To find the min-cost flow in N, the algorithm use a subroutine called CancelAll to cancel.

A New Estimate of Restricted Isometry Constants for Sparse Solutions
Jan 12, 2011 - where ˜x1 is the standard l1 norm of vector ˜x. Suppose that x∗. 0 = k. Let T0 ⊂ {1,2,ททท ,n} be the subset of indices for the k largest entries of ...

A New Estimate of Restricted Isometry Constants for Sparse Solutions
Jan 12, 2011 - q < hTc. 0 q. (11) for all nonzero vector h in the null space of Φ. It is called the null ... find two solutions hT0 and −hTc. 0 ... First of all, we have. 6 ...

An Improved Divide-and-Conquer Algorithm for Finding ...
Zhao et al. [24] proved that the approximation ratio is. 2 − 3/k for an odd k and 2 − (3k − 4)/(k2 − k) for an even k, if we compute a k-way cut of the graph by iteratively finding and deleting minimum 3-way cuts in the graph. Xiao et al. [23

an algorithm for finding effective query expansions ... - CiteSeerX
analysis on word statistical information retrieval, and uses this data to discover high value query expansions. This process uses a medical thesaurus (UMLS) ...

An Online Algorithm for Finding the Longest Previous ...
1 Department of Computer Science, University of Tokyo. Hongo 7-3-1, Bunkyo-ku, Tokyo 113-0013, Japan [email protected]. 2 Department of Computer ...

FINDING SECURE KEYS FOR RSA ALGORITHM ...
FINDING SECURE KEYS FOR RSA. ALGORITHM THROUGH. FACTORIZATION. Roksana Akter* Mohammad Shaiduzzaman**. Md. Enamul Karim ***. Abstract.

an algorithm for finding effective query expansions ... - CiteSeerX
UMLS is the Metathesaurus, a medical domain specific ontology. A key constituent of the Metathesaurus is a concept, which serves as nexus of terms across the.

an algorithm for finding effective query expansions ...
the set of UMLS relationships that connect the concepts in the queries with the .... database table MRXNS_ENG (This table contains the. English language ...

Numerical Solutions for the Most General.pdf
There was a problem loading more pages. Retrying... Numerical Solutions for the Most General.pdf. Numerical Solutions for the Most General.pdf. Open. Extract.

Internship M2 2014-2015 2. Numerical solutions for ...
2. Numerical solutions for Hamilton-Jacobi equations constrained on networks. PLACE: Institut de Recherche Mathématique de Rennes CNRS UMR6625.

A NEW ACTIVE LEARNING ALGORITHM FOR ...
We propose a new active learning algorithm to address the problem of selecting ..... from Microsoft Speech research group for their technical help. We also like to ...

A new Algorithm for Community Identification in Linked ...
community identification, community mining, web communities. 1 Introduction. Since late nineties, identification of web communities has received much attention from researchers. HITS is a seminal algorithm in the community identification (CI) algorit

A new algorithm for computing the minimum Hausdorff ...
Sort the spikes according to their left endpoints and add them from left to right. ... If we shift A* by t units, the left or the right endpoint will contribute at least |t| to ...

On a Simple Randomized Algorithm for Finding a 2 ... - Semantic Scholar
However, they left open the question of whether an Hamiltonian path/cycle or even a long path/cycle can be found in sparse random graphs, e.g., graphs of degree 3. Our result on 3-regular random Hamiltonian graphs improves on a result of Karger et al

On a Simple Randomized Algorithm for Finding a 2 ...
note that the probability space is determined both by the space of all such random graphs and the random choices made by the algorithm). Given a undirected ...

On a Simple Randomized Algorithm for Finding a 2 ... - Semantic Scholar
We analyze the performance of a simple randomized algorithm for finding 2-factors in directed. Hamiltonian graphs of out-degree at most two and in undirected Hamiltonian graphs of degree at most three. For the directed case, the algorithm finds a 2-f

A New Scheduling Algorithm for Distributed Streaming ...
Department of Computer Science and Technology, Tsinghua University, Beijing 100084 China. 1 This paper is ... Tel: +86 10 62782530; fax:+86 10 62771138; Email: [email protected]. Abstract ... In patching algorithm, users receive at.

An E cient Algorithm for Finding a Path Subject to Two ...
Jun 14, 1999 - Integrated network services (e.g., ATM, Intserv) are being designed to .... Phase 1, the algorithm assigns each edge e 2 E a weight l1(e) def.

download The Future of Service-Learning: New Solutions for ...
Full PDF The Future of Service-Learning: New Solutions for Sustaining and Improving Practice, Reading PDF The Future of Service-Learning: New Solutions for ...