Infinite-Horizon Optimal Control in the Discrete-Time Framework

Infinite-Horizon Optimal Control in the Discrete-Time Framework
Author: Joël Blot
Publisher: Springer Science & Business Media
Total Pages: 130
Release: 2013-11-08
Genre: Mathematics
ISBN: 1461490383

Download Infinite-Horizon Optimal Control in the Discrete-Time Framework Book in PDF, Epub and Kindle

​​​​In this book the authors take a rigorous look at the infinite-horizon discrete-time optimal control theory from the viewpoint of Pontryagin’s principles. Several Pontryagin principles are described which govern systems and various criteria which define the notions of optimality, along with a detailed analysis of how each Pontryagin principle relate to each other. The Pontryagin principle is examined in a stochastic setting and results are given which generalize Pontryagin’s principles to multi-criteria problems. ​Infinite-Horizon Optimal Control in the Discrete-Time Framework is aimed toward researchers and PhD students in various scientific fields such as mathematics, applied mathematics, economics, management, sustainable development (such as, of fisheries and of forests), and Bio-medical sciences who are drawn to infinite-horizon discrete-time optimal control problems.

Infinite Horizon Optimal Control

Infinite Horizon Optimal Control
Author: Dean A. Carlson
Publisher: Springer Science & Business Media
Total Pages: 270
Release: 2013-06-29
Genre: Business & Economics
ISBN: 3662025299

Download Infinite Horizon Optimal Control Book in PDF, Epub and Kindle

This monograph deals with various classes of deterministic continuous time optimal control problems wh ich are defined over unbounded time intervala. For these problems, the performance criterion is described by an improper integral and it is possible that, when evaluated at a given admissible element, this criterion is unbounded. To cope with this divergence new optimality concepts; referred to here as "overtaking", "weakly overtaking", "agreeable plans", etc. ; have been proposed. The motivation for studying these problems arisee primarily from the economic and biological aciences where models of this nature arise quite naturally since no natural bound can be placed on the time horizon when one considers the evolution of the state of a given economy or species. The reeponsibility for the introduction of this interesting class of problems rests with the economiste who first studied them in the modeling of capital accumulation processes. Perhaps the earliest of these was F. Ramsey who, in his seminal work on a theory of saving in 1928, considered a dynamic optimization model defined on an infinite time horizon. Briefly, this problem can be described as a "Lagrange problem with unbounded time interval". The advent of modern control theory, particularly the formulation of the famoue Maximum Principle of Pontryagin, has had a considerable impact on the treatment of these models as well as optimization theory in general.

Contrôle Optimal en Temps Discret Et en Horizon Infini

Contrôle Optimal en Temps Discret Et en Horizon Infini
Author: Thoi-Nhan Ngo
Publisher:
Total Pages: 0
Release: 2016
Genre:
ISBN:

Download Contrôle Optimal en Temps Discret Et en Horizon Infini Book in PDF, Epub and Kindle

This thesis contains original contributions to the optimal control theory in the discrete-time framework and in infinite horizon following the viewpoint of Pontryagin. There are 5 chapters in this thesis. In Chapter 1, we recall preliminary results on sequence spaces and on differential calculus in normed linear space. In Chapter 2, we study a single-objective optimal control problem in discrete-time framework and in infinite horizon with an asymptotic constraint and with autonomous system. We use an approach of functional analytic for this problem after translating it into the form of an optimization problem in Banach (sequence) spaces. Then a weak Pontyagin principle is established for this problem by using a classical multiplier rule in Banach spaces. In Chapter 3, we establish a strong Pontryagin principle for the problems considered in Chapter 2 using a result of Ioffe and Tihomirov. Chapter 4 is devoted to the problems of Optimal Control, in discrete time framework and in infinite horizon, which are more general with several different criteria. The used method is the reduction to finite-horizon initiated by J. Blot and H. Chebbi in 2000. The considered problems are governed by difference equations or difference inequations. A new weak Pontryagin principle is established using a recent result of J. Blot on the Fritz John multipliers. Chapter 5 deals with the multicriteria optimal control problems in discrete time framework and infinite horizon. New weak and strong Pontryagin principles are established, again using recent optimization results, under lighter assumptions than existing ones.

Stochastic Optimal Control

Stochastic Optimal Control
Author: Dimitri P. Bertsekas
Publisher:
Total Pages: 323
Release: 1961
Genre: Dynamic programming
ISBN: 9780120932603

Download Stochastic Optimal Control Book in PDF, Epub and Kindle

Essays on Pareto Optimality in Cooperative Games

Essays on Pareto Optimality in Cooperative Games
Author: Yaning Lin
Publisher: Springer Nature
Total Pages: 169
Release: 2022-09-21
Genre: Technology & Engineering
ISBN: 9811950490

Download Essays on Pareto Optimality in Cooperative Games Book in PDF, Epub and Kindle

The book focuses on Pareto optimality in cooperative games. Most of the existing works focus on the Pareto optimality of deterministic continuous-time systems or for the regular convex LQ case. To expand on the available literature, we explore the existence conditions of Pareto solutions in stochastic differential game for more general cases. In addition, the LQ Pareto game for stochastic singular systems, Pareto-based guaranteed cost control for uncertain mean-field stochastic systems, and the existence conditions of Pareto solutions in cooperative difference game are also studied in detail. Addressing Pareto optimality for more general cases and wider systems is one of the major features of the book, making it particularly suitable for readers who are interested in multi-objective optimal control. Accordingly, it offers a valuable asset for researchers, engineers, and graduate students in the fields of control theory and control engineering, economics, management science, mathematics, etc.

Optimization and Approximation

Optimization and Approximation
Author: Pablo Pedregal
Publisher: Springer
Total Pages: 261
Release: 2017-09-07
Genre: Mathematics
ISBN: 3319648438

Download Optimization and Approximation Book in PDF, Epub and Kindle

This book provides a basic, initial resource, introducing science and engineering students to the field of optimization. It covers three main areas: mathematical programming, calculus of variations and optimal control, highlighting the ideas and concepts and offering insights into the importance of optimality conditions in each area. It also systematically presents affordable approximation methods. Exercises at various levels have been included to support the learning process.

Discrete-Time Optimal Control and Games on Large Intervals

Discrete-Time Optimal Control and Games on Large Intervals
Author: Alexander J. Zaslavski
Publisher: Springer
Total Pages: 402
Release: 2017-04-03
Genre: Mathematics
ISBN: 3319529323

Download Discrete-Time Optimal Control and Games on Large Intervals Book in PDF, Epub and Kindle

Devoted to the structure of approximate solutions of discrete-time optimal control problems and approximate solutions of dynamic discrete-time two-player zero-sum games, this book presents results on properties of approximate solutions in an interval that is independent lengthwise, for all sufficiently large intervals. Results concerning the so-called turnpike property of optimal control problems and zero-sum games in the regions close to the endpoints of the time intervals are the main focus of this book. The description of the structure of approximate solutions on sufficiently large intervals and its stability will interest graduate students and mathematicians in optimal control and game theory, engineering, and economics. This book begins with a brief overview and moves on to analyze the structure of approximate solutions of autonomous nonconcave discrete-time optimal control Lagrange problems.Next the structures of approximate solutions of autonomous discrete-time optimal control problems that are discrete-time analogs of Bolza problems in calculus of variations are studied. The structures of approximate solutions of two-player zero-sum games are analyzed through standard convexity-concavity assumptions. Finally, turnpike properties for approximate solutions in a class of nonautonomic dynamic discrete-time games with convexity-concavity assumptions are examined.

Control and System Theory of Discrete-Time Stochastic Systems

Control and System Theory of Discrete-Time Stochastic Systems
Author: Jan H. van Schuppen
Publisher: Springer Nature
Total Pages: 940
Release: 2021-08-02
Genre: Technology & Engineering
ISBN: 3030669521

Download Control and System Theory of Discrete-Time Stochastic Systems Book in PDF, Epub and Kindle

This book helps students, researchers, and practicing engineers to understand the theoretical framework of control and system theory for discrete-time stochastic systems so that they can then apply its principles to their own stochastic control systems and to the solution of control, filtering, and realization problems for such systems. Applications of the theory in the book include the control of ships, shock absorbers, traffic and communications networks, and power systems with fluctuating power flows. The focus of the book is a stochastic control system defined for a spectrum of probability distributions including Bernoulli, finite, Poisson, beta, gamma, and Gaussian distributions. The concepts of observability and controllability of a stochastic control system are defined and characterized. Each output process considered is, with respect to conditions, represented by a stochastic system called a stochastic realization. The existence of a control law is related to stochastic controllability while the existence of a filter system is related to stochastic observability. Stochastic control with partial observations is based on the existence of a stochastic realization of the filtration of the observed process.​

Stochastic Optimal Control: The Discrete-Time Case

Stochastic Optimal Control: The Discrete-Time Case
Author: Dimitri Bertsekas
Publisher: Athena Scientific
Total Pages: 336
Release: 1996-12-01
Genre: Mathematics
ISBN: 1886529035

Download Stochastic Optimal Control: The Discrete-Time Case Book in PDF, Epub and Kindle

This research monograph, first published in 1978 by Academic Press, remains the authoritative and comprehensive treatment of the mathematical foundations of stochastic optimal control of discrete-time systems, including the treatment of the intricate measure-theoretic issues. It is an excellent supplement to the first author's Dynamic Programming and Optimal Control (Athena Scientific, 2018). Review of the 1978 printing:"Bertsekas and Shreve have written a fine book. The exposition is extremely clear and a helpful introductory chapter provides orientation and a guide to the rather intimidating mass of literature on the subject. Apart from anything else, the book serves as an excellent introduction to the arcane world of analytic sets and other lesser known byways of measure theory." Mark H. A. Davis, Imperial College, in IEEE Trans. on Automatic Control Among its special features, the book: 1) Resolves definitively the mathematical issues of discrete-time stochastic optimal control problems, including Borel models, and semi-continuous models 2) Establishes the most general possible theory of finite and infinite horizon stochastic dynamic programming models, through the use of analytic sets and universally measurable policies 3) Develops general frameworks for dynamic programming based on abstract contraction and monotone mappings 4) Provides extensive background on analytic sets, Borel spaces and their probability measures 5) Contains much in depth research not found in any other textbook