On Sample Size Control in Sample Average Approximations for Solving Smooth Stochastic Programs

On Sample Size Control in Sample Average Approximations for Solving Smooth Stochastic Programs
Author:
Publisher:
Total Pages: 29
Release: 2009
Genre:
ISBN:

Download On Sample Size Control in Sample Average Approximations for Solving Smooth Stochastic Programs Book in PDF, Epub and Kindle

We consider smooth stochastic programs and develop a discrete-time optimal-control problem for adaptively selecting sample sizes in a class of algorithms based on sample average approximations (SAA). The control problem aims to minimize the expected computational cost to obtain a near-optimal solution of a stochastic program and is solved approximately using dynamic programming. The optimal-control problem depends on unknown parameters such as rate of convergence, computational cost per iteration, and sampling error. Hence, we implement the approach within a receding-horizon framework where parameters are estimated and the optimal- control problem is solved repeatedly during the calculations of a SAA algorithm. The resulting sample-size selection policy consistently produces near-optimal solutions in short computing times as compared to other plausible policies in several numerical examples.

Handbook of Simulation Optimization

Handbook of Simulation Optimization
Author: Michael C Fu
Publisher: Springer
Total Pages: 400
Release: 2014-11-13
Genre: Business & Economics
ISBN: 1493913840

Download Handbook of Simulation Optimization Book in PDF, Epub and Kindle

The Handbook of Simulation Optimization presents an overview of the state of the art of simulation optimization, providing a survey of the most well-established approaches for optimizing stochastic simulation models and a sampling of recent research advances in theory and methodology. Leading contributors cover such topics as discrete optimization via simulation, ranking and selection, efficient simulation budget allocation, random search methods, response surface methodology, stochastic gradient estimation, stochastic approximation, sample average approximation, stochastic constraints, variance reduction techniques, model-based stochastic search methods and Markov decision processes. This single volume should serve as a reference for those already in the field and as a means for those new to the field for understanding and applying the main approaches. The intended audience includes researchers, practitioners and graduate students in the business/engineering fields of operations research, management science, operations management and stochastic control, as well as in economics/finance and computer science.

Optimal Search for Moving Targets

Optimal Search for Moving Targets
Author: Lawrence D. Stone
Publisher: Springer
Total Pages: 222
Release: 2016-04-06
Genre: Business & Economics
ISBN: 3319268996

Download Optimal Search for Moving Targets Book in PDF, Epub and Kindle

This book begins with a review of basic results in optimal search for a stationary target. It then develops the theory of optimal search for a moving target, providing algorithms for computing optimal plans and examples of their use. Next it develops methods for computing optimal search plans involving multiple targets and multiple searchers with realistic operational constraints on search movement. These results assume that the target does not react to the search. In the final chapter there is a brief overview of mostly military problems where the target tries to avoid being found as well as rescue or rendezvous problems where the target and the searcher cooperate. Larry Stone wrote his definitive book Theory of Optimal Search in 1975, dealing almost exclusively with the stationary target search problem. Since then the theory has advanced to encompass search for targets that move even as the search proceeds, and computers have developed sufficient capability to employ the improved theory. In this book, Stone joins Royset and Washburn to document and explain this expanded theory of search. The problem of how to search for moving targets arises every day in military, rescue, law enforcement, and border patrol operations.

Adaptive Selections of Sample Size and Solver Iterations in Stochastic Optimization with Application to Nonlinear Commodity Flow Problems

Adaptive Selections of Sample Size and Solver Iterations in Stochastic Optimization with Application to Nonlinear Commodity Flow Problems
Author: David A. Vondrak
Publisher:
Total Pages: 39
Release: 2009
Genre: Dynamic programming
ISBN:

Download Adaptive Selections of Sample Size and Solver Iterations in Stochastic Optimization with Application to Nonlinear Commodity Flow Problems Book in PDF, Epub and Kindle

We present an algorithm to approximately solve certain stochastic nonlinear programs through sample average approximations. The sample sizes in these approximations are selected by approximately solving optimal control problems defined on a discrete-time dynamic system. The optimal-control problem seeks to minimize the computational effort required to reach a near-optimal objective value of the stochastic nonlinear program. Unknown control-problem parameters such as rate of convergence, computational effort per solver iteration, and optimal value of the program are estimated within a receding horizon framework as the algorithm progresses. The algorithm is illustrated with single-commodity and multi-commodity network flow models. Measured against the best alternative heuristic policy we consider for selecting sample sizes, the algorithm finds a near-optimal objective value on average up to 17% faster. Further, the optimal-control problem also leads to a 40% reduction in standard deviation of computing times over a set of independent runs of the algorithm on identical problem instances. When we modify the algorithm by selecting a policy heuristically in the first stage (only), we improve computing time, on average, by nearly 47% against the best heuristic policy considered, while reducing the standard deviation across the independent runs by 55%.

Lectures on Stochastic Programming

Lectures on Stochastic Programming
Author: Alexander Shapiro
Publisher: SIAM
Total Pages: 447
Release: 2009-01-01
Genre: Mathematics
ISBN: 0898718759

Download Lectures on Stochastic Programming Book in PDF, Epub and Kindle

Optimization problems involving stochastic models occur in almost all areas of science and engineering, such as telecommunications, medicine, and finance. Their existence compels a need for rigorous ways of formulating, analyzing, and solving such problems. This book focuses on optimization problems involving uncertain parameters and covers the theoretical foundations and recent advances in areas where stochastic models are available. Readers will find coverage of the basic concepts of modeling these problems, including recourse actions and the nonanticipativity principle. The book also includes the theory of two-stage and multistage stochastic programming problems; the current state of the theory on chance (probabilistic) constraints, including the structure of the problems, optimality theory, and duality; and statistical inference in and risk-averse approaches to stochastic programming.

Applied Stochastic Differential Equations

Applied Stochastic Differential Equations
Author: Simo Särkkä
Publisher: Cambridge University Press
Total Pages: 327
Release: 2019-05-02
Genre: Business & Economics
ISBN: 1316510085

Download Applied Stochastic Differential Equations Book in PDF, Epub and Kindle

With this hands-on introduction readers will learn what SDEs are all about and how they should use them in practice.