Sequential Methods for Rare Event Simulations

Sequential Methods for Rare Event Simulations
Author: Shaojie Deng
Publisher:
Total Pages:
Release: 2010
Genre:
ISBN:

Download Sequential Methods for Rare Event Simulations Book in PDF, Epub and Kindle

We consider rare events modeled as a Markov Chain hitting a certain rare set. A sequential importance sampling with resampling (SISR) method is introduced to provide a versatile approach for computing such probabilities of rare events. The method uses resampling to track the zero-variance importance measure associated with the event of interest. A general methodology for choosing the importance measure and resampling scheme to come up with an efficient estimator of the probability of occurrence of the rare event is developed and the distinction between light-tailed and heavy-tailed problems is highlighted. Applications include classic tail probabilities for sums of independent light-tailed or heavy-tailed random variables. Markovian extensions and simultaneous simulation are also given. The heuristics and the methodology can also be applied to more complex Monte Carlo problems that arise in recent works on the dynamic portfolio credit risk model.

Rare Event Simulation using Monte Carlo Methods

Rare Event Simulation using Monte Carlo Methods
Author: Gerardo Rubino
Publisher: John Wiley & Sons
Total Pages: 278
Release: 2009-03-18
Genre: Mathematics
ISBN: 9780470745410

Download Rare Event Simulation using Monte Carlo Methods Book in PDF, Epub and Kindle

In a probabilistic model, a rare event is an event with a very small probability of occurrence. The forecasting of rare events is a formidable task but is important in many areas. For instance a catastrophic failure in a transport system or in a nuclear power plant, the failure of an information processing system in a bank, or in the communication network of a group of banks, leading to financial losses. Being able to evaluate the probability of rare events is therefore a critical issue. Monte Carlo Methods, the simulation of corresponding models, are used to analyze rare events. This book sets out to present the mathematical tools available for the efficient simulation of rare events. Importance sampling and splitting are presented along with an exposition of how to apply these tools to a variety of fields ranging from performance and dependability evaluation of complex systems, typically in computer science or in telecommunications, to chemical reaction analysis in biology or particle transport in physics. Graduate students, researchers and practitioners who wish to learn and apply rare event simulation techniques will find this book beneficial.

Introduction to Rare Event Simulation

Introduction to Rare Event Simulation
Author: James Bucklew
Publisher: Springer Science & Business Media
Total Pages: 262
Release: 2013-03-09
Genre: Mathematics
ISBN: 1475740786

Download Introduction to Rare Event Simulation Book in PDF, Epub and Kindle

This book presents a unified theory of rare event simulation and the variance reduction technique known as importance sampling from the point of view of the probabilistic theory of large deviations. It allows us to view a vast assortment of simulation problems from a unified single perspective.

An Introduction to Sequential Monte Carlo

An Introduction to Sequential Monte Carlo
Author: Nicolas Chopin
Publisher: Springer Nature
Total Pages: 378
Release: 2020-10-01
Genre: Mathematics
ISBN: 3030478459

Download An Introduction to Sequential Monte Carlo Book in PDF, Epub and Kindle

This book provides a general introduction to Sequential Monte Carlo (SMC) methods, also known as particle filters. These methods have become a staple for the sequential analysis of data in such diverse fields as signal processing, epidemiology, machine learning, population ecology, quantitative finance, and robotics. The coverage is comprehensive, ranging from the underlying theory to computational implementation, methodology, and diverse applications in various areas of science. This is achieved by describing SMC algorithms as particular cases of a general framework, which involves concepts such as Feynman-Kac distributions, and tools such as importance sampling and resampling. This general framework is used consistently throughout the book. Extensive coverage is provided on sequential learning (filtering, smoothing) of state-space (hidden Markov) models, as this remains an important application of SMC methods. More recent applications, such as parameter estimation of these models (through e.g. particle Markov chain Monte Carlo techniques) and the simulation of challenging probability distributions (in e.g. Bayesian inference or rare-event problems), are also discussed. The book may be used either as a graduate text on Sequential Monte Carlo methods and state-space modeling, or as a general reference work on the area. Each chapter includes a set of exercises for self-study, a comprehensive bibliography, and a “Python corner,” which discusses the practical implementation of the methods covered. In addition, the book comes with an open source Python library, which implements all the algorithms described in the book, and contains all the programs that were used to perform the numerical experiments.

Fast Sequential Monte Carlo Methods for Counting and Optimization

Fast Sequential Monte Carlo Methods for Counting and Optimization
Author: Reuven Y. Rubinstein
Publisher: John Wiley & Sons
Total Pages: 177
Release: 2013-11-13
Genre: Mathematics
ISBN: 1118612353

Download Fast Sequential Monte Carlo Methods for Counting and Optimization Book in PDF, Epub and Kindle

A comprehensive account of the theory and application of Monte Carlo methods Based on years of research in efficient Monte Carlo methods for estimation of rare-event probabilities, counting problems, and combinatorial optimization, Fast Sequential Monte Carlo Methods for Counting and Optimization is a complete illustration of fast sequential Monte Carlo techniques. The book provides an accessible overview of current work in the field of Monte Carlo methods, specifically sequential Monte Carlo techniques, for solving abstract counting and optimization problems. Written by authorities in the field, the book places emphasis on cross-entropy, minimum cross-entropy, splitting, and stochastic enumeration. Focusing on the concepts and application of Monte Carlo techniques, Fast Sequential Monte Carlo Methods for Counting and Optimization includes: Detailed algorithms needed to practice solving real-world problems Numerous examples with Monte Carlo method produced solutions within the 1-2% limit of relative error A new generic sequential importance sampling algorithm alongside extensive numerical results An appendix focused on review material to provide additional background information Fast Sequential Monte Carlo Methods for Counting and Optimization is an excellent resource for engineers, computer scientists, mathematicians, statisticians, and readers interested in efficient simulation techniques. The book is also useful for upper-undergraduate and graduate-level courses on Monte Carlo methods.

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments
Author:
Publisher:
Total Pages:
Release: 2012
Genre:
ISBN:

Download Sequential Importance Sampling for Rare Event Estimation with Computer Experiments Book in PDF, Epub and Kindle

Importance sampling often drastically improves the variance of percentile and quantile estimators of rare events. We propose a sequential strategy for iterative refinement of importance distributions for sampling uncertain inputs to a computer model to estimate quantiles of model output or the probability that the model output exceeds a fixed or random threshold. A framework is introduced for updating a model surrogate to maximize its predictive capability for rare event estimation with sequential importance sampling. Examples of the proposed methodology involving materials strength and nuclear reactor applications will be presented. The conclusions are: (1) Importance sampling improves UQ of percentile and quantile estimates relative to brute force approach; (2) Benefits of importance sampling increase as percentiles become more extreme; (3) Iterative refinement improves importance distributions in relatively few iterations; (4) Surrogates are necessary for slow running codes; (5) Sequential design improves surrogate quality in region of parameter space indicated by importance distributions; and (6) Importance distributions and VRFs stabilize quickly, while quantile estimates may converge slowly.

A Coupling Approach to Rare Event Simulation Via Dynamic Importance Sampling

A Coupling Approach to Rare Event Simulation Via Dynamic Importance Sampling
Author: Benjamin Jiahong Zhang
Publisher:
Total Pages: 109
Release: 2017
Genre:
ISBN:

Download A Coupling Approach to Rare Event Simulation Via Dynamic Importance Sampling Book in PDF, Epub and Kindle

Rare event simulation involves using Monte Carlo methods to estimate probabilities of unlikely events and to understand the dynamics of a system conditioned on a rare event. An established class of algorithms based on large deviations theory and control theory constructs provably asymptotically efficient importance sampling estimators. Dynamic importance sampling is one these algorithms in which the choice of biasing distribution adapts in the course of a simulation according to the solution of an Isaacs partial differential equation or by solving a sequence of variational problems. However, obtaining the solution of either problem may be expensive, where the cost of solving these problems may be even more expensive than performing simple Monte Carlo exhaustively. Deterministic couplings induced by transport maps allows one to relate a complex probability distribution of interest to a simple reference distribution (e.g. a standard Gaussian) through a monotone, invertible function. This diverts the complexity of the distribution of interest into a transport map. We extend the notion of transport maps between probability distributions on Euclidean space to probability distributions on path space following a similar procedure to Itô’s coupling. The contraction principle is a key concept from large deviations theory that allows one to relate large deviations principles of different systems through deterministic couplings. We convey that with the ability to computationally construct transport maps, we can leverage the contraction principle to reformulate the sequence of variational problems required to implement dynamic importance sampling and make computation more amenable. We apply this approach to simple rotorcraft models. We conclude by outlining future directions of research such as using the coupling interpretation to accelerate rare event simulation via particle splitting, using transport maps to learn large deviations principles, and accelerating inference of rare events.

The Cross-Entropy Method

The Cross-Entropy Method
Author: Reuven Y. Rubinstein
Publisher: Springer Science & Business Media
Total Pages: 316
Release: 2013-03-09
Genre: Computers
ISBN: 1475743211

Download The Cross-Entropy Method Book in PDF, Epub and Kindle

Rubinstein is the pioneer of the well-known score function and cross-entropy methods. Accessible to a broad audience of engineers, computer scientists, mathematicians, statisticians and in general anyone, theorist and practitioner, who is interested in smart simulation, fast optimization, learning algorithms, and image processing.

Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems

Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems
Author: Jerome Morio
Publisher: Woodhead Publishing
Total Pages: 217
Release: 2015-11-16
Genre: Technology & Engineering
ISBN: 0081001118

Download Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems Book in PDF, Epub and Kindle

Rare event probability (10-4 and less) estimation has become a large area of research in the reliability engineering and system safety domains. A significant number of methods have been proposed to reduce the computation burden for the estimation of rare events from advanced sampling approaches to extreme value theory. However, it is often difficult in practice to determine which algorithm is the most adapted to a given problem.Estimation of Rare Event Probabilities in Complex Aerospace and Other Systems: A Practical Approach provides a broad up-to-date view of the current available techniques to estimate rare event probabilities described with a unified notation, a mathematical pseudocode to ease their potential implementation and finally a large spectrum of simulation results on academic and realistic use cases. Provides a broad overview of the practical approach of rare event methods. Includes algorithms that are applied to aerospace benchmark test cases Offers insight into practical tuning issues