Empirical Likelihood and Bootstrap Inference with Constraints

Empirical Likelihood and Bootstrap Inference with Constraints
Author: Chunlin Wang
Publisher:
Total Pages: 172
Release: 2017
Genre:
ISBN:

Download Empirical Likelihood and Bootstrap Inference with Constraints Book in PDF, Epub and Kindle

Empirical likelihood and the bootstrap play influential roles in contemporary statistics. This thesis studies two distinct statistical inference problems, referred to as Part I and Part II, related to the empirical likelihood and bootstrap, respectively. Part I of this thesis concerns making statistical inferences on multiple groups of samples that contain excess zero observations. A unique feature of the target populations is that the distribution of each group is characterized by a non-standard mixture of a singular distribution at zero and a skewed nonnegative component. In Part I of this thesis, we propose modelling the nonnegative components using a semiparametric, multiple-sample, density ratio model (DRM). Under this semiparametric setup, we can efficiently utilize information from the combined samples even with unspecified underlying distributions. We first study the question of testing homogeneity of multiple nonnegative distributions when there is an excess of zeros in the data, under the proposed semiparametric setup. We develop a new empirical likelihood ratio (ELR) test for homogeneity and show that this ELR has a $\chi^2$-type limiting distribution under the homogeneous null hypothesis. A nonparametric bootstrap procedure is proposed to calibrate the finite-sample distribution of the ELR. The consistency of this bootstrap procedure is established under both the null and alternative hypotheses. Simulation studies show that the bootstrap ELR test has an accurate nominal type I error, is robust to changes of underlying distributions, is competitive to, and sometimes more powerful than, several popular one- and two-part tests. A real data example is used to illustrate the advantages of the proposed test. We next investigate the problem of comparing the means of multiple nonnegative distributions, with excess zero observations, under the proposed semiparametric setup. We develop a unified inference framework based on our new ELR statistic, and show that this ELR has a $\chi^2$-type limiting distribution under a general null hypothesis. This allows us to construct a new test for mean equality. Simulation results show favourable performance of the proposed ELR test compared with other existing tests for mean equality, especially when the correctly specified basis function in the DRM is the logarithm function. A real data set is analyzed to illustrate the advantages of the proposed method. In Part II of this thesis, we investigate the asymptotic behaviour of, the commonly used, bootstrap percentile confidence intervals when the parameters are subject to inequality constraints. We concentrate on the important one- and two-sample problems with data generated from distributions in the natural exponential family. Our attention is focused on quantifying asymptotic coverage probabilities of the percentile confidence intervals based on bootstrapping maximum likelihood estimators. We propose a novel local framework to study the subtle asymptotic behaviour of bootstrap percentile confidence intervals when the true parameter values are close to the boundary. Under this framework, we discover that when the true parameter is on, or close to, the restriction boundary, the local asymptotic coverage probabilities can always exceed the nominal level in the one-sample case; however, they can be, surprisingly, both under and over the nominal level in the two-sample case. The results provide theoretical justification and guidance on applying the bootstrap percentile method to constrained inference problems. The two individual parts of this thesis are connected by being referred to as {\em constrained statistical inference}. Specifically, in Part I, the semiparametric density ratio model uses an exponential tilting constraint, which is a type of equality constraint, on the parameter space. In Part II, we deal with inequality constraints, such as a boundary or ordering constraints, on the parameter space. For both parts, an important regularity condition in traditional likelihood inference, that parameters should be interior points of the parameter space, is violated. Therefore, the respective inference procedures involve non-standard asymptotics that create new technical challenges.

Empirical Likelihood

Empirical Likelihood
Author: Art B. Owen
Publisher: CRC Press
Total Pages: 322
Release: 2001-05-18
Genre: Mathematics
ISBN: 1420036157

Download Empirical Likelihood Book in PDF, Epub and Kindle

Empirical likelihood provides inferences whose validity does not depend on specifying a parametric model for the data. Because it uses a likelihood, the method has certain inherent advantages over resampling methods: it uses the data to determine the shape of the confidence regions, and it makes it easy to combined data from multiple sources. It al

Empirical Likelihood Methods in Biomedicine and Health

Empirical Likelihood Methods in Biomedicine and Health
Author: Albert Vexler
Publisher: CRC Press
Total Pages: 300
Release: 2018-09-03
Genre: Mathematics
ISBN: 1351001515

Download Empirical Likelihood Methods in Biomedicine and Health Book in PDF, Epub and Kindle

Empirical Likelihood Methods in Biomedicine and Health provides a compendium of nonparametric likelihood statistical techniques in the perspective of health research applications. It includes detailed descriptions of the theoretical underpinnings of recently developed empirical likelihood-based methods. The emphasis throughout is on the application of the methods to the health sciences, with worked examples using real data. Provides a systematic overview of novel empirical likelihood techniques. Presents a good balance of theory, methods, and applications. Features detailed worked examples to illustrate the application of the methods. Includes R code for implementation. The book material is attractive and easily understandable to scientists who are new to the research area and may attract statisticians interested in learning more about advanced nonparametric topics including various modern empirical likelihood methods. The book can be used by graduate students majoring in biostatistics, or in a related field, particularly for those who are interested in nonparametric methods with direct applications in Biomedicine.

Empirical Likelihood and Extremes

Empirical Likelihood and Extremes
Author: Yun Gong
Publisher:
Total Pages:
Release: 2012
Genre: Bootstrap (Statistics)
ISBN:

Download Empirical Likelihood and Extremes Book in PDF, Epub and Kindle

In 1988, Owen introduced empirical likelihood as a nonparametric method for constructing confidence intervals and regions. Since then, empirical likelihood has been studied extensively in the literature due to its generality and effectiveness. It is well known that empirical likelihood has several attractive advantages comparing to its competitors such as bootstrap: determining the shape of confidence regions automatically using only the data; straightforwardly incorporating side information expressed through constraints; being Bartlett correctable. The main part of this thesis extends the empirical likelihood method to several interesting and important statistical inference situations. This thesis has four components. The first component (Chapter II) proposes a smoothed jackknife empirical likelihood method to construct confidence intervals for the receiver operating characteristic (ROC) curve in order to overcome the computational difficulty when we have nonlinear constrains in the maximization problem. The second component (Chapter III and IV) proposes smoothed empirical likelihood methods to obtain interval estimation for the conditional Value-at-Risk with the volatility model being an ARCH/GARCH model and a nonparametric regression respectively, which have applications in financial risk management. The third component(Chapter V) derives the empirical likelihood for the intermediate quantiles, which plays an important role in the statistics of extremes. Finally, the fourth component (Chapter VI and VII) presents two additional results: in Chapter VI, we present an interesting result by showing that, when the third moment is infinity, we may prefer the Student's t-statistic to the sample mean standardized by the true standard deviation; in Chapter VII, we present a method for testing a subset of parameters for a given parametric model of stationary processes.

Empirical Likelihood Methods in Biomedicine and Health

Empirical Likelihood Methods in Biomedicine and Health
Author: Albert Vexler
Publisher: CRC Press
Total Pages: 149
Release: 2018-09-03
Genre: Mathematics
ISBN: 1351001507

Download Empirical Likelihood Methods in Biomedicine and Health Book in PDF, Epub and Kindle

Empirical Likelihood Methods in Biomedicine and Health provides a compendium of nonparametric likelihood statistical techniques in the perspective of health research applications. It includes detailed descriptions of the theoretical underpinnings of recently developed empirical likelihood-based methods. The emphasis throughout is on the application of the methods to the health sciences, with worked examples using real data. Provides a systematic overview of novel empirical likelihood techniques. Presents a good balance of theory, methods, and applications. Features detailed worked examples to illustrate the application of the methods. Includes R code for implementation. The book material is attractive and easily understandable to scientists who are new to the research area and may attract statisticians interested in learning more about advanced nonparametric topics including various modern empirical likelihood methods. The book can be used by graduate students majoring in biostatistics, or in a related field, particularly for those who are interested in nonparametric methods with direct applications in Biomedicine.

Sample Surveys: Inference and Analysis

Sample Surveys: Inference and Analysis
Author:
Publisher: Morgan Kaufmann
Total Pages: 667
Release: 2009-09-02
Genre: Mathematics
ISBN: 0080963544

Download Sample Surveys: Inference and Analysis Book in PDF, Epub and Kindle

Handbook of Statistics_29B contains the most comprehensive account of sample surveys theory and practice to date. It is a second volume on sample surveys, with the goal of updating and extending the sampling volume published as volume 6 of the Handbook of Statistics in 1988. The present handbook is divided into two volumes (29A and 29B), with a total of 41 chapters, covering current developments in almost every aspect of sample surveys, with references to important contributions and available software. It can serve as a self contained guide to researchers and practitioners, with appropriate balance between theory and real life applications. Each of the two volumes is divided into three parts, with each part preceded by an introduction, summarizing the main developments in the areas covered in that part. Volume 1 deals with methods of sample selection and data processing, with the later including editing and imputation, handling of outliers and measurement errors, and methods of disclosure control. The volume contains also a large variety of applications in specialized areas such as household and business surveys, marketing research, opinion polls and censuses. Volume 2 is concerned with inference, distinguishing between design-based and model-based methods and focusing on specific problems such as small area estimation, analysis of longitudinal data, categorical data analysis and inference on distribution functions. The volume contains also chapters dealing with case-control studies, asymptotic properties of estimators and decision theoretic aspects. Comprehensive account of recent developments in sample survey theory and practice Covers a wide variety of diverse applications Comprehensive bibliography

The Extended Empirical Likelihood

The Extended Empirical Likelihood
Author: Fan Wu
Publisher:
Total Pages:
Release: 2015
Genre:
ISBN:

Download The Extended Empirical Likelihood Book in PDF, Epub and Kindle

The empirical likelihood method introduced by Owen (1988, 1990) is a powerful nonparametric method for statistical inference. It has been one of the most researched methods in statistics in the last twenty-five years and remains to be a very active area of research today. There is now a large body of literature on empirical likelihood method which covers its applications in many areas of statistics (Owen, 2001). One important problem affecting the empirical likelihood method is its poor accuracy, especially for small sample and/or high-dimension applications. The poor accuracy can be alleviated by using high-order empirical likelihood methods such as the Bartlett corrected empirical likelihood but it cannot be completely resolved by high-order asymptotic methods alone. Since the work of Tsao (2004), the impact of the convex hull constraint in the formulation of the empirical likelihood on the finite sample accuracy has been better understood, and methods have been developed to break this constraint in order to improve the accuracy.

In All Likelihood

In All Likelihood
Author: Yudi Pawitan
Publisher: Oxford University Press
Total Pages: 552
Release: 2001-06-21
Genre: Business & Economics
ISBN: 9780198507659

Download In All Likelihood Book in PDF, Epub and Kindle

This text concentrates on what can be achieved using the likelihood/Fisherian methods of taking into account uncertainty when studying a statistical problem. It takes the concept of the likelihood as the best method for unifying the demands of statistical modeling and theory of inference. Every likelihood concept is illustrated with realistic examples ranging from a simple comparison of two accident rates to complex studies that require generalized linear or semiparametric modeling. The emphasis is on likelihood not as just a device used to produce an estimate, but as an important tool for modeling.

Emprical Likelihood and Constrained Statistical Inference for Some Moment Inequality Models

Emprical Likelihood and Constrained Statistical Inference for Some Moment Inequality Models
Author: Rami Tabri
Publisher:
Total Pages:
Release: 2013
Genre:
ISBN:

Download Emprical Likelihood and Constrained Statistical Inference for Some Moment Inequality Models Book in PDF, Epub and Kindle

"The principal purpose of this thesis is to extend empirical likelihood (EL) based procedures to some statistical models defined by unconditional moment inequalities. We develop EL procedures for two such models in the thesis. In the first type of model, the underlying probability distribution is the (infinite-dimensional) parameter of interest, and is defined by a continuum of moment inequalities indexed by a general class of estimating functions. We develop the EL estimation theory using a feasible-value-function approach, and demonstrate the uniform consistency of the estimator over the set of underlying distributions in the model. Furthermore, for large sample sizes, we prove that it has smaller mean integrated squared error than the estimator that ignores the information in the moment inequality conditions. We also develop computational algorithms for this estimator, and demonstrate its properties in Monte Carlo simulation experiments for the case of infinite-order stochastic dominance. The second type of moment inequality model concerns stochastic dominance (SD) orderings between two income distributions. We develop asymptotic and bootstrap empirical likelihood-ratio tests for the null hypothesis that a given unidirectional strong SD ordering between the income distributions holds. These distributions are discrete with finite support, and, therefore, the SD conditions are framed as sets of linear inequality constraints on the vector of SD curve ordinates. Testing for strong SD requires that we consider as the null model one that allows at most one pair of these ordinates to be equal at an interior point of their support. Finally, we study the performance of these tests in Monte Carlo simulations." --

Introduction to Empirical Processes and Semiparametric Inference

Introduction to Empirical Processes and Semiparametric Inference
Author: Michael R. Kosorok
Publisher: Springer Science & Business Media
Total Pages: 482
Release: 2007-12-29
Genre: Mathematics
ISBN: 0387749780

Download Introduction to Empirical Processes and Semiparametric Inference Book in PDF, Epub and Kindle

Kosorok’s brilliant text provides a self-contained introduction to empirical processes and semiparametric inference. These powerful research techniques are surprisingly useful for developing methods of statistical inference for complex models and in understanding the properties of such methods. This is an authoritative text that covers all the bases, and also a friendly and gradual introduction to the area. The book can be used as research reference and textbook.