Resampling-Based Multiple Testing

Resampling-Based Multiple Testing
Author: Peter H. Westfall
Publisher: John Wiley & Sons
Total Pages: 382
Release: 1993-01-12
Genre: Mathematics
ISBN: 9780471557616

Download Resampling-Based Multiple Testing Book in PDF, Epub and Kindle

Combines recent developments in resampling technology (including the bootstrap) with new methods for multiple testing that are easy to use, convenient to report and widely applicable. Software from SAS Institute is available to execute many of the methods and programming is straightforward for other applications. Explains how to summarize results using adjusted p-values which do not necessitate cumbersome table look-ups. Demonstrates how to incorporate logical constraints among hypotheses, further improving power.

Resampling-based Multiple Testing with Applications to Microarray Data Analysis

Resampling-based Multiple Testing with Applications to Microarray Data Analysis
Author: Dongmei Li
Publisher:
Total Pages: 120
Release: 2009
Genre: DNA microarrays
ISBN:

Download Resampling-based Multiple Testing with Applications to Microarray Data Analysis Book in PDF, Epub and Kindle

Abstract: In microarray data analysis, resampling methods are widely used to discover significantly differentially expressed genes under different biological conditions when the distributions of test statistics are unknown. When sample size is small, however, simultaneous testing of thousands, or even millions, of null hypotheses in microarray data analysis brings challenges to the multiple hypothesis testing field. We study small sample behavior of three commonly used resampling methods, including permutation tests, post-pivot resampling methods, and pre-pivot resampling methods in multiple hypothesis testing. We show the model-based pre-pivot resampling methods have the largest maximum number of unique resampled test statistic values, which tend to produce more reliable P-values than the other two resampling methods. To avoid problems with the application of the three resampling methods in practice, we propose new conditions, based on the Partitioning Principle, to control the multiple testing error rates in fixed-effects general linear models. Meanwhile, from both theoretical results and simulation studies, we show the discrepancies between the true expected values of order statistics and the expected values of order statistics estimated by permutation in the Significant Analysis of Microarrays (SAM) procedure. Moreover, we show the conditions for SAM to control the expected number of false rejections in the permutation-based SAM procedure. We also propose a more powerful adaptive two-step procedure to control the expected number of false rejections with larger critical values than the Bonferroni procedure.

Permutation Tests

Permutation Tests
Author: Phillip Good
Publisher: Springer Science & Business Media
Total Pages: 288
Release: 2013-04-17
Genre: Mathematics
ISBN: 147573235X

Download Permutation Tests Book in PDF, Epub and Kindle

A step-by-step manual on the application of permutation tests in biology, business, medicine, science, and engineering. Its intuitive and informal style make it ideal for students and researchers, whether experienced or coming to these resampling methods for the first time. The real-world problems of missing and censored data, multiple comparisons, nonresponders, after-the-fact covariates, and outliers are all dealt with at length. This new edition has more than 100 additional pages, and includes streamlined statistics for the k-sample comparison and analysis of variance plus expanded sections on computational techniques, multiple comparisons, multiple regression, comparing variances, and testing interactions in balanced designs. The comprehensive author and subject indexes, plus an expert-system guide to methods, provide for further ease of use, while the exercises at the end of every chapter have been supplemented with drills and a number of graduate-level thesis problems.

Modelling and Resampling Based Multiple Testing with Applications to Genetics

Modelling and Resampling Based Multiple Testing with Applications to Genetics
Author: Yifan Huang
Publisher:
Total Pages:
Release: 2005
Genre: Bootstrap (Statistics)
ISBN:

Download Modelling and Resampling Based Multiple Testing with Applications to Genetics Book in PDF, Epub and Kindle

Abstract: Multiple hypotheses testing is a common problem in practice. For instance, in microarray experiments, whether the goal is to select maintenance genes for normalization or to identify differentially expressed genes between samples, multiple genes are under consideration. Multiplicity inflates the type I error rate of the hypothesis testing, so we need to adjust the testing procedure to control the overly error rate. My research focuses on the strong control of Familywise Error Rate (FWER). There are mainly two different types of approaches to multiple testing. One is modelling based approach and the other non-modelling based. Modelling based approaches fit models to the data so that the joint distribution of the test statistics is tractable. Non-modelling based approaches consist of inequality based methods and resampling based methods. They require less or no information about the joint distribution of the test statistics. I have shown in Chapter 1 that frequently used Hochberg's step-up method is a special case of partition testing based on Simes' test. This is a new result. Hochberg's step-up method is an inequity based non-modelling partition testing. Modelling based partition testing is applicable whether the joint distribution of the test statistics is known or not. By applying modelling based partition testing when the joint distribution of test statistics is known, I illustrate that modelling based approaches are often more powerful than inequality based non-modelling approaches. In Chapter 2, I construct counterexamples to the validity of permutation test, demonstrating that the resampling based methods are often invalid. My results suggest recommendation of modelling based approaches. When the joint distribution of the test statistics is untractable, modelling followed by bootstrap can be applied. I use modelling followed by bootstrap in Chapter 3 to select maintenance genes for normalizing the gene expression data.

Multiple Testing Procedures with Applications to Genomics

Multiple Testing Procedures with Applications to Genomics
Author: Sandrine Dudoit
Publisher: Springer Science & Business Media
Total Pages: 611
Release: 2007-12-18
Genre: Science
ISBN: 0387493174

Download Multiple Testing Procedures with Applications to Genomics Book in PDF, Epub and Kindle

This book establishes the theoretical foundations of a general methodology for multiple hypothesis testing and discusses its software implementation in R and SAS. These are applied to a range of problems in biomedical and genomic research, including identification of differentially expressed and co-expressed genes in high-throughput gene expression experiments; tests of association between gene expression measures and biological annotation metadata; sequence analysis; and genetic mapping of complex traits using single nucleotide polymorphisms. The procedures are based on a test statistics joint null distribution and provide Type I error control in testing problems involving general data generating distributions, null hypotheses, and test statistics.

Multiple Testing Problems in Pharmaceutical Statistics

Multiple Testing Problems in Pharmaceutical Statistics
Author: Alex Dmitrienko
Publisher: CRC Press
Total Pages: 323
Release: 2009-12-08
Genre: Mathematics
ISBN: 1584889853

Download Multiple Testing Problems in Pharmaceutical Statistics Book in PDF, Epub and Kindle

Useful Statistical Approaches for Addressing Multiplicity IssuesIncludes practical examples from recent trials Bringing together leading statisticians, scientists, and clinicians from the pharmaceutical industry, academia, and regulatory agencies, Multiple Testing Problems in Pharmaceutical Statistics explores the rapidly growing area of multiple c

Multiple Hypothesis Testing

Multiple Hypothesis Testing
Author: Houston Nash Gilbert
Publisher:
Total Pages: 372
Release: 2009
Genre:
ISBN:

Download Multiple Hypothesis Testing Book in PDF, Epub and Kindle

Multiple Comparisons Using R

Multiple Comparisons Using R
Author: Frank Bretz
Publisher: CRC Press
Total Pages: 202
Release: 2016-04-19
Genre: Mathematics
ISBN: 1420010905

Download Multiple Comparisons Using R Book in PDF, Epub and Kindle

Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at http://CRAN.R-project.org After giving examples of multiplicity problems, the book covers general concepts and basic multiple comparisons procedures, including the Bonferroni method and Simes’ test. It then shows how to perform parametric multiple comparisons in standard linear models and general parametric models. It also introduces the multcomp package in R, which offers a convenient interface to perform multiple comparisons in a general context. Following this theoretical framework, the book explores applications involving the Dunnett test, Tukey’s all pairwise comparisons, and general multiple contrast tests for standard regression models, mixed-effects models, and parametric survival models. The last chapter reviews other multiple comparison procedures, such as resampling-based procedures, methods for group sequential or adaptive designs, and the combination of multiple comparison procedures with modeling techniques. Controlling multiplicity in experiments ensures better decision making and safeguards against false claims. A self-contained introduction to multiple comparison procedures, this book offers strategies for constructing the procedures and illustrates the framework for multiple hypotheses testing in general parametric models. It is suitable for readers with R experience but limited knowledge of multiple comparison procedures and vice versa. See Dr. Bretz discuss the book.

Multiple Testing Procedures with Applications to Genomics

Multiple Testing Procedures with Applications to Genomics
Author: Sandrine Dudoit
Publisher: Springer
Total Pages: 0
Release: 2008-11-01
Genre: Science
ISBN: 9780387517094

Download Multiple Testing Procedures with Applications to Genomics Book in PDF, Epub and Kindle

This book establishes the theoretical foundations of a general methodology for multiple hypothesis testing and discusses its software implementation in R and SAS. These are applied to a range of problems in biomedical and genomic research, including identification of differentially expressed and co-expressed genes in high-throughput gene expression experiments; tests of association between gene expression measures and biological annotation metadata; sequence analysis; and genetic mapping of complex traits using single nucleotide polymorphisms. The procedures are based on a test statistics joint null distribution and provide Type I error control in testing problems involving general data generating distributions, null hypotheses, and test statistics.