In Pericchi and Pereira [1] it is argued against the traditional way on which testing is based on fixed significance level, either using p-values (with fixed levels of evidence, like the 5% rule) or α values. We instead, follow an approach put forward by [2], on which an optimal test is chosen by minimizing type I and type II errors. Morris DeGroot in his authoritative book [2], Probability and Statistics 2nd Edition, stated that it is more reasonable to minimize a weighted sum of Type I and Type II error than to specify a value of type I error and then minimize Type II error. He showed it beyond reasonable doubt, but only in the very restrictive scenario of simple VS simple hypothesis, and it is not clear how to generalize it. We propose here a very natural generalization for composite hypothesis, by using general weight functions in the parameter space. This was also the position taken by [3, 4, 5]. We show, in a parallel manner to DeGroot's proof and Pereira's discussion, that the optimal test statistics are Bayes Factors, when the weighting functions are priors with mass on the whole parameter space. On the other hand when the weight functions are point masses in specific parameter values of practical significance, then a procedure is designed for which the sum of Type I error and Type II error in the specified points of practical significance is minimized. This can be seen as bridge between Bayesian Statistics and a new version of Hypothesis testing, more in line with statistical consistency and scientific insight.
Skip Nav Destination
Article navigation
18 October 2012
XI BRAZILIAN MEETING ON BAYESIAN STATISTICS: EBEB 2012
18–22 March 2012
Amparo‐SP, Brazil
Research Article|
October 18 2012
Towards a general theory of optimal testing
Luis R. G. Pericchi;
Luis R. G. Pericchi
Department of Mathematics and Center for Biostatistics and Bioinformatics, University of Puerto Rico, Rio Piedras, San Juan, PR,
Puerto Rico
Search for other works by this author on:
Carlos A. B. Pereira
Carlos A. B. Pereira
Instituto de Matemática e Estatística, Univ. Sao Paulo,
Brazil
Search for other works by this author on:
AIP Conf. Proc. 1490, 31–35 (2012)
Citation
Luis R. G. Pericchi, Carlos A. B. Pereira; Towards a general theory of optimal testing. AIP Conf. Proc. 18 October 2012; 1490 (1): 31–35. https://doi.org/10.1063/1.4759586
Download citation file:
Pay-Per-View Access
$40.00
Sign In
You could not be signed in. Please check your credentials and make sure you have an active account and try again.
5
Views
Citing articles via
Inkjet- and flextrail-printing of silicon polymer-based inks for local passivating contacts
Zohreh Kiaee, Andreas Lösel, et al.
Design of a 100 MW solar power plant on wetland in Bangladesh
Apu Kowsar, Sumon Chandra Debnath, et al.
Effect of coupling agent type on the self-cleaning and anti-reflective behaviour of advance nanocoating for PV panels application
Taha Tareq Mohammed, Hadia Kadhim Judran, et al.
Related Content
Decompositions of information divergences: Recent development, open problems and applications
AIP Conference Proceedings (November 2012)
Bayesian estimation of 3-component mixture geometric distribution under different loss functions
AIP Advances (January 2024)
Temperature-based model for monthly average hourly global solar radiation for the Caribbean island of Trinidad
J. Renewable Sustainable Energy (May 2018)
Towards an automatic and early detection of Parkinson’s disease: Modeling of a polar coordinates system based on spiral tests
AIP Conf. Proc. (February 2019)
Full Bayesian significance test for a class of jump‐diffusion models
AIP Conference Proceedings (November 2008)