Vol. 10. Num. 1. - 2018. Pages 35-47

Jesús F. Salgado

University of Santiago de Compostela, Spain

**Abstract**

The importance of the area under the normal curve (AUC) as a measure of the effect size (ES) in applied and forensic research has been highlighted in several articles and Tables for functioning the AUC curve into Pearson’s *r _{pb} *and Cohen’s d have been published. No Tables have been published for functioning AUC into other frequently used effect size indexes, such as OR and Ln(

**Resumen**

La importancia del área bajo la curva normal (ACN) como medida del tamaño del efecto (TE) en la investigación aplicada y forense ha sido resaltada en varios artículos y han sido publicadas tablas para ir el ACN en el coeficiente *r _{bp}* de Pearson y la

**Keywords**

Area under the normal curve, ROC, effect size, rpb, d, Ln(OR), Odd-ratio

**Palabras clave**

Área bajo la curva normal, ROC, tamaño del efecto, rpb, d, Ln(OR), Odd-ratio

jesus.salgado@usc.es (J. F. Salgado)

Introduction
Many research domains of life, social, and experimental sciences report their findings in terms of an effect size (ES) estimate. Nevertheless, there is not a single agreed definition of ES. In this regard, Kelley and Preacher (2012) revised several definitions of ES and provided a useful and comprehensive definition. According to Kelley and Preacher (2012, p. 140), ES is defined as “a quantitative reflection of the magnitude of some phenomenon that is used for the purpose of addressing a question of interest.” In this definition, an effect is a quantitative reflection of a phenomenon, and size is the magnitude of something. The use of an ES was recommended by the American Psychological Association (APA) Task Force on Statistical Inference (Wilkinson, 1999). The Task Force (Wilkinson, 1999, p. 599) stressed that “reporting and interpreting effect sizes in the context of previously reported effects is essential to good research. It enables readers to evaluate the stability of results across samples, designs, and analyses.” Currently, this practice is also required by some editors and journals. The number of ES measures is large, and the use of one or other coefficient depends, in part, on the traditions of a particular science or research area. The three most relevant factors for selecting a specific ES are: (a) the research question and the goals of the study; (b) the design type (e.g., experimental, correlational, cross-sectional, longitudinal, and so on), and (c) the nature of the variables and how they are measured (e.g., continuous, categorical, true dichotomous, dichotomized, and so on). The most common ES estimates are the correlation coefficient (e.g., Pearson’s r), Cohen’s d, and z. Nevertheless, many other ES indexes are available to researchers. For example, ratios, odds-ratio (OR), natural log odds-ratio - ln(OR) -, relative operating characteristic (ROC) curves, among others, are used for reporting findings (see Borenstein, Hedges, Higgings, & Rothstein, 2009; Card, 2012; Cohen, 1977; Cooper, Hedges, & Valentine, 2009; Hedges & Olkin, 1985; Kelley & Preacher, 2012; Sánchez-Meca, Marín-Martínez, & Chacón- Moscoso, 2003; for a large variety of ES indexes). In the last thirty years, the importance of calculating and reporting ESs has increased as they are the basis for cumulative quantitative research and meta-analysis. For example, the family of Pearson correlation coefficients is widely used in validity studies in work and organizational (W/O) psychology (e.g., Lado & Alonso, 2017; Rodríguez, 2016) and in psychometric meta-analytic methods and validity generalization studies (Salgado, 2017; Salgado, Moscoso, & Anderson, 2016; Schmidt & Hunter, 2015). Cohen’s d is the most common ES in experimental studies, for estimating the utility of clinical interventions (e.g., the effects of psychotherapy), in the Glassian meta-analytic method (Glass, 1976; Glass, McGraw, & Smith, 1981), and in the study of gender differences (e.g., Alonso & Moscoso, 2017; Alonso, Moscoso, & Salgado, 2017). Fisher’s Z transformation of correlation coefficients is used extensively in the study of attitudes and is the basis of the correlational meta-analysis method developed by Hedges and Olkin (1985). For its part, the area under the curve (AUC) is a relatively frequently used estimate of the effect size of the decisions taken under risk and uncertainty, in vigilance studies, forensic studies, law and human behavior studies, and, also, it is the basis for the estimates of the ROC curve when a normal distribution is assumed (Balaswany & Vardhan, 2015; Hasselblad & Hedges, 1995; Krzanowski & Hand, 2009; Marzban, 2004; Rice & Harris, 1995; Swets, 1973). Nevertheless, even within these research areas and domains, despite the fact that a specific ES index is more frequently employed, empirical studies use a variety of them for reporting their findings. Due to this, over the years, some formulas have been developed for the conversion of one ES coefficient into others. For example, there are formulas for converting r into d, and r into z, and vice versa (see, for example, Rosenthal, 1991, for a large number of formulas). There are also a large number of mathematical functions for converting AUC into z, and vice versa (e.g., Brophy, 1983; 1985; Bryc, 2002; Choudhury, 2014; Emerson, 1979; Hart, 1957; 1966; Polya, 1945; Zelen & Severo, 1964). Consequently, it is also technically possible to transform, for instance, the AUC into Cohen’s d through several, successive intermediate conversions. These transformations are very useful and necessary from a practical point of view, as for both researchers and practitioners it is very convenient to have the possibility of unifying findings in a common metric unit. The transformations are also useful for meta-analysis, as these methods require the estimation of all the ESs using the same coefficient. A problem with some empirical studies is that they do not inform about the ES and report the results in terms of alternative statistical coefficients, such as F, t, Therefore, converting one ES into another is technically possible and several transformation formulas are available to the researchers. However, many of these transformations require a number of intermediate conversions that increase the computational work of the researchers, together with the additional complication that many of the conversions are not available by default in the most popular statistical packages (e.g., SPSS, SAS). Furthermore, some of these intermediate transformations consist of large series of potencies. This difficulty has the side-effect that in meta-analytic studies some researchers exclude some primary studies from the final database because they cannot transform the original statistical coefficient into the effect size used in the meta-analytic method (typically, r and d in psychology, for instance). The objective of this paper is to provide researchers and practitioners with tables for converting AUC-values into Cohen’s d, r ROC Area and Effect Sizes In a pioneering effort, Rice and Harris (2005) posited the necessity of converting research results (e.g., F, and A ROC curve describes the functional relationships between the proportion of times that an alternative (say, h) is chosen when it occurs and the proportion of times that this alternative is chosen when another alternative (say, f) occurs. In signal-detection theory (SDT) terminology, h is termed hit rate (or success proportion, or true-positive proportion), and f is termed false-alarm rate (or failure proportion or false-positive proportion). The two most popular indices of discrimination are d and A In the proposal of the index, Tanner and Swets (1954) defined d as the z score corresponding to f minus the z score corresponding to h, and it was termed index of detectability (Swets, 1986a). According to SDT, d is equal to the difference between the means of h and f distributions, expressed in standard deviation units of the f distribution (or equivalently for the standard deviation of the h distribution; see (Gescheider, 1976; Swets, 1986a). Therefore:
This equation shows the difference between the means of the two probability density functions (PDF) in terms of the standard deviation of the PDF for f (or, equivalently, for h). The d index assumes equal-variance normal distributions. However, as there are cases in which the assumption of equal variances is not held, an index termed Δm was proposed which is consistent with unequal-variance, normal distributions (Green & Swets, 1974; Gescheider, 1976; Swets, 1986a). The definition of Δm is similar to d, therefore,
It is obvious that if
Therefore, Glass’ Δ and Δm are analogous. In addition, Glass’ Δ can be considered a special case of Cohen’s d, because if the standard deviation of the control group ( The second SDT index, A
and, therefore, if the two variances are unequal
These last two equations are particularly relevant because, due the equivalence among d´, Δm, Glass’ Δ, and Cohen’s d shown above, they provide a way to transform the AUC into a Cohen’s d. In addition, as Hedges and Olkin (1985) suggested, the assumption of equal population variances is reasonable in many cases in life and social sciences. A point that must be mentioned is that, in some cases, the observed A In order to facilitate comparisons across follow-up studies that report different ES indexes, Rice and Harris (2005) developed a table of the equivalences among AUC and d, and r To create the Table, Rice and Harris used three types of information. First, they converted the AUC values into z-scores (or normal deviate of AUC), using the Tables of Pearson and Hartley (1954). Second, they used the formula to transform the z-value into a Cohen’s d value as mentioned above:
Next, to transform the Cohen’s d value into the equivalent r
On this point, it is important to take into account that the conversion of d to a correlation is always r Consequently, the d values under the first research design (i.e., true experiment, true binary variable) and the second one (i.e., artificial dichotomization of a continuous variable) provide different information and different estimates of the ES. For example, a Pearson’s r of .50 equals an r When a continuous variable is dichotomized, r Aims of This Study Two new extended Tables have been created using a process of six steps. In each step, a new transformation of the AUC is made and a different ES estimate is given. In addition to z, the new Tables provide the estimates of AUC as Cohen’s d for dichotomous variables, r The process of construction of Table 1 was as follows. The first step was the conversion of an AUC-value into a z coefficient. This conversion can be made using the following equation provided by Zelen and Severo (1964, p. 933):
Where
Or it can be made using one of the functions listed by Yerukala and Boiroju (2015), all of which produce practically identical values until the third decimal. The second step was to convert the z-value into a Cohen’s d, using the formula given by Swets (1986a):
The third step involved the conversion of a Cohen’s d into an r
Where K = 1/p*q. Therefore, K values for p = 5, .3, .2, and .1 are, 4, 4.76, 6.25, and 11.11, respectively. The K values clearly illustrate the decline of the r Table 2 provides the d-values converted to OR and Ln(OR). The construction of Table 2 followed the same first two steps used for Table 1. The third step for Table 2 was to use the next two equations, provided by Borenstein et al. (2009), Card (2012), Hasselblad and Hedges (1995), and Sánchez-Meca et al. (2003) for obtaining the respective values of Ln(OR) and OR. These formulas are:
and
In summary, Table 1 provides the values for the conversion from AUC to z, d-Cohen, and r
Table 1
Table 2
Conclusion
Reporting ESs is a more and more common practice in research and Pearson’s r and Cohen’s d are two of the most frequently used indices of ES. However, a large variety of ES indices are used. Some of them are particularly used in specific research domains. The AUC is one of the most typically reported in forensic psychology research and in diagnostic and clinical research (e.g., radiology). Odds-ratio (OR) and its varieties - e.g., Ln(OR), risk ratio - are also commonly found in articles reporting research findings. To encourage applied and forensic psychology researchers to report an ES and also the conversion of a variety of ES indices to a common metric, this article tabulated the conversion from AUC into Cohen’s d, OR, Ln(OR), and r Researchers should be aware of when it is correct and appropriate to transform a specific ES into another one and when the transformation is not appropriate, even when the formulas can be used in both cases. For example, d’ should not be transformed into OR when a within-group design is used, as OR requires a design with two independent samples. With regard to Cohen’s d transformation into a correlation coefficient, the nature (true binary vs. dichotomized) of the independent variable dictates what type of correlation coefficient should be obtained (see pages 10-11). Therefore, we recommend the researchers make a reasonable use of the transformation formulas. In summary, this article presents two new Tables for obtaining four types of ESs from AUC-values and, simultaneously, converting an ES index in several others. In addition, researchers and practitioners can calculate by themselves the ES of interest with the formulas included here for the values not given in the Tables. References |

jesus.salgado@usc.es (J. F. Salgado)

Copyright © 2019. Colegio Oficial de Psicólogos de Madrid

© Copyright 2019. Colegio Oficial de Psicólogos de Madrid
Privacy PolicyCookies Policy