Manuel Martín-Fernández, Enrique Gracia, Miriam Marco, Viviana Vargas, Faraj A. Santirso, Marisol Lila
University of Valencia, SpainReceived 9 de August de 2017, Accepted 9 de October de 2017
Intimate partner violence against women (IPVAW) is a major social and public health problem of global proportions. Public attitudes toward IPVAW shape the social environment in which such violence takes place, and attitudes of acceptability of IPVAW are considered a risk factor to actual IPVAW. The aim of this study was to develop and validate a scale measuring acceptability of IPVAW (A-IPVAW). To this end, a sample of 1,800 respondents was recruited via social media. A second sample of 50 IPVAW offenders was used for concurrent validity analyses. Following a cross-validation approach and using item response theory analyses, we found that the latent structure of the scale was one-dimensional and very informative for high and very high levels of acceptability of IPVAW. Regarding criterion-related validity, we found that (a) our measure was related to perceived severity of IPVAW and ambivalent sexism, (b) men showed higher levels of acceptability than women, and (c) IPVAW offenders reported higher levels of acceptability than men from the general population. Taken together, our results provide evidence that the A-IPVAW is a reliable and valid instrument to assess acceptability of IPVAW.
La violencia de pareja contra la mujer (VPM) es un grave problema social y de salud pública con repercusión mundial. Las actitudes públicas hacia la VPM contribuyen al contexto social en el que esta violencia tiene lugar, y las actitudes de aceptabilidad de la VPM son un factor de riesgo en la comisión de este tipo de violencia. El objetivo de este estudio fue el desarrollo y validación de una escala de medida de la aceptabilidad de la VPM (A-IPVAW, Acceptability of Intimate Partner Violence against Women scale). Con este fin, se obtuvo una muestra de 1800 participantes reclutados a través de las redes sociales. Se utilizó una segunda muestra de 50 hombres agresores de VPM para los análisis de validez concurrente. Mediante una validación cruzada (cross-validation) y utilizando análisis basados en la Teoría de Respuesta al Ítem, se estableció que la estructura latente de la escala era unidimensional y muy informativa para los niveles altos y muy altos de aceptabilidad de la VPM. Con respecto a la validez de criterio se encontró que (a) esta medida se relacionaba con la gravedad percibida de la VPM y el sexismo ambivalente, (b) los hombres mostraban niveles más altos de aceptabilidad que las mujeres y (c) los hombres agresores de VPM mostraban niveles más altos de aceptabilidad que los hombres de la muestra general. En conjunto, estos resultados muestran que la A-IPVAW es un instrumento fiable y válido para evaluar la aceptabilidad de la VPM.
Acceptability, Attitudes, intimate partner violence, Item Response Theory, measurement, violence against women
Aceptabilidad, actitudes, violencia de pareja, Teoría de Respuesta al Ítem, medida, violencia contra la mujer
Intimate partner violence against women (IPVAW) is a major social and public health problem of global proportions (Ali & Naylor, 2013; García-Moreno, Jansen, Ellsberg, Heise, & Watts, 2006; World Health Organization [WHO] , 2013). IPVAW is one of the most frequent forms of violence suffered by women (Devries et al., 2013; Stockl et al., 2013), with important consequences for their physical, social and psychological well-being (Campbell, 2002; Craparo, Gori, Petruccelli, Cannella, & Simonelli, 2014; Ellsberg, Jansen, Heise, Watts, & Garcia-Moreno, 2008; Wong, Tiwari, Fong, & Bullock, 2016).
IPVAW is a complex phenomenon, deeply rooted in the socio-cultural context and in this regard it needs to be understood within the social and cultural norms that permeate it (Gracia, 2014b). Public attitudes and responses regarding violence against women reflect these norms and are key to better understanding its root causes and, therefore, developing more effective intervention measures (Gracia & Lila, 2015; Gracia & Merlo, 2016). Public attitudes toward IPVAW can shape the social environment in which such violence takes place, contributing to either foster or discourage IPVAW in societies (Browning, 2002; Campbell & Manganello, 2006; Frye, 2007; Gracia, 2014a). These attitudes have been related to incidence and reporting rates, public and professional responses, and the victims’ own responses (Carlson & Worden, 2005; Frye, 2007; Gracia, Garcia, & Lila, 2008, 2011, 2014; Gracia & Herrero, 2006b).
Attitudes of acceptability of IPVAW have been linked to the perpetration of this type of violence (Copp, Giordano, Longmore, & Manning, 2016; Gracia, Rodríguez, & Lila, 2015; Sugarman & Frankel, 1996). High levels of acceptability of IPVAW can lead to the perception of this type of behavior as normative, increasing the risk of men perpetrating IPVAW and of this type of violence being justified by victims and their social circles (Waltermaurer, 2012). In this regard, attitudes of acceptability of IPVAW have been considered as a risk factor of actual IPVAW (Archer & Graham-Kevan, 2003; Capaldi, Knoble, Shortt, & Kim, 2012; Flood & Please, 2009; Lila, Gracia, & Murgui, 2013; Stith, Smith, Penn, Ward, & Tritt, 2004; WHO, 2002). Attitudes toward IPVAW are hence one of the main targets for intervention and prevention strategies (García-Moreno et al., 2015; Gracia & Lila, 2015; Jewkes, Flood, & Lang, 2015; Lila, Gracia, & Herrero, 2012).
The availability of reliable and valid measures of the acceptability of IPVAW is important for research and intervention purposes, as they can provide knowledge on the social conditions that contribute to IPVAW (Gracia & Lila, 2015; Muehlenhard & Kimes, 1999). Some studies have used attitudinal scales to measure the acceptability of IPVAW among young people (Copp et al., 2016; Fincham, Cui, Braithwaite, & Pasley, 2008) and rural populations (Schwab-Reese & Renner, 2017). Among the general population, several demographic health surveys have included some brief scales and individual items measuring acceptability of certain IPVAW behaviors (Yount, Halim, Hynes, & Hillman, 2011; Wang, 2016; WHO 2013). However, most of these demographic surveys were designed for sub-Saharan countries and have yielded different results when minor changes are made to the wording of the items (Tsai et al., 2017). In this line, in their review of attitudes toward IPVAW in the European Union, Gracia and Lila (2015) found that the available information from European surveys was not only scarce (mostly based on single items), but neither was it supported by reliable and valid instruments. There is still a need for a reliable, valid, and concise measure of the acceptability of IPVAW suitable for this kind of surveys.
The Present Study
The aim of the current study is to address this gap in the literature and develop and validate a scale measuring acceptability of IPVAW. Drawing from the exhaustive pool of items identified in a review of European Union surveys (Gracia & Lila, 2015), we develop a measure to assess acceptability of IPVAW, including items tapping the acceptability of physical, verbal, and emotional violence (Capezza & Arriaga, 2008). We sought to cross-validate this scale following up-to-date guidelines for factor analyses (Schmitt, 2011), and fitting an item response theory (IRT) model. Although IRT models were originally developed for aptitude evaluation, in the last decades they have been increasingly utilized for personality, behavioral, and attitudinal measures. IRT models allow researchers to improve the development of their psychological instruments by assessing the quality and suitability of individual items. Given these advantages, in this study we sought to provide a unified and valid measure of the acceptability of IPVAW from an IRT framework.
For validity purposes, we will explore the relationships between our measure of acceptability and other related constructs, such as perceived severity of IPVAW and sexist attitudes, and gender and age differences. Perceived severity of IPVAW has been negatively related to acceptability of IPVAW (Gracia & Herrero, 2006a; Taylor & Sorenson, 2005). Sexist attitudes have been found to be closely related to attitudes toward IPVAW (Flood & Pease, 2009; Herrero, Rodríguez, & Torres, 2017; Lila, Gracia, & García, 2013). On the other hand, gender is one of the more consistent predictors of attitudes toward IPVAW, with research showing greater justification and acceptability of IPVAW among men; and regarding age, research suggests that attitudes supporting the use of IPVAW tend to be more prevalent among older people (Carlson & Worden, 2005; Fincham et al., 2008; Gracia et al., 2015; Gracia & Tomás, 2014). Finally, for concurrent validity we will use a sample of male offenders court-ordered to an intervention program for IPVAW batterers, as this population is expected to have higher rates of acceptability of IPVAW (Gracia et al., 2015; Ruiz-Hernández, García-Jiménez, Llor-Esteban, & Godoy-Fernández, 2015).Method
Online sampling recruitment was used for the current study. Data were collected through social media and e-mail snowballing. These methods have proven to be effective and cost-efficient in previous studies (for systematic reviews see Thornton et al., 2016; Topolovec-Vranic & Natarajan, 2016). A total pool of 2,698 responses was collected, most of which were from women (67.6% of the respondents). Although previous studies have found a similar proportion of participation in social media by gender (Thornton et al., 2016), we opted to use a representative sample balanced by gender. To do so, we selected a random sample that maintained a similar proportion of male and female participants.
The final sample consisted of 1800 Spanish-speaking respondents residing in Spain (52.8% females), aged from 18 to 82 years old (Mage = 34.55, SDage = 14.54). Following a cross-validation approach this sample was divided in two subsamples, each of 900 participants, with similar ratios of sex, age, nationality, and educational level categories. Socio-demographic characteristics of the sample are shown in Table 1.
A second sample of 50 male offenders court-ordered to an intervention program for IPVAW was selected for validity purposes. These offenders had a suspended sentence conditioned to their attending an intervention program. This sample had a mean age of 39.84, ranging from 21 to 69 years old. Most of these participants had completed compulsory secondary education (86%).
Acceptability of IPVAW scale (A-IPVAW). A pool of 102 items tapping acceptability of IPVAW was drawn from a recent review of European surveys on violence against women (Gracia & Lila, 2015). The items drawn from the pool were translated to English from their original language by European experts on the field of IPVAW who provided the survey data for the review. For this study, a panel of six experts on IPVAW rated the relevance of each item on a 5-point Likert-type scale (i.e., “Is this item relevant to measure attitudes of acceptability of IPVAW?”; 1 = strongly disagree, 5 = strongly agree). Those items rated with a 4 (i.e., the agree category) or more by the six experts were selected to compose a twenty-item measure of acceptability of IPVAW. The items were translated to Spanish by the same authors of the review of the European surveys. Respondents had to rate how acceptable were a range of men’s behaviors against their female partners on a 3-point Likert-type scale (0 = not acceptable, 1 = somewhat acceptable, 2 = acceptable). A fourth category, very acceptable, was merged with the acceptable category since it was selected by almost no respondents in both the general and offender samples. In particular, the frequencies of the upper category in both samples were quite similar. The items reflected physical violence (e.g., it is acceptable for a man “to hit his partner if she has been unfaithful”), coercion or verbal violence (e.g., it is acceptable for a man “to threaten his partner with hurting her or others if she leaves him”), and emotional violence such as controlling behaviors (e.g., it is acceptable for a man “to set limits on how his partner dresses”). The full A-IPVAW scale is provided in the Appendix A.
Perceived severity of IPVAW (PS-IPVAW; Gracia, García, & Lila, 2008, 2009, 2011). This instrument presents eight IPVAW situations (e.g., “During an argument, a man hits his partner and afterwards he asks for her forgiveness”) to which respondents had to rate the severity of each situation (ranging from 1, not severe at all, to 10, extremely severe). This instrument was validated in the general Spanish population, and with police officers and intimate partner violence offenders, showing acceptable psychometric properties, and has been related to IPVAW victim blaming attitudes, personal responsibility, sexism, and empathy (Gracia et al., 2009; Gracia & Tomás, 2014; Lila et al., 2013; Vargas, Lila, & Catalá-Miñana, 2015). The scale showed a good internal consistency in the recruited general sample (Cronbach’s α = .89).
Ambivalent Sexism Inventory (ASI; Glick & Fiske, 1996). The Spanish adaptation of the ASI was used (Expósito, Moya, & Glick, 1998). The ASI is comprised of two subscales, hostile and benevolent sexism, each with 11 items. Hostile sexism is related to attitudes of prejudice and discrimination against women based on the assumption of women’s inferiority and their differences from men (e.g., “Women are too easily offended”). Benevolent sexism, on the other hand, is based on men’s need for and reliance on women (e.g., “No matter how accomplished he is, a man is not truly complete as a person unless he has the love of a woman”). This inventory has been validated and adapted to more than twenty countries (Glick et al, 2000; Glick, Sakall, Urgurlu, Ferreira, & Aguilar de Souza, 2002), and has proved to be strongly related to IPVAW responsibility attribution and to attitudes toward intervention in IPVAW cases among police officers (Lila et al., 2013; Lila, Oliver, Catalá-Miñana, Galiana, & Gracia, 2014). Both subscales showed a good internal consistency in the sample of this study (Cronbach’s α = .88 and .89 for hostile and benevolent sexism, respectively).
An online survey was built presenting the A-IPVAW scale, the PS-IPVAW scale, and the ASI inventory. The survey was open for a four-week recruitment period and participation was anonymous. A message offering some information about the study and calling for participation was posted in several social media groups.
To assess the psychometric properties of the A-IPVAW scale, the following analyses were carried out. First, item descriptive statistics and the overall internal consistency of the scale were examined. Second, a cross-validation approach was followed to evaluate the factorial structure of the A-IPVAW scale. The sample was divided into two subsamples, each one of 900 participants. An exploratory factor analysis (EFA) was conducted on the first subsample, and the second subsample was used to replicate the EFA results taking a confirmatory factor analysis (CFA) approach.
To decide the number of factors needed for extraction, a parallel analysis based on minimum rank factor analysis with polychoric correlations (Timmerman & Lorenzo-Seva, 2011) and the minimum average partial (MAP) criterion (Velicer, 1976) was performed on the first subsample. These methods have shown a good performance determining the number of latent dimensions with categorical data (Garrido, Abad, & Ponsoda, 2011, 2016). Bartlett’s sphericity test and the Kaiser-Meyer-Olkin (KMO) statistic were computed to evaluate the suitability of the data for an EFA. Given the categorical nature of the data, the estimation method used was weighted least squares with adjusted means and variances (WLSMV), since it is more robust for ordinal and categorical data (Asparouhov & Muthén, 2010). The polychoric correlation matrix was used to conduct the EFA (Asparouhov & Muthén, 2010Muthén & Kaplan, 1985, Asparouhov & Muthén, 20101992). Model fit was assessed in terms of relative comparative fit, with the CFI and TLI indices. Model residuals were also evaluated with the SRMS and the RMSEA statistics. CFI and TLI values ≥ .95 are indicative of good model fit (Hu & Bentler, 1999), whereas SRMR values ≤ .08, and RMSEA values ≤ .06 are considered good fitting models (MacCallum, Browne, & Sugawara, 1996). Estimated chi-square values and their df were also provided, although this statistic tends to be affected by large sample sizes.
A CFA was then conducted with the second subsample, replicating the model suggested by the EFA. Again, WLSMV was selected as estimation method. Model fit was assessed using the same combination of fit indices and their aforementioned cut-off values (CFI & TLI ≥ .95, RMSEA ≤ .06).
Once the scale dimensionality was assessed, an item response theory (IRT) model was fitted to the whole sample. IRT models have some major advantages over CFA: (a) IRT includes improved factor scores estimates, and (b) does not assume measurement precision to be constant, allowing researchers to identify which factor scores of the latent construct are better assessed by their psychological instruments (Chernyshenko, Stark, Chan, Drasgow, & Williams, 2001). Samejima’s graded response model (1969) was selected given the ordinal nature of the data. Then the model was estimated using the MHRM algorithm (Cai, 2010), and model fit was evaluated with the same cut-off values for the same fit indices (CFI & TLI ≥ .95, RMSEA ≤ .06). To compute these indices, the Maydeu’s M2 statistic for ordinal variables was used instead of other approximations of the chi-square for ordinal variables, since it was specifically developed to assess the overall fit for IRT models (Maydeu-Olivares & Garcia-Forero, 2010; Maydeu-Olivares & Joe, 2006). The test information function was provided and the IRT scores-the person parameters of the model-were used as an acceptability estimate for the subsequent validity analyses.
Finally, the A-IPVAW scale validity was evaluated for the whole sample. First, acceptability estimates (i.e., IRT factor scores) were correlated with the PS-IPVAW scores and with the hostile and benevolent sexism scores from the ASI. Then comparisons were made of the A-IPVAW scale scores between men and women and age groups from the general sample, and between men from the general sample and the sample of male batterers.
Descriptive statistics, classical internal consistency, and IRT analyses were conducted with the statistical package R (R Core Team, 2016). The psych (Revelle, 2016) and the mirt (Chalmers, 2012) libraries were used for this purpose. Bartlett’s sphericity test, the KMO statistic, parallel analysis, and the MAP criterion were computed with the factor package (Lorenzo-Seva & Ferrando, 2006), whereas the EFA and CFA analysis were conducted with Mplus 7.1 (Muthén & Muthén, 2010).Results
Descriptive Statistics and Internal Consistency
The item descriptive analyses and item-total correlations are shown in Table 2. All items presented mean values close to 0, with standard deviations around 0.30. In addition, the skew and kurtosis indices showed that the item distributions were strongly displaced to the left, displaying a leptokurtic distribution. Taken together, the descriptive analyses reveal that respondents tended to choose the not acceptable category for almost all items. Regarding the item-total corrected correlations, all items presented values above .40, indicating that the items were strongly related to the measured construct. The internal consistency of the scale was good (Cronbach’s α = .89).
Exploratory Factor Analysis
An EFA was conducted using the first subsample. Bartlett’s sphericity test was significant (p < .001), indicating that the items were dependent, and the KMO index was acceptable (KMO = .928). Therefore, the correlations of the items and the data matrix were suitable for carrying out a factor analysis. The parallel analysis based on minimum rank factor analysis showed that the first factor accounted for 44.6% of the explained variance, far above the average 19.6% expected for a data matrix of random responses, whereas a hypothetical second factor accounted only for 8.4%, below the average 8.5% expected for a randomly generated data matrix. In addition, the MAP criterion indicated that the differences between the one-factor and the two-factor solutions were negligible; a one-factor solution was therefore considered more suitable. As both tests yielded similar results, only one factor was extracted using WLSMV as the estimation method. The estimated model converged normally and showed a good fit to the data. Although the chi-square test was significant, χ2(170) = 485.74, p < .001, which a priori implies that the model did not fit well the data, the comparative fit indices of the model were above the cut-off values (CFI = .96, TLI = .96), and the model residuals were fair (SRMR = .080, RMSEA = .045). These fit indices indicated that the model fitted well the data.
Confirmatory Factor Analysis
A CFA was conducted with the second subsample. A one-factor model was posited and estimated with the WLSMV method. As displayed in Figure 1, all standardized loadings were greater than .70, with standard estimation errors around .03. Again, the chi-square test was significant, χ2(170) = 502.94, p < .001, and the comparative fit indices of the model were above the cut-off values (CFI = .95, TLI = .95), and with well-fitted residuals (RMSEA = .047), showing an adequate fit to the data. The CFA results replicated the EFA results in a different subsample, yielding the same solution. This one-factor solution was kept as the latent structure of the A-IPVAW scale.
Item Response Theory
Once the dimensionality of the A-IPVAW scale was delimited, the items were calibrated under Samejima’s (1969) graded response model for the full sample.
Item parameter estimates are shown in Table 3. The threshold parameters (b1 and b2) indicate the point on the latent trait continuum (i.e., acceptability of IPVAW) where the probability of endorsement between two adjacent categories is .50 for any respondent with a person parameter θ (i.e., acceptability estimates) equal to the threshold parameter value. Therefore, respondents with acceptability estimates lower than the b1 parameter would be more likely to endorse the lowest category (i.e., not acceptable), whereas those respondents with acceptability estimates higher than the b1 parameter would tend to endorse one of the other two categories. Those respondents would more likely endorse the intermediate category (i.e., somewhat acceptable) if their acceptability estimate was lower than the b2 parameter, and the upper category (i.e., acceptable) if their acceptability estimate was higher than the b2 parameter. In general, the threshold parameters were high, indicating that the test was sampling high (above 1) and very high levels (above 2) of acceptability of IPVAW.
The discrimination parameters (a), in turn, provided information about the precision of each item. In particular, the greater this parameter, the less likely a given respondent will endorse a category above their acceptability estimate. The discrimination parameters of the A-IPVAW scale were very high, with values above 2 for almost all the items.
The information function of the test, as depicted in Figure 2, showed that the A-IPVAW scale was especially informative for respondents with high and very high acceptability estimates. The standard error of estimation (SE) informed about the accuracy of the scale for the different latent trait levels; the lower the SE, the higher the precision of the scale for a given latent trait level. In particular, SE values below 0.5 are equivalent to a a Cronbach’s α of .75 or higher; and SE values below 0.3 are equivalent to a Cronbach’s α of .91 or higher. This means that the test can estimate very accurately the attitudes toward acceptability of those respondents with moderate, high, and very high levels of acceptability of IPVAW, although it cannot discriminate well among respondents with low and very low levels of acceptability.
Overall fit of the model was evaluated with the ordinal version of the M2 statistic. This statistic works similarly to the χ2 statistic in the factor analysis framework. Thus, the same fit indices (CFI, TLI, and RMSEA) could be computed for the IRT analyses using the M2. Using this procedure, the model showed an adequate fit, M2 (150) = 560.87, p < .001; CFI = .99, TLI = .98, and RMSEA = .036.
The IRT scores (i.e., “acceptability estimates”) from the A-IPVAW scale were used for the validity analyses. IRT scores are more appropriate than the raw sum of the items, as some items are more relevant to measure the latent construct than others. IRT scores were on the logistic metric, with an expected mean value of 0 and a standard deviation of 1 (see Chalmers, 2012).
As shown in Table 4, the A-IPVAW scale was positively related with both subscales of the ASI, especially with the hostile sexism subscale, whereas the PS-IPVAW was negatively related with the test. Participants with higher acceptability estimates on the A-IPVAW scale tended to show more agreement with the ASI items and, moreover, tended to perceive the situations posited by the PS-IPVAW as less severe.
When the A-IPVAW scores were compared by gender, significant differences were found between men (M = 0.27, SD = 0.95) and women (M = -0.17, SD = 0.77), t(1637.5) = 10.82, p < .001, d = 0.51, with a moderate effect size. There were also significant differences between men from the general sample and those from the offenders sample (M = 0.98, SD = 1.35), t(51.88) = -3.67, p < .001, d = 0.61, with a moderate effect size. Significant differences were found between age groups, F(2) = 3.49, p = .03, η2 = .004; however the effect size was below the low cut-off value of .01 for the partial eta-squared, and therefore the effect of age on the A-IPVAW scores could be considered negligible (Miles & Shevlin, 2001).Discussion
Attitudes of acceptability of IPVAW are an important risk factor of actual IPVAW (Abramsky et al., 2011; Archer & Graham-Kevan, 2003; Copp et al., 2016; Gracia et al., 2015; WHO, 2002). However, the measurement of these attitudes in surveys in western countries tends to be based on single items and not supported by reliable and valid instruments (Gracia & Lila, 2015). The aim of this study was to develop and validate the A-IPVAW scale, a twenty-item instrument to assess the acceptability of IPVAW among the general population. Taken together, our results provide evidence that the A-IPVAW is a reliable and valid instrument to assess acceptability of IPVAW.
Regarding the latent structure of the scale, although items of different types of IPVAW (i.e., physical, verbal, and emotional) were included, results from the cross-validation analyses suggested that a single factor was sufficient to account for the variability of respondents’ attitudes of acceptability of IPVAW, rather than a multidimensional model considering one factor for each different type of IPVAW addressed by the scale. Adding more dimensions to the model was not necessary, as it would not have improved the model fit to the data and would hinder the interpretation of the scale.
The use of IRT to study the psychometric properties of the scale constitutes a major strength of this paper, since little research has applied this analytical framework to the study and measurement of IPVAW. Some previous research has applied IRT to the study of intimate partner violence, either by fitting an IRT model to an existing scale (e.g., Beck, Menke, & Figueredo, 2013; Jose, Olino, & O’Leary, 2012; Reichenheim, Klein, & Moraes, 2007) or by testing differential item functioning across gender (e.g., Edelen, McCaffrey, Marshall, & Jaycox, 2009; Yount et al., 2014); however, none of these studies addressed the acceptability of IPVAW. Moreover, IRT offers improved factor scores that can be used to assess which latent trait levels (i.e., acceptability estimates) are measured more accurately. The test information function is a dynamic approach to study the reliability of a psychometric instrument. Unlike Cronbach’s α, the IRT information function does not assume that the accuracy of the scale is constant across the entire latent trait (i.e., acceptability estimates), and thus some latent trait levels are more accurately measured than others. In particular, the A-IPVAW scale is especially informative (i.e., accurate) for moderate, high, and very high levels of acceptability of IPVAW. Our measure can detect individuals with high levels of acceptability and discriminate among them with high precision. On the other hand, the precision of the scale is lower for individuals with low and very low levels of acceptability.
Regarding the validity analyses, we found that respondents with higher scores on the A-IPVAW scale tend to evaluate less severely the IPVAW situations described by the PS-IPVAW items. This finding is congruent with previous research, since individuals who consider IPVAW as such only in cases of extreme or severe violence (e.g., physical violence) are more likely to perceive other kinds of violence (e.g., emotional or verbal violence) as more “tolerable” (Gracia & Herrero, 2006a; Muehlenhard & Kimes, 1999; Taylor & Sorenson, 2005). Our results also revealed that respondents with higher levels of acceptability presented higher scores of ambivalent sexism, in particular in the hostile sexism subscale. Sexism has also been previously related to attitudes justifying IPVAW (e.g., Glick et al., 2002; Herrera, Expósito & Moya, 2012; Herrero et al., 2017; Valor-Segura, Expósito, & Moya, 2011).
Regarding gender differences, women showed lower scores in the A-IPVAW scale than men, which is also consistent with previous research (Carlson & Worden, 2005; Fincham et al., 2008; Flood & Pease, 2009; Gracia & Herrero, 2006b). Moreover, in line with the findings of Gracia et al. (2015) , we found that convicted batterers are more prone to show higher levels of acceptability than men from the general population. Although this preliminary result should be taken with caution as the sample of batterers is small and somewhat limited, it highlights that the scale is indeed especially informative for those individuals with higher levels of acceptability of IPVAW, and thus at higher risk of committing IPVAW (Archer & Graham-Kevan, 2003; Gracia et al., 2015) . In this regard, the A-IPVAW scale can be used as a forensic tool that can detect cases of higher risk of IPVAW perpetration, as it can differentiate accurately between participants with low and high acceptability estimates (Andreu-Rodríguez, Peña-Fernández, & Loza, 2016). It can also be used as an evaluation instrument for intervention programs with IPVAW perpetrators, monitoring attitudinal changes during and after the intervention (Carbajosa, Catalá-Miñana, Lila, & Gracia, 2017; Ferrer-Perez, Ferreiro-Basurto, Navarro-Guzmán, & Bosch-Fiol, 2016; Lila, Gracia, & Catalá-Miñana, 2017; Lila, Oliver, Galiana, & Gracia, 2013).
This study is not without limitations. The scale was developed within the Spanish socio-cultural context, and thus further research is needed to generalize our results to other cultural settings. Another limitation is the sampling method. Although online recruitment has proven to be an effective and cost-effective sampling method (Thornton et al., 2016), it comes with some tradeoffs that limit the generalizability of the results. As noted by Topolovec-Vranic and Natarajan (2016), it is harder to verify the socio-demographic information provided by on-line participants than with more traditional sampling strategies. In addition, self-selection bias in the targeted sample can be an issue, since people who agree to participate in the study might be more motivated than the general population. However, the socio-demographic characteristics of the sample are similar to other internet-based demographic studies in Spain (Acebes-Arribas, 2016), ensuring the representativeness of the sample at least across Spanish internet users. The effect of social desirability should be carefully examined in future studies, assessing the relationship between the A-IPVAW, a self-reported measure, and implicit measures of acceptability of IPVAW (Gracia et al., 2015). Future research should also address the factorial invariance of the scale, ensuring that the gender differences encountered in the A-IPVAW scores are due to actual differences between latent means for men and women and not to different interpretations of the items. In the same way, factorial invariance between men and convicted batterers should be addressed with a larger sample of IPVAW perpetrators.
Despite these limitations, the development and validation of the A-IPVAW represents a step forward in the study of attitudes toward IPVAW. With the emergent importance of attitudes in the study of IPVAW in demographic surveys, the availability of psychometrically sound instruments becomes a key issue. The A-IPVAW aims to fill this need.
Abramsky, T., Watts, C. H., Garcia-Moreno, C., Devries, K., Kiss, L., Ellsberg, M., Heise, L. (2011). What factors are associated with recent intimate partner violence? Findings from the WHO multi-country study on women’s health and domestic violence. BMC Public Health, 11, 109. https://doi.org/10.1186/1471-2458-11-109
Ali, P. A., & Naylor, P. B. (2013). Intimate partner violence: A narrative review of the feminist, social and ecological explanations for its causation. Aggression and Violent Behavior, 18, 611-619. https://doi.org/10.1016/j.avb.2013.07.009
Andreu-Rodríguez, J. M., Peña-Fernández, M. E., & Loza, W. (2016). Predicting risk of violence through a self-appraisal questionnaire. The European Journal of Psychology Applied to Legal Context, 8, 51-56. https://doi.org/10.1016/j.ejpal.2016.03.001
Archer, J., & Graham-Kevan, N. (2003). Do beliefs about aggression predict physical aggression to partners? Aggressive Behavior, 29, 41-54. https://dx.doi.org/10.1002/ab.10029
Asparouhov, T., & Muthén, B. (2010). Weighted least squares estimation with missing data. Retrieved from
Beck, C. J., Menke, J. M., & Figueredo, A. J. (2013). Validation of a measure of intimate partner abuse (Relationship Behavior Rating Scale-Revised) using item response theory analysis. Journal of Divorce & Remarriage, 54, 58-77. https://doi.org/10.1080/10502556.2012.743830
Browning, C. R. (2002). The span of collective efficacy: Extending social disorganization theory to partner violence. Journal of Marriage and Family, 64, 833-850. https://dx.doi.org/10.1111/j.1741-3737.2002.00833.x
Cai, L. (2010). High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika, 75, 33-57.
Campbell, J. C. (2002). Health consequences of intimate partner violence. The Lancet, 359, 1331-1336. https://doi.org/10.1016/S0140-6736(02)08336-8
Campbell, J. C., & Manganello, J. (2006). Changing public attitudes as a prevention strategy to reduce intimate partner violence. Journal of Aggression, Maltreatment & Trauma, 13, 13-40. https://doi.org/10.1300/J146v13n03_02
Capaldi, D. M., Knoble, N. B., Shortt, J. W., & Kim, H. K. (2012). A systematic review of risk factors for intimate partner violence. Partner Abuse, 3, 231-280. https://doi.org/10.1891/1946-6518.104.22.168
Capezza, N. M., & Arriaga, X. B. (2008). Factors associated with acceptance of psychological aggression against women. Violence Against Women, 14, 612-633. https://doi.org/10.1177/1077801208319004
Carbajosa, P., Catalá-Miñana, A., Lila, M., & Gracia, E. (2017). Differences in treatment adherence, program completion, and recidivism among batterer subtypes. The European Journal of Psychology Applied to Legal Context, 9, 93-101. https://doi.org/10.1016/j.ejpal.2017.04.001
Carlson, B. E., & Worden, A. P. (2005). Attitudes and beliefs about domestic violence: Results of a public opinion survey I. Definitions of domestic violence, criminal domestic violence, and prevalence. Journal of Interpersonal Violence, 20, 1197-1218. https://doi.org/10.1177/0886260505278530
Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48, 1-29. Retrieved from
Chernyshenko, O. S., Stark, S., Chan, K. Y., Drasgow, F., & Williams, B. (2001). Fitting item response theory models to two personality inventories: Issues and insights. Multivariate Behavioral Research, 36, 523-562. https://doi.org/10.1207/S15327906MBR3604_03
Copp, J. E., Giordano, P. C., Longmore, M. A., & Manning, W. D. (2016). The development of attitudes toward intimate partner violence: An examination of key correlates among a sample of young adults. Journal of Interpersonal Violence.
Craparo, G., Gori, A., Petruccelli, I., Cannella, V., & Simonelli, C. (2014). Intimate partner violence: relationships between alexithymia, depression, attachment styles, and coping strategies of battered women. The Journal of Sexual Medicine, 11, 1484-1494. https://dx.doi.org/10.1111/jsm.12505
Devries, K. M., Mak, J. Y., Garcia-Moreno, C., Petzold, M., Child, J. C., Falder, G., Pallitto, C. (2013). The global prevalence of intimate partner violence against women. Science, 340, 1527-1528. https://dx.doi.org/10.1126/science.1240937
Edelen, M. O., McCaffrey, D. F., Marshall, G. N., & Jaycox, L. H. (2009). Measurement of teen dating violence attitudes an item response theory evaluation of differential item functioning according to gender. Journal of Interpersonal Violence, 24, 1243-1263. https://doi.org/10.1177/0886260508322187
Ellsberg, M., Jansen, H. A., Heise, L., Watts, C. H., & Garcia-Moreno, C. (2008). Intimate partner violence and women’s physical and mental health in the WHO multi-country study on women’s health and domestic violence: an observational study. The Lancet, 371, 1165-1172. https://doi.org/10.1016/S0140-6736(08)60522-X
Expósito, F., Moya, M. C., & Glick, P. (1998). Sexismo ambivalente: Medición y correlatos [Ambivalent sexism: measurement and correlates]. Revista de Psicología Social, 13, 159-169. https://doi.org/10.1174/021347498760350641
Ferrer-Perez, V. A., Ferreiro-Basurto, V., Navarro-Guzmán, C., & Bosch-Fiol, E. (2016). Programas de intervención con maltratadores en España: la perspectiva de los/as profesionales [Batterer intervention programs in Spain: The professionals’ perspective]. Psychosocial Intervention, 25, 159-168. https://doi.org/10.1016/j.psi.2016.06.001
Fincham, F. D., Cui, M., Braithwaite, S., & Pasley, K. (2008). Attitudes toward intimate partner violence in dating relationships. Psychological Assessment, 20, 260-269. https://doi.org/10.1037/1040-3522.214.171.1240
Flood, M., & Pease, B. (2009). Factors influencing attitudes to violence against women. Trauma, Violence, & Abuse, 10, 125-142. https://doi.org/10.1177/1524838009334131
Frye, V. (2007). The informal social control of intimate partner violence against women: Exploring personal attitudes and perceived neighborhood social cohesion. Journal of Community Psychology, 35, 1001-1018. https://dx.doi.org/10.1002/jcop.20209
Garcia-Moreno, C., Jansen, H. A., Ellsberg, M., Heise, L., & Watts, C. H. (2006). Prevalence of intimate partner violence: findings from the WHO multi-country study on women’s health and domestic violence. The Lancet, 368, 1260-1269. https://doi.org/10.1016/S0140-6736(06)69523-8
García-Moreno, C., Zimmerman, C., Morris-Gehring, A., Heise, L., Amin, A., Abrahams, N., Watts, C. (2015). Addressing violence against women: a call to action. The Lancet, 385, 1685-1695. https://doi.org/10.1016/S0140-6736(14)61830-4
Garrido, L. E., Abad, F. J., & Ponsoda, V. (2011). Performance of Velicer’s minimum average partial factor retention method with categorical variables. Educational and Psychological Measurement, 71, 551-570. https://doi.org/10.1177/0013164410389489
Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological methods, 21, 93-111. https://doi.org/10.1037/met0000064
Glick, P., & Fiske, S. T. (1996). The Ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of Personality and Social Psychology, 70, 491-512. https://doi.org/10.1037/0022-35126.96.36.1991
Glick, P., Fiske, S. T., Mladinic, A., Saiz, J. L., Abrams, D., Masser, B., Annetje, B. (2000). Beyond prejudice as simple antipathy: hostile and benevolent sexism across cultures. Journal of Personality and Social Psychology, 79, 763-775. https://doi.org/10.1037/0022-35188.8.131.523
Glick, P., Sakalli-Ugurlu, N., Ferreira, M. C., & Aguiar de Souza, M. (2002). Ambivalent sexism and attitudes toward wife abuse in Turkey and Brazil. Psychology of Women Quarterly, 26, 292-297. https://dx.doi.org/10.1111/1471-6402.t01-1-00068
Gracia, E. (2014a). Intimate partner violence against women and victim-blaming attitudes among Europeans. Bulletin of the World Health Organization, 92, 380-381.
Gracia, E. (2014b). Public attitudes toward partner violence against women. In A. C. Michalos (Ed.), Encyclopedia of quality of life and well-being research (pp. 4325-4328). Dordrecht, The Netherlands: Springer.
Gracia, E., García, F., & Lila, M. (2008). Police involvement in cases of intimate partner violence against women: The influence of perceived severity and personal responsibility. Violence Against Women, 14, 697-714. https://doi.org/10.1177/1077801208317288
Gracia, E., García, F., & Lila, M. (2009). Public responses to intimate partner violence against women: The influence of perceived severity and personal responsibility. The Spanish Journal of Psychology, 12, 648-656.
Gracia, E., García, F., & Lila, M. (2011). Police attitudes toward policing partner violence against women: Do they correspond to different psychosocial profiles? Journal of Interpersonal Violence, 26, 189-207. https://doi.org/10.1177/0886260510362892
Gracia, E., García, F., & Lila, M. (2014). Male police officers’ law enforcement preferences in cases of intimate partner violence versus non-intimate interpersonal violence: do sexist attitudes and empathy matter? Criminal Justice and Behavior, 41, 1195-1213. https://doi.org/10.1177/0093854814541655
Gracia, E., & Herrero, J. (2006a). Acceptability of domestic violence against women in the European Union: A multilevel analysis. Journal of Epidemiology and Community Health, 60, 123-129. https://dx.doi.org/10.1136/jech.2003.019604
Gracia, E., & Herrero, J. (2006b). Public attitudes toward reporting partner violence against women and reporting behavior. Journal of Marriage and Family, 68, 759-768. https://dx.doi.org/10.1111/j.1741-3737.2006.00288.x
Gracia, E., & Lila, M. (2015). Attitudes towards violence against women in the EU. Luxembourg: Publication Office of the European Union.
Gracia, E., & Merlo, J. (2016). Intimate partner violence against women and the Nordic paradox. Social Science & Medicine, 157, 27-30. https://doi.org/10.1016/j.socscimed.2016.03.040
Gracia, E., Rodriguez, C. M., & Lila, M. (2015). Preliminary evaluation of an analog procedure to assess acceptability of intimate partner violence against women: The Partner Violence Acceptability Movie Task. Frontiers in Psychology, 6(1567). https://dx.doi.org/10.3389%2Ffpsyg.2015.01567
Gracia, E., & Tomás, J. M. (2014). Correlates of victim-blaming attitudes regarding partner violence against women among the Spanish general population. Violence Against Women, 20, 26-41.
Herrera, M. C., Expósito, F., & Moya, M. (2012). Negative reactions of men to the loss of power in gender relations: Lilith vs. Eve. The European Journal of Psychology Applied to Legal Context, 4, 17-42. Retrieved from
Herrero, J., Rodríguez, F. J., & Torres, A. (2017). Acceptability of partner violence in 51 societies: The role of sexism and attitudes toward violence in social relationships. Violence Against Women, 23, 351-367. https://doi.org/10.1177/1077801216642870
Hu L. T., & Bentler P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
Jewkes, R., Flood, M., & Lang, J. (2015). From work with men and boys to changes of social norms and reduction of inequities in gender relations: A conceptual shift in prevention of violence against women and girls. The Lancet, 385, 1580-1589. https://doi.org/10.1016/S0140-6736(14)61683-4
Jose, A., Olino, T. M., & O’leary, K. D. (2012). Item response theory analysis of intimate-partner violence in a community sample. Journal of Family Psychology, 26, 198-205. https://doi.org/10.1037/a0027100
Lila, M., Gracia, E., & Catalá-Miñana, A. (2017). More likely to dropout, but what if they don’t? Partner violence offenders with alcohol abuse problems completing batterer intervention programs. Journal of Interpersonal Violence, 27, 471-491. https://doi.org/10.1177/0886260517699952
Lila, M., Gracia, E., & García, F. (2013). Ambivalent sexism, empathy and law enforcement attitudes towards partner violence against women among male police officers. Psychology, Crime & Law, 19, 907-919. https://doi.org/10.1080/1068316X.2012.719619
Lila, M., Gracia, E., & Herrero, J. (2012). Asunción de responsabilidad en hombres maltratadores: Influencia de la autoestima, la personalidad narcisista y la personalidad antisocial [Responsibility assumption among male batterers: self-esteem, narcissistic and antisocial personality influence]. Revista Latinoamericana de Psicología, 44, 99-108.
Lila, M., Gracia, E., Murgui, S. (2013). Psychological adjustment and victim-blaming among intimate partner violence offenders: The role of social support and stressful life events. The European Journal of Psychology Applied to Legal Context, 5, 147-153. https://doi.org/10.5093/ejpalc2013a4
Lila, M., Oliver, A., Catalá-Miñana, A., Galiana, L., & Gracia, E. (2014). The intimate partner violence responsibility attribution scale (IPVRAS). The European Journal of Psychology Applied to Legal Context, 6, 29-36. https://doi.org/10.5093/ejpalc2014a4
Lila, M., Oliver, A., Galiana, L., & Gracia, E. (2013). Predicting success indicators of an intervention programme for convicted intimate-partner violence offenders: The Contexto Programme. The European Journal of Psychology Applied to Legal Context, 5, 73-95.
Lorenzo-Seva, U., & Ferrando, P. J. (2006). FACTOR: A computer program to fit the exploratory factor analysis model. Behavior Research Methods, 38, 88-91. https://doi.org/10.3758/BF03192753
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149. https://doi.org/10.1037/1082-989X.1.2.130
Maydeu-Olivares, A., & Garcia-Forero, C. (2010). Goodness-of-fit testing. International Encyclopedia of Education, 7, 190-196.
Maydeu-Olivares, A., & Joe, H. (2006). Limited information goodness-of-fit testing in multidimensional contingency tables. Psychometrika, 71, 713-732. https://doi.org/10.1007/s11336-005-1295-9
Miles, J., & Shevlin, M. (2001). Applying Regression and Correlation: A Guide for Students and Researchers. London, UK: Sage.
Muehlenhard, C. L., & Kimes, L. A. (1999). The social construction of violence: The case of sexual and domestic violence. Personality and Social Psychology Review, 3, 234-245. https://doi.org/10.1207/s15327957pspr0303_6
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171-189. https://dx.doi.org/10.1111/j.2044-8317.1985.tb00832.x
Muthén, B., & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45, 19-30. https://dx.doi.org/10.1111/j.2044-8317.1992.tb00975.x
R Core Team (2016). R: A language and environment for statistical computing. R foundation for Statistical Computing. Retrieved from
Reichenheim, M. E., Klein, R., & Moraes, C. L. (2007). Assessing the physical violence component of the Revised Conflict Tactics Scales when used in heterosexual couples: An item response theory analysis. Cadernos de Saúde Pública, 23, 53-62. http://dx.doi.org/10.1590/S0102-311X2007000100007
Revelle, W. (2016). psych: Procedures for personality and psychological research. Northwestern University. Evanston, Illinois, USA. Retrieved from Version = 1.5.4
Ruiz-Hernández, J. A., García-Jiménez, J. J., Llor-Esteban, B., & Godoy-Fernández, C. (2015). Risk factors for intimate partner violence in prison inmates. The European Journal of Psychology Applied to Legal Context, 7, 41-49. https://doi.org/10.1016/j.ejpal.2014.11.003
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. New York, NY: Psychometric Society.
Schmitt, T. A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29, 304-321. https://doi.org/10.1177/0734282911406653
Schwab-Reese, L. M., & Renner, L. M. (2017). Attitudinal acceptance of and experiences with intimate partner violence among rural adults. Journal of Family Violence, 32, 115-123. https://doi.org/10.1007/s10896-016-9895-y
Stith, S. M., Smith, D. B., Penn, C. E., Ward, D. B., & Tritt, D. (2004). Intimate partner physical abuse perpetration and victimization risk factors: A meta-analytic review. Aggression and Violent Behavior, 10, 65-98. https://doi.org/10.1016/j.avb.2003.09.001
Stöckl, H., Devries, K., Rotstein, A., Abrahams, N., Campbell, J., Watts, C., & García-Moreno, C. (2013). The global prevalence of intimate partner homicide: A systematic review. The Lancet, 382, 859-865. https://doi.org/10.1016/S0140-6736(13)61030-2
Sugarman, D. B., & Frankel, S. L. (1996). Patriarchal ideology and wife-assault: A meta-analytic review. Journal of Family Violence, 11, 13-40.
Taylor, C. A., & Sorenson, S. B. (2005). Community-based norms about intimate partner violence: Putting attributions of fault and responsibility into context. Sex Roles, 53, 573-589. http://dx.doi.org/10.1007/s11199-006-9155-3
Thornton, L., Batterham, P. J., Fassnacht, D. B., Kay-Lambkin, F., Calear, A. L., & Hunt, S. (2016). Recruiting for health, medical or psychosocial research using Facebook: Systematic review. Internet Interventions, 4, 72-81.
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16, 209-220. http://dx.doi.org/10.1037/a0023353
Topolovec-Vranic, J., & Natarajan, K. (2016). The use of social media in recruitment for medical research studies: A scoping review. Journal of Medical Internet Research, 18, e286. https://dx.doi.org/10.2196/jmir.5698
Tsai, A. C., Kakuhikire, B., Perkins, J. M., , D., McDonough, A. Q., Ogburn, E. L., Bangsberg, D. R. (2017). Measuring personal beliefs and perceived norms about intimate partner violence: Population-based survey experiment in rural Uganda. PLoS Medicine, 14, e1002303. https://doi.org/10.1371/journal.pmed.1002303
Valor-Segura, I., Expósito, F., & Moya, M. (2011). Victim blaming and exoneration of the perpetrator in domestic violence: The role of beliefs in a just world and ambivalent sexism. The Spanish Journal of Psychology, 14, 195-206. https://doi.org/10.5209/rev_SJOP.2011.v14.n1.17
Vargas, V., Lila, M., & Catalá-Miñana, A. (2015). ¿Influyen las diferencias culturales en los resultados de los programas de intervención con maltratadores? Un estudio con agresores españoles y latinoamericanos [Do cultural differences influence batterer intervention program outcomes? A study with Spanish and Latin American offenders]. Psychosocial Intervention, 24, 41-47. https://doi.org/10.1016/j.psi.2015.03.001
Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321-327.
Waltermaurer, E. (2012). Public justification of intimate partner violence: A review of the literature. Trauma, Violence, & Abuse, 13, 167-175. https://doi.org/10.1177/1524838012447699
Wang, L. (2016). Factors influencing attitude toward intimate partner violence. Aggression and Violent Behavior, 29, 72-78. https://doi.org/10.1016/j.avb.2016.06.005
Wong, J. Y., Tiwari, A., Fong, D. Y., & Bullock, L. (2016). A cross-cultural understanding of depression among abused women. Violence Against Women, 22, 1371-1396. https://doi.org/10.1177/1077801215624791
World Health Organization (WHO). (2002). World report on violence and health. Geneva, Switzerland: World Health Organization. Retrieved from
World Health Organization (WHO). (2013). Global and regional estimates of violence against women: Prevalence and health effects of intimate partner violence and non-partner sexual violence. Geneva, Switzerland: World Health Organization Retrieved from
Yount, K. M., Halim, N., Hynes, M., & Hillman, E. (2011). Response effects to attitudinal questions about domestic violence against women: A comparative perspective. Social Science Research, 40, 873-884. https://doi.org/10.1016/j.ssresearch.2010.12.009
Yount, K. M., VanderEnde, K., Zureick-Brown, S., Minh, T. H., Schuler, S. R., & Anh, H. T. (2014). Measuring attitudes about women’s recourse after exposure to intimate partner violence: The ATT-RECOURSE scale. Journal of Interpersonal Violence, 29, 1579-1605. https://doi.org/10.1177/0886260513511536
firstname.lastname@example.org (E. Gracia)
Copyright © 2019. Colegio Oficial de Psicólogos de Madrid