The present study focuses on the EBPAS, which consists of 15 items measured on a 5-point Likert scale ranging from 0 (
Not at all) to 4 (
To a very great extent) (Aarons, 2004 (
link); Aarons, et al., 2007 (
link)). The EBPAS is conceptualized as consisting of four lower-order factors/subscales and a higher-order factor/total scale (i.e., total scale score), the latter representing respondents’ global attitude toward adoption of EBPs. For the lower-order factors,
Appeal assesses the extent to which the provider would adopt an EBP if it were intuitively appealing, could be used correctly, or was being used by colleagues who were happy with it. The
Requirements factor assesses the extent to which the provider would adopt an EBP if it were required by an agency, supervisor, or state. The
Openness factor assesses the extent to which the provider is generally open to trying new interventions and would be willing to try or use more structured or manualized interventions. The
Divergence factor assesses the extent to which the provider perceives EBPs as not clinically useful and less important than clinical experience.
As described in Aarons (2004) (
link), content validity of the EBPAS was based on initial development of a pool of items generated from literature review, consultation with mental health service providers, and consultation with mental health services researchers with experienced in evidence-based protocols. As additional evidence of content validity we also asked an expert panel of six mental health services researchers to rate each item of the EBPAS in terms of a)
relevance in assessing attitudes toward evidence-based practice, b)
importance in assessing attitudes toward evidence-based practice, and c) how
representative the item is of the particular factor it is attempting to assess on a 5-point Likert scale (e.g., 1 = “not at all relevant”, 2 = “relevant to a slight extent”, 3 = “relevant to a moderate extent”, 4 = “relevant to a great extent”, 5 = “relevant to a very great extent”) . For individual items the mean rating across panel members ranged from 3.33 - 4.67 for relevance, 3.17- 4.67 for importance, and 3.17- 4.67 for representative. This result supports EBPAS content validity as every item was on average rated as at least “moderately” relevant, important, and representative of the factor it was purported to assess.
Previous studies suggest moderate to good internal consistency reliability in two samples for the total score (Cronbach’s α = .77, .79) and subscale scores excluding divergence (α range= .78-.93), with somewhat lower reliability estimates for divergence (α = .59, .66) (Aarons, 2004 (
link); Aarons, et al., 2007 (
link)). Construct validity in previous studies is supported by two previous scale development studies that have found acceptable model-data fit for previous confirmatory factor analysis models (Aarons, et al., 2007 (
link)). In terms of construct and convergent validity, studies have found significant associations between EBPAS scores and mental health clinic structure and policies (Aarons, 2004 (
link)), organizational culture and climate (Aarons & Sawitzky, 2006 (
link)) and leadership (Aarons, 2006 (
link)).
Aarons G.A., Glisson C., Hoagwood K., Kelleher K., Landsverk J, & Cafri G. (2010). Psychometric Properties and United States National Norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological assessment, 22(2), 10.1037/a0019188.