Substance Abuse: Research and Treatment

Traditional mechanisms for rating adherence or fidelity are labor-intensive. We developed and validated a tool to rate adherence to Motivational Enhancement Therapy—Cognitive Behavioral Treatment (MET-CBT) through anonymous client surveys. The instrument was used to survey clients in 3 methadone programs over 2 waves. Explanatory and Confirmatory Factor Analyses were used to establish construct validity for both MET and CBT. Internal consistency based on Cronbach’s alpha was within adequate range (α > 0.70) for all but 2 of the subscales in one of the samples. Consensus between clients’ ratings (rwg(j) scores) were in the range of 0.6 and higher, indicating a moderate to strong degree of agreement among clients’ ratings of the same counselor. These results suggest that client surveys could be used to measure adherence to MET-CBT for quality monitoring that is more objective than counselor self-report and less resource-intensive than supervisor review of taped sessions. However, additional work is needed to develop this scale.