Back to Journals » Substance Abuse and Rehabilitation » Volume 12
![Highly-accessed](assets/img/article_icons/highly-accessed.png)
Addiction Medicine Practice-Based Research Network (AMNet): Assessment Tools and Quality Measures
Authors Clarke DE, Ibrahim A, Doty B, Patel S , Gibson D, Pagano A, Thompson L, Goldstein AB, Vocci F , Schwartz RP
Received 9 February 2021
Accepted for publication 18 May 2021
Published 25 June 2021 Volume 2021:12 Pages 27—39
DOI https://doi.org/10.2147/SAR.S305972
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 3
Editor who approved publication: Dr Scott Fraser
Diana E Clarke,1,2 Adila Ibrahim,3 Benjamin Doty,1 Sejal Patel,1 Debbie Gibson,1 Anna Pagano,4 Laura Thompson,1 Amy B Goldstein,5 Frank Vocci,3 Robert P Schwartz3
1Division of Research, American Psychiatric Association, Washington, DC, USA; 2Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA; 3Social Research Center, Friends Research Institute, Baltimore, MD, USA; 4Quality and Science Department,American Society of Addiction Medicine, Rockville, MD, USA; 5Prevention Research Branch,National Institute on Drug Abuse, Bethesda, MD, USA
Correspondence: Diana E Clarke
American Psyshiatric Association, 800 Maine Avenue SW, Suite 900, Washington, DC, 20024, USA
Tel +1 202-609-7120
Email [email protected]
Introduction: The need for innovative approaches to address the opioid epidemic in the United States is widely recognized. Many challenges exist to addressing this epidemic, including the obstacles outpatient substance use treatment practices face in implementing measurement-based care (MBC), quality measurement systems, and evidence-based treatments. Also, there are insufficient opportunities for clinicians in these settings to participate in research, resulting in diminished translation of research findings into community-based practice. To address these challenges, the Addiction Medicine Practice-Based Research Network (AMNet) was developed to facilitate the uptake of MBC in outpatient practices via implementation of patient-reported assessments and quality of care performance measures to improve patient outcomes. This network will offer clinicians in outpatient settings (not incuding opioid treatment programs [OTPs]) the opportunity to participate in future substance use disorder treatment research studies.
Methods: A key step in the development of AMNet was the selection of substance use-specific assessment tools and quality of care performance measures for incorporation into the American Psychiatric Association’s mental health patient registry, PsychPRO. A scoping review and multi-step consensus-based process were used to identify, review and select candidate assessment tools and quality of care performance measures for opioid use disorders (OUD) and substance use disorders (SUD).
Results: Following a consensus-based methodology, 12 standardized assessment tools and 3 quality of care performance measures for OUD and SUD were selected to help facilitate the implementation of MBC and quality improvement for AMNet participants. These tools were further categorized as core and optional.
Conclusion: By offering a collection of carefully vetted assessment tools and quality measures through PsychPRO, AMNet will help participating clinicians with the systematic uptake of MBC and delivery of evidence-based treatment for patients with SUD. Also, AMNet will act as a centralized repository of data collected from patients and clinicians in non-OTP outpatient addiction medicine practices and serve as a platform for opioid treatment research.
Keywords: measurement-based care, addiction medicine, patient-reported outcome measures, quality measures, quality improvement
Background/Rationale
The opioid epidemic in the United States (US) led to the overdose death of nearly 450,000 people from 1999 to 2018.1 Adverse outcomes attributable to opioid misuse impart significant personal, social, and economic burden in the US.1–3 Despite the enormity of this burden, however, the majority of the 1.6 million Americans with opioid use disorder (OUD) are left untreated.4
One approach to addressing the country’s opioid epidemic is the systematic implementation of measurement-based care (MBC) in substance use disorder (SUD) treatment. MBC refers to the use of standardized patient-reported outcome measures (PROMs) to identify and monitor patients’ symptoms and functioning and to adjust treatment to maximize improvements in patient outcomes.5 MBC can also facilitate the detection of emerging symptoms and comorbid diagnoses, which can impact the prognosis of SUD.6 MBC can be considered a “framework” since it can be implemented with many different treatment modalities or approaches across different settings and patient populations, and as such, can be considered a core component of numerous evidence-based practices.7,8 Therefore, the opioid epidemic and the principles of treatment identified by payers and funders provide a strong rationale for MBC in the treatment of people with SUD, including OUD.6,9–12 The combined use of MBC and quality measures to inform treatment planning in evidence-based treatment has been shown to improve the quality of care and outcomes for patients with SUD.6,7
Amid growing interest and momentum in value-based care in the US, clinicians are increasingly expected to measure and track outcomes to demonstrate the value of their service at the patient and population levels.13 Further, this demonstration of value should include input from patients who are informed and selective about their healthcare options.14 The systematic uptake of MBC and the assessment of performance via quality measures can help clinicians meet these expectations. In addition, a quality improvement program that includes systematic uptake of MBC can help ensure patients receive the same level of high-quality, evidence-based care regardless of the treatment setting. However, many clinicians do not consistently implement MBC or a quality measurement system in their practices, thus missing a potential opportunity to improve patient outcomes.5
SUD treatment is provided in specialized SUD treatment programs and outpatient practices. While most clinical research has been conducted in specialized programs, particularly opioid treatment programs (OTP), little is known about the patients and treatment outcomes in other outpatient practice settings in which buprenorphine and naltrexone are provided for OUD. Further, the clinicians in non-OTP outpatient settings are rarely engaged in clinical SUD research, which impedes the translation of research findings to clinical practice. The lack of implementation of MBC and quality measurement in OUD treatment, uptake of evidence-based treatment, and insufficient research occurring in outpatient practices create an opportunity to address the OUD epidemic.
The American Psychiatric Association (APA), American Society of Addiction Medicine (ASAM), and Friends Research Institute (FRI) have partnered to develop the Addiction Medicine Practice-based Research Network (AMNet). AMNet is a novel practice-based research network that aims to develop a repository of information on addiction treatment and outcomes and facilitate performance improvement in addiction medicine and addiction psychiatry.15 This network is focused on the systematic uptake of MBC and quality metrics in non-OTP outpatient practices that treat SUDs. In the future, it will also provide a platform for practice-based research using standardized assessments and other data in a robust database. AMNet has adapted the APA’s mental health patient registry, PsychPRO, for SUDs through the incorporation of addiction-specific assessments and quality measures.16 PsychPRO provides an electronic application for efficient implementation of MBC and serves as a robust quality improvement tool, including the technological platform for quality data aggregation and reporting. A concerted multi-stakeholder effort has been used to guide the selection of addiction-focused PROMs and quality measures with a focus on OUD. The purpose of the present paper is to describe the process by which PROMS and quality of care performance measures were selected for AMNet following a scoping review and to discuss their potential clinical utility.
Methods
The AMNet Executive and Steering Committees used a multi-step, consensus-based process to identify and select OUD and other SUD standardized assessment tools and quality measures. These measures will facilitate the implementation of MBC and quality improvement for AMNet participants in non-OTP outpatient treatment settings, including office-based opioid treatment practices, certified intensive outpatient programs, outpatient programs, and community health and mental health centers. The Executive Committee comprises the investigators from APA, ASAM, and FRI as well as the AMNet grant’s Science Officer at the National Institute on Drug Abuse (NIDA). The Steering Committee consists of the members of the Executive Committee plus three clinicians, two federal advisors, and one consumer representative.
The Committees followed a multi-step process as illustrated in Figure 1 and involved the following steps: 1) identify domains of interest for OUD and other SUDs; 2) search for assessment tools and quality measures using the domains of interest and other keywords related to substance use (ie, use, misuse, abuse, dependence, disorder); 3) initial review of the tools and quality measures; 4) final review and consensus-based selection of tools and quality measures; and 5) categorize tools as core versus optional. We delineate this process in the following sections.
AMNet Standardized Assessment Tools
Identify Domains of Interest for Assessment Tools
The AMNet Executive Committee sought domains that would 1) be of interest to treating clinicians and patients with OUD/SUD; and 2) have a potential clinical relevance to OUD/SUD and its treatment. Committee members proposed domains, discussed their importance in the field of addiction medicine, and reached a unanimous agreement on the final domains of interest during a regularly scheduled meeting. The Executive Committee, drawing on its clinical and research expertise in addiction medicine/psychiatry and public health, identified ten domains of interest for the AMNet assessment tools: 1) substance consumption/frequency, quantity, and mode of administration; 2) withdrawal; 3) insomnia; 4) craving; 5) overdose; 6) prescription opioid misuse; 7) quality of life; 8) recovery; 9) functioning; and 10) mental health. The domains of consumption and prescription opioid misuse were selected to characterize the opioid use pattern. The domains of withdrawal, insomnia, craving, and overdose were selected as effects and consequences of interest. The domains of quality of life, recovery, functioning, and mental health were considered to be important to assess both the current state of the patient and any improvements with treatment. Although the Executive Committee focused its discussions on domains that would be of great use to clincians, the Committee noted many of these domains would be of interest to patients (such as withdrawal, insomnia, and quality of life) and the addiction field (such as craving) as they are considered important endpoints for demonstrating the efficacy of drugs for the treatment of OUD by the Food and Drug Administration.17
Search for Candidate Assessment Tools
A subcommittee of the Executive Committee conducted a scoping review to identify candidate patient- and clinician-rated assessment tools related to OUD and other SUDs. The subcommittee searched PubMed and PsycINFO databases for records published through November 2019 as well as the online catalogs of PROMs, including the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS), the PhenX Toolkit, and NIDA’s Clinical Trials Network Common Data Elements.18–21 Search terms were related to: all dimensions of substance use (ie, use OR misuse OR disorder OR abuse OR dependence); the domains of interest identified in Step 1; assessment (ie, measure OR tool OR instrument OR screen); and—for specifically finding tools for OUD—terms related to the substance (opioid OR opiate). The inclusion criteria were as follows: 1) focused on assessment tools used for SUD or OUD; 2) provided information on scoring and interpretation; 3) reported psychometric properties of tools or described tools derived from national surveys; and 4) freely available or in the public domain. The exclusion criteria were as follows: 1) letters, editorials, commentaries, posters, and conference proceedings; and 2) articles not published in the English language. Records from the peer-reviewed literature were screened in two stages—first on titles/abstracts and then full-text. The reference lists of applicable articles were hand-searched for additional resources. Using this approach, the subcommittee located 45 candidate assessment tools.
Initial Review of Candidate Assessment Tools
The Executive Committee conducted an initial review of the 45 tools found in Step 2 against four criteria: 1) brief enough to be a low burden to patients and practices; 2) clinically useful (ie, provide information that is useful in clinical decision-making for both the clinician and the patient); 3) in the public domain; and 4) possessing acceptable or greater reliability (ie, any combination of internal consistency, test-retest, or inter-rater reliability) and validity (ie, any combination of face, criterion, concurrent, or discriminant validity). The Executive Committee sought to identify preferred candidate tools for each of the ten domains of interest identified in Step 1. The Executive Committee shared the list of 45 tools with preferences with the Steering Committee at its face-to-face meeting on December 16, 2019, for consideration and final consensus selection.
Final Review and Consensus-Based Selection of Assessment Tools
The Executive Committee presented the Steering Committee with an overview of the 45 candidate assessment tools as well as its review process and deliberations (Step 3) to arrive at the 13 preferred candidate tools. The Steering Committee selected the final AMNet assessment tools (Table 1) by consensus. This involved at least 7 of 12 Steering Committee members voting “yes” to include the assessment tool. To eliminate redundancies and reduce patient burden, the Steering Committee suggested replacing four of the tools recommended by the Executive Committee with alternate tools that captured multiple domains. Specifically, the Steering Committee suggested using the 17-item Brief Addiction Monitor (BAM) to replace four other candidate tools—PhenX Quantity/Frequency Alcohol & Drug, PROMIS Sleep Disturbance & Sleep-related Impairments, Brief WHO-Quality of Life (WHOQOL-BREF), and the Brief Assessment of Recovery Capital (BARC-10)—to capture substance consumption/frequency, quantity, and mode; insomnia; quality of life; functioning; and recovery for patients with OUD and other SUDs.18,19,22–24 Also, the Steering Committee suggested the Treatment Effectiveness Assessment (TEA) replace the WHOQOL-BREF and the BARC.25 According to the developers of the TEA, the tool provides a brief (ie, four items), patient-centered, clinically useful, and internally reliable measure of treatment progress and outcome for patients with SUD.25 The TEA “directly assesses the patient’s personal perspectives on substance use, personal health, lifestyle, and responsibility to the community,” attesting to its patient-centeredness because it captures “common elements of recovery.”25 During the meeting, the APA’s Principal Investigator recommended the Steering Committee discuss the relationship between suicide and suicide attempts and addictions, including OUD and alcohol use disorder (AUD).26 Specifically, studies have found that AUD and OUD are two SUDs that are strongly associated with increased risk for suicide ideation, suicide attempt, and death by suicide.27 As such, the Steering Committee approved the inclusion of the Screen Version of the Columbia-Suicide Severity Rating Scale (C-SSRS).28 The final selected battery includes assessment tools that are applicable to all SUDs (eg, PhenX Injection Drug Use, BAM, TAPS Tool) and some that are specific to OUD (eg, SOWS and COWS). This combination of general SUD and OUD-specific tools were selected because OUD tends to co-occur with other SUDs, such as AUD. Although tools for the domains of overdose and prescription opioid misuse were identified and reviewed, they focused only on scales to assist prescribers of opioid analgesics and were, therefore, not included in the final battery for AMNet clinicians who are treating OUD, and other SUDs, and are not likely to be prescribing opioids for analgesia.
![]() |
Table 1 AMNet Assessment Tools |
Categorize Assessment Tools
To minimize burden, the Executive and Steering Committees limited the number of assessment tools recommended for use with all patients. The final list of assessment tools was categorized as either core/Tier 1 or optional/Tier 2. For Tier 1, the Committees wanted tools that directly assess and monitor SUD and corresponding treatment and would, therefore, be useful for all patients being treated for SUD. The Tier 2 tools assess relevant co-morbidities, outcomes associated with substance use (eg, impaired functioning), and a supplemental clinician-rated opioid withdrawal scale. These tools were considered optional for appropriate patients at the clinicians' discretion.
AMNet Quality of Care Performance Measures
Identify Domains of Interest for Quality of Care Performance Measures
The Executive Committee identified three domains of interest for selecting AMNet quality of care performance measures: initiation, adherence, and retention. These domains were selected because they are pertinent to OUD as well as AUD treatment across populations and treatment settings. A measure focused on the initiation of treatment was considered essential because pharmacotherapy is underutilized in non-OTP outpatient opioid treatment, especially in rural areas.29 Domains related to follow-up—adherence and retention—were selected because studies show continuity of care leads to better outcomes.30,31 Further, the Executive Committee considered AMNet clinicians would find quality measures in these domains aligned with their treatment practices and, therefore, be likely to use them to drive improvements in quality of care for OUD over time.
Search for Candidate Quality Measures
Following a process similar to that for the assessment tools, the subcommittee conducted a scoping review of quality measures for OUD treatment to implement in AMNet. The subcommittee searched PubMed and PsycINFO databases for records published through November 2019 using the terms “opioid” OR “opiate” and terms related to quality measure (quality measure OR performance measure OR quality indicator OR performance indicator). The subcommittee used the same terms to also search the online directories of the National Quality Forum, Agency for Healthcare Research and Quality, National Committee for Quality Assurance, and the Physician Consortium for Performance Improvement.32–35 Measures were included if they 1) focused on OUD, OUD treatment, or use of prescription opioids; and 2) contained detailed specifications (eg, precisely defined numerator and denominator). Using these parameters, the subcommittee located 25 candidate quality measures.
Initial Review of Candidate Quality Measures
The Executive Committee conducted an initial review of the 25 candidate quality measures to examine suitability for AMNet (Figure 2). Desirable characteristics of quality measures for AMNet included being: 1) extractable from electronic health records into PsychPRO; 2) in use in the field of addiction medicine; and 3) associated with favorable treatment outcomes. In consideration of each quality measure against these review criteria and to ensure coverage of the prioritized domains, the subcommittee selected 7 candidate measures for AMNet. Five of the measures were developed by the Center for Care Innovation (CCI), one measure by ASAM, and one measure by the Physician Consortium for Performance Improvement.36 The CCI measures evaluated treatment initiation, engagement, retention, and toxicological monitoring. These measures, along with ASAM’s Standard of Care measure quantifying the prescription of medication for OUD among patients with an OUD diagnosis, were selected by the Executive Committee as they are associated with positive patient outcomes and can be easily extracted from the medical record.37 The Physicians Consortium for Performance Improvement measure, pertaining to counseling on treatment types for those with OUD, takes into consideration both pharmacological and psychosocial treatment and was chosen by the Executive Committee due to its comprehensive assessment of treatment.38 Although not selected for recommendation to the Steering Committee due to their lack of generalizability to individuals with OUD, the Executive Committee took into consideration measures from Mathematica Policy Research (Medicaid beneficiaries receiving buprenorphine-alone or in combination with naloxone) and Pharmacy Quality Alliance (concurrent use of prescription opioids and benzodiazepines).39,40
![]() |
Figure 2 AMNet Quality Measure Selection Flowchart. Abbreviations: *OUD, opioid use disorder; **CCI, Center for Care Innovations. |
Final Review and Consensus-Based Selection of Quality Measures
The Executive Committee presented the Steering Committee with an overview of the 25 candidate quality measures (Step 2) and the rationale for the 7 selected by its subcommittee (Step 3). As with the selection of the AMNet assessments, a consensus-based approach was used by the Steering Committee to select the quality measures. The CCI Initiation, Engagement, and Retention measures were chosen because of their face validity and the ease with which they could be extracted from medical records. Specifically, the initiation and engagement measures were selected because patient monitoring is particularly important early in treatment when there is a high risk of drop-out. The retention measure was selected because of its association with positive patient outcomes. The Steering Committee also noted that the CCI Initiation and Engagement measures are an OUD-specific adaptation of the general Healthcare Effectiveness Data and Information Set (HEDIS) measures on initiation and engagement and, thus, would be suitable for inclusion in the AMNet battery.
Results
AMNet Standardized Assessment Tools
AMNet assessment tools were selected using a consensus-based process (Table 1). The Tier 1 measures include the Tobacco, Alcohol, Prescription Medications, and other Substances (TAPS) Tool, Brief Addiction Monitor (BAM), PhenX Cigarette Smoking Status, PhenX Injection Drug Use, Treatment Effectiveness Assessment (TEA), Short Opiate Withdrawal Scale (SOWS), single-item craving Visual Analog Scale (VAS), and the Patient Health Questionnaire (PHQ)-2+1. The Tier 2 measures include the Clinical Opiate Withdrawal Scale (COWS), PHQ-9, Columbia-Suicide and Severity Rating Scale (C-SSRS), and the PROMIS Pain Interference Instrument. The SOWS and COWS are the only AMNet assessment tools limited to patients with OUD. The VAS for craving, although predominately used for OUD, can also be used for other SUDs. These assessment tools, when used as a MBC framework, are useful for guiding clinical care and tracking and improving patient outcomes in a number of domains of interest to clinicians and patients alike. In addition, they provide a common set of standardized data that can be collected with routine clinical care in support of delivery of evidence-based treatment and quality measurement and improvement. In support of this MBC framework, a detailed resource guide was developed to help clinicians implement the practice, including suggested timing of baseline or initial and follow-up assessments.
AMNet Quality Measures
The consensus-based process resulted in the selection of three quality of care performance process measures that met the review criteria of being extractable from electronic health records, currently in use in addiction medicine practice settings, and associated with desired treatment outcomes. These quality of care performance measures were developed by the CCI and align with the prioritized domains of initiation, engagement, and retention in treatment:
- Percent of patients with one follow-up visit within 14 days of starting OUD pharmacotherapy [CCI Initiation];
- Percent of patients with two follow-up visits within 30 days of the date of the initial prescription for OUD pharmacotherapy [CCI Engagement];
- Percent of patients prescribed OUD pharmacotherapy six months prior who have adhered to this medication continuously for six consecutive months. Continuous adherence will be measured by identifying patients who have attended practice visits and continued with medication refills for six months without interruption [CCI Retention].
Discussion
The US opioid epidemic and public health consequences of SUD underscore the need to improve the outcomes of patients in SUD treatment. SUD treatment, including OUD treatment, is routinely provided in outpatient practices outside of the specialty treatment system. Yet, little is known about the outcomes of patients treated in such practices. The Addiction Medicine Practice-based Research Network (AMNet) was created to address this issue by improving the implementation of MBC via standardized patient-reported assessment tools and quality measures while also serving as a research platform to examine effective treatments and implementation.
A key step in the development of AMNet was the selection of standardized assessment tools and quality measures for incorporation into the APA’s qualified clinical data registry, PsychPRO. A stakeholder group comprising researchers, clinicians, federal advisors, and a consumer representative followed a multi-step, consensus-based process to select the assessment tools and quality measures, with a focus on those most relevant to patients with OUD. The process resulted in the selection of 12 assessment tools and 3 quality measures. The selected assessment tools cover numerous domains pertinent to patients with SUD, such as substance consumption, withdrawal, insomnia, craving, pain, depressive symptoms, suicidal ideation and behavior, and recovery. The selected quality measures are companion measures for treatment initiation, engagement, and retention. By offering an array of assessment tools and quality measures and incorporating them into PsychPRO, AMNet will facilitate participating clinicians' systematic uptake of MBC and delivery of evidence-based treatment for patients with SUD.
MBC can be clinically useful to patients and clinicians by improving the quality of care and patient outcomes.8,41,42 MBC can help patients report, understand, and track their progress over time by validly quantifying symptoms and other domains of interest. In turn, MBC can help clinicians meaningfully track individual patient progress while facilitating comparison to group averages or norms. Clinicians can also use MBC in conjunction with information obtained in clinical interviews to recognize and assess treatment needs, inform clinical decision-making, and explore factors associated with change or progress. Further, at the population or practice level, MBC can improve the programmatic efficiency of care by adjusting the course, frequency, or duration of encounters according to group need and anticipated benefit.43
Specifically, MBC can be used to personalize and adapt OUD treatment to increase patient engagement, retention, and outcome.6 For example, administering the BAM, which covers important substance use-related behaviors, could be used at the beginning of treatment to determine the severity of a patient’s problem and at subsequent time points to chart patient status over time.22 Further, the craving symptom can be an important and actionable item for MBC as distressing craving experiences may trigger relapse and persist long into recovery. Using an assessment tool to assess and track craving over time can prompt a discussion that could help build therapeutic alliance, increase change motivation and interest to engage with treatment.6
Quality of care performance process measures, on the other hand, provide a means to aggregate and review data to assess the delivery of healthcare and are especially useful when processes can be linked to improved outcomes. Initiation, as well as engagement and retention in evidence-based treatment interventions, are important to reduce OUD and other SUD. However, only 18.1% of individuals with OUD and 7.6% of those with AUD receive evidence-based treatment each year, and even fewer are retained in treatment.4,44,45 AMNet aims to address this gap by incorporating quality measures for each of these domains. Specifically, PsychPRO’s quality dashboard has been adapted for AMNet by including the CCI quality measures for initiation, engagement, and retention in OUD treatment. This is an important step for augmenting MBC in non-OTP outpatient practices because quality of care performance measures play a crucial role in guiding quality improvement efforts for the delivery of effective care and, subsequently, for improving patient outcomes.20 Therefore, access to CCI quality of care performance measures, which can also be adapted to include patients with AUD, in the PsychPRO dashboard will allow AMNet clinicians to use their performance information for quality improvement and to guide care over time.37 Underscoring the benefits of including the CCI quality measures in AMNet are its potential links to improved patient outcomes. Medication initiation represents a benchmark in the recovery process for patients. Once medication is initiated, it is important to keep the patient engaged in treatment to monitor their experience and make modifications if necessary, such as titrating up or down or addressing any side effects.46 Engagement and retention in treatment are necessary to achieve optimal patient outcomes, including decreased involvement with the criminal justice system, improved employment outcomes, and lower substance use.38 Regarding OUD, retention on medication for OUD, particularly methadone and buprenorphine, is associated with decreased mortality both from overdose and all-cause mortality, with the risk of overdose increasing significantly after discontinuation of medication.47
The development of other networks has also demonstrated the need for careful selection of assessments to identify common standardized data to address important clinical questions for improvement of patient outcomes. This function for AMNet is expected in the future, through its use of the APA’s PsychPRO Registry to leverage patient data from routine care or the implementation of MBC. For example, NIDA’s Clinical Trials Network, which was established in 1999 to expedite the translation of evidence-based substance use treatment into community-based practice, focused on selecting assessments that are useful to researchers and feasible to implement in busy practice settings. The network recognized the need for a common assessment battery to standardize data collection and formed a committee of researchers and clinicians to select assessments for this battery.48 The process for selecting tools and measures for AMNet reflects the importance the field places on the involvement of multiple stakeholder groups in developing network projects and on measure standardization and its implications for research and, ultimately, clinical practice.
Given challenges to implementing MBC in practice (eg, time restrictions, material resource limitations, patient complexity), AMNet has planned feasibility testing of the selected tools and measures. The feasibility testing will entail the collection of quantitative and qualitative data from pilot test sites to explore data capture, clinical utility, workflow impact, and the potential burden on clincians and patients. These data will be used to increase uptake of the tools and measures by AMNet’s participating clincians while minimizing disruption to workflows and burden.
Limitations
The current review has several limitations. First, we are uncertain whether the use of a systematic review methodology, as opposed to a scoping review with Steering Committee consensus decisions, would have produced different results in terms of the assessment tools and quality of care performance measures identified and included in AMNet. Although it is possible that additional tools or measures could have been located with a systematic review covering more databases, our approach was informed by an a priori protocol with a wide search strategy and decision-making steps to increase reliability. Another limitation is that selected assessment tools must have been freely available or in the public domain to avoid copyright issues, or could be obtained from the developers for use in AMNet at no cost. This selection criterion eliminated a number of assessment tools that are clinically useful, reliable and valid. Lastly, we selected English-language only articles and there may have been relevant articles not published in English.
Conclusion
Quality registries have not been harnessed previously to collect data in non-OTP outpatient treatment settings regarding OUD patients’ characteristics, treatments, outcomes, and quality care, or data used to examine comparative effectiveness of treatment modalities, other patient-centered outcomes research, or implementation studies. AMNet as a novel research network embedded within the infrastructure of a quality registry will provide a centralized repository including common data elements collected from patients and clinicians in non-OTP outpatient addiction medicine treatment practices. AMNet will serve as a network for enhancing the quality of care and for innovative opioid treatment research that ultimately underpins improved patient outcomes. AMNet can be envisioned as a “Quality Improvement community” that could, in the future, be funded to innovate measurement-based care and develop quality outcome measures in addiction medicine to benchmark and improve population outcomes.
Ethics Approval and Informed Consent
The AMNet protocol was reviewed and approved by the APA’s Institutional Review Board (IRB). Because clincians' particpation in AMNet is a quality improvement activity and based on the revised common rule,64 the IRB determined that patients' informed consent was not needed.
Funding
This project was made possible by grant number 3U01DA046910-02S2 from the National Institute on Drug Abuse at the National Institutes of Health, with funding from the Office of the Secretary Patient Centered Outcomes Research Trust Fund (Interagency Agreement Number 750120PE080047). Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health or the US Department of Health and Human Services.
Disclosure
Dr. Clarke serves on the Mental Health Landscape Project Advisory Panel for RAND Corporation: a project funded by Otsuka Pharmaceuticals that is not related to the present paper. Dr. Clarke reports grants, non-financial support from National Institute on Drug Abuse (NIDA), Agency for Healthcare Research and Quality, and Health and Human Services Center for Medicare and Medicaid Services (CMS) during the conduct of the study. Dr. Schwartz reports providing consultation to Verily Life Sciences, grants from NIDA, during the conduct of the study. He is PI of a NIDA-funded study that is receiving free medication from Indivior and Alkermes. Dr. Vocci reports receiving free medication from Alkermes and Braeburn Pharma for clinical studies. Dr. Vocci has also received meals from Braeburn Pharma. Dr. Vocci has consulted with and received meals and travel reimbursements from Lyndra Pharmaceuticals and Takeda Pharmaceuticals and a group of generic buprenorphine manufacturers. Dr. Vocci also received meals and travel reimbursement from Intratab Labs. Ms Ibrahim reports non-financial grant support from NIDA during the conduct of the study. Dr. Doty reports non-financial grant support from NIDA and CMS during the conduct of the study. Ms Patel reports non-financial grant support from NIDA during the conduct of the study. Ms Thompson reports non-financial grant support from NIDA and CMS during the conduct of the study.
References
1. Lyden J, Binswanger IA. The United States opioid epidemic. Semin Perinatol. 2019;43(3):123–131. doi:10.1053/j.semperi.2019.01.001
2. Sordo L, Barrio G, Bravo MJ, et al. Mortality risk during and after opioid substitution treatment: systematic review and meta-analysis of cohort studies. BMJ. 2017;357:j1550. doi:10.1136/bmj.j1550
3. Cicero TJ, Ellis MS, Kasper ZA. Polysubstance use: a broader understanding of substance use during the opioid crisis. Am J Public Health. 2020;110(2):244–250. doi:10.2105/AJPH.2019.305412
4. Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: results from the 2019 National Survey on Drug Use and Health (HHS Publication No. PEP20-07-01-001, NSDUH series H-55). Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services; 2020. Administration. Available from: https://www.samhsa.gov/data/.
5. Lewis CC, Boyd M, Puspitasari A, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiatry. 2019;76(3):324–335. doi:10.1001/jamapsychiatry.2018.3329
6. Marsden J, Tai B, Ali R, Hu L, Rush AJ, Volkow N. Measurement-based care using DSM-5 for opioid use disorder: can we make opioid medication treatment more effective? Addiction. 2019;114(8):1346–1353. doi:10.1111/add.14546
7. Scott K, Lewis CC. Using measurement-based care to enhance any treatment. Cogn Behav Pract. 2015;22(1):49–59. doi:10.1016/j.cbpra.2014.01.010
8. Fortney JC, Unützer J, Wrenn G, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–188. doi:10.1176/appi.ps.201500439
9. Shatterproof National Principles of Care. Shatterproof website; 2020. Available from: https://www.shatterproof.org/shatterproof-national-principles-care.
10. NIDA. Principles of effective treatment. National Institute on Drug Abuse website; 2020. Available from: https://www.drugabuse.gov/publications/principles-drug-addiction-treatment-research-based-guide-third-edition/principles-effective-treatment.
11. Simon KM, Harris SK, Shrier LA, Bukstein OG. Measurement-based care in the treatment of adolescents with substance use disorders. Child Adolesc Psychiatr Clin N Am. 2020;29(4):675–690. doi:10.1016/j.chc.2020.06.006
12. Goodman JD, McKay JR, DePhilippis D. Progress monitoring in mental health and addiction treatment: a means of improving care. Prof Psychol Res Pr. 2013;44(4):231–246. doi:10.1037/a0032605
13. Stewart RE, Lareef I, Hadley TR, Mandell DS. Can we pay for performance in behavioral health care? Psychiatr Serv. 2017;68(2):109–111. doi:10.1176/appi.ps.201600475
14. O’Grady MA, Lincourt P, Gilmer E, et al. How are substance use disorder treatment programs adjusting to value-based payment? A statewide qualitative study. Subst Abuse. 2020;14:1178221820924026. doi:10.1177/1178221820924026
15. Schwartz RP, Gibson D, Pagano A, et al. An addiction medicine practice-based research network (AMNet): building partnerships. Psychiatr Serv. 2020.
16. American Psychiatric Association. PsychPRO: APA’s mental health registry website; 2020. Available from: https://www.psychiatry.org/psychiatrists/registry.
17. US Food and Drug Administration. Opioid use disorder: endpoints for demonstrating effectiveness of drugs for medication-assisted treatment guidance for industry. U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER); 2020. Available from: https://www.fda.gov/media/114948/download.
18. PROMIS. Healthmeasures website; 2020. Available from: http://www.healthmeasures.net/explore-measurement-systems/promis.
19. PhenX website. PhenX consensus measures for phenotypes and exposures; 2020. Available from: https://www.phenx.org/.
20. Ghitza UE, Gore-Langton RE, Lindblad R, Tai B. NIDA clinical trials network common data elements initiative: advancing big-data addictive-disorders research. Front Psychiatry. 2015;6:33. doi:10.3389/fpsyt.2015.00033
21. NIDA CTN Common Data Elements. National institute on drug abuse website; 2020. Available from: https://cde.drugabuse.gov/.
22. Cacciola JS, Alterman AI, Dephilippis D, et al. Development and initial evaluation of the Brief Addiction Monitor (BAM). J Subst Abuse Treat. 2013;44(3):256–263. doi:10.1016/j.jsat.2012.07.013
23. Group W; Whoqol Group. Development of the WHOQOL: rationale and current status. Int J Ment Health. 1994;23(3):24–56. doi:10.1080/00207411.1994.11449286
24. Vilsaint CL, Kelly JF, Bergman BG, Groshkova T, Best D, White W. Development and validation of a Brief Assessment of Recovery Capital (BARC-10) for alcohol and drug use disorder. Drug Alcohol Depend. 2017;177:71–76. doi:10.1016/j.drugalcdep.2017.03.022
25. Ling W, Nadipelli VR, Solem CT, et al. Measuring recovery in opioid use disorder: clinical utility and psychometric properties of the treatment effectiveness assessment. Subst Abuse Rehabil. 2019;10:13–21. doi:10.2147/SAR.S198361
26. Dragisic T, Dickov A, Dickov V, Mijatovic V. Drug addiction as risk for suicide attempts. Mater Sociomed. 2015;27(3):188–191. doi:10.5455/msm.2015.27.188-191
27. Rizk MM, Herzog S, Dugad S, et al. Suicide risk and addiction: the impact of alcohol and opioid use disorders. Curr Addict Rep. 2021. doi:10.1007/s40429-021-00361-z
28. Posner K, Brown GK, Stanley B, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168(12):1266–1277. doi:10.1176/appi.ajp.2011.10111704
29. Andrilla CHA, Moore TE, Patterson DG, Larson EH. Geographic distribution of providers with a DEA waiver to prescribe buprenorphine for the treatment of opioid use disorder: a 5-year update. J Rural Health. 2019;35(1):108–112. doi:10.1111/jrh.12307
30. Timko C, Schultz NR, Cucciare MA, Vittorio L, Garrison-Diehn C. Retention in medication-assisted treatment for opiate dependence: a systematic review. J Addict Dis. 2016;35(1):22–35. doi:10.1080/10550887.2016.1100960
31. Sullivan MA, Bisaga A, Pavlicova M, et al. A randomized trial comparing extended-release injectable suspension and oral naltrexone, both combined with behavioral therapy, for the treatment of opioid use disorder. Am J Psychiatry. 2019;176(2):129–137. doi:10.1176/appi.ajp.2018.17070732
32. National Quality Forum website; 2019. Available from: https://www.qualityforum.org/about_nqf/.
33. Agency for Healthcare Research and Quality website; 2020. Available from: https://www.ahrq.gov/.
34. National Committee for Quality Assurance website; 2020. Available from: https://www.ncqa.org/.
35. Agency for Healthcare Research and Quality. Major Physician Measurement Sets.Updated September 2019. Available from: https://www.ahrq.gov/talkingquality/measures/setting/physician/measurement-sets.html. Accessed June 2, 2021.
36. Center for Care Innovations website; 2020. Available from: https://www.careinnovations.org/.
37. Harris AH, Weisner CM, Chalk M, Capoccia V, Chen C, Thomas CP. Specifying and pilot testing quality measures for the American Society of Addiction Medicine’s standards of care. J Addict Med. 2016;10(3):148–155. doi:10.1097/ADM.0000000000000203
38. Williams AR, Nunes EV, Bisaga A, et al. Developing an opioid use disorder treatment cascade: a review of quality measures [published correction appears in J Subst Abuse Treat. 2018 Sep;92:99]. J Subst Abuse Treat. 2018;91:57–68. doi:10.1016/j.jsat.2018.06.001
39. Mathematica Policy Research website; 2020. Available from: https://www.mathematica.org/.
40. Pharmacy Quality Alliance website; 2020. Available from: https://www.pqaalliance.org/opioid-measure-endorsed.
41. Pincus HA, Scholle SH, Spaeth-Rublee B, Hepner KA, Brown J. Quality measures for mental health and substance use: gaps, opportunities, and challenges. Health Aff (Millwood). 2016;35(6):1000–1008. doi:10.1377/hlthaff.2016.0027
42. Wray LO, Ritchie MJ, Oslin DW, Beehler GP. Enhancing implementation of measurement-based mental health care in primary care: a mixed-methods randomized effectiveness evaluation of implementation facilitation. BMC Health Serv Res. 2018;18(1):753. doi:10.1186/s12913-018-3493-z
43. Hsin H, Fromer M, Peterson B, et al. Transforming psychiatry into data-driven medicine with digital measurement tools. NPJ Digital Med. 2018;1(1):1–4. doi:10.1038/s41746-018-0046-0
44. Chan B, Gean E, Arkhipova-Jenkins I, et al. Retention strategies for medications for opioid use disorder in adults: a rapid evidence review [published online ahead of print, 2020 Sep 17]. J Addict Med. 2020. doi:10.1097/ADM.0000000000000739
45. Graff FS, Morgan TJ, Epstein EE, et al. Engagement and retention in outpatient alcoholism treatment for women. Am J Addict. 2009;18(4):277–288. doi:10.1080/10550490902925540
46. Cantone RE, Garvey B, O’Neill A, et al. Predictors of medication-assisted treatment initiation for opioid use disorder in an interdisciplinary primary care model. J Am Board Fam Med. 2019;32(5):724–731. doi:10.3122/jabfm.2019.05.190012
47. Winhusen T, Walley A, Fanucchi LC, et al. The Opioid-overdose Reduction Continuum of Care Approach (ORCCA): evidence-based practices in the HEALing communities study. Drug Alcohol Depend. 2020;217:108325. doi:10.1016/j.drugalcdep.2020.108325
48. Rosa C, Ghitza U, Tai B. Selection and utilization of assessment instruments in substance abuse treatment trials: the National Drug Abuse Treatment Clinical Trials Network experience. Subst Abuse Rehabil. 2012;3(1):81–89. doi:10.2147/SAR.S31836
49. McNeely J, Wu LT, Subramaniam G, et al. Performance of the tobacco, alcohol, prescription medication, and other substance use (TAPS) tool for substance use screening in primary care patients. Ann Intern Med. 2016;165(10):690–699. doi:10.7326/M16-0317
50. PhenX Toolkit website. Protocol-cigarette smoking status-adult; 2020. Available from: https://www.phenxtoolkit.org/protocols/view/30604.
51. PhenX Toolkit website. Protocol-injection drug use; 2020. Available from: https://www.phenxtoolkit.org/protocols/view/161101.
52. Gossop M. The development of a Short Opiate Withdrawal Scale (SOWS). Addict Behav. 1990;15(5):487–490. doi:10.1016/0306-4603(90)90036-w
53. Vernon MK, Reinders S, Mannix S, Gullo K, Gorodetzky CW, Clinch T. Psychometric evaluation of the 10-item Short Opiate Withdrawal Scale-Gossop (SOWS-Gossop) in patients undergoing opioid detoxification. Addict Behav. 2016;60:109–116. doi:10.1016/j.addbeh.2016.03.028
54. Kleykamp BA, De Santis M, Dworkin RH, et al. Craving and opioid use disorder: a scoping review. Drug Alcohol Depend. 2019;205:107639. doi:10.1016/j.drugalcdep.2019.107639
55. Arroll B, Goodyear-Smith F, Crengle S, et al. Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. Ann Fam Med. 2010;8(4):348–353. doi:10.1370/afm.1139
56. Wesson DR, Ling W. The Clinical Opiate Withdrawal Scale (COWS). J Psychoactive Drugs. 2003;35(2):253–259. doi:10.1080/02791072.2003.10400007
57. Tompkins DA, Bigelow GE, Harrison JA, Johnson RE, Fudala PJ, Strain EC. Concurrent validation of the Clinical Opiate Withdrawal Scale (COWS) and single-item indices against the Clinical Institute Narcotic Assessment (CINA) opioid withdrawal instrument. Drug Alcohol Depend. 2009;105(1–2):154–159. doi:10.1016/j.drugalcdep.2009.07.001
58. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–613. doi:10.1046/j.1525-1497.2001.016009606.x
59. Amtmann D, Cook KF, Jensen MP, et al. Development of a PROMIS item bank to measure pain interference. Pain. 2010;150(1):173–182. doi:10.1016/j.pain.2010.04.025
60. Hadlandsmyth K, Dindo LN, St Marie BJ, et al. Patient-Reported Outcomes Measurement Information System (PROMIS) instruments: reliability and validity in veterans following orthopedic surgery. Eval Health Prof. 2020;43(4):207–212. doi:10.1177/0163278719856406
61. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research [published correction appears in J Chiropr Med. 2017 Dec;16(4):346]. J Chiropr Med. 2016;15(2):155–163. doi:10.1016/j.jcm.2016.02.012
62. Statistics How to Website. Cronbach’s alpha: simple definition, use and interpretation; 2021. Available from: https://www.statisticshowto.com/wpcontent/uploads/2014/12/CA2.png.
63. Statistics How to Website. Correlation coefficient: simple definition, formula, easy steps; 2021. Available from: https://www.statisticshowto.com/probability-and-statistics/correlation-coefficient-formula/#:~:text=Pearson’s%20Correlation%20Coefficient%20is%20a,is%20also%20called%20zero%20correlation.
64. Department of Health and Human Services et al. Federal Policy for the Protection of Human Subjects. Final rule.Federal register the Daily Journal of the United States Government 2021;82(12):7149–7274. Available from: https://www.federalregister.gov/documents/2017/01/19/2017-01058/federal-policy-for-the-protection-of-human-subjects.
© 2021 The Author(s). This work is published and licensed by Dove Medical Press Limited. The
full terms of this license are available at https://www.dovepress.com/terms.php
and incorporate the Creative Commons Attribution
- Non Commercial (unported, v3.0) License.
By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted
without any further permission from Dove Medical Press Limited, provided the work is properly
attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.