1Division of Research, Kaiser Permanente Northern California, Oakland
2Oakland Medical Center, Kaiser Permanente Northern California, Oakland
Question Can the use of medical scribes decrease electronic health record documentation burden, improve productivity and patient communication, and enhance job satisfaction among primary care physicians?
Findings In this crossover study of 18 primary care physicians, use of scribes was associated with significant reductions in electronic health record documentation time and significant improvements in productivity and job satisfaction.
Meaning Use of medical scribes to reduce the increasing electronic health record documentation burden faced by primary care physicians could potentially reduce physician burnout.
Importance Widespread adoption of electronic health records (EHRs) in medical care has resulted in increased physician documentation workload and decreased interaction with patients. Despite the increasing use of medical scribes for EHR documentation assistance, few methodologically rigorous studies have examined the use of medical scribes in primary care.
Objective To evaluate the association of use of medical scribes with primary care physician (PCP) workflow and patient experience.
Design, Setting, and Participants This 12-month crossover study with 2 sequences and 4 periods was conducted from July 1, 2016, to June 30, 2017, in 2 medical center facilities within an integrated health care system and included 18 of 24 eligible PCPs.
Interventions The PCPs were randomly assigned to start the first 3-month period with or without scribes and then alternated exposure status every 3 months for 1 year, thereby serving as their own controls. The PCPs completed a 6-question survey at the end of each study period. Patients of participating PCPs were surveyed after scribed clinic visits.
Main Outcomes and Measures PCP-reported perceptions of documentation burden and visit interactions, objective measures of time spent on EHR activity and required for closing encounters, and patient-reported perceptions of visit quality.
Results Of the 18 participating PCPs, 10 were women, 12 were internal medicine physicians, and 6 were family practice physicians. The PCPs graduated from medical school a mean (SD) of 13.7 (6.5) years before the study start date. Compared with nonscribed periods, scribed periods were associated with less self-reported after-hours EHR documentation (<1 hour daily during week: adjusted odds ratio [aOR], 18.0 [95% CI, 4.7-69.0]; <1 hour daily during weekend: aOR, 8.7; 95% CI, 2.7-28.7). Scribed periods were also associated with higher likelihood of PCP-reported spending more than 75% of the visit interacting with the patient (aOR, 295.0; 95% CI, 19.7 to >900) and less than 25% of the visit on a computer (aOR, 31.5; 95% CI, 7.3-136.4). Encounter documentation was more likely to be completed by the end of the next business day during scribed periods (aOR, 2.8; 95% CI, 1.2-7.1). A total of 450 of 735 patients (61.2%) reported that scribes had a positive bearing on their visits; only 2.4% reported a negative bearing.
Conclusions and Relevance Medical scribes were associated with decreased physician EHR documentation burden, improved work efficiency, and improved visit interactions. Our results support the use of medical scribes as one strategy for improving physician workflow and visit quality in primary care.
Physician burnout induced by work-related stress leads to emotional exhaustion, depersonalization, and a diminished sense of personal accomplishment.11,12 One in every 2 physicians experience symptoms of burnout, with primary care physicians (PCPs) experiencing the highest rates.12 Between 2011 and 2014, burnout prevalence among physicians increased from 46% to 54%.13 A major contributor to physician burnout is the burden of EHR-created documentation.8,14 For every hour of direct patient care, physicians spend nearly 2 additional hours on unpaid EHR and desk work.15 Among PCPs, introduction of additional EHR features has been associated with even higher rates of burnout, stress, and desire to leave practice.14
Use of medical scribes, paraprofessionals who transcribe clinical visit information into the EHRs in real time under physician supervision, has been proposed as one strategy to alleviate documentation burden and improve physician efficiency. Recent estimates indicate that there are approximately 20 000 scribes currently working with physicians, with the number expected to reach 100 000 by 2020.16,17 However, despite the rapid increase in the number of scribes, evidence of their association with PCP job satisfaction and productivity is lacking, especially among PCPs at the frontline of care. Existing small-scale studies18–21 suggest that scribes may improve physician productivity, professional satisfaction, and patient-physician interaction. However, methodologic limitations of these initial studies underscore the need for a more rigorous approach to assess the use of scribes in primary care.18,21–23 Using a 12-month multiple crossover design, we tested the hypothesis that medical scribe use in primary care would reduce physician documentation burden and improve clinical workflow, physician work satisfaction, and patient-physician visit interactions.
We conducted this study from July 1, 2016, to June 30, 2017, in 2 medical center facilities in Kaiser Permanente Northern California (KPNC). KPNC is an integrated health care delivery system that provides comprehensive care to 4.2 million patients in Northern California. The demographic and socioeconomic composition of patients in the KPNC system is representative of the area population except at the extremes of income distribution.24 This quality improvement study was reviewed and approved by the Kaiser Permanente Research Determination Board and deemed exempt from review by the Kaiser Permanente Institutional Review Board. Informed consent was not required; patient data were collected without identifiers other than the patient’s PCP name.
Of the 24 eligible PCPs at the 2 practices, 18 (75%) agreed to participate. The 6 PCPs who declined cited reluctance to train a scribe in the particulars of their workflow, concern about having to review scribed notes, and unwillingness to have a third person in the examination room with them. None of the eligible PCPs had any prior experience working with scribes. Before the study, the PCPs completed EHR documentation independently, simultaneously while evaluating patients, at the end of the day, or after clinic hours and on weekends. Scribes were trained by and contracted through an independent scribe company. Scribes logged into the EHR using their own log-in credentials and documented clinical visit notes in real time. The PCPs assessed the notes for accuracy before signing them.
We used a dual-balanced crossover design with 4 periods, 2 sequences, and 2 treatments. We assume that the carryover effect from each period is negligible. Each period lasted 3 months. The PCPs were randomly assigned to begin the first period with a scribe (treatment A) or without a scribe (treatment B). The use of a scribe was then alternated in each subsequent period for 1 year, thus creating ABAB or BABA treatment sequences. By contrasting the same PCP in different treatment periods, this study design allowed PCPs to serve as their own matched controls, thereby reducing the potential influence of between-PCP variance.
The PCPs completed a 4-question survey at baseline and a 6-question survey (eTable 1 in the Supplement) near the end of each of the 4 study periods. Surveys assessed the association of scribe use with the aspects of physician work that have previously been reported as worsened by EHRs: clerical burden, quality of patient-physician interaction, and job satisfaction. Clerical work that extended into personal time (nonclinic hours on weekdays and on weekends) was assessed using a 4-level ordinal scale (<1, 1 to <2, 2 to <3, and >3 hours daily). Physician perception of time spent on EHRs and on direct patient interaction during a clinical visit was measured using a 4-level ordinal scale (<25%, 25 to <50%, 50 to <75%, and >75% of visit). Physician perception of the association of scribe use with the quality of patient interactions and work satisfaction was measured using a 5-point Likert-scale, with 1 indicating much worse and 5 indicating much better. The PCPs also completed a poststudy survey to assess their satisfaction with scribe-written notes and the additional number of patients that they would be willing to accept if they received scribe assistance.
Near the end of each scribed period, a week was allocated for collecting anonymous patient satisfaction surveys that asked patients (eTable 2 in the Supplement) to compare their usual clinical visits with their PCP with the just-completed scribed visit with their PCP. Patient perception of the time spent by PCPs on direct interaction and on the computer was assessed using a 3-point Likert scale, with 1 indicating less time than usual, 2 indicating no difference, and 3 indicating more time than usual. Patient’s comparative satisfaction with the quality of visit was measured using a 5-point Likert scale, with 1 indicating much worse and 5 indicating much better.
Physician survey collection periods were designed to overlap with KPNC’s quarterly quality reporting periods. These administrative quality reports, created using EHR data, were the source of the physician’s clinical workflow data and included user activity measured using time-stamped event logs. These event log data were used to calculate the proportion of a physician’s clinic unit (1 unit = 240 minutes) spent on EHR activity: the mean number of minutes each physician spent on in-person visits and on EHR documentation during and after clinic hours. Similarly, event logs generated from office, telephone, and virtual encounters were used to calculate the time that physicians required to close encounters. KPNC PCPs are prescribed a target of closing 95% of these encounters by the end of next business day. We used achievement of target (yes/no) as a measure of the PCP’s clinical workflow efficiency.
We used χ2 and independent 2-tailed, paired t tests to assess the significance of frequency and continuous variable differences between the scribe and nonscribe groups. We applied multilevel logistic (PROC GLIMMIX, SAS, version 9.3) and multilevel linear (PROC MIXED, SAS, version 9.3) regression models (SAS Institute Inc) to assess each outcome by treating the period and treatment effects as fixed effects and the subject effect (PCP) as the random effect. The random-effects model was chosen to account for possible heterogeneity across PCPs. The PCP responses were dichotomized to account for skewness in distribution. Responses were dichotomized to less than 1 vs 1 hour or more for documentation, less than 25% vs 25% or more for time spent on the EHR during the office visit, and less than 75% vs 75% or more for interaction.
Of the 18 participating PCPs, 10 were women. Twelve PCPs were internal medicine and 6 were family practice physicians. The PCPs graduated from medical school a mean (SD) of 13.7 (6.5) years before the study start date. At baseline, 11 PCPs (61%) reported spending 1 to 2 hours daily during the week and 1 to 3 hours daily on the weekends outside scheduled clinic time on EHR documentation. Only 5 (28%) reported spending more than 75% of a typical return visit on patient interaction and less than 25% of the visit on EHR documentation.
The PCPs completed 65 of 72 surveys (90% response rate) during the study period. The PCPs reported significant improvements across all outcome measures during scribe intervention periods. Compared with nonscribed periods, scribed periods were associated with decreased off-hour EHR documentation work (69% vs 17% of PCPs reported <1 hour daily on weekdays; adjusted odds ratio [aOR], 18.0 [95% CI, 4.7-69.0], P < .001; 77% vs 40% reported <1 hour daily on weekends; aOR, 8.7 [95% CI, 2.7-28.7], P < .001). Scribed periods were also associated with greater patient interaction during visits (85% vs 13% spending >75% of visit interacting with patient; aOR, 295.0; 95% CI, 19.7 to >900; P < .001) and correspondingly less time during the visit documenting in the EHR (77% vs 20% spending <25% of time on EHR; aOR, 31.5; 95% CI, 7.3-136.4; P < .001). Seventeen PCPs (94%) reported greater job satisfaction, and 16 (89%) reported improved clinical interactions when assisted by scribes. The Figure presents the PCP survey results by scribe status.
Physician scheduling templates with number of available appointments per clinical session appointment schedules were not changed during the study period. As expected, scribes produced no mean (SD) change in the length of clinic visit (20.6 [3.9] vs 21.4 [4.7] minutes, P = .42). Compared with nonscribed periods, the PCPs were significantly more likely to meet their prescribed target for timely completion of their visit documentation during the scribed periods (61.7% vs 50.9% without scribe; aOR, 2.9; 95% CI, 1.2-7.1; P = .02). Scribed periods were also associated with a 77-minute decrease in the time that the PCPs spent on clinical documentation per clinic unit (32% of a clinic unit); however, the decrease approximated but did not reach statistical significance (mean, −77.2 minutes; 95% CI, −172.7 to 18.3 minutes; P = .11). The PCPs also had modestly improved patient-reported satisfaction scores (69.4% above medical center mean with scribe vs 63.9% without scribe) that did not reach statistical significance (aOR, 1.6; 95% CI, 0.4-5.4; P = .48). Compared with the nonscribed periods, measured time spent logged into the EHR system during off hours decreased by 17 minutes per week on each EHR; however, this reduction was not statistically significant (mean, −17.1 minutes; 95% CI, −50.2 to 16.1 minutes; P = .62). The proportion of each PCP’s clinic unit spent on EHR activity decreased in the scribed periods by 8% but did not reach statistical significance (101.3% vs 110.4% in the scribed vs nonscribed periods; 95% CI, 25.5-9.5; P = .36).
Surveys were received from 735 patients of the participating PCPs (37 patients per PCP; range, 9-77 patients) during scribed periods. A total of 428 patients (57.0%) reported that their PCP spent less time than usual on the computer during scribed visits, 281 (37.2%) reported no difference, and only 47 (6.2%) reported more computer use than usual. A total of 375 patients (49.8%) reported that their PCP spent more time than usual speaking with them during the scribed periods. A total of 460 patients (61.2%) reported that scribes had a positive consequence and 274 (36.4%) reported they had no consequence on the office visit, with only 18 (2.4%) reporting a negative consequence.
After completion of the study, 17 PCPs completed a brief survey about their scribe experience. All PCPs worked with at least 3 different scribes during the study, with 7 PCPs (39%) working with 4 or more. Fifteen of the 17 PCPs (88%) indicated satisfaction with the quality of scribe EHR documentation. Eleven of the 17 PCPs (65%) indicated that they would be willing to accept additional patients into their panel (100-200 additional patients by 8 PCPs and >200 additional patients by 3 PCPs) in exchange for a full-time scribe. Of the PCPs who would not be willing to expand their patient panel sizes in exchange for a scribe, 4 of 6 had an existing panel size that exceeded the practice limit.
Burnout is an increasing problem in US medicine and is particularly intense among PCPs. The burden of EHR documentation has been posited as one of the leading contributors to this problem. In this crossover study, we evaluated the association between use of scribes for EHR documentation assistance and PCP perception of documentation burden, visit quality, and job satisfaction. Our study also leveraged extensive quantitative EHR clinical workflow data to complement PCP- and patient-reported outcomes. We found that scribe assistance resulted in significant reduction in PCP-reported EHR documentation burden outside visits and significant increase in time spent on face-to-face patient interaction during visits. These self-reported results were corroborated by objective improvement in measured time to completion of encounter documentation. Other quantitative measures (eg, time spent logged into the EHR) favored scribe use but did not reach statistical significance. Overall, most PCPs and patients consistently indicated that scribes had a positive association with their clinical visit.
Physician-perceived meaningful communication with patients is central to physician job satisfaction25; however, there is increasing evidence that EHR documentation burden is interfering with physician-patient interaction time.15 A study8 of physicians in 4 US states found that physicians spend 27% of office time on direct patient interaction and more than 49% of office time on EHRs and deskwork. Despite conceptually recognizing the benefits of EHRs, many physicians struggle to use currently implemented EHR systems, which they report has worsened their professional satisfaction and quality of patient care.8 Physicians also report that administrative tasks required by EHRs could be performed more efficiently by clerks and transcriptionists.8 Our study found that perceived patient interaction time in office visits increased significantly in the scribed periods. This result provides evidence that delegating EHR documentation to scribes may reduce EHR distraction, securing PCPs more time for patient interaction.
During periods of scribe assistance, the PCPs reported significant reductions in their EHR documentation burden during off hours, suggesting that scribes may also improve a physician’s work-life balance. These results are consistent with a prior report18 of increased patient facetime, improved clinical visit quality, and enhanced physician work satisfaction with scribe assistance. Concordant with our finding, a study26 of 5 urologists found that scribes reduced EHR documentation burden and improved satisfaction with clinic hours. Similarly, a small (4 PCPs) study18 in an academic family medicine practice reported that scribes produced significant improvements in patient facetime and clinic satisfaction and significant reductions in perceived documentation time.
Our study found that use of scribes was associated with improved physician productivity, which was measured by the likelihood of closing at least 95% of office, telephone, and virtual encounters by the targeted time. This result suggests that by removing documentation burden from PCPs, scribes created more time for PCPs to complete their EHR work. Consistent with our results, the study of 4 PCPs mentioned above also reported improved odds of completing EHR work within 48 hours in association with scribe assistance.18 Our findings also confirm a prior report27 of high patient satisfaction in scribed visits. A study27 of scribes with 12 dermatologists in an academic dermatology practice reported positive patient-perceived association of scribe use with visit experience, for which patients expressed a high degree of scribe approval.
Of note, the self-reported results showing the benefit of scribes were of a greater relative magnitude compared with the objectively measured data. This finding may reflect PCP enthusiasm that exceeds the reality of scribe benefit. Alternatively, PCP self-report may be accurate but reflective of the best week rather than the full overall experience. All PCPs having 3 or more different scribes during their two 3-month scribe periods indicates that there was likely some variation in the experience from week to week as PCPs learned to work with new and different scribes.
Our results must be considered in the context of the study design. First, although we have undertaken the largest crossover study, to our knowledge, assessing the association between scribe use and PCP job satisfaction to date, we recognize that our PCP sample size remains relatively small. However, crossover studies are uniquely able to reduce the subject-level variability that requires larger sample sizes in traditional, parallel randomized clinical studies.28 Second, revenue analysis was beyond the scope of our study, although the willingness of many of the participating PCPs to modestly increase their panel size in return for a scribe suggests the possibility of cost savings. Investigation of scribe use in fee-for-service or pay-for-performance health care delivery systems is warranted to measure the association between scribe use and revenue. Third, although most patients surveyed (>94%) had favorable views of scribes, qualitative analysis of patient perspectives is needed to evaluate the potential of drawbacks of using scribes. Prior research has established that primary care patients are reluctant to discuss sensitive topics, such as sexually transmitted diseases, mental health, and domestic violence, with physicians, which may be an impediment to delivering adequate care.29 Future research is needed to assess how scribes may affect such patient disclosures, particularly among vulnerable populations. Qualitative analysis is also needed to evaluate the quality of scribe documentation and coding accuracy. Fourth, surveyed patients were asked to recall their usual PCP visits with the scribed visits, which could have subjected patient response to a recall bias. However, we found that KPNC patients had a mean of 2 visits with a PCP in the study period, suggesting that a patient’s last visit likely occurred within the same year. Fifth, PCPs in the study might have been more amenable to scribe implementation than their counterparts who declined participation. However, analysis comparing physician characteristics, such as age, specialty, sex, years of employment, and years since graduation, revealed no significant differences between the 2 groups.
One of the drivers of increasing interest in medical scribes is the current crisis in primary care. The current PCP shortage is expected to increase to 20 400 by 2020 and up to 43 100 by 2030, with fewer graduates entering the field and more leaving because of physician burnout.30–33 Addressing physician burnout is critical to control the impending PCP shortage crisis. Although physician burnout is a multifaceted and complex issue, there is increasing evidence associating EHR adoption with increasing burnout rates.8,9,12,34 Our results suggest that the use of scribes may be one strategy to mitigate the increasing EHR documentation burden among PCPs, who are at the highest risk of burnout among physicians. Although scribes do not obviate the need for improving suboptimal EHR designs, they may help alleviate some of the inefficiencies of currently implemented EHRs.
Article link: https://jamanetwork.com/journals/jamainternalmedicine/fullarticle/2701617
Accepted for Publication: June 23, 2018.
Corresponding Author: Pranita Mishra, MPP, Division of Research, Kaiser Permanente Northern California, 2000 Broadway, Oakland, CA 94612 (firstname.lastname@example.org).
Published Online: September 17, 2018. doi:10.1001/jamainternmed.2018.3956
Author Contributions: Ms Mishra and Dr Kiang had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Kiang, Grant.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Mishra, Grant.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Mishra, Kiang.
Obtained funding: Kiang.
Administrative, technical, or material support: Kiang, Grant.
Conflict of Interest Disclosures: None reported.
Additional Contributions: David Velek, MD, Pinole Medical Center, Kaiser Permanente, Pinole, California, inspired this project. Jay Yadegar, MD, Saralinda Jackson, Linda Carnes, RN, Christine Hartlove, Kara Durand, MD, and Aida Sadikovic, MD, Oakland Medical Center, Kaiser Permanente, Oakland, California, and Maya Shaw, MD, Pinole Medical Center, Kaiser Permanente, Pinole, California, provided leadership and support. We thank the physicians, medical assistants, and patients from our 2 primary care practices for their participation in this project. These individuals were not compensated for their work.