This paper is in the followinge-collection/theme issue:

Personal Health Records, Patient-Accessible Electronic Health Records, Patient Portals (437)

Published oninVol 21, No 4(2019):April

Preprints (earlier versions) of this paper are available athttps://preprints.www.mybigtv.com/preprint/12779, first published.
Patient Portals Facilitating Engagement With Inpatient Electronic Medical Records: A Systematic Review

Patient Portals Facilitating Engagement With Inpatient Electronic Medical Records: A Systematic Review

Patient Portals Facilitating Engagement With Inpatient Electronic Medical Records: A Systematic Review

Authors of this article:

Ronald Dendere1 Author Orcid Image; Christine Slade2 Author Orcid Image; Andrew Burton-Jones3 Author Orcid Image; Clair Sullivan1, 4 Author Orcid Image; Andrew Staib5, 6 Author Orcid Image; Monika Janda1 Author Orcid Image
Article Authors Cited by (105) Tweetations (21) Metrics

    Review

    1Centre for Health Services Research, Faculty of Medicine, The University of Queensland, Woolloongabba, Australia

    2Institute for Teaching and Learning Innovation, The University of Queensland, Brisbane, Australia

    3School of Business, Faculty of Business, Economics and Law, The University of Queensland, Brisbane, Australia

    4Metro North Hospital and Health Service, Department of Health, Queensland Government, Brisbane, Australia

    5Metro South Hospital and Health Service, Department of Health, Queensland Government, Brisbane, Australia

    6University of Queensland School of Medicine, Brisbane, Australia

    *all authors contributed equally

    Corresponding Author:

    Monika Janda, PhD

    Centre for Health Services Research

    Faculty of Medicine

    The University of Queensland

    Level 2, Building 33, Princess Alexandra Hospital

    Woolloongabba,

    Australia

    Phone: 61 7 3176 4569

    Fax:61 7 3365 1488

    Email:m.janda@uq.edu.au


    Background:Engaging patients in the delivery of health care has the potential to improve health outcomes and patient satisfaction. Patient portals may enhance patient engagement by enabling patients to access their electronic medical records (EMRs) and facilitating secure patient-provider communication.

    Objective:本研究的目的是审查文学describing patient portals tethered to an EMR in inpatient settings, their role in patient engagement, and their impact on health care delivery in order to identify factors and best practices for successful implementation of this technology and areas that require further research.

    Methods:A systematic search for articles in the PubMed, CINAHL, and Embase databases was conducted using keywords associated with patient engagement, electronic health records, and patient portals and their respective subject headings in each database. Articles for inclusion were evaluated for quality using A Measurement Tool to Assess Systematic Reviews (AMSTAR) for systematic review articles and the Quality Assessment Tool for Studies with Diverse Designs for empirical studies. Included studies were categorized by their focus on input factors (eg, portal design), process factors (eg, portal use), and output factors (eg, benefits) and by the valence of their findings regarding patient portals (ie, positive, negative, or mixed).

    Results:因为我的系统搜索确定58文章nclusion. The inputs category was addressed by 40 articles, while the processes and outputs categories were addressed by 36 and 46 articles, respectively: 47 articles addressed multiple themes across the three categories, and 11 addressed only a single theme. Nineteen articles had high- to very high-quality, 21 had medium quality, and 18 had low- to very low-quality. Findings in the inputs category showed wide-ranging portal designs; patients’ privacy concerns and lack of encouragement from providers were among portal adoption barriers while information access and patient-provider communication were among facilitators. Several methods were used to train portal users with varying success. In the processes category, sociodemographic characteristics and medical conditions of patients were predictors of portal use; some patients wanted unlimited access to their EMRs, personalized health education, and nonclinical information; and patients were keen to use portals for communicating with their health care teams. In the outputs category, some but not all studies found patient portals improved patient engagement; patients perceived some portal functions as inadequate but others as useful; patients and staff thought portals may improve patient care but could cause anxiety in some patients; and portals improved patient safety, adherence to medications, and patient-provider communication but had no impact on objective health outcomes.

    Conclusions:While the evidence is currently immature, patient portals have demonstrated benefit by enabling the discovery of medical errors, improving adherence to medications, and providing patient-provider communication, etc. High-quality studies are needed to fully understand, improve, and evaluate their impact.

    J Med Internet Res 2019;21(4):e12779

    doi:10.2196/12779

    Keywords

    patient portal; electronic medical record; electronic health record; patient engagement; digital hospital


    The increasing adoption of electronic medical records (EMRs) by hospitals presents an opportunity for patients to access their clinical data and actively participate in their care via the EMR. Hospitals and other health care organizations can facilitate patient access to their EMR information through patient portals. Patient portals can provide secure, online access to personal health information [1)等药物列表、实验室结果、immunizations, allergies, and discharge information [2]. They can also enable patient-provider communication using secure messaging, appointments and payment management, and prescription refill requests [2,3].

    The increase in patient portal implementation is, in part, due to some preliminary evidence that they may improve patient engagement [4] and health outcomes such as medication adherence [5-10]. Government incentive programs and regulations also influenced some health care organizations to implement patient portals [11,12]. For example, in the United States, implementing patient portals was a way to meet the requirements for Meaningful Use, Stage 2, of the Healthcare Information Technology for Economic and Clinical Health Act [13].

    Promoting patient involvement in health care delivery may lead to improved quality and safety of care [14,15] by enabling patients to spot and report errors in EMRs, for example [6]. Some patients recognize the role of patient portals in their health care, reporting satisfaction with the ability to communicate with their health care teams and perform tasks such as requesting prescription refills conveniently [3,16]. Portal use may reduce in-person visits, visits to emergency departments, and patient-provider telephone conversations [3,8-10,12,16]. Despite the potential of portals, already used in the ambulatory setting for some time, implementation in the inpatient setting has only recently gathered momentum [17-19]. The inpatient setting presents additional challenges for implementing patient portals [18,20]. Clinical conditions leading to hospitalization are often acute and the amount of medical information generated during this time can be extensive, which may overwhelm patients [20] and challenge information technology to rapidly display this information.

    本研究的目的是审查文学describing patient portals tethered to an EMR in inpatient settings, their role in patient engagement, and their impact on health care delivery in order to identify factors and best practices for successful implementation of this technology and areas that require further research. Our review aims to inform researchers, health care organizations, and policymakers.


    Search Strategy

    The PubMed, CINAHL, and Embase databases were searched for articles published between 2005 and 2017 using keywords related to patient engagement, electronic health records, patient portals, and their associated subject headings in each database: the full search terms for each database are provided inMultimedia Appendix 1.

    Study Selection and Quality Assessment

    Figure 1shows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram for the systematic search and selection process. Inclusion criteria for articles were (1) written in English, (2) hospital inpatient setting, and (3) patient portals tethered to a hospital EMR. The initial combined database search produced 703 articles, and an additional 16 were identified by scanning their reference lists. After eliminating duplicates, the article abstracts were independently reviewed by three authors to identify articles that did not meet the inclusion criteria. This led to 617 articles being excluded. Full-text screening was conducted for the remaining 102 articles, leading to the identification of 62 articles that did not meet the inclusion criteria. At each stage, the authors met to reconcile, by consensus, any disagreements about article inclusion. An independent coder also coded the 102 articles for inclusion/exclusion using our criteria, and interrater agreement was high (Cohen kappa=.75). In cases of disagreement, we opted to include the article if it addressed a potentially important policy issue (eg, privacy issues, rural/urban divide). To ensure we included as many up-to-date papers as possible, we periodically conducted database searches for new articles after the initial search. This step was performed by just one author because by this stage, the authors had established a well-developed understanding of the inclusion/exclusion criteria. This periodic update, up to August 2018, identified another 18 articles for inclusion.

    The included articles were assessed for quality. Two authors independently scored each article’s quality using the most recent version of A Measurement Tool to Assess Systematic Reviews (AMSTAR 2) [21] for review articles and the Quality Assessment Tool for Studies with Diverse Designs (QATSDD) [22] for qualitative, quantitative, and mixed empirical studies. We classified the overall AMSTAR 2– or QATSDD-derived score for each paper on a 5-point scale (very low, low, medium, high, very high), thus establishing the qualities of all articles on one scale. The ratings by the authors and the independent coder were highly correlated (r=.81). A third coauthor then independently reviewed and reconciled the scores. We assigned valence ratings to each article to characterize the overall findings in each article regarding patient portals as positive, negative, or mixed [23].

    Data Analysis

    我们分析了从公司提取的信息luded articles by categorizing the themes related to the implementation of patient portals into inputs, processes, and outputs. The inputs are the material (eg, hardware and software) and nonmaterial (eg, leadership) components that facilitate or impair the establishment or use of the portal. Processes include the interactions of the users with the portal. Outputs comprise the results of the implementation or the use of the portal. Through the analysis, we identified 14 themes within these three categories, shown inTextbox 1.

    ‎
    Figure 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart of the search and selection process.
    View this figure
    Description of the themes identified in the implementation of inpatient portals.
    • Input themes
      • Portal design: umbrella term for all design-related aspects of the portal including portal interface, content, features, and functions
      • Usability: extent to which a patient portal has the property of being able to be used by patients, caregivers, and health care teams to enhance patient engagement with effectiveness, efficiency, and satisfaction
      • Barriers: factors that hinder widespread adoption or portal use
      • Facilitators: factors that motivate or enable users to sign up for or actively use a portal
      • User training: equipping patients and health care team members with the necessary skills and knowledge to effectively use a portal
      • Organizational factors: culture of a health care organization; decisions and actions it takes when an initial consideration is made to implement a patient portal
    • Process themes
      • Adoption: from a patient perspective, adoption is the registration for a portal account; from a health care provider perspective, portal adoption refers to acceptance and promotion of the portal [16]
      • Use: active engagement and continued use after signing up for a portal [4]
      • Information: all aspects associated with providing patients with clinical and nonclinical information via a portal
      • Communication: all aspects associated with portal-based patient-provider communication
    • Output themes
      • Patient engagement: active involvement of patients in their own health care
      • User perceptions: thoughts, feelings, and opinions of patients, caregivers, and health care team members about their experiences with a patient portal
      • Health outcomes: impact of patient portals on clinical indicators
      • Benefits: value provided by patient portals to the health care delivery process
    Textbox 1. Description of the themes identified in the implementation of inpatient portals.

    Overview: Search Strategy, Study Selection, and Quality Assessment

    Details of the 58 articles included in this review are given inMultimedia Appendices 2and3. The majority of the articles (41) are indexed in all three databases; 13 articles are indexed in two databases, and only 4 are in indexed in a single database. The PubMed and Embase databases each index 56 articles while CINAHL indexes 41 articles. Nineteen articles described qualitative studies, 18 quantitative studies, and 9 mixed method studies, while 12 were reviews. Our quality assessment placed 19 articles in the high- or very high–quality categories, 21 in the medium category, and 18 in the low- or very low–quality categories. Twenty-nine articles were assigned mixed valence, 16 articles were assigned positive valence, and 2 were assigned negative valence. Valence was not applicable or could not be drawn in 11 articles (ie, those that examined portals but that were not focused on evaluating them in any way).

    There was a spread of articles addressing themes over the inputs, processes and outputs categories (seeMultimedia Appendix 3). However, only one-third of the articles (19/58) addressed the full spectrum of categories.

    Textbox 2shows that there was corroboration among studies for some findings (eg, information) but contradicting findings in some themes (eg, health outcomes). We did not observe trends in the findings that were related to study quality or design (ie, there was no association between study quality or study design and reported findings).

    Summary of findings in the reviewed literature.
    • Inputs
      • Portal design
        • Portals were designed using an iterative approach [6,16,24]
        • Integrated infobuttons linked users with reliable sources of medical information [19,25-27]
        • Artificial intelligence was used to enhance portal designs [28]
        • Portals can be designed for specific diseases or medical conditions [29]
        • Patients requested electronic games within portals [18,30] and functionality to control caregivers’ access to their electronic medical records (EMRs) and receive notifications when their EMRs had been viewed by a caregiver [31]
      • Usability
        • Some participants had difficulties using patient portals mainly because of complex portal interfaces [19,24,32-34]
        • Some patients found patient portals easy to use [17,30,35-37]
      • Barriers
        • Lack of appropriate training [33]
        • Doubt of the portal’s usefulness [38]
        • Lost passwords [38,39]
        • Difficulties in using portals [16,33,34]
        • Anxiety associated with viewing personal medical information [38]
        • Data security and privacy concerns [34,40]
        • Lack of encouragement from providers [3,40]
      • Facilitators
      • User training
        • Patients were trained using videos and reading material [24,33]
        • Health care teams were trained using verbal instructions and hands-on sessions [5,30,44,45]
      • Organizational factors
        • Rural hospitals were more likely to report costs and obtaining staff cooperation as barriers to health information technology (HIT; including patient portals) adoption than urban hospitals [46]
        • Small hospitals were more likely to report cost-related barriers than large hospitals [46]
        • Leaderships had crucial roles in the implementation of patient portals, working closely with developers in system design, developing policies to guide user training, and integrating portals into clinical workflows [33]
        • Implementation of patient portals varied across organizations due to different interpretations of government legislations by the health care organizations [47]
    • Processes
      • Adoption
        • Portal use was higher among white patients than other racial groups, younger patients than older patients, female patients than male patients, and high-income than low-income patients [4,6,33,48]
      • Use
        • Portal use was higher among patients with greater disease severity [4]
        • Patients were less inclined to use a portal when they were seriously ill, in intense pain,or soon after undergoing multiple tests or procedures [24]
      • Information
        • Patients wanted timely and comprehensive access to their medical information [6,18,24,26,30]
        • Some patients preferred to have access to their entire EMR, including doctors’ notes [24,41]
        • Patients wanted personalized information tailored to their conditions and needs [6,24,35,49]
        • Patients requested clinical unit maps, meal menus [30], and short biographies of their health care team members [19,24]
      • Communication
        • Patients and caregivers expressed interest in using portals to communicate with health care staff [6,24,30,36] but not many actually used this feature [30,44]
        • Patients used portal messaging to request information, communicate needs and concerns, contribute to care coordination, offer feedback [26], compliment health care staff, and express gratitude [30,45]
        • Some patients wanted an option to send messages to specific staff members and an indication of whether a message had been read and when to expect a response [33]
        • Ethnicity, age, and gender were associated with portal-based communication [7,16,33,48]
    • Outputs
      • Patient engagement
        • Some portals did not significantly improve patient engagement [17,50] but others did [6,41,43,51,52]
        • Patients in some studies reported that portals enabled better engagement in their own care [19,24,30]
      • User perceptions
        • Some patients felt that portals did not adequately fulfill their information needs [6,24,29,42]
        • Patients associated unrestricted access to their EMRs with empowerment and a sense of control [24,36,42,53]
        • Some patients and health care staff had concerns that unrestricted access to sensitive information may cause anxiety and more questions for health care staff [24,41,49]
        • Health care teams had preimplementation concerns about disruptions to workflows and potential for large volumes of patient messages, but such concerns did not materialize [45]
        • Patients and staff thought that the messaging feature of patient portals was important for patient care [17,24,26,30]
        • Patients who used a disease-specific portal were more satisfied than those who used a generic portal [29]
        • Patients and health care staff agreed that patient portals helped to improve patient care [5,30,44]
      • Health outcomes
        • Significant association between portal use and health outcomes was not observed in some studies [2,4,20] but was observed in others [54]
        • Patient portals facilitated discovery of EMR errors by patients [24,26,30,54-56]
      • Benefits
        • Improved adherence to medication [3,9,39,43,52,57]
        • Improved patient satisfaction [3,29,30,39,45]
        • Enhanced patient-provider communication [6,30,40,43,52]
        • Improved patient safety [6,26,52,55]
        • Reduced patient uncertainty and anxiety [3,24,36]
        • Increased patient engagement [6,19,24,30,41,43,45,51,52]
    Textbox 2. Summary of findings in the reviewed literature.

    Patient Portal Inputs

    Forty articles addressed themes in the inputs category. We identified 22 articles that addressed portal design. In an iterative design approach, feedback from patients, including requests for electronic games and other functions, was used to refine designs. Enhancements included links to medical education, artificial intelligence techniques, and disease-specific design.

    As shown inTextbox 2, poor portal designs caused usability difficulties for some patients. Those difficulties were among the barriers to portal use.Textbox 2also shows that more barriers to portal use than facilitators were identified in the reviewed literature. Various methods were used to train patients and staff to use the portals. However, training methods were not optimal [5,33,44]. For example, in one study, patient training was delivered via an 11-minute video that was not well received, with less than a third (26.3%) watching the entire video [33]. In another study among health care staff, doctors had the lowest confidence in a patient portal, and they doubted their training was sufficient to allow them to effectively use it [5].

    Organizational factors (leadership, staff support, and key decisions, etc) was the least addressed theme. However, the findings summarized inTextbox 2indicate that organizational factors are likely the most crucial in determining whether or how patient portals are implemented.

    Patient Portal Processes

    Thirty-six articles addressed themes categorized as processes. Five articles addressed portal adoption while use was addressed in 18 articles (seeMultimedia Appendix 3). Sociodemographic characteristics of patients such as race, age, gender, level of education, and social status were predictors of both portal adoption and use [4,6,33,48]. In addition to sociodemographic factors, there was higher portal use among patients with greater disease severity (eg, advanced cancer) [4], but at any given time, patient condition influenced portal use as described inTextbox 2.

    Seventeen articles addressed information and 20 addressed communication. The articles suggested that patients wanted unlimited access to their EMRs, medical education in layman’s terms [24,41], and nonclinical information [19,24,30].

    Patient-provider communication, usually in the form of secure messages, is a key feature of inpatient portals [26]. Despite expressions of interest in this feature, actual use was low [30,44]; in a pediatric study with 296 parents participating, only about 6% sent messages to health care teams via the inpatient portal [30]. Most portals enabled patients to send messages to a single mailbox that was accessed by staff members on duty, but some patients wanted to communicate with specific staff members [33]. Similar to adoption and use, sociodemographic factors were predictors of which patients used the messaging feature (seeTextbox 2).

    Patient Portal Outputs

    The outputs category was addressed by 46 articles, and 24 articles addressed patient engagement. Results of patient engagement were mixed: portals in some studies did not cause statistically significant improvement, but patients in other studies reported that portals enabled better engagement in their care.

    User perceptions was the most commonly addressed theme across all categories (35 articles), andTextbox 2显示用户感知到门的一些功能ls (eg, access to information) as inadequate but perceived other functions (eg, communication) as very useful. Despite dissatisfaction and concerns with some aspects of the portals, users’ perceptions of the patient portal concept as a whole were mostly positive. For example, in one study, 90% of participants reported overall satisfaction with the portal, 89% thought that the portal reduced errors, and 94% agreed that the portal improved care delivery [30]. In another study, 84% of participants described a patient portal as useful and 90% reported that they would recommend it to their peers [32]. Health care staff appreciated the reasons for implementing patient portals and their own roles and responsibilities in the process, but they stated that they would like to receive sufficient training [5].

    Twenty articles addressed the association between patient portals and health outcomes, such as medical errors, readmissions, and mortality. Results were mixed as some studies did not show positive associations between portal use and health outcomes [2,4,20]. For example, a retrospective study of cancer patients found no association between portal adoption or use and adverse events [4] and another retrospective study found no association between portal use and 30-day readmission or inpatient mortality [20]. However, in a third study, active portal use significantly improved glycated hemoglobin levels [54]. Importantly, patient portals in several studies facilitated discovery of EMR errors by patients, particularly medication errors [24,26,30,54-56].

    Finally, 7 articles addressed the benefits of patient portals, andTextbox 2shows that portals offers a wide range of benefits for patient care.


    Principal Findings

    This systematic review examined 58 articles studying inpatient portals. Although there was overlap in the themes reflected in these studies, there was also significant variation in the setting, patient population, software, outcomes assessed, and study methodology, making it hard to come to a definitive conclusion on whether inpatient portals are beneficial. This is further shown by the higher number of included studies that were judged to relay mixed valence than those with positive valence. However, more studies relayed positive than negative valence, showing that patient portals may be beneficial for health care. We discuss below the patient portal input, process and output factors that contribute to this assessment, and the areas of research that need focus in order to improve patient care.Figure 2provides a visual summary.

    ‎
    Figure 2. Conceptual framework summarizing the findings and key areas for future research.
    View this figure

    Patient Portal Inputs

    When assessing common themes within the inputs category, portal design, usability, and barriers were more widely covered than user training and organizational factors. Many articles showed that good portal design is crucial for usability and adoption by patients. While most studies involved users in the design process, more needs to be done to overcome design-related barriers, particularly for people with low health literacy [6,19,24]. Increasing the use of enabling technology such as voice-commanded digital assistants, artificial intelligence, and natural language processing could make the systems cater to a wider range of audiences. Designing platforms so that they can be displayed on users’ personal mobile devices could be another enabler of portal adoption.

    Patients’ concerns regarding privacy and security of their medical information [34,40] are particularly relevant in cases where caregivers need access to patients’ EMRs. Discussion of privacy issues in cases of caregiver access to patient medical information in the literature is limited. In the absence of formal policy for caregiver access, patients may opt to disclose personal log-in details to their caregivers, which is not recommended [26].

    The results of user training showed that reliance on a one-size-fits-all approach may not be effective for educating users because of varying preferences. Training could be enhanced by providing information that directly addresses common patient concerns (eg, information security) and health care staff concerns (eg, workflow changes).

    Information on the best timing to deliver training material to patients is lacking in the literature. While staff training can be scheduled ahead of deploying a patient portal, patients may only encounter a portal upon hospitalization. Furthermore, the severity of their condition may limit their ability to focus on or understand the training material. Innovation may be needed to inform patients about portal services prior to hospitalization. For example, patients could sign up for outpatient portals which would be similar in design to the inpatient portals to ensure seamless transition between the two portals. Hospitals could also collaborate with medical insurance providers to make training material available to potential patients already signing up for hospital insurance.

    Patient Portal Processes

    Associations between patient sociodemographic characteristics and portal use [4,6,33,48] indicate that patients who are most vulnerable (eg, those with low health literacy or seriously ill) would be least likely to benefit from patient portals. Recruitment and participation bias when engaging participants in user testing mean that actual use by patients may not reflect the use in the initial testing phases. Therefore, health care organizations may need to conduct multiple studies to iteratively address factors that influence portal use within the communities they serve.

    The varying preference among patients for level of access to EMRs [6,18,24,26,30] and staff concerns with unlimited patient access to sensitive information (information that could cause anxiety for patients) [24,41,49] present challenges for health care organizations. Health care organizations could fulfill these diverse information needs by flagging sensitive information and warning patients that despite having access to the information, they can opt to receive it in person from a health care team member. Some hospitals already have guidelines for releasing sensitive information to outpatient portals [26], and those guidelines could be adapted to the inpatient setting.

    Health care organizations may view patient requests of nonclinical information and functions such as electronic games [18,19,24,30] as fringe requests that could raise developmental costs. However, granting these requests may improve portal adoption and use and overall patient satisfaction. Also, patients have requested background information on their health care staff, but staff perceptions about the disclosure of such information to their patients is not known [19,24]. Further research is needed to uncover staff perceptions in this regard and explore ways of implementing this service.

    Portal-based patient-provider communication is potentially beneficial but may also be disruptive [26]. Although staff concerns about potential interruptions caused by constant patient messaging did not materialize [45),在实践中,员工可能会不知所措y messages at any time. Structured messaging may be a solution that ensures patients communicate only important and relevant information [26]. If health care organizations decide to enforce structured messaging, they should prioritize patient safety and therefore avoid restrictions that could prevent patients reporting genuine concerns.

    Patient Portal Outputs

    The literature explored some, but not all, potential outputs of patient portal implementations. Most of the studies assessed implementation of patient portals using interim outcomes such as user perceptions, and few studies addressed important objective outcomes such as length of stay, morbidity, or mortality [2,4,20,54].

    Some studies showed no association between portal use and health outcomes such as readmission, adverse events, or mortality [2,4,20]. However, a number of those studies drew their conclusions from retrospective analysis of portal adoption and use data only [4,20]—adoption and frequency of use alone do not provide sufficient information about effective portal use, which may affect outcomes.

    增加病人接触病人的目标portals, but the engagement of health care staff is also important since they are likely to be approached by the patients with portal-related queries [5,44]. Nurses and doctors should have sufficient knowledge to answer basic questions or appropriately escalate complex questions (eg, to information technology support). Also, nurses may be required to respond to patient-generated messages within the portal. Similarly, doctors’ perceptions of portals are also important, as they may use a portal to communicate with patients [5),因此需要自信的函数tions. Theories in health care information technology suggest that user perceptions can predict the acceptance and use of new technologies [58-60]. Therefore, it is essential for hospitals to ensure positive staff attitudes toward patient portals through effective staff training and technical support and incorporating staff needs in portal design and workflows.

    Several studies reported that patient portals facilitate patient discovery of errors in EMRs [24,26,30,54-56]. Discussion in the literature of how patients could notify health care providers of such errors is lacking. Further research is needed to establish how patient-discovered errors are reported and to identify optimal reporting methods.

    Research in the evaluation of patient portals is also currently limited. Standardized evaluation frameworks and measures are needed to enable better comparisons of patient portal implementation and outcomes in the future.

    Limitations

    While an extensive search was undertaken, the majority of the included studies were conducted at single locations, used outcome measures that were not comparable to those used in other studies, and had small sample sizes. That means results of those studies may not be generalizable to other population groups. Also, a number of the studies were conducted in controlled settings, such as closed-door observations and interviews, which would not be representative of hospital settings. The absence of standardized evaluation tools means the results could not be compared or synthesized, and we were thus limited to providing a descriptive summary of findings only. Most studies that addressed user perceptions or patient-reported results depended on the opinions of those who completed end-of-study questionnaires or interviews; such results could be biased as they may lack feedback from participants who felt uneasy about giving negative feedback. Finally, our conceptual framework enabled us to group the findings gleaned from the included articles, although there was some overlap in the categories caused by interdependence in some of the themes.

    Conclusion

    The review results suggest that the available evidence for inpatient portals is currently immature. Standardized outcomes assessment and more high-quality studies with objective outcomes (length of stay, mortality, and morbidity) are required to fully understand the impact of such portals.

    Acknowledgments

    This study benefited from the support of the Australian Research Council (ARC FT130100942), the National Health and Medical Research Council Translating Research into Practice Fellowship (APP 1151021), and the University of Queensland.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Search terms for the PubMed, CINAHL, and Embase databases.

    PDF File (Adobe PDF File), 24KB
    ‎

    Multimedia Appendix 2

    Detailed summary of each article selected for inclusion in the review.

    PDF File (Adobe PDF File), 122KB
    ‎

    Multimedia Appendix 3

    Themes addressed by each article.

    PDF File (Adobe PDF File), 107KB
    1. Office of the National Coordinator for Health Information Technology. 2017. What is a patient portal? URL:https://www.healthit.gov/faq/what-patient-portal[accessed 2019-03-12] [WebCite Cache]
    2. Griffin A, Skinner A, Thornhill J, Weinberger M. Patient portals: Who uses them? What features do they use? And do they reduce hospital readmissions? Appl Clin Inform 2016;7(2):489-501. [CrossRef] [Medline]
    3. Kruse CS, Bolton K, Freriks G. The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review. J Med Internet Res 2015;17(2):e44 [FREE Full text] [CrossRef] [Medline]
    4. Aljabri D, Dumitrascu A, Burton MC, White L, Khan M, Xirasagar S, et al. Patient portal adoption and use by hospitalized cancer patients: a retrospective study of its impact on adverse events, utilization, and patient satisfaction. BMC Med Inform Decis Mak 2018 Jul 27;18(1):70 [FREE Full text] [CrossRef] [Medline]
    5. Hefner JL, Sieck CJ, Walker DM, Huerta TR, McAlearney AS. System-wide inpatient portal implementation: survey of health care team perceptions. JMIR Med Inform 2017 Sep 14;5(3):e31 [FREE Full text] [CrossRef] [Medline]
    6. Kelly MM, Coller RJ, Hoonakker PL. Inpatient portals for hospitalized patients and caregivers: a systematic review. J Hosp Med 2018 Dec 01;13(6):405-412. [CrossRef] [Medline]
    7. Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. What do we know about developing patient portals? A systematic literature review. J Am Med Inform Assoc 2016 Apr;23(e1):e162-e168 [FREE Full text] [CrossRef] [Medline]
    8. Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. How outcomes are achieved through patient portals: a realist review. J Am Med Inform Assoc 2014 Jul;21(4):751-757. [CrossRef] [Medline]
    9. Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res 2012;14(6):325-327 [FREE Full text] [CrossRef] [Medline]
    10. Goldzweig CL, Orshansky G, Paige NM, Towfigh AA, Haggstrom DA, Miake-Lye I, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med 2013 Nov 19;159(10):677-687. [CrossRef] [Medline]
    11. Reed P, Conrad DA, Hernandez SE, Watts C, Marcus-Smith M. Innovation in patient-centered care: lessons from a qualitative study of innovative health care organizations in Washington State. BMC Fam Pract 2012 Dec 14;13:120 [FREE Full text] [CrossRef] [Medline]
    12. Australian Commission on Safety and Quality in Healthcare. 2018. Impact of digital health on the safety and quality of health care URL:https://tinyurl.com/y9puca9o[accessed 2018-10-19] [WebCite Cache]
    13. National Learning Consortium. 2013. How to optimize patient portals for patient engagement and meet meaningful use requirement URL:https://www.healthit.gov/sites/default/files/nlc_how_to_optimizepatientportals_for_patientengagement.pdf[accessed 2019-03-12] [WebCite Cache]
    14. Little P, Everitt H, Williamson I, Warner G, Moore M, Gould C, et al. Observational study of effect of patient centredness and positive approach on outcomes of general practice consultations. BMJ 2001 Oct 20;323(7318):908-911 [FREE Full text] [Medline]
    15. Stewart M, Brown JB, Donner A, McWhinney IR, Oates J, Weston WW, et al. The impact of patient-centered care on outcomes. J Fam Pract 2000 Sep;49(9):796-804. [Medline]
    16. Irizarry T, DeVito DA, Curran CR. Patient portals and patient engagement: a state of the science review. J Med Internet Res 2015;17(6):e148 [FREE Full text] [CrossRef] [Medline]
    17. O'Leary KJ, Lohman ME, Culver E, Killarney A, Randy SG, Liebovitz DM. The effect of tablet computers with a mobile patient portal application on hospitalized patients' knowledge and activation. J Am Med Inform Assoc 2016 Jan;23(1):159-165. [CrossRef] [Medline]
    18. Prey JE, Woollen J, Wilcox L, Sackeim AD, Hripcsak G, Bakken S, et al. Patient engagement in the inpatient setting: a systematic review. J Am Med Inform Assoc 2014;21(4):742-750 [FREE Full text] [CrossRef] [Medline]
    19. Vawdrey DK, Wilcox LG, Collins SA, Bakken S, Feiner S, Boyer A, et al. A tablet computer application for patients to participate in their hospital care. AMIA Annu Symp Proc 2011;2011:1428-1435 [FREE Full text] [Medline]
    20. Dumitrascu AG, Burton MC, Dawson NL, Thomas CS, Nordan LM, Greig HE, et al. Patient portal use and hospital outcomes. J Am Med Inform Assoc 2018 Apr 01;25(4):447-453. [CrossRef] [Medline]
    21. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017 Dec 21;358:j4008 [FREE Full text] [CrossRef] [Medline]
    22. Sirriyeh R, Lawton R, Gardner P, Armitage G. Reviewing studies with diverse designs: the development and evaluation of a new tool. J Eval Clin Pract 2012 Aug;18(4):746-752. [CrossRef] [Medline]
    23. de Matos CA, Rossi CAV. Word-of-mouth communications in marketing: a meta-analytic review of the antecedents and moderators. J Acad Mark Sci 2008 Sep 23;36(4):578-596. [CrossRef]
    24. Woollen J, Prey J, Wilcox L, Sackeim A, Restaino S, Raza ST, et al. Patient experiences using an inpatient personal health record. Appl Clin Inform 2016;7(2):446-460 [FREE Full text] [CrossRef] [Medline]
    25. Borbolla D, Del Fiol G, Taliercio V, Otero C, Campos F, Martinez M, et al. Integrating personalized health information from MedlinePlus in a patient portal. Stud Health Technol Inform 2014;205:348-352. [Medline]
    26. Grossman LV, Choi SW, Collins S, Dykes PC, O'Leary KJ, Rizer M, et al. Implementation of acute care patient portals: recommendations on utility and use from six early adopters. J Am Med Inform Assoc 2018 Apr 01;25(4):370-379. [CrossRef] [Medline]
    27. Lister Hill National Center for Biomedical Communications, NLM. 2016. Infobuttons URL:https://lhncbc.nlm.nih.gov/project/infobuttons[accessed 2018-10-19] [WebCite Cache]
    28. 阿诺CW,麦克纳马拉M, El-Saden年代,陈年代,Taira RK, Bui AAT. Imaging informatics for consumer health: towards a radiology patient portal. J Am Med Inform Assoc 2013;20(6):1028-1036 [FREE Full text] [CrossRef] [Medline]
    29. Lee J, Kim JGB, Jin M, Ahn K, Kim B, Kim S, et al. Beneficial effects of two types of personal health record services connected with electronic medical records within the hospital setting. Comput Inform Nurs 2017 Nov;35(11):574-581. [CrossRef] [Medline]
    30. Kelly MM, Hoonakker PLT, Dean SM. Using an inpatient portal to engage families in pediatric hospital care. J Am Med Inform Assoc 2017 Dec;24(1):153-161. [CrossRef] [Medline]
    31. Caine K, Kohn S, Lawrence C, Hanania R, Meslin EM, Tierney WM. Designing a patient-centered user interface for access decisions about EHR data: implications from patient interviews. J Gen Intern Med 2015 Jan;30 Suppl 1:S7-S16 [FREE Full text] [CrossRef] [Medline]
    32. Nazi KM, Hogan TP, McInnes DK, Woods SS, Graham G. Evaluating patient access to electronic health records: results from a survey of veterans. Med Care 2013 Mar;51(3 Suppl 1):S52-S56. [CrossRef] [Medline]
    33. Yen P, Walker DM, Smith JMG, Zhou MP, Menser TL, McAlearney AS. Usability evaluation of a commercial inpatient portal. Int J Med Inform 2018 Dec;110:10-18. [CrossRef] [Medline]
    34. Zarcadoolas C, Vaughon WL, Czaja SJ, Levy J, Rockoff ML. Consumers' perceptions of patient-accessible electronic medical records. J Med Internet Res 2013;15(8):e168 [FREE Full text] [CrossRef] [Medline]
    35. Runaas L, Bischoff E, Hoodin F, Kentor R, Ostarello L, Seyedsalehi S, et al. A novel health informatics tool to improve caregiver activation: findings from pediatric BMT in a hospital-based setting. Blood 2016;128(22):2382 [FREE Full text]
    36. Snyder CF, Blackford AL, Wolff AC, Carducci MA, Herman JM, Wu AW. Feasibility and value of PatientViewpoint: a web system for patient-reported outcomes assessment in clinical practice. Psychooncology 2013 Apr;22(4):895-901 [FREE Full text] [CrossRef] [Medline]
    37. van der Vaart R, Drossaert CH, Taal E, Drossaers-Bakker KW, Vonkeman HE, van de Laar MA. Impact of patient-accessible electronic medical records in rheumatology: use, satisfaction and effects on empowerment among patients. BMC Musculoskelet Disord 2014;15:102 [FREE Full text] [CrossRef] [Medline]
    38. Hazara AM, Bhandari S. Barriers to patient participation in a self-management and education website Renal PatientView: a questionnaire-based study of inactive users. Int J Med Inform 2016 Mar;87:10-14. [CrossRef] [Medline]
    39. Osborn CY, Mayberry LS, Mulvaney SA, Hess R. Patient web portals to improve diabetes outcomes: a systematic review. Curr Diab Rep 2010 Dec;10(6):422-435 [FREE Full text] [CrossRef] [Medline]
    40. Powell KR. Patient-perceived facilitators of and barriers to electronic portal use: a systematic review. Comput Inform Nurs 2017 Nov;35(11):565-573. [CrossRef] [Medline]
    41. Pillemer F, Price RA, Paone S, Martich GD, Albert S, Haidari L, et al. Direct release of test results to patients increases patient engagement and utilization of care. PLoS One 2016;11(6):e0154743 [FREE Full text] [CrossRef] [Medline]
    42. Rexhepi H, Åhlfeldt R, Cajander A, Huvila I. Cancer patients' attitudes and experiences of online access to their electronic medical records: a qualitative study. Health Informatics J 2016 Jul 19;24(2):115-124. [CrossRef] [Medline]
    43. Rathert C, Mittler JN, Banerjee S, McDaniel J. Patient-centered communication in the era of electronic health records: what does the evidence say? Patient Educ Couns 2017 Jan;100(1):50-64. [CrossRef] [Medline]
    44. Hefner JL, Sieck CJ, McAlearney AS. Training to optimize collaborative use of an inpatient portal. Appl Clin Inform 2018 Jul;9(3):558-564. [CrossRef] [Medline]
    45. Kelly MM, Dean SM, Carayon P, Wetterneck TB, Hoonakker PLT. Healthcare team perceptions of a portal for parents of hospitalized children before and after implementation. Appl Clin Inform 2017 Dec 15;8(1):265-278 [FREE Full text] [CrossRef] [Medline]
    46. Adler-Milstein J, Holmgren AJ, Kralovec P, Worzala C, Searcy T, Patel V. Electronic health record adoption in US hospitals: the emergence of a digital. J Am Med Inform Assoc 2017 Nov 01;24(6):1142-1148. [CrossRef] [Medline]
    47. 埃森,Scandurra我,gerrit R, G汉弗莱,约翰sen MA, Kierkegaard P, et al. Patient access to electronic health records: differences across ten countries. Health Policy and Technology 2018 Mar;7(1):44-56. [CrossRef]
    48. Mikles SP, Mielenz TJ. Characteristics of electronic patient-provider messaging system utilisation in an urban health care organisation. J Innov Health Inform 2014 Dec 18;22(1):214-221 [FREE Full text] [CrossRef] [Medline]
    49. Walker DM, Menser T, Yen P, McAlearney AS. Optimizing the user experience: identifying opportunities to improve use of an inpatient portal. Appl Clin Inform 2018 Dec;9(1):105-113. [CrossRef] [Medline]
    50. Ralston JD, Silverberg MJ, Grothaus L, Leyden WA, Ross T, Stewart C, et al. Use of web-based shared medical records among patients with HIV. Am J Manag Care 2013 Apr 01;19(4):e114-e124 [FREE Full text] [Medline]
    51. Risling T, Martinez J, Young J, Thorp-Froslie N. Evaluating patient empowerment in association with ehealth technology: scoping review. J Med Internet Res 2017 Sep 29;19(9):e329 [FREE Full text] [CrossRef] [Medline]
    52. van der Vaart R, Drossaert CH, Taal E, van de Laar MA. Giving rheumatology patients online home access to their electronic medical record (EMR): advantages, drawbacks and preconditions according to care providers. Rheumatol Int 2013 Sep;33(9):2405-2410 [FREE Full text] [CrossRef] [Medline]
    53. Davis GT, Menon S, Parrish DE, Sittig DF, Singh H. Patient access to medical records and healthcare outcomes: a systematic review. J Am Med Inform Assoc 2014;21(4):737-741. [CrossRef] [Medline]
    54. Toscos T, Daley C, Heral L, Doshi R, Chen Y, Eckert GJ, et al. Impact of electronic personal health record use on engagement and intermediate health outcomes among cardiac patients: a quasi-experimental study. J Am Med Inform Assoc 2016 Jan;23(1):119-128. [CrossRef] [Medline]
    55. Heyworth L, Paquin AM, Clark J, Kamenker V, Stewart M, Martin T, et al. Engaging patients in medication reconciliation via a patient portal following hospital discharge. J Am Med Inform Assoc 2014 Feb;21(e1):e157-e162 [FREE Full text] [CrossRef] [Medline]
    56. Wright A, Feblowitz J, Maloney FL, Henkin S, Ramelson H, Feltman J, et al. Increasing patient engagement: patients' responses to viewing problem lists online. Appl Clin Inform 2014;5(4):930-942. [CrossRef] [Medline]
    57. Saberi P, Catz SL, Leyden WA, Stewart C, Ralston JD, Horberg MA, et al. Antiretroviral therapy adherence and use of an electronic shared medical record among people living with HIV. AIDS Behav 2015 Jun;19 Suppl 2:177-185 [FREE Full text] [CrossRef] [Medline]
    58. Carayon P, Cartmill R, Blosky MA, Brown R, Hackenberg M, Hoonakker P, et al. ICU nurses' acceptance of electronic health records. J Am Med Inform Assoc 2011;18(6):812-819 [FREE Full text] [CrossRef] [Medline]
    59. Karsh B. Beyond usability: designing effective technology implementation systems to promote patient safety. Qual Saf Health Care 2004 Oct;13(5):388-394 [FREE Full text] [CrossRef] [Medline]
    60. Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010 Feb;43(1):159-172 [FREE Full text] [CrossRef] [Medline]

    ‎
    AMSTAR:A Measurement Tool to Assess Systematic Reviews
    EMR:electronic medical record
    HIT:health information technology
    QATSDD:Quality Assessment Tool for Studies With Diverse Designs

    Edited by G Eysenbach; submitted 18.11.18; peer-reviewed by B Xie, A McAlearney, G Strudwick, T Irizarry; comments to author 27.12.18; revised version received 30.01.19; accepted 17.02.19; published 11.04.19

    Copyright

    ©Ronald Dendere, Christine Slade, Andrew Burton-Jones, Clair Sullivan, Andrew Staib, Monika Janda. Originally published in the Journal of Medical Internet Research (//www.mybigtv.com), 11.04.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on //www.mybigtv.com/, as well as this copyright and license information must be included.
    Baidu
    map