Brief Reports

Assessment of readability, understandability, and completeness of pediatric hospital medicine discharge instructions

Abstract

The average American adult reads at an 8th-grade level. Discharge instructions written above this level might increase the risk of adverse outcomes for children as they transition from hospital to home. We conducted a cross-sectional study at a large urban academic children’s hospital to describe readability levels, understandability scores, and completeness of written instructions given to families at hospital discharge. Two hundred charts for patients discharged from the hospital medicine service were randomly selected for review. Written discharge instructions were extracted and scored for readability (Fry Readability Scale [FRS]), understandability (Patient Education Materials Assessment Tool [PEMAT]), and completeness (5 criteria determined by consensus). Descriptive statistics enumerated the distribution of readability, understandability, and completeness of written discharge instructions. Of the patients included in the study, 51% were publicly insured. Median age was 3.1 years, and median length of stay was 2.0 days. The median readability score corresponded to a 10th-grade reading level (interquartile range, 8-12; range, 1-13). Median PEMAT score was 73% (interquartile range, 64%-82%; range, 45%-100%); 36% of instructions scored below 70%, correlating with suboptimal understandability. The diagnosis was described in only 33% of the instructions. Although explicit warning signs were listed in most instructions, 38% of the instructions did not include information on the person to contact if warning signs developed. Overall, the readability, understandability, and completeness of discharge instructions were subpar. Efforts to improve the content of discharge instructions may promote safe and effective transitions home. Journal of Hospital Medicine 2017;12:98-101. © 2017 Society of Hospital Medicine

© 2017 Society of Hospital Medicine

The average American adult reads at an 8th-grade level.1 Limited general literacy can affect health literacy, which is defined as the “degree to which individuals have the capacity to obtain, process and understand basic health information and services needed to make appropriate health decisions.”2,3 Adults with limited health literacy are at risk for poorer outcomes, including overuse of the emergency department and lower adherence to preventive care recommendations.4

Children transitioning from hospital to home depend on their adult caregivers (and their caregivers’ health literacy) to carry out discharge instructions. During the immediate postdischarge period, complex care needs can involve new or changed medications, follow-up instructions, home care instructions, and suggestions regarding when and why to seek additional care.

The discharge education provided to patients in the hospital is often subpar because of lack of standardization and divided responsibility among providers.5 Communication of vital information to patients with low health literacy has been noted to be particularly poor,6 as many patient education materials are written at 10th-, 11th-, and 12th-grade reading levels.4 Evidence supports providing materials written at 6th-grade level or lower to increase comprehension.7 Several studies have evaluated the quality and readability of discharge instructions for hospitalized adults,8,9 and one study found a link between poorly written instructions for adult patients and readmission risk.10 Less is known about readability in pediatrics, in which education may be more important for families of children most commonly hospitalized for acute illness.

We conducted a study to describe readability levels, understandability scores, and completeness of written instructions given to families at hospital discharge.

METHODS

Study Design and Setting

In this study, we performed a cross-sectional review of discharge instructions within electronic health records at Cincinnati Children’s Hospital Medical Center (CCHMC). The study was reviewed and approved by CCHMC’s Institutional Review Board. Charts were randomly selected from all hospital medicine service discharges during two 3-month periods of high patient volume: January-March 2014 and January-March 2015.

CCHMC is a large urban academic referral center that is the sole provider of general, subspecialty, and critical pediatric inpatient care for a large geographical area. CCHMC, which has 600 beds, provides cares for many children who live in impoverished settings. Its hospital medicine service consists of 4 teams that care for approximately 7000 children hospitalized with general pediatric illnesses each year. Each team consists of 5 or 6 pediatric residents supervised by a hospital medicine attending.

Providers, most commonly pediatric interns, generate discharge instructions in electronic health records. In this nonautomated process, they use free-text or nonstandardized templates to create content. At discharge, instructions are printed as part of the postvisit summary, which includes updates on medications and scheduled follow-up appointments. Bedside nurses verbally review the instructions with families and provide printed copies for home use.

Data Collection and Analysis

A random sequence generator was used to select charts for review. Instructions written in a language other than English were excluded. Written discharge instructions and clinical information, including age, sex, primary diagnosis, insurance type, number of discharge medications, number of scheduled appointments at discharge, and hospital length of stay, were abstracted from electronic health records and anonymized before analysis. The primary outcomes assessed were discharge instruction readability, understandability, and completeness. Readability was calculated with Fry Readability Scale (FRS) scores,11 which range from 1 to 17 and correspond to reading levels (score 1 = 1st-grade reading level). Health literacy experts have used the FRS to assess readability in health care environments.12

Understandability was measured with the Patient Education Materials Assessment Tool (PEMAT), a validated scoring system provided by the Agency for Healthcare Research and Quality.13 The PEMAT measures the understandability of print materials on a scale ranging from 0% to 100%. Higher scores indicate increased understandability, and scores under 70% indicate instructions are difficult to understand.

Although recent efforts have focused on the development of quality metrics for hospital-to-home transitions of pediatric patients,14 during our study there were no standard items to include in pediatric discharge instructions. Five criteria for completeness were determined by consensus of 3 pediatric hospital medicine faculty and were informed by qualitative results of work performed at our institution—work in which families noted challenges with information overload and a desire for pertinent and usable information that would enhance caregiver confidence and discharge preparedness.15 The criteria included statement of diagnosis, description of diagnosis, signs and symptoms indicative of the need for escalation of care (warning signs), the person caregivers should call if worried, and contact information for the primary care provider, subspecialist, and/or emergency department. Each set of discharge instructions was manually evaluated for completeness (presence of each individual component, number of components present, presence of all components). All charts were scored by the same investigator. A convenience sample of 20 charts was evaluated by a different investigator to ensure rating parameters were clear and classification was consistent (defined as perfect agreement). If the primary rater was undecided on a discharge instruction score, the secondary rater rated the instruction, and consensus was reached.

Means, medians, and ranges were calculated to enumerate the distribution of readability levels, understandability scores, and completeness of discharge instructions. Instructions were classified as readable if the FRS score was 6 or under, as understandable if the PEMAT score was under 70%, and as complete if all 5 criteria were satisfied. Descriptive statistics were generated for all demographic and clinical variables.

Demographics of Patients Whose Discharge Instructions Were Reviewed

Table 1

RESULTS

Of the study period’s 3819 discharges, 200 were randomly selected for review. Table 1 lists the demographic and clinical information of patients included in the analyses. Median FRS score was 10, indicating a 10th-grade reading level (interquartile range, 8-12; range, 1-13) (Table 2). Only 14 (7%) of 200 discharge instructions had a score of 6 or under. Median PEMAT understandability score was 73% (interquartile range, 64%-82%), and 36% of instructions had a PEMAT score under 70%. No instruction satisfied all 5 of the defined characteristics of complete discharge instructions (Table 2).

Descriptive Statistics of Written Discharge Instructions

Table 2

DISCUSSION

To our knowledge, this is the first study of the readability, understandability, and completeness of discharge instructions in a pediatric population. We found that the majority of discharge instruction readability levels were 10th grade or higher, that many instructions were difficult to understand, and that important information was missing from many instructions.

Discharge instruction readability levels were higher than the literacy level of many families in surrounding communities. The high school dropout rates in Cincinnati are staggering; they range from 22% to 64% in the 10 neighborhoods with the largest proportion of residents not completing high school.16 However, such findings are not unique to Cincinnati; low literacy is prevalent throughout the United States. Caregivers with limited literacy skills may struggle to navigate complex health systems, understand medical instructions and anticipatory guidance, perform child care and self-care tasks, and understand issues related to consent, medical authorization, and risk communication.17

Although readability is important, other factors also correlate with comprehension and execution of discharge tasks.18 Information must be understandable, or presented in a way that makes sense and can inform appropriate action. In many cases in our study, instructions were incomplete, despite previous investigators’ emphasizing caregivers’ desire and need for written instructions that are complete, informative, and inclusive of clearly outlined contingency plans.15,19 In addition, families may differ in the level of support needed after discharge; standardizing elements and including families in the development of discharge instructions may improve communication.8

This study had several limitations. First, the discharge instructions randomly selected for review were all written during the winter months. As the census on the hospital medicine teams is particularly high during that time, authors with competing responsibilities may not have had enough time to write effective discharge instructions then. We selected the winter period in order to capture real-world instructions written during a busy clinical time, when providers care for a high volume of patients. Second, caregiver health literacy and English-language proficiency were not assessed, and information regarding caregivers’ race/ethnicity, educational attainment, and socioeconomic status was unavailable. Third, interrater agreement was not formally evaluated. Fourth, this was a single-center study with results that may not be generalizable.

In conclusion, discharge instructions for pediatric patients are often difficult to read and understand, and incomplete. Efforts to address these communication gaps—including educational initiatives for physician trainees focused on health literacy, and quality improvement work directed at standardization and creation of readable, understandable, and complete discharge instructions—are crucial in providing safe, high-value care. Researchers need to evaluate the relationship between discharge instruction quality and outcomes, including unplanned office visits, emergency department visits, and readmissions.

Disclosure

Nothing to report.

References

   Comments ()

Related Articles from PubMed

Otolaryngol Head Neck Surg. 2016 Mar;154(3):460-4. doi: 10.1177/0194599815626146. Epub 2016 Feb 9.
Otolaryngol Head Neck Surg. 2016 Nov;155(5):758-763. Epub 2016 Jun 21.