Can natural language processing improve the completeness of immunization data?
Harnessing natural language processing to enhance immunization information
Challenge
The VISION surveillance collaboration aims to support public health efforts by routinely collecting and synthesizing respiratory illness data and publishing timely statistical analyses, including vaccine effectiveness (VE).
Surveillance methods often rely on the structured data elements within the electronic health record (EHR) to identify key health characteristics, procedures, and conditions. However, in some instances, details may only be documented in the narrative, text-based sections of the EHR.
Solution
Rule-based natural language processing (NLP) methods have the potential to identify health conditions and procedures using a dictionary of key terms and pattern-matching techniques. We developed NLP rules that leveraged grammatical dependencies within the text and accounted for a range of text variations using a combination of synthetic and publicly available data. Our rules aimed to identify immunizations for respiratory infections, influenza, and respiratory syncytial virus.
We applied the rules to a large sample of individuals from the EHRs of a large health care system and measured performance by conducting a manual review of individual notes, assessing concurrence with structured data, and comparing performance with prior methods.
Results
We were able to identify additional immunizations for respiratory infections, influenza, and RSV that were not present in the structured data. This research demonstrated the feasibility and utility of NLP methods to enhance structured vaccine information from EHRs and served to validate the information contained within the structured EHR data.
Focus Areas
Biomedical Informatics and Data Coordination Clinical Research Disease Surveillance Public HealthCapabilities
Biomedical Informatics and Data Coordination Biostatistics and Epidemiology Data Analytics, Clinical Data Science, and AI Data Collection Data Science EHR Harmonization and Analysis Natural Language Processing and Text AnalyticsSenior Expert Contact
Kevin Wilson
Vice President
-
Perspective
Westat @ JSM 2025: Enriching Society with StatisticsJuly 2025
Westat staff will be participating in the 2025 Joint Statistical Meetings (JSM), the largest annual gathering of statisticians and data scientists in North America. Held…
-
Expert Interview
2026 ASA President Mulrow: Communities in Action Advancing SocietyJuly 2025
Jeri Mulrow, MS, Vice President and Sector Lead for Data Solutions at Westat, will serve as the 121st President of the American Statistical Association (ASA),…
-
Expert Interview
What Impact Is AI Having in Government Research?July 2025
With the increased use of artificial intelligence (AI) in government research, questions regarding its impact on public policy and its ability to address today’s pressing…