Visualizing Semantic Structure of a Clinical Text Document
##plugins.themes.bootstrap3.article.main##
The increasing use of Electronic Health Records (EHRs) in healthcare delivery settings has led to increase availability of electronic clinical data. They generate a lot of patients’ clinical data each day, requiring physicians to review them to find clinically relevant information of different patients during care episodes. The availability of electronically collected healthcare data has created the need of computational tools to analyze them. One of the types of data which doctors have access to is clinical notes that resides in electronic health records. These notes are useful as they provide comprehensive information about patients’ health histories with many practical uses. For example, doctors always review these notes during care episodes to appraise themselves about the health history of a patient. These reviews are currently manual where a doctor reads a patient’s chart while looking for specific clinical information. Without the proper support, this manual process leads to information overload and increases physician cognitive workload. Current electronic health records (EHRs) do not provide support to help physicians reduce cognitive workload when completing clinical tasks. This is especially true for long clinical documents which require quick review at the point of care. The growing amount of clinical documentation available in EHRs has arose the need of tools that support synthesize of information in EHRs. The use of visual analytics to explore healthcare data is one such research direction to address this problem. However, existing visualization techniques are mainly based on structured electronic health record and rarely support therapeutic activities. Therefore, visualization of unstructured clinical records to support clinical practice is required. In this paper we propose a unique approach for graphically representing and visualizing the semantic structure of a clinical text document to aid doctors in reviewing electronic clinical notes. A user evaluation demonstrates that the proposed method for visualizing and navigating a document’s semantic structure facilitates a user’s document information exploration.
References
Wang, Y., Tafti, A.P., Sohn, S., & Zhang, R. (2019). Applications of Natural Language Processing in Clinical Research and Practice. NAACL-HLT.
Meystre, S., Savova, G., Kipper-schuler, K., & Hurdle, J. (2008). Extracting information from textual documents in the electronic health record: a review of recent research. Yearbook of medical informatics, 128-44 .
Laxmisan, A., McCoy, A. B., Wright, A., & Sittig, D. F. (2012). Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records. Applied Clinical Informatics, 3(1), pp. 80–93. http://doi.org/10.4338/ACI-2011-11-RA-0066.
Katal, A., Wazid, M., & Goudar, R.H. (2013). Big data: Issues, challenges, tools and Good practices. 2013 Sixth International Conference on Contemporary Computing (IC3), 404-409.
Jonnalagadda, S. R., Del Fiol, G., Medlin, R., Weir, C., Fiszman, M., Mostafa, J., & Liu, H. (2013). Automatically extracting sentences from Medline citations to support clinicians' information needs. Journal of the American Medical Informatics Association: JAMIA, 20(5), 995–1000. https://doi.org/10.1136/amiajnl-2012-001347.
Taylor, C., 2020. Structured Vs. Unstructured Data. [online] Datamation.com. Available at: <https://www.datamation.com/big-data/structured-vs-unstructured-data.html> [Accessed 2 August 2020].
Sun, W., Cai, Z., Li, Y., Liu, F., Fang, S., & Wang, G. (2018). Data Processing and Text Mining Technologies on Electronic Medical Records: A Review. Journal of Healthcare Engineering, 2018.
Huang, K., Altosaar, J., & Ranganath, R. (2019). ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission. ArXiv, abs/1904.05342.
Barbulescu, M., Grigoriu, R., Halcu, I., Neculoiu, G., Sandulescu, V. C., Marinescu, M., & Marinescu, V. (2013). Integrating of structured, semi-structured and unstructured data in natural and build environmental engineering. In 2013 11th RoEduNet International Conference (pp. 1–4). IEEE. doi:10.1109/RoEduNet.2013.6511738.
Farri, O., Pieczkiewicz, D.S., Rahman, A., Pakhomov, S.V., Adam, T., & Melton, G.B. (2012). A Qualitative Analysis of EHR Clinical Document Synthesis by Clinicians. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2012, 1211-20.
Farri, O., Monsen, K.A., Pakhomov, S.V., Pieczkiewicz, D.S., Speedie, S.M., & Melton, G.B. (2013). Effects of time constraints on clinician-computer interaction: A study on information synthesis from EHR clinical notes. Journal of biomedical informatics, 46 6, 1136-44.
Pollack, A.H., & Pratt, W. (2020). Association of Health Record Visualizations With Physicians’ Cognitive Load When Prioritizing Hospitalized Patients. JAMA Network Open, 3.
Farri, O. (2012). Understanding Clinician Information Demands and Synthesis of Clinical Documents in Electronic Health Record Systems.
Bui, A.A., Aberle, D., & Kangarloo, H. (2007). TimeLine: Visualizing Integrated Patient Records. IEEE Transactions on Information Technology in Biomedicine, 11, 462-473.
Farri, O., Rahman, A., Monsen, K. A., Zhang, R., Pakhomov, S. V., Pieczkiewicz, D. S., … Melton, G. B. (2012). Impact of of a Prototype Visualization Tool for New Information in EHR Clinical Documents. Applied Clinical Informatics, 3(4), 404–418. http://doi.org/10.4338/ACI-2012-05-RA-0017.
Ruan, W., Appasani, N., Kim, K., Vincelli, J., Kim, H., & Lee, W. (2018). Pictorial Visualization of EMR Summary Interface and Medical Information Extraction of Clinical Notes. 2018 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), 1-6.
Deng, Y., & Denecke, K. (2014). Visualizing Unstructured Patient Data for Assessing Diagnostic and Therapeutic History. Studies in health technology and informatics, 205, 1158-1162.
Ledesma, A., Bidargaddi, N., Strobel, J.E., Schrader, G., Nieminen, H., Korhonen, I., & Ermes, M. (2019). Health timeline: an insight-based study of a timeline visualization of clinical data. BMC Medical Informatics and Decision Making, 19(170).
Bui, A., Aberle, D.R., Kangarloo, H., (2007). TimeLine: Visualizing Integrated Patient Records. IEEE Transactions on Information Technology in Biomedicine 11(4), pp.462-473.
Interactive Visualization and Exploration of Patient Progression in a Hospital Setting.
Dornan, L., Pinyopornpanish, K., Jiraporncharoen, W., Hashmi, A.H., Dejkriengkraikul, N., & Angkurawaranon, C. (2019). Utilisation of Electronic Health Records for Public Health in Asia: A Review of Success Factors and Potential Challenges. BioMed Research International, 2019.
Boonstra, A., Versluis, A., & Vos, J.F. (2014). Implementing electronic health records in hospitals: a systematic literature review. BMC Health Services Research, 14.
Wolfe, L., Chisolm, M.S., & Bohsali, F. (2018). Clinically Excellent Use of the Electronic Health Record: Review. JMIR Human Factors, 5.
Pivovarov, R., & Elhadad, N. (2015). Automated methods for the summarization of electronic health records. Journal of the American Medical Informatics Association: JAMIA, 22(5), 938–947. https://doi.org/10.1093/jamia/ocv032.
Schopf, T.R., Nedrebø, B., Hufthammer, K.O., Daphu, I.K., & Lærum, H. (2019). How well is the electronic health record supporting the clinical tasks of hospital physicians? A survey of physicians at three Norwegian hospitals. BMC Health Services Research, 19.
Menachemi, N., & Collum, T.H. (2011). Benefits and drawbacks of electronic health record systems. Risk Management and Healthcare Policy, 4, 47 - 55.
Bates, D.W., Teich, J.M., Lee, J., Seger, D.L., Kuperman, G.J., Ma'Luf, N., Boyle, D., & Leape, L. (1999). Research Paper: The Impact of Computerized Physician Order Entry on Medication Error Prevention. Journal of the American Medical Informatics Association : JAMIA, 6 4, 313-21.
Bates, D.W., Leape, L., Cullen, D.J., Laird, N., Petersen, L.A., Teich, J.M., Burdick, E., Hickey, M., Kleefield, S., Shea, B., Vliet, M.V., & Seger, D.L. (1998). Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA, 280 15, 1311-6.
HealthIT. “Improved Diagnostics & Patient Outcomes.” HealthIT.gov. http://www.healthit.gov/providers-professionals/improved-diagnostics-patient-outcomes. Updated June 2019. Accessed May 2020.
Landi, I., Glicksberg, B., Lee, H., Cherng, S.T., Landi, G., Danieletto, M., Dudley, J., Furlanello, C., & Miotto, R. (2020). Deep representation learning of electronic health records to unlock patient stratification at scale. NPJ Digital Medicine, 3.
Koopman, R.J., Steege, L.M., Moore, J.L., Clarke, M.A., Canfield, S.M., Kim, M.S., & Belden, J.L. (2015). Physician Information Needs and Electronic Health Records (EHRs): Time to Reengineer the Clinic Note. Journal of the American Board of Family Medicine : JABFM, 28 3, 316-23.
Mujjiga, S., Krishna, V., Chakravarthi, K., & Vijayananda, J. (2019). Identifying Semantics in Clinical Reports Using Neural Machine Translation. AAAI.
Reis, J.C., Bonacin, R., & Perciani, E.M. (2016). Intention-Based Information Retrieval of Electronic Health Records. 2016 IEEE 25th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE), 217-222.
Hultman, G.M., Marquard, J.L., Lindemann, E., Arsoniadis, E.G., Pakhomov, S.V., & Melton, G.B. (2019). Challenges and Opportunities to Improve the Clinician Experience Reviewing Electronic Progress Notes. Applied clinical informatics, 10 3, 446-453.
Reichert, D., Kaufman, D., Bloxham, B., Chase, H., & Elhadad, N. (2010). Cognitive analysis of the summarization of longitudinal patient records. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2010, 667–671.
Nordo, A.H., Levaux, H.P., Becnel, L.B., Gálvez, J., Rao, P.K., Stem, K., Prakash, E., & Kush, R.D. (2019). Use of EHRs data for clinical research: Historical progress and current applications. Learning Health Systems, 3.
Juhn, Y.J., & Liu, H. (2019). Natural language processing to advance EHR-based clinical research in Allergy, Asthma, and Immunology. The Journal of allergy and clinical immunology.
Meystre, S.M., Lovis, C., Bürkle, T., Tognola, G., Budrionis, A., & Lehmann, C.U. (2017). Clinical Data Reuse or Secondary Use: Current Status and Potential Future Progress. Yearbook of medical informatics, 26 1, 38-52.
Beresniak, A., Schmidt, A., Proeve, J., Bolaños, E., Patel, N., Ammour, N., Sundgren, M., Ericson, M., Karakoyun, T., Coorevits, P.L., Kalra, D., Moor, G.J., & Dupont, D. (2016). Cost-benefit assessment of using electronic health records data for clinical research versus current practices: Contribution of the Electronic Health Records for Clinical Research (EHR4CR) European Project. Contemporary clinical trials, 46, 85-91.
Arbabi, A., Adams, D.R., Fidler, S., & Brudno, M. (2019). Identifying Clinical Terms in Medical Text Using Ontology-Guided Machine Learning. JMIR Medical Informatics, 7.
Hultman, G.M., Marquard, J.L., Lindemann, E., Arsoniadis, E.G., Pakhomov, S.V., & Melton, G.B. (2019). Challenges and Opportunities to Improve the Clinician Experience Reviewing Electronic Progress Notes. Applied clinical informatics, 10 3, 446-453.
Su, Y., Chao, C., Hung, L., Sung, S., & Lee, P. (2020). A Natural Language Processing Approach to Automated Highlighting of New Information in Clinical Notes. Applied Sciences, 10, 2824.
Clarke, M.A., Belden, J.L., Koopman, R.J., Steege, L.M., Moore, J.L., Canfield, S.M., & Kim, M.S. (2013). Information needs and information-seeking behaviour analysis of primary care physicians and nurses: a literature review. Health information and libraries journal, 30(3), 178-190.
McEnery, K. W. 2018. Reference Guide in Information
Technology for the Practicing Radiologist. American College of Radiology.
Ajami S, Bagheri-Tadi T. Barriers for adopting electronic health records (EHRs) by physicians. Acta Informatica Medica 2013;21:129. pmid:24058254
View ArticlePubMed/NCBIGoogle Scholar.
Roman, L.C., Ancker, J., Johnson, S., & Senathirajah, Y. (2017). Navigation in the electronic health record: A review of the safety and usability literature. Journal of biomedical informatics, 67, 69-79.
Reisman, M. (2017). EHRs: The Challenge of Making Electronic Data Usable and Interoperable. P & T : a peer-reviewed journal for formulary management, 42 9, 572-575.
Jensen, P., Jensen, L. & Brunak, S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet 13, 395–405 (2012). https://doi.org/10.1038/nrg3208.
Ben-Assuli, O., Ziv, A., Sagi, D., Leshno, M., & Ironi, A. (2014). Improving Diagnostic Accuracy Using EHR in Emergency Departments: A Simulation-Based Study. Journal of biomedical informatics, 55, 31-40.
Aleksi, D.S., Rajkovi, P., Vukovi, D., Jankovi, D., & Milenkovi, A. (2017). Data summarization method for chronic disease tracking. Journal of Biomedical Informatics, 69, 188-202.
Samal, L., Wright, A., Wong, B., Linder, J., & Bates, D. (2011). Leveraging electronic health records to support chronic disease management: the need for temporal data views. Informatics in primary care, 19 2, 65-74.
Lesselroth, B.J., & Pieczkiewicz, D.S. (2011). Data Visualization Strategies for the Electronic Health Record.
Ledesma, A., Bidargaddi, N., Strobel, J., Schrader, G., Nieminen, H., Korhonen, I., & Ermes, M. (2019). Health timeline: an insight-based study of a timeline visualization of clinical data. BMC Medical Informatics and Decision Making, 19.
West, V., Borland, D. and Hammond, W. (2014). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association.
Roque, F., Slaughter, L.A., & Tkatsenko, A. (2010). A Comparison of Several Key Information Visualization Systems for Secondary Use of Electronic Health Record Content. In: Proceedings of NAACL HLT Workshop on Text and Data Mining of Health Documents, pp.1–8.
Rind, A., Wang, T. D., Aigner, W., Miksh, S., Wongsuphasawat, K., Plaisant, C., and Shneiderman, B (2013). Interactive Information Visualization to Explore and Query Electronic Health Records. Foundations and Trends in Human–Computer Interaction, 5(3), pp.207-298.
Sultanum, N., Singh, D.A., Brudno, M., & Chevalier, F. (2018). Doccurate: A Curation-Based Approach for Clinical Text Visualization. IEEE transactions on visualization and computer graphics.
Trivedi, G., Pham, P., Chapman, W.W., Hwa, R., Wiebe, J., & Hochheiser, H. (2018). NLPReViz: an interactive tool for natural language processing on clinical text. Journal of the American Medical Informatics Association: JAMIA, 25(1), pp. 81-87.
Yerebakan, H.Z., Shinagawa, Y., Bhatia, P.S., & Zhan, Y. (2018). Document Representation Learning for Patient History Visualization. COLING.
West, V. L., Borland, D., & Hammond, W. E. (2015). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association : JAMIA, 22(2), pp. 330–339. http://doi.org/10.1136/amiajnl-2014-002955.
Plaisant, C., Mushlin, R., Snyder, A., Li, J., Heller, D., & Shneiderman, B. (1998). LifeLines: using visualization to enhance navigation and analysis of patient records. Proceedings. AMIA Symposium, 76-80.
Wang, T.D., Plaisant, C., Quinn, A.J., Stanchak, R., Murphy, S., & Shneiderman, B. (2008). Aligning temporal data by sentinel events: discovering patterns in electronic health records. CHI.
Zhang, Z., Ahmed, F., Mittal, A., Zhao, R., Viccellio, A., & Mueller, K. (2011). AnamneVis: A Framework for the Visualization of Patient History and Medical Diagnostics Chains.
Plaisant, C., Milash, B., Rose, A., Widoff, S., & Shneiderman, B. (1996). LifeLines: visualizing personal histories. CHI '96.
West, V. L., Borland, D., & Hammond, W. E. (2015). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association : JAMIA, 22(2), 330–339. https://doi.org/10.1136/amiajnl-2014-002955.
Plaisant, C., Mushlin, R., Snyder, A., Li, J., Heller, D., & Shneiderman, B. (1998). LifeLines: using visualization to enhance navigation and analysis of patient records. Proceedings. AMIA Symposium, 76-80.
Plaisant, C., Milash, B., Rose, A., Widoff, S., & Shneiderman, B. (1996). LifeLines: visualizing personal histories. CHI '96.
Martins, S.B., Shahar, Y., Goren-Bar, D., Galperin-Aizenberg, M., Kaizer, H., Basso, L., McNaughton, D., & Goldstein, M. (2008). Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data. Artificial intelligence in medicine, 43 1, 17-34.
Klimov, D., Shahar, Y., & Taieb-Maimon, M. (2010). Intelligent visualization and exploration of time-oriented data of multiple patients. Artificial intelligence in medicine, 49 1, 11-31.
Klimov, D., Shahar, Y., & Taieb-Maimon, M. (2009). Intelligent interactive visual exploration of temporal associations among multiple time-oriented patient records. Methods of information in medicine, 48 3, 254-62.
Ola, O., & Sedig, K. (2016). Beyond simple charts: Design of visualizations for big health data. Online Journal of Public Health Informatics, 8.
Sahu, M., & Maringanti, H.B. (2016). Cognitive Architectural Model for Solving Clustering Problem. FICTA.
Andrus, M.R., Mcdonough, S.K., Kelley, K., Stamm, P.L., McCoy, E., Lisenby, K.M., Whitley, H., Slater, N.A., Carroll, D., Hester, E., Helmer, A., Jackson, C.W., & Byrd, D. (2018). Development and Validation of a Rubric to Evaluate Diabetes SOAP Note Writing in APPE. American Journal of Pharmaceutical Education, 82.
Lisenby, K.M., Andrus, M.R., Jackson, C.W., Stevenson, T., Fan, S., Gaillard, P., & Carroll, D. (2018). Ambulatory care preceptors' perceptions on SOAP note writing in advanced pharmacy practice experiences (APPEs). Currents in pharmacy teaching & learning, 10 12, 1574-1578.
[4] Cresswell, S. (2016, October 13). Understanding SOAP format for Clinical Rounds. Retrieved from https://www.gapmedics.com/blog/2015/01/02/understanding-soap-format-for-clinical-rounds/.
Mowery, D., Wiebe, J., Visweswaran, S., Harkema, H., & Chapman, W. (2012). Building an automated SOAP classifier for emergency department reports. Journal of biomedical informatics, 45 1, 71-81.
March, S. T. and Smith, G. F. (1995) Design and natural science research on information technology, in Decision Support Systems, 15(4): 251-266.
Hevner, A. R., March, S. T., Park, J., and Ram, S. (2004) Design science in information systems research. In MIS Quarterly 28 (1):75-105.
Norman, K.L. & Schneiderman, B. (2017) QUIS: Questionnaire for UserInteraction Satisfaction. Vol. 2017 University of Maryland.
Marghescu, D., & Rajanen, M. (2004). Evaluating the Quality of Use of Visual Data-Mining Tools.
Lewis, J.R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction, 34, 577 - 590.
Brooke, J. (1996) SUS - A quick and dirty usability scale. Usability evaluation inindustry, 189(194), 4-7.
Bangor, A., Kortum, P. & Miller, J. (2009) Determining what individual SUSscores mean: adding an adjective rating scale. J. Usability Studies, 4(3),114-123.
Brooke, J. (2013) SUS: a retrospective. J. Usability Studies, 8(2), 29-40.