Although information technology (IT)-based applications in healthcare have existed for more than three decades, methods to evaluate outputs and outcomes of the use of IT-based systems in medical informatics is still a challenge for decision makers, as well as to those who want to measure the effects of ICT in healthcare settings. The aim of this paper is to review published articles in the area evaluations of IT-based systems in order to gain knowledge about methodologies used and findings obtained from the evaluation of IT-based systems applied in healthcare settings. The literature review includes studies of IT-based systems between 2003 and 2005. The findings show that economic and organizational aspects dominate evaluation studies in this area. However, the results focus mostly on positive outputs such as user satisfaction, financial benefits and improved organizational work. This review shows that there is no standard framework for evaluation effects and outputs of implementation and use of IT in the healthcare setting and that until today no studies explore the impact of IT on the healthcare system' productivity and effectiveness.
Shekelle PG, Morton SC, Keeler EB. Shekelle PG, et al. Evid Rep Technol Assess (Full Rep). 2006 Apr;(132):1-71. doi: 10.23970/ahrqepcerta132. Evid Rep Technol Assess (Full Rep). 2006. PMID: 17627328 Free PMC article. Review.
Standing S, Standing C. Standing S, et al. Int J Electron Healthc. 2008;4(3-4):221-35. doi: 10.1504/IJEH.2008.022661. Int J Electron Healthc. 2008. PMID: 19174359
Villamor Ordozgoiti A, Delgado Hito P, Guix Comellas EM, Fernandez Sanchez CM, Garcia Hernandez M, Lluch Canut T. Villamor Ordozgoiti A, et al. Stud Health Technol Inform. 2016;226:169-72. Stud Health Technol Inform. 2016. PMID: 27350495 Review.
Dienemann J, Van de Castle B. Dienemann J, et al. J Nurs Adm. 2003 Nov;33(11):557-62. doi: 10.1097/00005110-200311000-00001. J Nurs Adm. 2003. PMID: 14608210 Review. No abstract available.
Weems K. Weems K. Healthc Financ Manage. 2010 Jun;64(6):86-8, 90. Healthc Financ Manage. 2010. PMID: 20533682
Yang A, Singh N, Varshney U. Yang A, et al. J Med Syst. 2022 Sep 7;46(10):66. doi: 10.1007/s10916-022-01856-6. J Med Syst. 2022. PMID: 36068371 Review.
Berardi C, Hinwood M, Smith A, Melia A, Paolucci F. Berardi C, et al. PLoS One. 2021 Nov 22;16(11):e0259995. doi: 10.1371/journal.pone.0259995. eCollection 2021. PLoS One. 2021. PMID: 34807937 Free PMC article.
Leon N, Balakrishna Y, Hohlfeld A, Odendaal WA, Schmidt BM, Zweigenthal V, Anstey Watkins J, Daniels K. Leon N, et al. Cochrane Database Syst Rev. 2020 Aug 13;8(8):CD012012. doi: 10.1002/14651858.CD012012.pub2. Cochrane Database Syst Rev. 2020. PMID: 32803893 Free PMC article.
Taylor CO, Tarczy-Hornoch P. Taylor CO, et al. Yearb Med Inform. 2019 Aug;28(1):181-189. doi: 10.1055/s-0039-1677916. Epub 2019 Aug 16. Yearb Med Inform. 2019. PMID: 31419830 Free PMC article. Review.
Rahimi B, Nadri H, Lotfnezhad Afshar H, Timpka T. Rahimi B, et al. Appl Clin Inform. 2018 Jul;9(3):604-634. doi: 10.1055/s-0038-1668091. Epub 2018 Aug 15. Appl Clin Inform. 2018. PMID: 30112741 Free PMC article.
