An evaluation framework for information systems from the users’ perspective: a scoping review
An evaluation framework for information systems from the users’ perspective: a scoping review
Vanessa Pereira Corrêa Rampinelli,Catiele Raquel Schmidt,7 Authors,Eduardo Monguilhott Dalmarco
TLDR
This scoping review underscores the methodological diversity in information systems evaluation models and highlights the limitations of current use and emphasizes the need for standardized approaches to enhance comparability, transparency, and long-term system development.
Abstract
This scoping review aims to synthesize scientific literature on information systems evaluation methods from the users’ perspective, focusing on their characteristics, construction stages, and measurement properties. The search was conducted in 2024 across the following databases: ACM Digital Library, Embase, Engineering Village, ERIC, IEEE Xplore, LILACS, MEDLINE (via PubMed), Scopus, and Web of Science. The study selection process was independently carried out by two reviewers. A total of 18,837 articles were identified in the searches, and 11 were ultimately included in the review. The studies presented various evaluation frameworks specifically for health information systems, with one study also evaluating information systems from other fields. Only five studies reported the frameworks’ validation procedures, and very few provided comprehensive results of the validations or sufficiently thorough analyses. This scoping review underscores the methodological diversity in information systems evaluation models and highlights the limitations of current use. It emphasizes the need for standardized approaches to enhance comparability, transparency, and long-term system development.