Research article

Testing a model to help analysts understand, evaluate, and make inferences about health technology change

Stitzlein C. Sanderson P. Orihuela C. Jack L. Venkatesh B.
Ergonomics Australia – HFESA 2011 Conference Edition, 2011 11:44.

Abstract

Background: Implementing new technologies in a hospital is difficult. The healthcare environment is complex, with many factors for decision makers to consider before a new system is introduced.  Aim: The aim of this study was to evaluate a modeling approach designed to help healthcare stakeholders evaluate the impact of electronic information technologies on existing clinical work. We performed an initial test of an information flow and workflow model, evaluating its effectiveness at providing descriptions, supporting evaluation, and supporting conjectures.  Method: Hospital staff were interviewed and a model of information flow and workflow of a critical care work context was developed from the interview data. We then used a structured set of tests to probe non-healthcare participants’ ability to understand the model’s notation and evaluate the work activities.  Results: An analysis of participants’ responses indicated that although participants did not understand some model symbols initially, once provided with a legend they could satisfactorily describe the information flow and workflow represented in the model. The participants’ verbal reports of work activities and their perceptions of the notation indicate which parts of the model were difficult to understand and suggest ways of improving this type of representation.  Conclusions: Initial support was found for the adequacy of our modeling approach. Results from this study are being used to refine the model’s notation and structure. Next steps in the research are discussed, which include a test with healthcare professionals to see if our approach helps stakeholders make decisions about the implementation of new technologies.

[Return to Journal page]