An Integrated Framework to Evaluate Information Systems Performance in High-Risk Settings: Experiences from the iTRACK Project

Ahmed A. Abdelgawad*, Tina Comes

*Corresponding author for this work

Research output: Chapter in Book/Conference proceedings/Edited volumeChapterScientificpeer-review

110 Downloads (Pure)

Abstract

Evaluation and testing are significant steps in developing any information system. More attention must be devoted to these steps if the system is to be used in high-risk contexts, such as the response to conflict disasters. Several testing methodologies are designed to guarantee that software fulfills technology requirements; others will assure usability and usefulness. However, there is currently no integrated evaluation framework with agreed standards that bring together the three elements: technology requirements, usability, and usefulness. This gap constitutes a barrier to innovation and imposes risks to responders or affected populations if the technology is introduced without proper testing. This chapter aims to close this gap. Based on a review of evaluation methods and measurement metrics for information systems, we designed an integrated evaluation framework including standard metrics for code quality testing, usability methods, subjective usefulness questionnaires, and key performance indicators. We developed and implemented a reporting and evaluation system that demonstrates our evaluation framework within the context of the EU H2020 project iTRACK. iTRACK developed an integrated system for the safety and security of humanitarian missions. We demonstrate how our approach allows measuring the quality and usefulness of the iTRACK integrated system.
Original languageEnglish
Title of host publicationPublic Administration and Information Technology
PublisherSpringer
Pages147-180
Number of pages34
DOIs
Publication statusPublished - 2023

Publication series

NamePublic Administration and Information Technology
Volume40
ISSN (Print)2512-1812
ISSN (Electronic)2512-1839

Keywords

  • Evaluation framework
  • High risk
  • Humanitarian disaster
  • Requirements engineering
  • Software quality testing
  • Usability
  • Usefulness

Fingerprint

Dive into the research topics of 'An Integrated Framework to Evaluate Information Systems Performance in High-Risk Settings: Experiences from the iTRACK Project'. Together they form a unique fingerprint.

Cite this