Evaluation Framework for the iTRACK Integrated System

Ahmed Abdelgawad, Tina Comes

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

67 Downloads (Pure)

Abstract

Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the three elements. The lack of such a framework and commonly agreed standards constitutes a barrier for innovation, and at the same time imposes risks to responders if the technology is introduced without proper testing. This paper aims to close this gap. Based on a reviewing of evaluation methods and measurement metrics, we design a comprehensive evaluation framework including common code quality testing metrics, usability testing methods, subjective usefulness questionnaires, and performance indicators. We demonstrate our approach by using the example of an integrated system for the safety and security of humanitarian missions, and we highlight how our approach allows measuring the system’s quality and usefulness.
Original languageEnglish
Title of host publicationProceedings of the 16th International Conference on Information Systems for Crisis Response And Management (ISCRAM2019)
EditorsZeno Franco, Jose Gonzalez, Jose Canos
Place of PublicationValencia
PublisherISCRAM
Number of pages1160
ISBN (Electronic)978-84-09-10498-7
Publication statusPublished - 2019

Publication series

NameISCRAM Conference Proceedings
PublisherISCRAM
ISSN (Electronic)2411-3387

Keywords

  • Evaluation framework
  • Disaster management
  • Usability

Fingerprint Dive into the research topics of 'Evaluation Framework for the iTRACK Integrated System'. Together they form a unique fingerprint.

Cite this