Audiovisual sonifications: A design map for multisensory integration in data representation

Valentina Caiola, Sara Lenzi, Dina Ricco'

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review


In the field of data sonification, the construction of meaning is hampered by the lack of shared perceptual codes derived from common modes of perception, as it happens for the visual register. In this paper, we re-organize knowledge from previous experimental projects to build the foundations of future work in data representation. This experimental investigation aims to identify patterns in the translation process from different sensory modalities. To this end, 80 audiovisual sonifications have been collected and analyzed through phenomenological analysis with the goal of recording sensory correspondences. The resulting cross-sensory design map is a visual synthesis of the analysis, and it has a dual function. In the research domain, it proposes testable hypotheses for a systematic approach to data sonification. In the practice, it offers a space that is based on shared conventions that aim to standardize the actions and the choices of both sonification experts and communication designers.
Original languageEnglish
Title of host publicationProceedings of DRS 2022
Subtitle of host publicationDesign Research Society International Conference (DRS2022), Bilbao
Number of pages19
Publication statusPublished - 2022
Externally publishedYes


  • data sonification
  • perceptual codes
  • cross-sensory design
  • visualization


Dive into the research topics of 'Audiovisual sonifications: A design map for multisensory integration in data representation'. Together they form a unique fingerprint.

Cite this