Discovering Digital Representations for Remembered Episodes from Lifelog Data

Bernd Dudzik, Joost Broekens, Mark Neerincx, Jeffrey Olenick, Chu-Hsiang Chang, Steve W. J. Kozlowski, Hayley Hung

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review


Combining self-reports in which individuals reflect on their thoughts and feelings (Experience Samples) with sensor data collected via ubiquitous monitoring can provide researchers and applications with detailed insights about human behavior and psychology. However, meaningfully associating these two sources of data with each other is difficult: while it is natural for human beings to reflect on their experience in terms of remembered episodes, it is an open
challenge to retrace this subjective organization in sensor data
referencing objective time. Lifelogging is a specific approach to the ubiquitous monitoring of individuals that can contribute to overcoming this recollection gap. It strives to create a comprehensive timeline of semantic annotations that reflect the impressions of the monitored person from his or her own subjective point-of-view. In this paper, we describe a novel approach for processing such lifelogs to situate remembered experiences in an objective timeline. It involves the computational modeling of individuals’ memory processes to estimate segments within a lifelog acting as plausible digital representations for their recollections. We report about an empirical investigation in which we use our approach to discover plausible representations for remembered social interactions between participants in a longitudinal study. In particular, we describe an exploration of the behavior displayed by our model for memory processes in this setting. Finally, we explore the representations discovered for this study and discuss insights that might be gained from them.
Original languageEnglish
Title of host publicationProceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD'18
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Number of pages9
ISBN (Electronic)978-1-4503-6072-2
Publication statusPublished - 2018
EventMCPMD 2018: Workshop on Modeling Cognitive Processes from Multimodal Data - Boulder, CO, United States
Duration: 16 Oct 201818 Oct 2018


WorkshopMCPMD 2018
CountryUnited States
CityBoulder, CO


Dive into the research topics of 'Discovering Digital Representations for Remembered Episodes from Lifelog Data'. Together they form a unique fingerprint.

Cite this