SalientGaze: Saliency-based gaze correction in virtual reality

Peiteng Shi*, Markus Billeter, Elmar Eisemann

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

2 Citations (Scopus)


Eye-tracking with gaze estimation is a key element in many applications, ranging from foveated rendering and user interaction to behavioural analysis and usage metrics. For virtual reality, eye-tracking typically relies on near-eye cameras that are mounted in the VR headset. Such methods usually involve an initial calibration to create a mapping from eye features to a gaze position. However, the accuracy based on the initial calibration degrades when the position of the headset relative to the users’ head changes; this is especially noticeable when users readjust the headset for comfort or even completely remove it for a short while. We show that a correction of such shifts can be achieved via 2D drift vectors in eye space. Our method estimates these drifts by extracting salient cues from the shown virtual environment to determine potential gaze directions. Our solution can compensate for HMD shifts, even those arising from taking off the headset, which enables us to eliminate reinitialization steps.

Original languageEnglish
Pages (from-to)83-94
Number of pages12
JournalComputers and Graphics (Pergamon)
Publication statusPublished - 2020


  • Drift estimation
  • Eye-tracking
  • Headsets shifts
  • Saliency
  • Stereo
  • Virtual reality


Dive into the research topics of 'SalientGaze: Saliency-based gaze correction in virtual reality'. Together they form a unique fingerprint.

Cite this