ETH Sensing, Interaction & Perception Lab one logo ETH Sensing, Interaction & Perception Lab full logo

GazeConduits: Calibration-Free Cross-Device Collaboration through Gaze and Touch

Simon Voelker, Sebastian Hueber, Christian Remy, Christian Holz, and Nicolai Marquardt. Proceedings of ACM CHI 2020.
Abstract

We present GazeConduits, a calibration-free ad-hoc mobile interaction concept that enables users to collaboratively interact with tablets, other users, and content in a cross-device setting using gaze and touch input. GazeConduits leverages recently introduced smartphone capabilities to detect facial features and estimate users’ gaze directions. To join a collaborative setting, users place one or more tablets onto a shared table and position their phone in the center, which then tracks users present as well as their gaze direction to determine the tablets they look at. We present a series of techniques using GazeConduits for collaborative interaction across mobile devices for content selection and manipulation. Our evaluation with 20 simultaneous tablets on a table shows that GazeConduits can reliably identify which tablet or collaborator a user is looking at.