Research projects

Our research spans the areas of computational interaction, physical computing, virtual/mixed reality and haptics, and predictive mobile health monitoring. See also the list of our releases. For all general inquiries and requests, email Christian at christian/holz#inf/ethz/ch.

The projects below are selected from a subset of our research output. See our full list of publications here.

Biomarkers for daily fatigue

Continuous wearable monitoring for fatigue modeling. Cell Press iScience.

Quasi-periodic Data Augmentation

From Chaos to Order in Contrastive Learning for Time Series. Neural Information Processing Systems 2023.

Video-based Sympathetic Arousal

Non-contact estimation of electrodermal activity. Biomedical Optics Express 2023.

Structured Light Speckle

Joint egocentric depth estimation and low-latency contact detection via remote vibrometry. ACM UIST 2023.

ViGather

Inclusive Virtual Conferencing with a Joint Experience Across Traditional Screen Devices and Mixed Reality Headsets. ACM MHCI 2023.

BeliefPPG

Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation. Uncertainty in Artificial Intelligence (UAI) 2023.

HOOV

Hand Out-Of-View Tracking for Mixed Reality using Inertial Sensing. ACM CHI 2023.

Reality Rifts

Wonder-ful Interfaces by Disrupting Perceptual Causality. ACM CHI 2023.

HandyCast

Bimanual Input for VR in Space-Constrained Settings via Smartphone. ACM CHI 2023.

InfinitePaint

Painting in Virtual Reality with Passive Haptics Using Wet Brushes and a Physical Proxy Canvas. ACM CHI 2023.

DeltaPen

High-Precision Translation and Rotation Sensing on Passive Surfaces. ACM UIST 2022.

AvatarPoser

Articulated Full-Body Pose Tracking from Sparse Motion Sensing. ECCV 2022.

ComforTable User Interfaces

Passive surfaces benefit input performance and lower exertion and strain in VR. IEEE ISMAR 2022.

Physiological Responses to Fear, Frustration, and Insight

A study in Virtual Reality. IEEE TVCG 2022.

Cognitive Fatigability Assessment Test

A novel instrument to assess perceived fatigue. DIGITAL HEALTH 2022.

Causality-preserving Asynchronous Reality

Where everything remains real except the flow of time. ACM CHI 2022. Best paper award.

TapType

Ten-finger text entry on everyday surfaces via Bayesian inference. ACM CHI 2022.

Affective State Prediction

From Smartphone Touch and Sensor Data in the Wild. ACM CHI 2022.

The Chaotic Behavior of Redirection

Revisiting Simulations in Redirected Walking. IEEE VR 2022. Best paper award.

SoundsRide

Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality. ACM UIST 2021. Best paper award.

TouchPose

3D Hand Pose Prediction and Depth Estimation from Capacitive Images. ACM UIST 2021.

AirConstellations

In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures. ACM UIST 2021.

TransforMR

Pose-Aware Object Substitution for Composing Alternate Mixed Realities. IEEE ISMAR 2021.

Gaze comes in handy

Predicting and Preventing Erroneous Hand Actions in AR-Supported Manual Tasks. IEEE ISMAR 2021.

Predicting Fatigue from Fatigability

A phone-based in-the-wild Study with Multiple Sclerosis Patients. ACM IMWUT 2021.

CoolMoves

User Motion Accentuation in Virtual Reality. ACM IMWUT 2021.

CapContact

Super-resolution Contact Areas from Capacitive Touchscreens. ACM CHI 2021. Best paper award.

TapID

Rapid Touch Interaction in Virtual Reality using Wearable Sensing. IEEE VR 2021. Best demonstration award.

Flashpen

A High-Fidelity and High-Precision Multi-Surface Pen for Virtual Reality. IEEE VR 2021.

Omni

Volumetric Sensing and Actuation of Passive Magnetic Tools for Dynamic Haptic Feedback. ACM UIST 2020.

SurfaceFleet

Exploring Distributed Interactions Unbounded from Device, Application, User, and Time. ACM UIST 2020.

Tilt-Responsive Techniques for Digital Drawing Boards

ACM UIST 2020.

Virtual Reality Without Vision

A Haptic and Auditory White Cane to Navigate Complex Virtual Worlds. ACM CHI 2020. Honorable mention award.

Assessing Fatigability in Multiple Sclerosis Patients

A Rapid Tapping Task for Phone-based Mobile Health. ACM CHI 2020.

Towards Privacy-Preserving Ego-Motion Estimation using an Extremely Low-Resolution Camera

IEEE Robotics and Automation Letters 2020.

DreamWalker

Substituting Real-World Walking Experiences with a Virtual Reality. ACM UIST 2019.

CapstanCrunch

A Haptic VR Controller with User-supplied Force Feedback. ACM UIST 2019. Best demonstration honorable mention award.

Mise-Unseen

Using Eye Tracking to Hide Virtual Reality Scene Changes in Plain Sight. ACM UIST 2019.

TORC

A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction. ACM CHI 2019.

Sensing Posture-Aware Pen+Touch Interaction on Tablets

ACM CHI 2019. Honorable mention award.

SeeingVR

A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. ACM CHI 2019.

RealityCheck

Blending Virtual Environments with Situated Physical Reality. ACM CHI 2019.

Cross-Device Taxonomy

Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. ACM CHI 2019.

VRoamer

Generating On-The-Fly VR Experiences While Walking inside Large, Unknown Real-World Building Environments. IEEE VR 2019.

Naptics

Continuous Blood Pressure Monitoring during Sleep. ACM IMWUT 2018.

Smartphone Pulse Oximetry

Phone displays for selective illumination and cameras as sensors. IEEE EMBC 2018.

Project Zanzibar

A Portable and Flexible Tangible Interaction Platform. ACM CHI 2018. Best paper award.

Haptic Revolver

Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. ACM CHI 2018. Honorable mention award.

CLAW

A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. ACM CHI 2018.

Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation

ACM CHI 2018.

SurfaceConstellations

A Modular Hardware Platform for Ad-Hoc Reconfigurable Cross-Device Workspaces. ACM CHI 2018.

PolarTrack

Optical Outside-In Device Tracking that Exploits Display Polarization. ACM CHI 2018.

Glabella

Smart Glasses for Continuously Monitoring Blood Pressure. ACM IMWUT 2017. Distinguished paper award.

Sparse Haptic Proxy

Touch Feedback in Virtual Environments Using a General Passive Prop. ACM CHI 2017.

Finding Common Ground

A Survey of Capacitive Sensing in Human-Computer Interaction. ACM CHI 2017.

NormalTouch and TextureTouch

High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. ACM UIST 2016. Honorable mention award.

DuoSkin

Rapidly Prototyping On-Skin User Interfaces Using Skin-Friendly Materials. ACM ISWC 2016.

On-Demand Biometrics

Fast and Convenient Cross-Device Login. ACM CHI 2016.

Tracko

Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. ACM UIST 2015.

Biometric Touch Sensing

Seamlessly Augmenting Each Touch with Continuous Authentication. ACM UIST 2015.

Bodyprint

Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. ACM CHI 2015.

Fiberio

A Touchscreen that Senses Fingerprints. ACM UIST 2013. Best paper award.

The Generalized Perceived Input Point Model

How to Double Touch Accuracy by Extracting Fingerprints. ACM CHI 2010.

Releases

SVG2Keynote

Convert SVG documents to editable Apple Keynote shapes.