Scalable motion capture in the wild (ECCV '26)
play
distributed ego-exo human motion capture from head-mounted devices
read more
SIPLAB: Sensing, Interaction & Perception Lab
The SIPLAB is a research lab at ETH Zürich working on egocentric perception, computational interaction, and behavioral AI. We advance mixed reality, robotics, and human-computer interaction toward adaptive intelligence and human-aware systems. We are part of the Department of Computer Science and the AI Center.
egocentric perception
motion tracking, action understanding, and planning
input decoding for adaptive systems
user modeling for computational interaction
behavioral AI
human affect, emotions, and traits via digital biomarkers
Projects to appear and recent research
InvisiSpeech
Making Silent Speech Invisible through a Miniature Intraoral SensorCapFM
A Foundation Model for Capacitive Touch SensingEgoPHI
Estimating 3D Hand-Object Contact and Force from Egocentric VisionEgoExoMoCap
Distributed Ego-Exo Human Motion CaptureEgoHRV
Continuous Heart Rate Variability Estimation from Egocentric SystemsSkillSpotter
Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo VideosAffiliations and collaborations
- Department of Computer Science (D-INFK)
- Robotics, Systems and Control Program at ETH Zürich
- Department of Information Technology & Electrical Engineering (D-ITET)
- ETH AI Center
- Max Planck ETH Center for Learning Systems (CLS)
- ELLIS Unit Zürich
- ETH Augmented Reality Research Hub (ETHAR)
- Human-Computer Interaction @ ETH Zürich (HCI@ETH)
- Competence Centre for Rehabilitation Engineering and Science (ETH RESC)
- Zurich Information Security & Privacy Center (ZISC)