Synthesizing Avatar Motion from AI Glasses (in collaboration with Google XR)
We will generate expressive avatar motions from lightweight AI Glasses observations (where the wearer’s body is almost never visible). Using sparse inputs alone, such as speech audio, head pose, IMU signals, and occasional observations of the hands, our method will generate plausible, temporally coherent, and speech-synchronized torso, shoulder, and arm motion for telepresence and embodied avatar applications.