MMTSA: Multi-Modal Temporal Segment Attention Network for Efficient Human Activity Recognition
Efficient multimodal HAR using camera and IMU. Achieves 11% F1-score improvement with lower latency on edge devices.
ConeSpeech: Exploring Directional Speech Interaction for Multi-Person Remote Communication in Virtual Reality
Remote communication is essential for efficient collaboration among people at different locations. We present ConeSpeech, a virtual reality (VR) based multi-user remote …
GlucoScreen: A Smartphone-based Readerless Glucose Test Strip for Prediabetes Screening
Blood glucose measurement is commonly used to screen for and monitor diabetes, a chronic condition characterized by the inability to effectively modulate blood glucose that can …
Enabling Real-Time On-Chip Audio Super Resolution for Bone-Conduction Microphones
Voice communication using an air-conduction microphone in noisy environments suffers from the degradation of speech audibility. Bone-conduction microphones (BCM) are robust against …
DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU Rings
We present DRG-Keyboard, a gesture keyboard enabled by dual IMU rings, allowing the user to swipe the thumb on the index fingertip to perform word gesture typing as if typing on a …
Modeling the Noticeability of User-Avatar Movement Inconsistency for Sense of Body Ownership Intervention
An avatar mirroring the user's movement is commonly adopted in Virtual Reality(VR). Maintaining the user-avatar movement consistency provides the user a sense of body ownership and …
MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing
First mobile personalized rPPG system using dual cameras. Self-supervised learning without gold standard data.
Easily-add battery-free wireless sensors to everyday objects: system implementation and usability study
The trend of IoT brings more and more connected smart devices into our daily lives, which can enable a ubiquitous sensing and interaction experience. However, augmenting many …
Natural interactive techniques for the detection and assessment of neurological diseases
DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU Rings
We present DualRing, a novel ring-form input device that can capture the state and movement of the user's hand and fingers. With two IMU rings attached to the user's thumb and …