DreamCatcher: a wearer-aware sleep event dataset based on earables in non-restrictive environments

January 1, 2024·
Zeyu Wang
,
Xiyuxing Zhang
,
Ruotong Yu
Yuntao Wang
Yuntao Wang
,
Kenneth Christofferson
,
Jingru Zhang
,
Alex Mariakakis
,
Yuanchun Shi
· 0 min read
URL
Abstract
Poor quality sleep can be characterized by the occurrence of events ranging from body movement to breathing impairment. Widely available earbuds equipped with sensors (also known as earables) can be combined with a sleep event detection algorithm to offer a convenient alternative to laborious clinical tests for individuals suffering from sleep disorders. Although various solutions utilizing such devices have been proposed to detect sleep events, they ignore the fact that individuals often share sleeping spaces with roommates or couples. To address this issue, we introduce DreamCatcher, the first publicly available dataset for wearer-aware sleep event algorithm development on earables. DreamCatcher encompasses eight distinct sleep events, including synchronous dual-channel audio and motion data collected from 12 pairs (24 participants) totaling 210 hours (420 hour.person) with fine-grained label. We tested multiple benchmark models on three tasks related to sleep event detection, demonstrating the usability and unique challenge of DreamCatcher. We hope that the proposed Dream-Catcher can inspire other researchers to further explore efficient wearer-aware human vocal activity sensing on earables. DreamCatcher is publicly available at https://github.com/thuhci/DreamCatcher.
Type
Publication
Proceedings of the 38th International Conference on Neural Information Processing Systems
publications
Authors
Authors
Yuntao Wang
Authors
Associate Professor (Research Track)
Yuntao Wang’s research centers on physiobehavioral computing and intelligent interaction for mobile and wearable systems. His work focuses on (1) developing robust, efficient sensing that performs reliably on mainstream devices, (2) extracting spatiotemporal patterns from multimodal signals to infer interaction intent by leveraging natural behavioral correlations, and (3) designing edge-efficient interfaces that deliver high performance on mobile and wearable platforms. He has published 90+ papers, received 10 international conference awards, and holds 30+ granted patents. His contributions have been recognized with honors including the Wu Wenjun AI Outstanding Youth Award (2024), the CAST Young Elite Scientists Sponsorship Program (2022), the Qinghai High-Level Innovation & Entrepreneurship Leading Talent (2024), and the First Prize of the China Electronics Institute Science & Technology Award (2019).