论文成果 / Publications

Eyes-free target acquisition is a basic and important human ability to interact with the surrounding physical world, relying on the sense of space and proprioception. In this research, we leverage this ability to improve interaction in virtual reality (VR), by allowing users to acquire a virtual object without looking at it. We expect this eyes-free approach can effectively reduce head movements and focus changes, so as to speed up the interaction and alleviate fatigue and VR sickness.

We propose VirtualGrasp, a novel gestural approach to retrieve virtual objects in virtual reality. Using VirtualGrasp, a user retrieves an object by performing a barehanded gesture as if grasping its physical counterpart. The object-gesture mapping under this metaphor is of high intuitiveness, which enables users to easily discover, remember the gestures to retrieve the objects.

We present ForceBoard, a pressure-based input technique that enables text entry by subtle finger motion. To enter text, users apply pressure to control a multi-letter-wide sliding cursor on a one-dimensional keyboard with alphabetical ordering, and confirm the selection with a quick release. We examined the error model of pressure control for successive and error-tolerant input, which was incorporated into a Bayesian algorithm to infer user input.

本文阐述了通过 Bayes 方法来预测用户交互意图的建模方法过程和推理过程. 在自然交互界面上, 用户不再是严格地通过离散明确的交互操作完成交互, 而是通过连续、非确定的多模态数据表达交互意图. 在解释用户的交互意图时, 既可以使用 “黑盒子” 的机器学习方法, 也可以利用 “白盒子” 的基于用户行为建模的方法. 后者中的用户建模, 其本质是通过计算的方法来刻画用户的行为能力, 对于理解用户意图和探索自然交互的计算原理具有重要的科学意义. 文章回顾了近年来人机交互研究中主要采用的智能算法, 向读者厘清不同方法之间的差别, 并通过我们实验室的具体研究工作展示用户建模的方法和Bayes推理的建模方法过程和推理过程.

The trend toward ubiquitous deployment of electronic devices demands novel low maintenance power schemes to decrease the burden of maintaining such a large number of devices. In this paper, we propose Interaction-based Power Transfer (IPT): a novel power scheme for power-as-needed devices (i.e., devices that only require power during interaction).

Radio-Frequency Identification (RFID)systems are becoming increasingly used within smart environments. In this paper, we propose BitID, a passive Ultra-High Frequency (UHF)RFID based sensing technique that can easily be made using off-the-shelf tags. BitID can be added to everyday objects to enable sensing and control capabilities. With a simple shorting mechanism, BitID is able to differentiate between two states of the object to which it is attached(for example, whether a door is open or closed). We explain the working principle of BitID,and demonstrate how to build and apply it to target objects. We also show that by using a three-layered system architecture,BitID can be used for various applications, including event detection, energy monitoring, fitness tracking, human behavior tracking and control.

Eyes-free input is desirable for ubiquitous computing, since interacting with mobile and wearable devices often competes for visual attention with other devices and tasks. In this paper, we explore eyes-free typing on a touchpad using one thumb, wherein a user taps on an imaginary QWERTY keyboard while receiving text feedback on a separate screen.

Typing on tiny QWERTY keyboards on smartwatches is considered challenging or even impractical due to the limited screen space. In this paper, we describe three user studies undertaken to investigate users’ typing abilities and preferences on tiny QWERTY keyboards.