论文成果 / Publications

We present the satellite cursor - a novel technique that uses multiple cursors to improve pointing performance by reducing input movement. The satellite cursor associates every target with a separate cursor in its vicinity for pointing, which realizes the MAGIC (manual and gaze input cascade) pointing method without gaze tracking. We discuss the problem of visual clutter caused by multiple cursors and propose several designs to mitigate it. Two controlled experiments were conducted to evaluate satellite cursor performance in a simple reciprocal pointing task and a complex task with multiple targets of varying layout densities. Results show the satellite cursor can save significant mouse movement and consequently pointing time, especially for sparse target layouts, and that satellite cursor performance can be accurately modeled by Fitts' Law.

Layered streaming in P2P networks has become a hot topic recently. However, the "layered" feature makes the data scheduling quite different from that for nonlayered streaming, and it hasn't been systematically studied yet. In this paper, first, according to the unique characteristics caused by layered coding, we present four objectives that should be addressed by scheduling: throughput, layer delivery ratio, useless packets ratio, and subscription jitter prevention; then a three-stage scheduling approach LayerP2P is designed to request data, where the min-cost flow model, probability decision mechanism, and multiwindow remedy mechanism are used in Free Stage, Decision Stage, and Remedy Stage, respectively, to collaboratively achieve the above objectives. With the basic version of LayerP2P and corresponding experiment results achieved in our previous work, in this paper, more efforts are put on its mechanism details and analysis to its unique features; besides, to further guarantee the performance under sharp bandwidth variation, we propose the enhanced approach by improving the Decision Stage strategy. Extensive experiments by simulation and real network implementation indicate that it outperforms other schemes. LayerP2P has also been deployed in PDEPS Project in China, which is expected to be the first practical layered streaming system for education in P2P networks.

In this paper, we re-visit the issue of multi-point laser pointer interaction from a wrist-rolling perspective. Firstly, we proposed SLP---Structured Laser Pointer, and detects a laser pointer's rotation along its emitting axis. SLP adds the wrist-rolling gestures as a new interactive dimension to the conventional laser pointer interaction approach. We asked a group of users to perform certain tasks using SLP, and derived from test results a set of criteria to distinguish between incidental and intentional SLP rolling, and then the experimental results also approved the high accuracy and acceptable speed as well as throughput of such rolling interaction.

In the large scale multimedia interactive applications over the Internet, data can be categorized into the streaming data (e.g. the audio and the video streaming) and the sporadic data (e.g. the annotation in a whiteboard). The mesh-pull overlay fits for the streaming data, for it is resilient in heterogeneous network, while the tree-push overlay is more suitable for the sporadic data, for its easy-to-manage structure can solve the problem of packet loss and disorder. To address the transmission of both types of data, a Hybrid Mesh/Tree Overlay (HyMTO) is proposed in this paper, where the sporadic data and the streaming data are transmitted through different overlays with a novel synchronous scheme. HyMTO can provide the resilient, reliable and ordered transmission for both types of data respectively. Simulations are presented to evaluate the effectiveness and efficiency of HyMTO and a practical e-conference system based on HyMTO is implemented and deployed to demonstrate its practicability and reasonability.

Touch screen phone roaming with people features high accessibility and direct-manipulation interaction, regarded as one of the most convenient interfaces for daily life. In this paper, we present HouseGenie to leverage universal monitor and control of networked devices in smart home on touch screen phone. By wirelessly communicating with an OSGi based portal, which maintains all the devices through varied protocols (e.g. industrial standard UPnP or IGRS), HouseGenie facilitates universal home monitor and control: 1) monitoring current status in panoramic view; 2) direct manipulating single/multiple device(s) using pie-menu, list-mode and drag drop gesture; 3) easily controlling devices in several multimodality ways.

With the development of pervasive computing, smart home is increasingly popular. Smart Home usually requires an integration of many heterogeneous devices and service applications in deployment so it is hard and expensive to implement system test. To cope with this problem, this paper describes an OSGI-based smart home simulator named SHSim that is suitable for smart home test. SHSim is built on a dynamic mechanism that allows user to configure the system and test cases easily, and provides device transparent simulation meaning that virtual devices can transplant to real devices with no or little modifications. Practical applications show that SHSim can effectively improve development efficiency and reduce test cost.

This paper introduced pPen, a pressure-sensitive digital pen enabled precise pressure and touch input on vision based interactive tabletops. With the help of pPen inputs and feature matching technology, we implemented a novel method supporting multi-user authenticated interaction in the bimanual pen and touch scenario: login can be performed just by stroking one's signature with pPen on the table; a binding between user and pPen was created at the same time, then each interaction command made by pPen is user differentiating. We also conducted laboratory user studies, which later proved the safety and the high resistance to shoulder surfing problem: in the evaluation procedure, any attacker can never log into other user's working space.

Painting artworks, especially those having surreal or super-rational elements, are difficult for ordinary people to deeply appreciate in a static exhibiting manner. We believe that bringing interactivity to an existing painting would have benefits of emphasizing the theme, encouraging active and collaborative learning, and compensating its aura. To this end, in this paper we present DALI (Dali's Artwork for Learning Interactively), a multi-touch system designed to guide viewers in their processes of appreciating painting artworks. The current system runs on a multi-touch tabletop. 30 paintings of Spanish artist Salvador Dali's were digitized, deconstructed, and interactively displayed on the table. Visual effects on the paintings can be triggered by hand and finger gestures-an effective way of visual arts education.