Devices: WiiMote, Wiisoft (interface-Z)

The demonstration shows the usage of various compositions of interaction modalities in the application context of a multimodal slide viewer. The user’s tasks are: (change slide) and (zoom on a point). The modalities include using the Wiimote and the Wiisoft (interface-Z) to change the slides or to zoom on a point .

Devices: WiiMote, iPhone

Using the OIDE for dynamically running components, the demonstration shows the usage of various interaction modalities in the application context of a multimodal game (ArkanOI) The user’s tasks are: (move right/left) and (change puck angle). The modalities include using the Wiimote and the iPhone to control the pucks .

Devices: WiiMote, Space Navigator, Shake, Inteface-Z sensors

Using the OIDE for assembling components and changing the specified pipeline, the demonstration shows the usage of various interaction modalities in the application context of a multimodal slide viewer. The user’s tasks are: (next/previous slide), (zoom x y) and (change transition). The modalities include pure modalities such as the ones based on buttons and gesture using the Wiimote and the SpaceNavigator as well as combined modalities based on pointing using the wiimote combined with pressure on a balloon for zooming onto a point.

Devices: Microphone, Shake

The demonstration illustrates the use of the component based OI framework for prototyping advanced interaction techniques. In order to investigate, evaluate and refine interaction techniques, the designer needs access to usage data both in real time and retrospectively. To do so, visualization tools of usage data are embedded in the OI framework. The demonstration shows the visualization tools in the context of navigating GoogleEarth by using the SHAKE sensor device.

Devices: WiiMote, iPhone

The demonstration illustrates different pure and combined modalities for navigating in GoogleEarth. The modalities are based on two devices, the iPhone and the Wiimote. Navigation can be done by gesturing using the iPhone or the Wiimote, by using buttons or gesture on the iPhone touchscreen. Finally we show a combined usage of two modalities: a Wiimote button pressed for indicating the beginning of a gesture performed by moving the iPhone.

Devices: Augmented table, Microphone

The demonstration illustrates the navigation of a map view displayed on a table. The user can directly manipulate the map with her/his fingers as well as issue voice commands such as “zoom” or “left”. Combined usage of two modalities, speech and pointing, is illustrated by the commands (Go there) or (Zoom here). The speech command is accompanied by a natural gesture to point to the place on the map.

This demo can not be downloaded due to legal issues. In order to get the speech component, contact Multitel (www.multitel.be). In order to get the touch component, contact Merl (www.merl.com) for the DiamondTouch, or Julien Letessier (www.hilabs.net) for the IR Fingertracker.

Devices: Mobile phone, Mouse, Camera

The demonstration illustrates our game test-bed platform for the iterative design of multimodal games on a mobile phone or a PDA. Focusing on multimodal interaction, the test-bed is based on the OpenInterface framework by linking the OI framework running on a PC with the functional core of the game running on devices such as mobile phones and PDAs (Bluetoooth or TCP/IP over WiFi). The demonstration illustrates the test-bed by showing various modalities for moving a character in a 3D space displayed on the mobile phone screen. The modalities include pressure on arrow buttons, movement with the mouse and head movement.

Speedy Copter (Arcadia design)

Devices: Shake

The demonstration presents the game Speedy Copter. The goal is to fly a helicopter in a virtual city. Several modalities for steering the helicopter have been explored using the OpenInterface framework. In the video we show how the player can use the SHAKE device sensor for steering the helicopter, by tilting the SHAKE. Vibrotactile feedback is employed when the helicopter is touching a building.

Devices: TrackIR, WiiMote

Component: Gesture recognition

The demonstration presents the gesture recognition OI component. The component is generic and can be used with devices such Wiimote, SHAKE, TrackIR. The video shows how the user records a gesture by demonstration using the Wiimote and TrackIR, and then associates an event with the recognized gesture (output of the component). The usage of the Gesture component in the context of a 3D game on a mobile phone is then demonstrated.