Astral: Prototyping Mobile and IoT Interactive Behaviours via Streaming and Input Remapping

Abstract
We present Astral, a prototyping tool for mobile and Internet of Things interactive behaviours that streams selected desktop display contents onto mobile devices (smartphones and smartwatches) and remaps mobile sensor data into desktop input events (i.e., keyboard and mouse events). Interactive devices such as mobile phones, watches, and smart objects, offer new opportunities for interaction design– yet prototyping their interactive behaviour remains an implementation challenge. Additionally, current tools often focus on systems responding after an action takes place as opposed to while the action takes place. With Astral, designers can rapidly author interactive prototypes live on mobile devices through familiar desktop applications. Designers can also customize input mappings using easing functions to author, fine-tune and assess rich outputs. We demonstrate the expressiveness of Astral through a set of prototyping scenarios with novel and replicated examples from past literature which reflect how the system might support and empower designers throughout the design process.
Description
Keywords
Prototyping, design tool, interactive behaviour, smart objects, mobile interfaces
Citation
Ledo, D., Vermeulen, J., Carpendale, S., Greenberg, S., Oehlberg, L., and Boring, S. (2018). Astral: Prototyping Mobile and IoT Interactive Behaviours via Streaming and Input Remapping (Report 2018-1107-06). Calgary, AB. : Department of Computer Science, University of Calgary.