Interacting with connected devices through a drawable user interface

The massive increase in connected devices and the opportunities they present makes it essential to give users a tool to manage the complexity of such systems. This new landscape creates the need to memorize multiple relations and connections, between different objects and their functionalities. Thus, a big mental load is required for the user in order to interact with these devices. In this paper, we present a novel approach using a drawable user interface. We explain the capabilities of drawing to interact with connected devices and how they empower users to define the functions of their system based on their personal, local and often task-specific needs. We also explore different applications for this type of interaction as well as its implementation. Finally, we discuss how to use our concept in order to design a drawable programming language.