Making a scene: Representing and annotating enacted interfaces in co-performances using the screenplay

Automated and connected technologies are increasingly present in everyday life. The concept of co-performance offers a new perspective on artificial agency by understanding artifacts as capable of performing everyday practices next to people. In this pictorial we adopt a lens informed by co-performance, and propose the visual vocabulary of the screenplay as a novel way to represent and annotate co-performances. We highlight conflicts and how they are they are resolved through the enactment of new interfaces in-use. We visually represent and annotate scenes found in data from a study of households living with smart technologies. Using this visual vocabulary reveals the role of time, embodiment, character development and more, in the enactment of interfaces.