This paper describes ObjectResponder - a tool that allows designers to use Artificial Intelligence (AI) to rapidly prototype concepts for context-aware intelligent interaction in the wild. To our knowledge, there are currently no available tools for designing and prototyping with AI within the actual context of use. Our application uses Google Cloud Vision to allow designers assigning chat bot-like responses to objects recognized by the smart-phone camera. This enables designers to use object recognition labels as a means to diverge on possible interpretations of the context and start generating ideas that can then be immediately tested and iterated. Initial results suggest that looking at the world from the perspective of the AI may enable designers to balance human and nonhuman biases, enrich a designer's understanding of the context, and open up unexpected directions for idea generation.
|Title of host publication||DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference|
|Place of Publication||New York, NY, USA|
|Publisher||Association for Computing Machinery (ACM)|
|Number of pages||6|
|Publication status||Published - 2019|
|Event||2019 ACM Conference on Designing Interactive Systems, DIS 2019 - San Diego, United States|
Duration: 23 Jun 2019 → 28 Jun 2019
|Name||DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference|
|Conference||2019 ACM Conference on Designing Interactive Systems, DIS 2019|
|Period||23/06/19 → 28/06/19|
Bibliographical noteGreen Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
- Computer vision
- Interaction design
- Machine learning