Actuation Confirmation and Negation via Facial-Identity and -Expression Recognition

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

4 Citations (Scopus)
23 Downloads (Pure)


This paper presents the implementation of a facial-identity and-expression recognition mechanism that confirms or negates physical and/or computational actuations in an intelligent built-environment. Said mechanism is built via Google Brain's TensorFlow (as regards facial identity recognition) and Google Cloud Platform's Cloud Vision API (as regards facial gesture recognition); and it is integrated into the ongoing development of an intelligent built-environment framework, viz., Design-To-Robotic-Production &-Operation (D2RP&O), conceived at Delft University of Technology (TUD). The present work builds on the inherited technological ecosystem and technical functionality of the Design-To-Robotic-Operation (D2RO) component of said framework; and its implementation is validated via two scenarios (physical and computational). In the first scenario-and building on an inherited adaptive mechanism-if building-skin components perceive a rise in interior temperature levels, natural ventilation is promoted by increasing degrees of aperture. This measure is presently confirmed or negated by a corresponding facial expression on the part of the user in response to said reaction, which serves as an intuitive override / feedback mechanism to the intelligent building-skin mechanism's decision-making process. In the second scenario-and building on another inherited mechanism-if an accidental fall is detected and the user remains consciously or unconsciously collapsed, a series of automated emergency notifications (e.g., SMS, email, etc.) are sent to family and/or care-Takers by particular mechanisms in the intelligent built-environment. The precision of this measure and its execution are presently confirmed by (a) identity detection of the victim, and (b) recognition of a reflexive facial gesture of pain and/or displeasure. The work presented in this paper promotes a considered relationship between the architecture of the built-environment and the Information and Communication Technologies (ICTs) embedded and/or deployed.

Original languageEnglish
Title of host publicationProceedings IEEE 3rd Ecuador Technical Chapters Meeting (ETCM 2018)
Number of pages6
ISBN (Electronic)9781538666579
ISBN (Print)9781538666586
Publication statusPublished - 2018
EventETCM 2018: 3rd IEEE Ecuador Technical Chapters Meeting - Cuenca, Ecuador
Duration: 15 Oct 201819 Oct 2018


ConferenceETCM 2018: 3rd IEEE Ecuador Technical Chapters Meeting

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project

Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.


  • Adaptive Architecture
  • Ambient Intelligence
  • Design-To-Robotic-Production &-Operation
  • Facial Recognition
  • Wireless Sensor and Actuator Networks


Dive into the research topics of 'Actuation Confirmation and Negation via Facial-Identity and -Expression Recognition'. Together they form a unique fingerprint.

Cite this