A Unified Decision-Theoretic Model for Information Gathering and Communication Planning

Jennifer Renoux; Tiago S. Veiga; Pedro U. Lima; Matthijs T.J. Spaan

doi:10.1109/RO-MAN47096.2020.9223597

A Unified Decision-Theoretic Model for Information Gathering and Communication Planning

Jennifer Renoux, Tiago S. Veiga, Pedro U. Lima, Matthijs T.J. Spaan

Algorithmics

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

4 Citations (Scopus)

Abstract

We consider the problem of communication planning for human-machine cooperation in stochastic and partially observable environments. Partially Observable Markov Decision Processes with Information Rewards (POMDPs-IR) form a powerful framework for information-gathering tasks in such environments. We propose an extension of the POMDP-IR model, called a Communicating POMDP-IR (com-POMDP-IR), that allows an agent to proactively plan its communication actions by using an approximation of the human’s beliefs. We experimentally demonstrate the capability of our com-POMDPIR agent to limit its communication to relevant information and its robustness to lost messages.

Original language	English
Title of host publication	2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
Subtitle of host publication	Proceedings
Publisher	IEEE
Pages	67-74
Number of pages	8
ISBN (Electronic)	978-1-7281-6075-7
ISBN (Print)	978-1-7281-6076-4
DOIs	https://doi.org/10.1109/RO-MAN47096.2020.9223597
Publication status	Published - 2020
Event	The 29th IEEE International Conference on Robot and Human Interactive Communication - 2020 VIRTUAL CONFERENCE Duration: 31 Aug 2020 → 4 Sept 2020 Conference number: 29

Conference

Conference	The 29th IEEE International Conference on Robot and Human Interactive Communication
Abbreviated title	Ro-MAN 2020
Period	31/08/20 → 4/09/20

Bibliographical note

Virtual/online event due to COVID-19

Access to Document

10.1109/RO-MAN47096.2020.9223597

Cite this

@inproceedings{6d73f5fc1b184a6dba98e90b23242351,

title = "A Unified Decision-Theoretic Model for Information Gathering and Communication Planning",

abstract = "We consider the problem of communication planning for human-machine cooperation in stochastic and partially observable environments. Partially Observable Markov Decision Processes with Information Rewards (POMDPs-IR) form a powerful framework for information-gathering tasks in such environments. We propose an extension of the POMDP-IR model, called a Communicating POMDP-IR (com-POMDP-IR), that allows an agent to proactively plan its communication actions by using an approximation of the human{\textquoteright}s beliefs. We experimentally demonstrate the capability of our com-POMDPIR agent to limit its communication to relevant information and its robustness to lost messages.",

author = "Jennifer Renoux and Veiga, {Tiago S.} and Lima, {Pedro U.} and Spaan, {Matthijs T.J.}",

note = "Virtual/online event due to COVID-19 ; The 29th IEEE International Conference on Robot and Human Interactive Communication, Ro-MAN 2020 ; Conference date: 31-08-2020 Through 04-09-2020",

year = "2020",

doi = "10.1109/RO-MAN47096.2020.9223597",

language = "English",

isbn = "978-1-7281-6076-4",

pages = "67--74",

booktitle = "2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)",

publisher = "IEEE",

address = "United States",

}

Renoux, J, Veiga, TS, Lima, PU & Spaan, MTJ 2020, A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. in 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN): Proceedings. IEEE, pp. 67-74, The 29th IEEE International Conference on Robot and Human Interactive Communication, 31/08/20. https://doi.org/10.1109/RO-MAN47096.2020.9223597

A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. / Renoux, Jennifer; Veiga, Tiago S.; Lima, Pedro U. et al.
2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN): Proceedings. IEEE, 2020. p. 67-74.

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - A Unified Decision-Theoretic Model for Information Gathering and Communication Planning

AU - Renoux, Jennifer

AU - Veiga, Tiago S.

AU - Lima, Pedro U.

AU - Spaan, Matthijs T.J.

N1 - Conference code: 29

PY - 2020

Y1 - 2020

N2 - We consider the problem of communication planning for human-machine cooperation in stochastic and partially observable environments. Partially Observable Markov Decision Processes with Information Rewards (POMDPs-IR) form a powerful framework for information-gathering tasks in such environments. We propose an extension of the POMDP-IR model, called a Communicating POMDP-IR (com-POMDP-IR), that allows an agent to proactively plan its communication actions by using an approximation of the human’s beliefs. We experimentally demonstrate the capability of our com-POMDPIR agent to limit its communication to relevant information and its robustness to lost messages.

AB - We consider the problem of communication planning for human-machine cooperation in stochastic and partially observable environments. Partially Observable Markov Decision Processes with Information Rewards (POMDPs-IR) form a powerful framework for information-gathering tasks in such environments. We propose an extension of the POMDP-IR model, called a Communicating POMDP-IR (com-POMDP-IR), that allows an agent to proactively plan its communication actions by using an approximation of the human’s beliefs. We experimentally demonstrate the capability of our com-POMDPIR agent to limit its communication to relevant information and its robustness to lost messages.

UR - http://www.scopus.com/inward/record.url?scp=85095738796&partnerID=8YFLogxK

U2 - 10.1109/RO-MAN47096.2020.9223597

DO - 10.1109/RO-MAN47096.2020.9223597

M3 - Conference contribution

SN - 978-1-7281-6076-4

SP - 67

EP - 74

BT - 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)

PB - IEEE

T2 - The 29th IEEE International Conference on Robot and Human Interactive Communication

Y2 - 31 August 2020 through 4 September 2020

ER -

A Unified Decision-Theoretic Model for Information Gathering and Communication Planning

Abstract

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this