Human-Like Decision-Making for Automated Driving in Highways

David Sierra Gonzalez, Mario Garzon, Jilles Steeve Dibangoye, Christian Laugier

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

8 Citations (Scopus)


In this work, we present a decision-making system for automated vehicles driving in highway environments. The task is modeled as a Partially Observable Markov Decision Process, in which the physical states and intentions of surrounding traffic are uncertain. The problem is solved in an online fashion using Monte Carlo tree search. At each decision step, a search tree of beliefs is incrementally built and explored in order to find the current best action for the ego-vehicle. The beliefs represent the predicted state of the world as a response to the actions of the ego-vehicle and are updated using an interaction-and intention-aware probabilistic model. To estimate the long-term consequences of any action, we rely on a lightweight model-based prediction of the scene that assumes risk-averse behavior for all agents. We refer to the proposed decision-making approach as human-like, since it mimics the human abilities of anticipating the intentions of surrounding drivers and of considering the long-term consequences of their actions based on an approximate, common-sense, prediction of the scene. We evaluate the proposed approach in two different navigational tasks: lane change planning and longitudinal control. The results obtained demonstrate the ability of the proposed approach to make foresighted decisions and to leverage the uncertain intention estimations of surrounding drivers.

Original languageEnglish
Title of host publication2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019
ISBN (Electronic)9781538670248
Publication statusPublished - 2019
Externally publishedYes
Event2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019 - Auckland, New Zealand
Duration: 27 Oct 201930 Oct 2019


Conference2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019
Country/TerritoryNew Zealand


Dive into the research topics of 'Human-Like Decision-Making for Automated Driving in Highways'. Together they form a unique fingerprint.

Cite this