Abstract
Complex real-world systems pose a significant challenge to decision making: an agent needs to explore a large environment, deal with incomplete or noisy information, generalize the experience and learn from feedback to act optimally. These processes demand vast representation capacity, thus putting a burden on the agent’s limited computational and storage resources. State abstraction enables effective solutions by forming concise representations of the agents world. As such, it has been widely investigated by several research communities which have produced a variety of different approaches. Nonetheless, relations among them still remain unseen or roughly defined. This hampers potential applications of solution methods whose scope remains limited to the specific abstraction context for which they have been designed. To this end, the goal of this paper is to organize the developed approaches and identify connections between abstraction schemes as a fundamental step towards methods generalization. As a second contribution we discuss general abstraction properties with the aim of supporting a unified perspective for state abstraction.
Original language | English |
---|---|
Title of host publication | 34th Benelux Conference on Artificial Intelligence (BNAIC) and the 30th Belgian Dutch Conference on Machine Learning (Benelearn) |
Number of pages | 15 |
Publication status | Published - 2022 |
Event | 34th Benelux Conference on Artificial Intelligence (BNAIC) and the 30th Belgian Dutch Conference on Machine Learning (Benelearn) - Mechelen, Belgium Duration: 7 Nov 2022 → 9 Nov 2022 |
Conference
Conference | 34th Benelux Conference on Artificial Intelligence (BNAIC) and the 30th Belgian Dutch Conference on Machine Learning (Benelearn) |
---|---|
Abbreviated title | BNAIC/BeNeLearn 2022 |
Country/Territory | Belgium |
City | Mechelen |
Period | 7/11/22 → 9/11/22 |
Keywords
- State Abstraction
- Model Irrelevance
- Robust Reinforcement Learning
- Bounded Parameters Markov Decision Processes