TY - GEN
T1 - Improving reinforcement learning by using case based heuristics
AU - Bianchi, Reinaldo A.C.
AU - Ros, Raquel
AU - Lopez De Mantaras, Ramon
PY - 2009
Y1 - 2009
N2 - This work presents a new approach that allows the use of cases in a case base as heuristics to speed up Reinforcement Learning algorithms, combining Case Based Reasoning (CBR) and Reinforcement Learning (RL) techniques. This approach, called Case Based Heuristically Accelerated Reinforcement Learning (CB-HARL), builds upon an emerging technique, the Heuristic Accelerated Reinforcement Learning (HARL), in which RL methods are accelerated by making use of heuristic information. CB-HARL is a subset of RL that makes use of a heuristic function derived from a case base, in a Case Based Reasoning manner. An algorithm that incorporates CBR techniques into the Heuristically Accelerated Q-Learning is also proposed. Empirical evaluations were conducted in a simulator for the RoboCup Four-Legged Soccer Competition, and results obtained shows that using CB-HARL, the agents learn faster than using either RL or HARL methods.
AB - This work presents a new approach that allows the use of cases in a case base as heuristics to speed up Reinforcement Learning algorithms, combining Case Based Reasoning (CBR) and Reinforcement Learning (RL) techniques. This approach, called Case Based Heuristically Accelerated Reinforcement Learning (CB-HARL), builds upon an emerging technique, the Heuristic Accelerated Reinforcement Learning (HARL), in which RL methods are accelerated by making use of heuristic information. CB-HARL is a subset of RL that makes use of a heuristic function derived from a case base, in a Case Based Reasoning manner. An algorithm that incorporates CBR techniques into the Heuristically Accelerated Q-Learning is also proposed. Empirical evaluations were conducted in a simulator for the RoboCup Four-Legged Soccer Competition, and results obtained shows that using CB-HARL, the agents learn faster than using either RL or HARL methods.
UR - https://www.scopus.com/pages/publications/70350352555
U2 - 10.1007/978-3-642-02998-1_7
DO - 10.1007/978-3-642-02998-1_7
M3 - Conference contribution
AN - SCOPUS:70350352555
SN - 3642029973
SN - 9783642029974
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 75
EP - 89
BT - Case-Based Reasoning Research and Development - 8th International Conference on Case-Based Reasoning, ICCBR 2009, Proceedings
T2 - 8th International Conference on Case-Based Reasoning, ICCBR 2009
Y2 - 20 July 2009 through 23 July 2009
ER -