CPG BASED RL ALGORITHM LEARNS TO CONTROL OF A HUMANOID ROBOT LEG
[ X ]
Tarih
2015
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Acta Press
Erişim Hakkı
info:eu-repo/semantics/closedAccess
Özet
Autonomous humanoid robots equipped with learning capabilities are able to learn tasks such as sitting down, standing up, balancing, walking and running. In this paper, central pattern generator (CPG) based reinforcement learning (RL) algorithm is applied to a robot leg with 3-links to balance it at upright by reducing dimensionality of the learning problem from 6 to 2. MapleSim is used for the leg modelling and this model is combined with the CPG based RL algorithm by utilizing Modelica and Maple software properties. Maple multi-body analysis template and Modelica custom component template allow symbolic inverse kinematics solution for the leg to be obtained. Thus, time and information lost in case of using a numerical solution are eliminated. The learning results show that the value function is maximized, temporal difference error is significantly reduced to zero and the leg is balanced at upright.
Açıklama
Anahtar Kelimeler
CPG based reinforcement learning, convergent value function, symbolic inverse kinematics solution, MapleSim, Modelica multi-body modelling software
Kaynak
International Journal of Robotics & Automation
WoS Q Değeri
Q4
Scopus Q Değeri
Q3
Cilt
30
Sayı
2
