Skip to Main content Skip to Navigation
Journal articles

Data-Efficient Reinforcement Learning for Energy Optimization Under Human Fatigue Constraints of Power-Assisted Wheelchairs

Abstract : The objective of this paper is to develop a method for assisting users to push Power-Assisted Wheelchairs (PAW) in such a way that the electrical energy consumption over a predefined distance-to-go is optimal, while at the same time bringing users to a desired fatigue level. This assistive task is formulated as an optimal control problem and solved in [17] by the model-free approach Gradient Partially Observable Markov Decision Processes. To increase the data efficiency of the model-free framework, we propose here to use Policy learning by Weighting Exploration with the Returns (PoWER) with 25 controller parameters. Moreover, we provide a new nearoptimality analysis of the finite-horizon fuzzy Q-iteration, which derives a model-based baseline solution to verify numerically the near-optimality of the presented model-free approaches. Simulation results show that the PoWER algorithm with the new parameterization converges to a near-optimal solution within 200 trials and possesses the adaptability to cope with changes of the human fatigue dynamics. Finally, 24 experimental trials are carried out on the PAW system, with fatigue feedback provided by the user via a joystick. The performance tends to increase gradually after learning. The results obtained demonstrate the effectiveness and the feasibility of PoWER in our application
Document type :
Journal articles
Complete list of metadata

https://hal-uphf.archives-ouvertes.fr/hal-03468370
Contributor : Mylène Delrue Connect in order to contact the contributor
Submitted on : Tuesday, December 7, 2021 - 10:05:01 AM
Last modification on : Tuesday, January 4, 2022 - 6:35:13 AM

Identifiers

  • HAL Id : hal-03468370, version 1

Collections

Citation

Guoxi Feng, Lucian Buşoniu, Thierry-Marie Guerra, Sami Mohammad. Data-Efficient Reinforcement Learning for Energy Optimization Under Human Fatigue Constraints of Power-Assisted Wheelchairs. IEEE Transactions on Industrial Electronics, Institute of Electrical and Electronics Engineers, 2019, 66 (12), pp.9734-9744. ⟨hal-03468370⟩

Share

Metrics

Les métriques sont temporairement indisponibles