6533b861fe1ef96bd12c4c48

RESEARCH PRODUCT

A Learning Automata Local Contribution Sampling Applied to Hydropower Production Optimisation

Jahn Thomas FidjeOle-christopher GranmoChristian Kråkevik HaraldseidBernt Viggo MatheussenMorten Goodwin

subject

Scheme (programming language)Mathematical optimizationEngineeringSpeedupLearning automatabusiness.industrySampling (statistics)Machine learningcomputer.software_genrePower (physics)Range (mathematics)Convergence (routing)Reinforcement learningArtificial intelligencebusinesscomputercomputer.programming_language

description

Learning Automata (LA) is a powerful approach for solving complex, non-linear and stochastic optimisation problems. However, existing solutions struggle with high-dimensional problems due to slow convergence, arguably caused by the global nature of feedback. In this paper we introduce a novel Learning Automata (LA) scheme to attack this challenge. The scheme is based on a parallel form of Local Contribution Sampling (LCS), which means that the LA receive individually directed feedback, designed to speed up convergence. Furthermore, our scheme is highly decentralized, allowing parallel execution on GPU architectures. To demonstrate the power of our scheme, the LA LCS is applied to hydropower production optimisation, involving several particularly challenging optimisation scenarios. The experimental results show that LA LCS is able to quickly find optimal solutions for a wide range of problem configurations. Our results also demonstrate that local directed feedback provides significantly faster convergence than global feedback. These results lead us to conclude that LA LCS holds great promise for solving complex, non-linear and stochastic optimisation problems, opening up for improved performance in a number of real-world applications.

yearjournalcountryeditionlanguage
2017-01-01
https://doi.org/10.1007/978-3-319-71078-5_15