A reinforcement-learning-based evolutionary algorithm using solution space clustering for multimodal optimization problems

dc.cclicenceN/Aen
dc.contributor.authorXia, Hai
dc.contributor.authorLi, Changhe
dc.contributor.authorZeng, Sanyou
dc.contributor.authorTan, Qingshan
dc.contributor.authorWang, Junchen
dc.contributor.authorYang, Shengxiang
dc.date.acceptance2021-04
dc.date.accessioned2021-04-20T10:52:29Z
dc.date.available2021-04-20T10:52:29Z
dc.date.issued2021-06
dc.descriptionThe file attached to this record is the author's final peer reviewed version.en
dc.description.abstractIn evolutionary algorithms, how to effectively select interactive solutions for generating offspring is a challenging problem. Though many operators are proposed, most of them select interactive solutions (parents) randomly, having no specificity for the features of landscapes in various problems. To address this issue, this paper proposes a reinforcement-learning-based evolutionary algorithm to select solutions within the approximated basin of attraction. In the algorithm, the solution space is partitioned by the k-dimensional tree, and features of subspaces are approximated with respect to two aspects: objective values and uncertainties. Accordingly, two reinforcement learning (RL) systems are constructed to determine where to search: the objective-based RL exploits basins of attraction (clustered subspaces) and the uncertainty-based RL explores subspaces that have been searched comparatively less. Experiments are conducted on widely used benchmark functions, demonstrating that the algorithm outperforms three other popular multimodal optimization algorithms.en
dc.funderOther external funder (please detail below)en
dc.funder.otherNational Natural Science Foundation of Chinaen
dc.identifier.citationXia, H., Li, C., Zeng, S., Tan, Q., Wang, J. and Yang, S. (2021) A reinforcement-learning-based evolutionary algorithm using solution space clustering for multimodal optimization problems. Proceedings of the 2021 IEEE Congress on Evolutionary Computation, June 2021.en
dc.identifier.doihttps://doi.org/10.1109/cec45853.2021.9504896
dc.identifier.urihttps://dora.dmu.ac.uk/handle/2086/20780
dc.language.isoen_USen
dc.peerreviewedYesen
dc.projectid62076226, 61673355 and 61673331en
dc.publisherIEEE Pressen
dc.researchinstituteInstitute of Artificial Intelligence (IAI)en
dc.subjectEvolutionary algorithmen
dc.subjectreinforcement learningen
dc.subjectlandscape approximationen
dc.subjectbasin of attractionen
dc.titleA reinforcement-learning-based evolutionary algorithm using solution space clustering for multimodal optimization problemsen
dc.typeConferenceen

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
CEC21-2.pdf
Size:
1.09 MB
Format:
Adobe Portable Document Format
Description:
Main article
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description: