Large Scale Problems in Practice: The effect of dimensionality on the interaction among variables
| dc.cclicence | CC-BY-NC | en |
| dc.contributor.author | Caraffini, Fabio | en |
| dc.contributor.author | Neri, Ferrante | en |
| dc.contributor.author | Iacca, Giovanni | en |
| dc.date.acceptance | 2017-01-11 | en |
| dc.date.accessioned | 2017-03-08T10:54:10Z | |
| dc.date.available | 2017-03-08T10:54:10Z | |
| dc.date.issued | 2017-01 | |
| dc.description | The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link. | en |
| dc.description.abstract | This article performs a study on correlation between pairs of variables in dependence on the problem dimensionality. Two tests, based on Pearson and Spearman coefficients, have been designed and used in this work. In total, $86$ test problems ranging between 10 and 1000 variables have been studied. If the most commonly used experimental conditions are used, the correlation between pairs of variables appears, from the perspective of the search algorithm, to consistently decrease. This effect is not due to the fact that the dimensionality modifies the nature of the problem but is a consequence of the experimental conditions: the computational feasibility of the experiments imposes an extremely shallow search in case of high dimensions. An exponential increase of budget and population with the dimensionality is still practically impossible. Nonetheless, since real-world application may require that large scale problems are tackled despite of the limited budget, an algorithm can quickly improve upon initial guesses if it integrates the knowledge that an apparent weak correlation between pairs of variables occurs, regardless the nature of the problem. | en |
| dc.funder | N/A | en |
| dc.identifier.citation | Caraffini, F., Neri, F. and Iacca, G. (2017) Large Scale Problems in Practice: The effect of dimensionality on the interaction among variables. In: Squillero G., Sim K. (eds) Applications of Evolutionary Computation. EvoApplications 2017. Lecture Notes in Computer Science, vol 10199, pp. 636-652 | en |
| dc.identifier.doi | https://doi.org/10.1007/978-3-319-55849-3_41 | |
| dc.identifier.uri | http://hdl.handle.net/2086/13465 | |
| dc.language.iso | en | en |
| dc.peerreviewed | Yes | en |
| dc.projectid | N/A | en |
| dc.researchgroup | Centre for Computational Intelligence | |
| dc.researchinstitute | Institute of Artificial Intelligence (IAI) | en |
| dc.subject | Large Scale Optimisation | en |
| dc.subject | Scalability | en |
| dc.title | Large Scale Problems in Practice: The effect of dimensionality on the interaction among variables | en |
| dc.type | Conference | en |