Hybridizing Cartesian Genetic Programming and Harmony Search for adaptive feature construction in supervised learning problems
Author/s
Elola, Andoni; Del Ser, Javier; Bilbao, Miren Nekane; Perfecto, Cristina; Alexandre, Enrique; [et al.]Date
2016Keywords
Feature construction
Supervised learning
Cartesian Genetic Programming
Harmony Search
Abstract
The advent of the so-called Big Data paradigm has motivated a flurry of research aimed at enhancing machine learning models by following very diverse approaches. In this context this work focuses on the automatic construction of features in supervised learning problems, which differs from the conventional selection of features in that new characteristics with enhanced predictive power are inferred from the original dataset. In particular this manuscript proposes a new iterative feature construction approach based on a self-learning meta-heuristic algorithm (Harmony Search) and a solution encoding strategy (correspondingly, Cartesian Genetic Programming) suited to represent combinations of features by means of constant-length solution vectors. The proposed feature construction algorithm, coined as Adaptive Cartesian Harmony Search (ACHS), incorporates modifications that allow exploiting the estimated predictive importance of intermediate solutions and, ultimately, attaining better conve ...
Type
article