Type
Text
Type
Thesis
Advisor
Murray, John. | Doboli, Alex
Date
2013-12-01
Keywords
Electrical engineering | symbolic regression
Department
Department of Electrical Engineering.
Language
en_US
Source
This work is sponsored by the Stony Brook University Graduate School in compliance with the requirements for completion of degree.
Identifier
http://hdl.handle.net/11401/77467
Publisher
The Graduate School, Stony Brook University: Stony Brook, NY.
Format
application/pdf
Abstract
In this thesis we set out to find whether the true data generating formula behind a set of data points can be automatically inferred from the data points alone. We start with the topic of machine learning and quickly realize that black box models can only approximate the real world which creates the motivation to move on to evolutionary algorithms as a vehicle to implement symbolic regression. Through a series of experiments we discover that the mean-squared error cost function is easily fooled by decoy solutions and is unable to make use of all the information presented in the training examples. Based on this result we develop the concept of feature signatures which uniquely define a set of training examples and possess several desirable properties, the most important being invariance to linear transformations. Armed with this concept we conduct several more numerical experiments based on common analytical functions and real world data sets which ultimately lead to the experimental evidence we need to support the thesis. | 219 pages
Recommended Citation
Hensley, Asher, "Machine Learning, Evolutionary Algorithms, and the Inference of Mathematical Truths" (2013). Stony Brook Theses and Dissertations Collection, 2006-2020 (closed to submissions). 3279.
https://commons.library.stonybrook.edu/stony-brook-theses-and-dissertations-collection/3279