Abstract
The increasing availability of public datasets offers an inexperienced opportunity to conduct data-driven studies. Metric Multi-Dimensional Scaling aims to find a low-dimensional embedding of the data, preserving the pairwise dissimilarities amongst the data points in the original space. Along with the visualizability, this dimensionality reduction plays a pivotal role in analyzing and disclosing the hidden structures in the data. This work introduces Sparse Kernel-based Least Squares Multi-Dimensional Scaling approach for exploratory data analysis and, when desirable, data visualization. We assume our embedding map belongs to a Reproducing Kernel Hilbert Space of vector-valued functions which allows for embeddings of previously unseen data. Also, given appropriate positive-definite kernel functions, it extends the applicability of our method to non-numerical data. Furthermore, the framework employs Multiple Kernel Learning for implicitly identifying an effective feature map and, hence, kernel function. Finally, via the use of sparsity-promoting regularizers, the technique is capable of embedding data on a, typically, lowerdimensional manifold by naturally inferring the embedding dimension from the data itself. In the process, key training samples are identified, whose participation in the embedding map's kernel expansion is most influential. As we will show, such influence may be given interesting interpretations in the context of the data at hand. The resulting multi-kernel learning, non-convex framework can be effectively trained via a block coordinate descent approach, which alternates between an accelerated proximal average method-based iterative majorization for learning the kernel expansion coefficients and a simple quadratic program, which deduces the multiple-kernel learning coefficients. Experimental results showcase potential uses of the proposed framework on artificial data as well as real-world datasets, that underline the merits of our embedding framework. Our method discovers genuine hidden structure in the data, that in case of network data, matches the results of well-known Multi- level Modularity Optimization community structure detection algorithm.
Notes
If this is your thesis or dissertation, and want to learn how to access it or for more information about readership statistics, contact us at STARS@ucf.edu
Graduation Date
2017
Semester
Summer
Advisor
Georgiopoulos, Michael
Degree
Master of Science in Electrical Engineering (M.S.E.E.)
College
College of Engineering and Computer Science
Department
Electrical Engineering and Computer Engineering
Degree Program
Electrical Engineering
Format
application/pdf
Identifier
CFE0007132
URL
http://purl.fcla.edu/fcla/etd/CFE0007132
Language
English
Release Date
2-15-2019
Length of Campus-only Access
1 year
Access Status
Masters Thesis (Open Access)
STARS Citation
Sedghi, Mahlagha, "Learning Kernel-based Approximate Isometries" (2017). Electronic Theses and Dissertations. 5930.
https://stars.library.ucf.edu/etd/5930