Exploiting Inter-Image Similarity And Ensemble Of Extreme Learners For Fixation Prediction Using Deep Features
Keywords
Extreme learning machines; Fixation prediction; Inter-image similarity; Saliency prediction; Visual attention
Abstract
This paper presents a novel fixation prediction and saliency modeling framework based on inter-image similarities and ensemble of Extreme Learning Machines (ELM). The proposed framework is inspired by two observations, (1) the contextual information of a scene along with low-level visual cues modulates attention, (2) the influence of scene memorability on eye movement patterns caused by the resemblance of a scene to a former visual experience. Motivated by such observations, we develop a framework that estimates the saliency of a given image using an ensemble of extreme learners, each trained on an image similar to the input image. That is, after retrieving a set of similar images for a given image, a saliency predictor is learnt from each of the images in the retrieved image set using an ELM, resulting in an ensemble. The saliency of the given image is then measured in terms of the mean of predicted saliency value by the ensemble's members.
Publication Date
6-28-2017
Publication Title
Neurocomputing
Volume
244
Number of Pages
10-18
Document Type
Article
Personal Identifier
scopus
DOI Link
https://doi.org/10.1016/j.neucom.2017.03.018
Copyright Status
Unknown
Socpus ID
85017026850 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/85017026850
STARS Citation
R. Tavakoli, Hamed; Borji, Ali; Laaksonen, Jorma; and Rahtu, Esa, "Exploiting Inter-Image Similarity And Ensemble Of Extreme Learners For Fixation Prediction Using Deep Features" (2017). Scopus Export 2015-2019. 4775.
https://stars.library.ucf.edu/scopus2015/4775