Title

Evaluating Semantic Metrics On Tasks Of Concept Similarity

Abstract

In this study, first, concept similarity measures are evaluated over human judgments by using existing sets of word similarity pairs that we annotated with word senses. Next, an application-oriented study is presented to evaluate semantic metrics based on integration into an algorithm, first focused on the task of concept similarity then on the task of concept relatedness. The results found no single measure to be most significantly correlated with human-judgments, while an information content-based measure clearly lead to the best results in the application-oriented task of concept similarity. Reinforcing the difference between tasks of concept similarity and concept relatedness, the best measure for an application-oriented task of concept relatedness was a gloss-based relatedness measure rather than a similarity measure. A major conclusion of this work is that similarity measures may perform differently if embedded in specific applications than if they are compared with human judgments. © 2012, IGI Global.

Publication Date

12-1-2011

Publication Title

Cross-Disciplinary Advances in Applied Natural Language Processing: Issues and Approaches

Number of Pages

324-340

Document Type

Article; Book Chapter

Personal Identifier

scopus

DOI Link

https://doi.org/10.4018/978-1-61350-447-5.ch021

Socpus ID

84898563731 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84898563731

This document is currently not available here.

Share

COinS