Automatic evaluation of complex alignment: a query-oriented approach

Tracking #: 2137-3350

This paper is currently under review
Elodie Thieblin
Ollivier Haemmerlé
Cassia Trojahn dos Santos

Responsible editor: 
Jens Lehmann

Submission type: 
Full Paper
Ontology matching is the task of generating a set of correspondences (i.e., an alignment) between the entities of different ontologies. While most efforts on alignment evaluation have been dedicated to the evaluation of simple alignments, the emergence of complex approaches requires new strategies for addressing the hard problem of automatically evaluating complex alignments. This paper proposes a benchmark for complex alignment evaluation composed of an automatic evaluation system that relies on queries and instances, and a populated dataset about conference organisation with a set of associated competency questions for alignment as SPARQL queries. State-of-the-art alignments are evaluated and a comprehensive discussion on the difficulties of the evaluation task is provided.
Full PDF Version: 
Under Review