Automatic evaluation of complex alignments: an instance-based approach

Tracking #: 2379-3593

This paper is currently under review
Authors: 
Elodie Thieblin
Ollivier Haemmerlé
Cassia Trojahn dos Santos

Responsible editor: 
Jens Lehmann

Submission type: 
Full Paper
Abstract: 
Ontology matching is the task of generating a set of correspondences (i.e., an alignment) between the entities of different ontologies. While most efforts on alignment evaluation have been dedicated to the evaluation of simple alignments (i.e., those linking one single entity of a source ontology to one single entity of a target ontology), the emergence of complex approaches requires new strategies for addressing the problem of automatically evaluating complex alignments (i.e., those composed of correspondences involving logical constructors or transformation functions). This paper proposes a benchmark for complex alignment evaluation composed of an automatic evaluation system that relies on queries and instances, and a dataset about conference organisation. This dataset is composed of populated ontologies and a set of competency questions for alignment as SPARQL queries. State-of-the-art alignments are evaluated and a discussion on the difficulties of the evaluation task is provided
Full PDF Version: 
Tags: 
Under Review