Review Comment:
This article describes a novel method for automatic cross-lingual ontology alignment, based on lexical, semantic, and structural aspects of the ontology. It combines a number of similarity metrics, relying on Google translate and BabelNet for the cross-lingual aspects. An analysis of the similarity of neighbouring concepts (at depth 1) is added in case that the initial similarity between terms is not conclusive enough. A preliminary evaluation with the Multifarm track shows promising results.
The paper is well written and organised in general. The topic, cross-lingual ontology matching, is a timely and interesting one. The system uses BabelNet as a source of background knowledge for cross-lingual ontology matching, through the use of NASARI vectors. The main novelty resides, according to the authors, in the weighted combination of semantic and syntactic similarities, leveraging the concept of neighbourhood to improve the correctness of the generated mappings.
This revised version of the manuscript fixes a good number of the minor issues identified by the reviewers, and some of the major ones; for instance the comparison with the SoA has been substantially improved. The access to the repository has been granted. However, there is a lack of a README file with a description of the project.
Despite the interest of this approach and the effort made in improving the paper, some important issues regarding the experimental set up remain open and need to be addressed before a later resubmission:
* The authors run the test on the same data used to tune the system. This is a methodological flaw even if, as stated by the authors, their approach is not based on machine learning models. They have derived their optimal thresholds and weights based on the same data that is used later for testing (instead of testing with unseen data), which might result in the system behaving well with precisely such data; its ability to generalize results remains undemonstrated. This has not changed in the revised version of this work.
* This work only addresses type (ii) (same ontology) alignments in the evaluation disregarding type (i) (different ontologies) which is the most interesting case. The lack of a type (i) evaluation is a considerable limitation, not sufficiently justified in the paper. This has not changed in the revised version of this work.
A couple of minor remarks:
- The definition of ontology does not consider individuals, thus being incomplete. They should define ontology properly an then indicate that the system does not cover individuals, instead of re-defining ontology to accommodate it to the system limitations.
- The labels in Russian appear empty
|