Machine Translation Using Semantic Web Technologies: A Survey

Tracking #: 1427-2639

Authors: 
Diego Moussallem
Axel-Cyrille Ngonga Ngomo
Matthias Wauer

Responsible editor: 
Philipp Cimiano

Submission type: 
Survey Article
Abstract: 
Recently, a large number of Machine Translation (MT) approaches have been developed with the aim of migrating content across languages easily. However, literature suggests that a large number of semantic boundaries have to be dealt with so as to achieve better MT. A central issue that MT systems have to deal with is ambiguity. A promising way of overcoming the ambiguity problem is using Semantic Web technologies. This article presents the results of a systematic review of approaches that rely on Semantic Web Technologies (SWT) in MT approaches. Overall, our survey suggests that Semantic Web (SW) can enhance the quality of MT outputs for various problems, however it is still in its infancy.
Full PDF Version: 
Tags: 
Reviewed

Decision/Status: 
Major Revision

Solicited Reviews:
Click to Expand/Collapse
Review #1
By John McCrae submitted on 20/Aug/2016
Suggestion:
Reject
Review Comment:

This paper presents the application of Semantic Web technology to the task of machine translation. The authors nicely explicitly state the problem with this area of research: "the MT community is mostly unconvinced by the potential improvements contributed by the SW community." Unfortunately, this paper seems to further enforce this opinion as it focuses only on the application of SW in MT, not for example the combination of SW and MT technologies to other tasks, which in IMHO is a much more fruitful direction. This is further compounded by the fact that the authors are not very well aware of the current state of the art in machine translation and often cite papers that are many years out-of-date and spend much time on methods, which the MT community has largely moved on from. As such this paper does not perform a good job in informing a reader where interesting research directions may be in the combination of SW and MT and narrows its scope unnecessarily to a small area of research.

The paper starts by identifying a range of papers that are of relevance to this survey. For my taste, far too much detail is given about this and yet some notable papers still seem to be missing, e.g., McCrae et al.'s "Domain Adaptation for Ontology Localization". The presentation of this almost as an algorithm in itself seems unnecessary.

Section 3 presents the main survey of current MT techniques, and starts with some very odd statements namely: "all MT paradigms can be subsumed under one generic architecture" and "each MT approach is best suited to address particular types of problems". These are backed up by citations from 1999 and 1992 respectively! Koehn's 2010 book (cited as [93]) is generally treated as the best presentation of the basics of MT and the authors would be advised to consult this book more carefully. The authors give significant space to RBMT approaches, while the SMT section is short and does not describe the standard models used in the field, e.g., Phrase-based MT. It is also not surprising that there is no mention of the recent improvements that have been made with Neural Attention Models. In 3.3, challenges are laid out, yet these are only a few of the main issues (again see Koehn's book for a better description).

There are several odd assertions in this section:
"CBMT systems try to solve [structural divergence] by using a bag-of-words approach": This is not true for nearly all SMT systems!
"hybrid approaches group all of the drawbacks [of RBMT and SMT]" This is obviously not true, hybrid systems are complex but have high performance.
I miss the citation of the Grammatical Framework when describing interlingual approaches to MT.

Section 4 gives a description of each of the papers chosen for this study, but little overall comparison and contrast is made between the approaches. Also, many of the papers describe only hypothetical systems that were not implemented, as only a small handful of authors have actually attempted to apply SW to MT (and with mostly disappointing results).

In section 4.3, the authors finally layout why they think that SW technologies may be applicable to MT, highlighting three areas: Firstly, disambiguation, yet they seem unaware that WSD has had mixed success in MT (see the works of Carpuat for example), they mention reasoning as a potential area here, but I know of no work that has used reasoning for WSD and it is not made clear why it would be better in an MT context. Secondly, the highlight "non-standard speech"... this is very puzzling as "non-standard speech" is not common on the SW. Finally, they highlight NER, and in this seems the most optimistic to me, in that the use of Linked Data may help in the long tail of difficult to translate names, however this may be of only minor interest to MT researchers.

The paper has a few minor errors:
p2. "TechnologiesSWT@
p8. "processEach"
p10. "*The* author's explanantion"
p12. "Vertan" is (I assume) Cristina Vertan of Hamburg, but is referred to as 'he'
p14. "*the* future of MT"

Review #2
By Tim Heuss submitted on 22/Aug/2016
Suggestion:
Minor Revision
Review Comment:

SWJ Review

(1) Suitability as introductory text, targeted at researchers, PhD students, or practitioners, to get started on the covered topic.

The sections 1 (Introduction) and 3 (Classification of MT Approaches) introduce into the history, challenges, recent considerations of the MT topic. Furthermore, section 3 describes a classification of existing MT approaches and fundamental properties associated to them.

Both sections provide a well readable and helpful introduction.

(2) How comprehensive and how balanced is the presentation and coverage.

Judging by section 2 (Research Method), the survey contains papers from well-known, relevant sources. It covers quite a few papers, ranging from trivial to more sophisticated MT approaches.

The selection is understandable and seems to be suitable.

(3) Readability and clarity of the presentation.

The survey is mostly easy to read. The following suggestions help to make the paper even more valuable. I would consider these as mandatory improvements, despite the STYLISTIC ones:

CLARIFICATIONS

P. 2: I do not see the specific difference between RQ2 and RQ4. Using the term "Linked-Data-driven tools" (instead of SWT) seems to be important here, but the differentiation and purpose is not clear to me. I would suggest to add a purpose to RQ4. What kinds of Linked-Data-driven tools are available for doing / supporting / …

P. 4: Section 3.1 introduces the dimensions "Architectures" and "Methodology" as individual dimensions, but those terms seem to be used synonymously alongside with "approach" (eg. a subsubsection of "Architectures" is "3.2.1.2. Transfer-based approaches. The transfer- based methodology for MT ..."). Considering the fact that this is a survey paper, It is not clear to me why those terms are distinguished at all, because the specific architecture always follows the specific demands of a given MT method(ology) aka approach. I would propose to merge both dimensions "Architectures" and "Methodology", to harmonise use of mentioned terms, and to provide a sharper definition of each.

P. 4: After the definition of the dimensions, the structure of section 3 is surprising. 3.2 is architectures, corresponding to the first dimension described in 3.1. Other dimensions however do not seem to be equally represented as subsections. I would have expected to find these dimensions as subsections of 3 and as columns or rows in table 2.

P. 4: "Newer works however suggest that at least two generic architectures are necessary to model existing MT systems". Citation needed.

P. 16: "which is not possible for many of the surveyed articles due to not explicitly de- fined or limited data and evaluation." Please clarify "due to not explicitly defined".

SPELLING MISTAKES / TYPOS

P. 1: "Machine Translation MT" -> "Machine Translation (MT)"
P. 2: "rely" -> "relies"
P. 2: "Semantic Web TechnologiesSWT" -> "Semantic Web Technologies (SWT)"
P. 5: " Figure 3 presents a generic MT architecture" -> " Figure 2 presents a generic MT architecture"
P. 9: " SWT are quite performed in semantic analysis step than other steps " - "often"?
P. 10: Table 4: Reasoner -> Reasoner

CONTENT

P. 9: "Thus, many research works made several mistakes when creating ontologies or linked data repositories by themselves." Please elaborate (classify) the mistakes that are made. I think it is the unique place in this paper to make such a reflection.

P. 10: The dimensions to compare existing MT work in table 4 should be elaborated, just like the authors did in section 3.1. In particular, please describe "SW method" and "Resource". What's the SW method "Annotation"? What's the difference between Resource "Ontologies", "Ontology" and "LOD"? And why is that interesting to compare?
I would also suggest to add additional columns to table 4
- Add citation year so that the reader can assess the up-to-dateness of the work
- Add a grade for the evaluation of the MT approaches to that the reader can assess the maturity of the MT approaches.

P. 10: Concerning the works [74,77] it's not clear to me why [74] uses "Ontologies", while [77] uses "LOD". As an author of these works, I would consider [74,77,75] to be one single approach, whereby it does not make a huge difference where the data comes from.

P. 10: Please remove [75], it's a draft that was never officially published.

P. 15: "One potential solution could extend the type extrac- tion method by CETUS [136] and combining it with FOX [151] and AGDISTIS [160]." This is a surprisingly specific tool stack, that pops up all of a sudden. Please describe your idea in a conceptual manner first, and specify the reasons for selecting these tools. A nice overview of related tools including a performance evaluation is provided by: Aldo Gangemi - A Comparison of Knowledge Extraction Tools for the Semantic Web

P. 15: "These characteristics can be extracted from social media or user logs and stored as user prop- erties using SWT". While the idea is appealing, it's not clear to me how colloquial words can be extracted "using FOAF and SIOC" from unstructured text sources. Please add a few more words about that.

P. 16: General critic points like this are most interesting for the scientific community. Please cite common automatic metrics that would help describing the advantage of SWT in MT.

STYLISTIC (optional)

P. 5: Do not split enumerations. Move "For example..." on the previous page

P. 9: Section 4 directly starts with subsection 4.1. Please add a small introduction text for the section in-between.

(4) Importance of the covered material to the broader Semantic Web community.

With Section 4.3. (SWT suggestions for Semantic MT challenges) and 5 (Conclusion and Future Work), the authors present valuable insides and lessons that can be learned from their survey. Some (e.g. Evaluation deficiencies, NER + MT combination, identified modelling issues) are likely to be significant insights for the Semantic Web community.
,

Review #3
Anonymous submitted on 23/Nov/2016
Suggestion:
Major Revision
Review Comment:

The paper at hand is a survey article about Machine Translation (MT) approaches that rely on Semantic Web Technologies (SWT).
The topic is very pertinent to both the Semantic Web community and the MT community, and is a hot research topic.
The main claim of the authors is that SWT can be used to solve the problem of lexical and semantic ambiguity, which is one of the main problems in MT, and that the potential of these technologies is “still in its infancy”.
The paper is organized in the following way. In section 2 the authors explain the research methodology followed to identify papers in which approaches that use SWT in MT are described. The result is a list of 17 papers whose authors and titles are included in Table 1. In order to classify each study according to the translation approach they follow, they provide a classification of MT approaches in section 3, and describe the main types of MT approaches in the subsequent subsections. Then they identify the challenges of such approaches and compare them. Section 4 consists of several sections. They start by providing a brief overview of the possible benefits of applying SWT to MT systems. Then, they describe each of the studies surveyed according to the MT approaches identified in section 3. Finally, they discuss and suggest future solutions to 3 MT challenges: Disambiguation, Non-standard speech, and Named Entity Recognition. In section 5 they conclude the paper.
The paper needs a thorough review of the English (specially, section 4).
One of my concerns with the paper, however, is the lack of systematization and consistency in some sections that need to be systematic and consistent (specially, again, section 4). Also, the accuracy and precision in the use of some concepts, dimensions, classifications schemas, etc., used along the paper. I have included a detailed justification of these concerns in the rest of the review. Specifically, in the sections that describe the identified studies for this survey, I miss a clear and concise description of each of them. Sometimes the information is not clearly presented or structured, some items of information are not clearly related, and the main aspects of the studies not appropriately highlighted (more as a copy-paste of unrelated sentences). I miss a lack of systematization in the description of the systems (maybe they could use the four dimensions introduced in section 3.1?). This should be solved if the paper is to be accepted for publication. Finally, the relevance of some of the approaches is also doubtful, since some have not been appropriately evaluated.
--
As for the introduction, could they provide more specific data of the types of errors? They claim that WSD is the “most common source of error”. What about other errors such as inflectional errors, reordering errors, missing words, etc.? Popovic and Ney (2011) in their article in Computational Linguistics provide a classification of typical errors in MT (also Vilar et al. 2006). It would be very interesting to have some numbers or percentages of the incidence of the different types of errors. Or are they just focusing on how SWT can help in solving the WSD problem in MT?? (then maybe the scope of the paper should be re-thought).
As for Corpus-Based Machine Translation (CBMT) approaches, they say that the problems of these approaches are “connected to the problem of ambiguity, including syntactic variations, expressions, irregular verbs, slang, and others”. Do they mean that “syntactic variations, expressions, irregular verbs, slang, and others” are subtypes of ambiguity problems? I don’t think this is accurate.
In section 2 they start by presenting the research question they aim at answering with this survey, which is: How can SWT enhance MT quality? Then, they formulate 4 more questions that are subsumed by this one. Two of them mention explicitly Linked Data (RQ1. What are state-of-the-art approaches in MT which use “Linked Data”? And RQ4. What kinds of Linked-Data-driven tools are available for MT?) In the other two, they refer to SWT and ontological knowledge. I think that they should justify the interest of these questions. Also, Why do they use Linked Data in some of them, and why ontological knowledge and SWT in others? Do they mean something different by each of these terms? Isn’t the use of Linked Data too restrictive ein RQ1 and RQ4?
As for the criteria for identifying a study and including it in their survey, they claim that studies should “focus on the evaluation of multilingual approaches using Linked Data”. What is the interest of this criterion? What is meant by “multilingual approaches”? MT systems, or also other systems? I could think of several studies that would meet this criterion and that have not been included in the survey.
The forth criterion they include is not clear either: “Studies that evaluated MT based on SW principles”. What are these principles and how do they influence evaluation? An explanation of this criterion is as well required.
In the Exclusion criteria, again I think that the use of Linked Data imposes an unnecessary restriction on MT approaches that may use some other type of SW technology.
Is the exclusion criterion “Studies that did not focus on Linked Data, MT or SW” correctly formulated? Would a study focusing on Linked Data be accepted?
As for the search queries they introduce in section 2.2.3, the authors should justify the interest of the keywords selected, as well as the need for two search queries (was the first query now enough? Did it not return relevant results?).
They list a set of conferences in which matched papers were presented. I was wondering if they include in their searches some dedicated workshops associated to those conferences, such as the “Multilingual Semantic Web” workshop or the “Semantic Web Technologies for Machine Translation” workshop, or if they just searched the papers in the proceedings of the corresponding main conference.
In the search steps, they say that “we excluded publications that are not in English or did not contain any reference to SW”. Is this correct? Shouldn’t it be SW and MT, to be exact?
In section 3 they provide a classification of MT approaches according to 4 dimensions. Descriptions of the dimensions are maybe too brief and many questions remain open. For instance, in the case of the dimension called “problem space addressed”, they try to illustrate this dimensions with some examples that are not clear. Why do we need deep linguistic rules for translating old Egyptian texts? Probably, because SMT is not possible (no corpus available). Why “translating large volume of text is best carried out using statistical method”? It will in its turn depend on the languages involved, the existence of parallel corpora to previously train the system, etc., right?
Then, to be systematic, one would expect to identify the 4 dimensions in the subsequent descriptions of MT approaches, but it is not the case. Specifically, “problem space addressed” and “performance” are not addressed in most of them.
As for CBMT, they mention that a bilingual corpus is needed… comparable corpora or a parallel one? Both? Details are needed.
Once the different approaches have been described, they include a section (section 3.3) in which some challenges are listed. Are these challenges general enough so that they are faced by all the systems reviewed? Or only faced by some of them? I miss many challenges there related to the different systems (corpus creation, superficial fluency, difficulties in extracting meaning of text and creating an interlingua…) A more systematic analysis is missed at this stage.
As for the final comparison, they only compare quality and run time behavior of RBMT and CBMT in the text, and do not take into account any other dimensions. On the contrary, they include a quite complete table of pros and cons of each approach. I would suggest they relate the text to the table, and explain with more details the information contained in the table.
Section 4.1 provides an overview of the possible benefits of applying SWT to MT. I do not understand the purpose of this section, nor its title. Moreover, some paragraphs need revision from both a content and a grammar perspective. For example in paragraph 2 they say, and I quote “Although the graph structure behind SW can act as a disambiguation method with high decision power, some SW concepts still need to be addressed before they can be applied successfully in MT systems”. What is meant by “some SW concepts”? Then they continue with the following sentence “For instance, the coverage of multilingual content in semantic structures and how to link this content with multilingual ontologies has to be improved”. Not clear what they mean. The same happens with the last paragraph in this section.
As for the first studies described in sections 4.2.1. and 4.2.2., I miss an organized description of the different steps in the translation process that involve the use of SWT. They are not systematic in the descriptions and sometimes take for granted that readers are experts in the field. For example, when referring to the different metrics (“so it may not be suitable as introductory text to get started on the covered topic”.)
Not clear how the approach in 4.2.3. works.
In Arcan et al. work, (section 4.2.4.1), what do you mean when saying that for translations the authors use the SKOS vocabulary? Skos is a model. What do you mean by “using SWT to retrieve ontology content resulted in clear improvements to the translation model”?
In McCrae and Cimiano’s work, what were the results of the evaluation? Not clear.
In Moussalem and Choren, what are the ontologies they use? Are all of them implemented in SKOS? Available implementations?
As for section 4.2.4.2, which MT approaches are described in there? Is BabelNet used in the MT system. The purpose of the section is not clear.
It the work by Vertan [162] an architecture or only a methodology? I think that the space devoted to this and related studies is unjustified.
In Almasound et al., what is “the ontology” used? Is it a domain ontology or an upper ontology (of general knowledge)?
In Knoth et al., what do they mean by this sentence “present a new approach combining CLIR and MT by multilingual domain ontologies”? How is the lightweight ontology generated?
The last paragraph describing the work by Simov et al. is not clear at all? Did they use DBpedia or LT4eL? WordNet or OntoWordNet? Also, MT metrics are included there, but have not been mentioned or briefly defined in previous sections.
What do they mean by “the algorithm performs WSD by analyzing the ontological relationships between parts of speech for potential translations”?
In section 4.3, could they provide more details on how SWT are applied to the output translation? Another question is how do they suggest that verbal tenses can be recognized by using relationships among properties? Shouldn’t they include a section about the use of reasoners in MT? How does this relate to the disambiguation challenge?
As for the NER challenge, they suggest the use of methods and tools to improve the results of NER, but do not relate it to the translation problem. How would this be integrated in the MT system? At which stage of the process?


Comments