A Reasonable Semantic Web
Review 1 by Claudia d'Amato:
The paper argues on the necessity of rethinking the way of reasoning in the Semantic Web to cope
with the scaling problem.
The paper addresses a very interesting problem in a very clear way, giving an overview of the
adopted approaches and indicating inductive reasoning as a possible solution.
In the following some detailed comments are reported
* the argumentation and the example at the end of sect. 1 could be extended and made more explicit
* end of 1st column pp. 2: if A and B do not refer to the same knowledge base, an ontology matching
problem would be solved/considered in order to count the shared inferences. Some comments on this aspect could be added
* end of sect. 2: can you please clarify why semantics as "shared inference" do not presuppose to
use model theory? How inferences are computed (until here alternative forms of reasoning have not been analyzed)?
* middle of 1st column pp. 4 (sect. 5): "Two of the main obstacles are scalability of the algorithms, and requirements on the input data" --> maybe it is better to anticipate that the desired requirement is the absence of noise (this is written two paragraph later on).
* I find very interesting the argumentation of the need of new forms of reasoning with the parallel with precision and recall in the information retrieval setting. However, some experimental results showed in Claudia d'Amato, Nicola Fanizzi, Floriana Esposito: Query Answering and Ontology
Population: An Inductive Approach. ESWC 2008:288-302 demonstrated that alternative/additional metrics are necessary due to the Open World Assumption. Discussing also the evaluation aspect could be interesting
* 2nd paragraph sect. 4: arguing of the necessity of dynamically handling inconsistency, the following references could be useful (even if the adopted approach focuses on the TBox rather than on the ABox)
(a) Thomas Scharrenbach, Rolf Grütter, Bettina Waldvogel, Abraham Bernstein, Structure Preserving TBox Repair using Defaults, Proceedings of the 23rd International Workshop on Description Logics (DL 2010) 2010, CEUR Workshop Proceedings.
(b) Thomas Scharrenbach, Abraham Bernstein, On the Evolution of Ontologies using Probabilistic Description Logics, Proceedings of the First ESWC Workshop on Inductive Reasoning and Machine Learning on the Semantic Web, June ; 2009, CEUR Workshop Proceedings.
* beginning of 2nd column pp. 1: "However, as is often the case" -> "However, as it is often the case"
* please recall the definition of instance unification problem with a footnote
* 1st column pp. 3: "Only recently has the semantic web community begun to appreciate" -> "Only
recently the semantic web community has begun to appreciate"
* middle of 1st column pp. 3: "to which they they approximate full" -> "to which they approximate full"
* last row pp. 3: "practially" -> "practically"
* 2nd paragraph sect. 6: "Approximate reasoning, under...of further research" -> this sentence should be rephrased
Review 2 by Thomas Lukasiewicz:
Contents: The paper suggests that shared and non-classical inference, which is based on approximate (deductive and non-deductive) techniques, and which should be scalable to the size of the Web and also be able to handle noisy data, are a very promising direction of future research for the Semantic Web. Here, soundness and completeness as quality measures from KRR are very likely to be replaced by precision and recall from IR, respectively.
Evaluation: This is a very nice paper, which I fully support; however, I have some suggestions for improvements: the current contents is written in a rather vague way; it would be very good to give some further evidence for the statements about the current developments in the Semantic Web via existing systems or previous publications in the literature. Similarly, it would be good to be more concrete about the suggested future direction of research for the Semantic Web; for example, by taking some representative systems or approaches from the literature. Especially the following two papers match exactly the vision of future research in the Semantic Web laid down in the submission (the first one combines Semantic Web reasoning with standard Web search, giving up the completeness of standard reasoning for the sake of efficiency, while the second one goes even one step further by replacing deductive inference by inductive inference, thus even giving up the correctness of standard reasoning, for the sake of additionally being able to handle inconsistencies, noise, and incompleteness):
-- Bettina Fazzinga, Giorgio Gianforme, Georg Gottlob, Thomas Lukasiewicz: Semantic Web Search Based on Ontological Conjunctive Queries. In Proceedings FoIKS 2010, pp. 153-172, LNCS 5956, Springer, 2010.
-- Claudia d'Amato, Nicola Fanizzi, Bettina Fazzinga, Georg Gottlob, and Thomas Lukasiewicz: Combining Semantic Web Search with the Power of Inductive Reasoning. In Proceedings SUM 2010, LNCS, Springer, 2010 (full paper in press).
Minor comments: The paper contains some typos, which may be easily found by a spell-checker.