Optimizing Storage of RDF Archives using Bidirectional Delta Chains

Tracking #: 2666-3880

This paper is currently under review
Authors: 
Ruben Taelman
Thibault Mahieu
Ruben Verborgh

Responsible editor: 
Aidan Hogan

Submission type: 
Full Paper
Abstract: 
Linked Open Datasets on the Web that are published as RDF can evolve over time. There is a need to be able to store such evolving RDF datasets, and query across their versions. Different storage strategies are available for managing such versioned datasets, each being efficient for specific types of versioned queries. In recent work, a hybrid storage strategy has been introduced that combines these different strategies to lead to more efficient query execution for all versioned query types at the cost increased ingestion time. While this trade-off is beneficial in the context of Web querying, it suffers from exponential ingestion times in terms of the number of versions, which becomes problematic for RDF datasets with many versions. As such, there is a need for an improved storage strategy that scales better in terms of ingestion time for many versions. We have designed, implemented, and evaluated a change to the hybrid storage strategy where we make use of a bidirectional delta chain instead of the default unidirectional delta chain. In this article, we introduce a concrete architecture for this change, together with accompanying ingestion and querying algorithms. Experimental results from our implementation show that the ingestion time scales significantly better. As an additional benefit, this change also leads to lower total storage size and improved query execution performance for most cases. This work shows that modifying the structure of delta chains within the hybrid storage strategy can be highly beneficial for RDF archives. In future work, other modifications to this delta chain structure deserve to be investigated, as they may be able to provide additional benefits.
Full PDF Version: 
Tags: 
Under Review