Size and characteristics of the datasets
Abstact
Knowledge Graphs (KGs) represent heterogeneous domain knowledge on the Web and within organizations. There exist shapes constraint languages to define validating shapes to ensure the quality of the data in KGs. Existing techniques to extract validating shapes often fail to extract complete shapes, are not scalable, and are prone to produce spurious shapes. To address these shortcomings, we propose the Quality Shapes Extraction (QSE) approach to extract validating shapes in very large graphs, for which we devise both an exact and an approximate solution. QSE provides information about the reliability of shape constraints by computing their confidence and support within a KG and in doing so allows to identify shapes that are most informative and less likely to be affected by incomplete or incorrect data. To the best of our knowledge, QSE is the first approach to extract a complete set of validating shapes from WikiData. Moreover, QSE provides a 12x reduction in extraction time compared to existing approaches, while managing to filter out up to 93% of the invalid and spurious shapes, resulting in a reduction of up to 2 orders of magnitude in the number of constraints presented to the user, e.g., from 11,916 to 809 on DBpedia.
Cite
Rabbani, Kashif; Lissandrini, Matteo; and Hose, Katja. Extraction of Validating Shapes from very large Knowledge Graphs In Proceedings of the Very Large Databases 2023 (Volume 16), August 28 - Sept 02, 2023, Vancouver, Canada.
EXPERIMENTS
We have used the following datasets:
- WikiData (2021): We downloaded the truthy dump of WikiData (2021) and used our python script to remove labels, descriptions, and non-English strings.
- WikiData (2015): We downloaded a WikiData dump from 2015 form this link.
- DBPedia: We used dbpedia script to download all the dbpedia files listed here.
- YAGO-4: We downloaded YAGO-4 English version from https://yago-knowledge.org/data/yago4/en/.
- LUBM: We generated LUBM dataset following the guidelines available at LUBM's official Website.
You can download a copy of these datasets from our single archive.
ANALYSIS
To evaluate the performance of our approach, we used QSE with the above-mentioned datasets on a single
machine with Ubuntu 18.04, having 16 cores, 1TB HDD and 256GB
RAM and measured the execution time.
We have the following metrics to evaluate our approach against others:
Shapes Statistics such as Node Shapes (NS), Property Shapes (PS), Property Shapes Constraint (PSc)
Running Time and Memory Consumption
SHACL Shapes
We have published the extracted SHACL shapes of all three datasets on Zenodo.
Additionally, we have also made available an executable Jar file of our application on Zenodo to extract
SHACL shapes from RDF datasets in .nt format.
Source Code
Visit our GitHub repository.