org.dice_research.squirrel.analyzer.impl.ckan

Class CkanDatasetConsumer

java.lang.Object

org.dice_research.squirrel.analyzer.impl.ckan.CkanDatasetConsumer

All Implemented Interfaces:

Consumer<eu.trentorise.opendata.jackan.model.CkanDataset>

public class CkanDatasetConsumer
extends Object
implements Consumer<eu.trentorise.opendata.jackan.model.CkanDataset>

A simple consumer of CkanDataset objects transforming them into RDF triples and writing the triples to the given Sink and UriCollector.

Author:

Michael Röder (michael.roeder@uni-paderborn.de)

Field Summary

Fields

Modifier and Type	Field and Description
protected UriCollector	collector
protected org.dice_research.squirrel.data.uri.CrawleableUri	curi
protected String	curiString
private static org.slf4j.Logger	LOGGER
protected org.dice_research.squirrel.sink.Sink	sink
protected TripleEncoder	tripleEncoder

Constructor Summary

Constructors

Constructor and Description
CkanDatasetConsumer(org.dice_research.squirrel.sink.Sink sink, UriCollector collector, org.dice_research.squirrel.data.uri.CrawleableUri curi, TripleEncoder tripleEncoder)

Method Summary

Modifier and Type	Method and Description
void	accept(eu.trentorise.opendata.jackan.model.CkanDataset dataset) This consumer method maps a single CkanDataset object to set of RDF triples.
protected org.apache.jena.rdf.model.Resource	createDatasetResource(eu.trentorise.opendata.jackan.model.CkanDataset dataset, Map<String,String> extras)
protected String	findLicense(eu.trentorise.opendata.jackan.model.CkanResource resource)
protected List<String>	findTheme(List<eu.trentorise.opendata.jackan.model.CkanPair> pairList)
protected void	store(org.apache.jena.rdf.model.Resource s, org.apache.jena.rdf.model.Property p, org.apache.jena.rdf.model.RDFNode o)
protected void	storeContact(org.apache.jena.rdf.model.Resource datasetRes, eu.trentorise.opendata.jackan.model.CkanDataset dataset, Map<String,String> extras)
protected void	storePublisher(eu.trentorise.opendata.jackan.model.CkanDataset dataset, org.apache.jena.rdf.model.Resource datasetRes, Map<String,String> extras)
protected void	storeResource(org.apache.jena.rdf.model.Resource datasetRes, eu.trentorise.opendata.jackan.model.CkanResource ckanResource)
private void	storeResourceOrText(org.apache.jena.rdf.model.Resource subject, org.apache.jena.rdf.model.Property predicate, boolean storeFirstMatch, String... values)
protected void	storeResources(org.apache.jena.rdf.model.Resource datasetRes, eu.trentorise.opendata.jackan.model.CkanDataset dataset)
protected void	storeTextLiteral(org.apache.jena.rdf.model.Resource subject, org.apache.jena.rdf.model.Property predicate, boolean storeFirstMatch, String... literals) Method creating one or several literals based on the given data and storing it as object of the given subject and predicate.
private void	storeTypedLiteral(org.apache.jena.rdf.model.Resource subject, org.apache.jena.rdf.model.Property predicate, org.apache.jena.datatypes.RDFDatatype datatype, boolean storeFirstMatch, Object... literals)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.function.Consumer

andThen

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

sink

protected org.dice_research.squirrel.sink.Sink sink

collector

protected UriCollector collector

curi

protected org.dice_research.squirrel.data.uri.CrawleableUri curi

curiString

protected String curiString

tripleEncoder

protected TripleEncoder tripleEncoder

Constructor Detail

CkanDatasetConsumer

public CkanDatasetConsumer(org.dice_research.squirrel.sink.Sink sink,
                           UriCollector collector,
                           org.dice_research.squirrel.data.uri.CrawleableUri curi,
                           TripleEncoder tripleEncoder)

Method Detail

accept

public void accept(eu.trentorise.opendata.jackan.model.CkanDataset dataset)

This consumer method maps a single CkanDataset object to set of RDF triples. The mapping is based on the mapping from http://extensions.ckan.org/extension/dcat/#rdf-dcat-to-ckan-dataset-mapping.

Specified by:

accept in interface Consumer<eu.trentorise.opendata.jackan.model.CkanDataset>

storePublisher

protected void storePublisher(eu.trentorise.opendata.jackan.model.CkanDataset dataset,
                              org.apache.jena.rdf.model.Resource datasetRes,
                              Map<String,String> extras)

storeContact

protected void storeContact(org.apache.jena.rdf.model.Resource datasetRes,
                            eu.trentorise.opendata.jackan.model.CkanDataset dataset,
                            Map<String,String> extras)

storeResources

protected void storeResources(org.apache.jena.rdf.model.Resource datasetRes,
                              eu.trentorise.opendata.jackan.model.CkanDataset dataset)

storeResource

protected void storeResource(org.apache.jena.rdf.model.Resource datasetRes,
                             eu.trentorise.opendata.jackan.model.CkanResource ckanResource)

findTheme

protected List<String> findTheme(List<eu.trentorise.opendata.jackan.model.CkanPair> pairList)

findLicense

protected String findLicense(eu.trentorise.opendata.jackan.model.CkanResource resource)

storeTextLiteral

protected void storeTextLiteral(org.apache.jena.rdf.model.Resource subject,
                                org.apache.jena.rdf.model.Property predicate,
                                boolean storeFirstMatch,
                                String... literals)

Method creating one or several literals based on the given data and storing it as object of the given subject and predicate.

Parameters:

subject - the resource which should be used as subject

predicate - the property which should be used as predicate

storeFirstMatch - a flag indicating whether the first non null value of the literals is used or if all non null literals should be stored (in mutliple triples)

literals - the list of literals which will be taken into account

storeTypedLiteral

private void storeTypedLiteral(org.apache.jena.rdf.model.Resource subject,
                               org.apache.jena.rdf.model.Property predicate,
                               org.apache.jena.datatypes.RDFDatatype datatype,
                               boolean storeFirstMatch,
                               Object... literals)

storeResourceOrText

private void storeResourceOrText(org.apache.jena.rdf.model.Resource subject,
                                 org.apache.jena.rdf.model.Property predicate,
                                 boolean storeFirstMatch,
                                 String... values)

createDatasetResource

protected org.apache.jena.rdf.model.Resource createDatasetResource(eu.trentorise.opendata.jackan.model.CkanDataset dataset,
                                                                   Map<String,String> extras)

store

protected void store(org.apache.jena.rdf.model.Resource s,
                     org.apache.jena.rdf.model.Property p,
                     org.apache.jena.rdf.model.RDFNode o)