org.dice_research.squirrel.sink.impl.sparql

Class SparqlBasedSink

java.lang.Object

org.dice_research.squirrel.sink.impl.sparql.AbstractBufferingSink

org.dice_research.squirrel.sink.impl.sparql.SparqlBasedSink

All Implemented Interfaces:

Closeable, AutoCloseable, org.dice_research.squirrel.sink.quadbased.QuadBasedSink, org.dice_research.squirrel.sink.Sink, org.dice_research.squirrel.sink.SinkBase, org.dice_research.squirrel.sink.triplebased.AdvancedTripleBasedSink, org.dice_research.squirrel.sink.triplebased.TripleBasedSink, org.dice_research.squirrel.sink.UnstructuredDataSink

public class SparqlBasedSink
extends AbstractBufferingSink
implements org.dice_research.squirrel.sink.triplebased.AdvancedTripleBasedSink, org.dice_research.squirrel.sink.Sink

A sink which stores the data in different graphs in a sparql based db.

Field Summary

Fields

Modifier and Type	Field and Description
private int	attempts
private int	delay
private static org.slf4j.Logger	LOGGER
protected org.dice_research.squirrel.data.uri.CrawleableUri	metadataGraphUri
protected org.aksw.jena_sparql_api.core.QueryExecutionFactory	queryExecFactory The Query factory used to query the SPARQL endpoint.
protected org.aksw.jena_sparql_api.core.UpdateExecutionFactory	updateExecFactory

Fields inherited from class org.dice_research.squirrel.sink.impl.sparql.AbstractBufferingSink

bufferSize, DEFAULT_BUFFER_SIZE

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	SparqlBasedSink(org.aksw.jena_sparql_api.core.QueryExecutionFactory queryExecFactory, org.aksw.jena_sparql_api.core.UpdateExecutionFactory updateExecFactory)
protected	SparqlBasedSink(org.aksw.jena_sparql_api.core.QueryExecutionFactory queryExecFactory, org.aksw.jena_sparql_api.core.UpdateExecutionFactory updateExecFactory, int delay, int attempts)

Method Summary

Modifier and Type	Method and Description
void	addData(org.dice_research.squirrel.data.uri.CrawleableUri uri, InputStream stream)
void	close()
void	closeSinkForUri(org.dice_research.squirrel.data.uri.CrawleableUri uri)
static SparqlBasedSink	create(String sparqlEndpointUrl)
static SparqlBasedSink	create(String sparqlEndpointUrl, String username, String password, int delay, int attempts)
void	deleteTriples()
void	flushMetadata()
static String	getGraphId(org.dice_research.squirrel.data.uri.CrawleableUri uri) Get the id of the graph in which the given uri is stored.
List<org.apache.jena.graph.Triple>	getTriplesForGraph(org.dice_research.squirrel.data.uri.CrawleableUri uri)
protected void	sendQuads(org.dice_research.squirrel.data.uri.CrawleableUri uri, Collection<org.apache.jena.sparql.core.Quad> quadList) Method to send all buffered quads to the database
protected void	sendTriples(org.dice_research.squirrel.data.uri.CrawleableUri uri, Collection<org.apache.jena.graph.Triple> triples) Method to send all buffered triples to the database
void	setMetadataGraphUri(org.dice_research.squirrel.data.uri.CrawleableUri metadataGraphUri)

Methods inherited from class org.dice_research.squirrel.sink.impl.sparql.AbstractBufferingSink

addQuad, addTriple, openSinkForUri

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dice_research.squirrel.sink.Sink

addMetaData

Methods inherited from interface org.dice_research.squirrel.sink.triplebased.TripleBasedSink

addTriple

Methods inherited from interface org.dice_research.squirrel.sink.quadbased.QuadBasedSink

addQuad

Methods inherited from interface org.dice_research.squirrel.sink.UnstructuredDataSink

addData, addData

Methods inherited from interface org.dice_research.squirrel.sink.SinkBase

openSinkForUri

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

queryExecFactory

protected org.aksw.jena_sparql_api.core.QueryExecutionFactory queryExecFactory

The Query factory used to query the SPARQL endpoint.

updateExecFactory

protected org.aksw.jena_sparql_api.core.UpdateExecutionFactory updateExecFactory

metadataGraphUri

protected org.dice_research.squirrel.data.uri.CrawleableUri metadataGraphUri

delay

private int delay

attempts

private int attempts

Constructor Detail

SparqlBasedSink

protected SparqlBasedSink(org.aksw.jena_sparql_api.core.QueryExecutionFactory queryExecFactory,
                          org.aksw.jena_sparql_api.core.UpdateExecutionFactory updateExecFactory,
                          int delay,
                          int attempts)

SparqlBasedSink

protected SparqlBasedSink(org.aksw.jena_sparql_api.core.QueryExecutionFactory queryExecFactory,
                          org.aksw.jena_sparql_api.core.UpdateExecutionFactory updateExecFactory)

Method Detail

create

public static SparqlBasedSink create(String sparqlEndpointUrl)

create

public static SparqlBasedSink create(String sparqlEndpointUrl,
                                     String username,
                                     String password,
                                     int delay,
                                     int attempts)

getTriplesForGraph

public List<org.apache.jena.graph.Triple> getTriplesForGraph(org.dice_research.squirrel.data.uri.CrawleableUri uri)

Specified by:

getTriplesForGraph in interface org.dice_research.squirrel.sink.triplebased.AdvancedTripleBasedSink

deleteTriples

public void deleteTriples()

closeSinkForUri

public void closeSinkForUri(org.dice_research.squirrel.data.uri.CrawleableUri uri)

Specified by:

closeSinkForUri in interface org.dice_research.squirrel.sink.SinkBase

Overrides:

closeSinkForUri in class AbstractBufferingSink

sendTriples

protected void sendTriples(org.dice_research.squirrel.data.uri.CrawleableUri uri,
                           Collection<org.apache.jena.graph.Triple> triples)

Method to send all buffered triples to the database

Specified by:

sendTriples in class AbstractBufferingSink

Parameters:

uri - the crawled CrawleableUri

tripleList - the list of Triples regarding that uri

sendQuads

protected void sendQuads(org.dice_research.squirrel.data.uri.CrawleableUri uri,
                         Collection<org.apache.jena.sparql.core.Quad> quadList)

Method to send all buffered quads to the database

Specified by:

sendQuads in class AbstractBufferingSink

Parameters:

uri - the crawled CrawleableUri

quadList - the list of quadss regarding that uri

addData

public void addData(org.dice_research.squirrel.data.uri.CrawleableUri uri,
                    InputStream stream)

Specified by:

addData in interface org.dice_research.squirrel.sink.UnstructuredDataSink

getGraphId

public static String getGraphId(org.dice_research.squirrel.data.uri.CrawleableUri uri)

Get the id of the graph in which the given uri is stored.

Parameters:

uri - The given uri.

Returns:

The id of the graph.

setMetadataGraphUri

public void setMetadataGraphUri(org.dice_research.squirrel.data.uri.CrawleableUri metadataGraphUri)

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.dice_research.squirrel.sink.Sink

Throws:

IOException

flushMetadata

public void flushMetadata()

Specified by:

flushMetadata in interface org.dice_research.squirrel.sink.Sink