Modifier and Type | Field and Description |
---|---|
protected UriCollector |
AbstractAnalyzer.collector |
Constructor and Description |
---|
AbstractAnalyzer(UriCollector collector) |
Modifier and Type | Field and Description |
---|---|
private UriCollector |
FilterSinkRDF.collector |
private UriCollector |
SquirrelTripleHandler.collector |
private UriCollector |
SquirrelClerezzaSink.collector |
Modifier and Type | Method and Description |
---|---|
static org.semarglproject.sink.TripleSink |
SquirrelClerezzaSink.connect(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
Constructor and Description |
---|
FilterSinkRDF(org.dice_research.squirrel.data.uri.CrawleableUri curi,
org.dice_research.squirrel.sink.Sink sink,
UriCollector collector,
TripleEncoder encoder) |
SquirrelClerezzaSink(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
SquirrelTripleHandler(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
Modifier and Type | Field and Description |
---|---|
private UriCollector |
HDTAnalyzer.collector |
Constructor and Description |
---|
HDTAnalyzer(UriCollector collector) |
JsonAnalyzer(UriCollector collector) |
MicrodataAnalyzer(UriCollector collector) |
MicroformatMF2JAnalyzer(UriCollector collector) |
RDFaAnalyzer(UriCollector collector) |
RDFAnalyzer(UriCollector collector) |
Modifier and Type | Field and Description |
---|---|
private UriCollector |
CkanJsonAnalyzer.collector |
protected UriCollector |
CkanDatasetConsumer.collector |
Constructor and Description |
---|
CkanDatasetConsumer(org.dice_research.squirrel.sink.Sink sink,
UriCollector collector,
org.dice_research.squirrel.data.uri.CrawleableUri curi,
TripleEncoder tripleEncoder) |
CkanJsonAnalyzer(UriCollector collector) |
Modifier and Type | Field and Description |
---|---|
private UriCollector |
MicroformatsAnalyzer.collector |
Constructor and Description |
---|
MicroformatsAnalyzer(UriCollector collector) |
MicroformatsAnalyzer(UriCollector collector,
com.kylewm.mf2j.Mf2Parser parser) |
Modifier and Type | Field and Description |
---|---|
private UriCollector |
HTMLScraperAnalyzer.collector |
Constructor and Description |
---|
HTMLScraperAnalyzer(UriCollector collector) |
HTMLScraperAnalyzer(UriCollector collector,
HtmlScraper htmlScraper) |
Constructor and Description |
---|
SimpleAnalyzerManager(UriCollector uriCollector,
String... analyzers)
Deprecated.
|
SimpleOrderedAnalyzerManager(UriCollector uriCollector)
Deprecated.
|
Modifier and Type | Class and Description |
---|---|
class |
SimpleUriCollector
Simple in-memory implementation of the
UriCollector interface based
on the given Serializer . |
class |
SqlBasedUriCollector
An implementation of the
UriCollector interface that is backed by a
SQL database. |
Modifier and Type | Field and Description |
---|---|
protected UriCollector |
WorkerImpl.collector |
Constructor and Description |
---|
WorkerImpl(org.dice_research.squirrel.frontier.Frontier frontier,
Fetcher fetcher,
org.dice_research.squirrel.sink.Sink sink,
Analyzer analyzer,
RobotsManager manager,
org.dice_research.squirrel.data.uri.serialize.Serializer serializer,
UriCollector collector,
long waitingTime,
String logDir,
boolean sendAliveMessages,
boolean storeMetadata)
Constructor.
|
Copyright © 2017–2020. All rights reserved.