| Modifier and Type | Field and Description |
|---|---|
protected UriCollector |
AbstractAnalyzer.collector |
| Constructor and Description |
|---|
AbstractAnalyzer(UriCollector collector) |
| Modifier and Type | Field and Description |
|---|---|
private UriCollector |
FilterSinkRDF.collector |
private UriCollector |
SquirrelTripleHandler.collector |
private UriCollector |
SquirrelClerezzaSink.collector |
| Modifier and Type | Method and Description |
|---|---|
static org.semarglproject.sink.TripleSink |
SquirrelClerezzaSink.connect(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
| Constructor and Description |
|---|
FilterSinkRDF(org.dice_research.squirrel.data.uri.CrawleableUri curi,
org.dice_research.squirrel.sink.Sink sink,
UriCollector collector,
TripleEncoder encoder) |
SquirrelClerezzaSink(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
SquirrelTripleHandler(org.dice_research.squirrel.data.uri.CrawleableUri curi,
UriCollector collector,
org.dice_research.squirrel.sink.Sink sink) |
| Modifier and Type | Field and Description |
|---|---|
private UriCollector |
HDTAnalyzer.collector |
| Constructor and Description |
|---|
HDTAnalyzer(UriCollector collector) |
JsonAnalyzer(UriCollector collector) |
MicrodataAnalyzer(UriCollector collector) |
MicroformatMF2JAnalyzer(UriCollector collector) |
RDFaAnalyzer(UriCollector collector) |
RDFAnalyzer(UriCollector collector) |
| Modifier and Type | Field and Description |
|---|---|
private UriCollector |
CkanJsonAnalyzer.collector |
protected UriCollector |
CkanDatasetConsumer.collector |
| Constructor and Description |
|---|
CkanDatasetConsumer(org.dice_research.squirrel.sink.Sink sink,
UriCollector collector,
org.dice_research.squirrel.data.uri.CrawleableUri curi,
TripleEncoder tripleEncoder) |
CkanJsonAnalyzer(UriCollector collector) |
| Modifier and Type | Field and Description |
|---|---|
private UriCollector |
MicroformatsAnalyzer.collector |
| Constructor and Description |
|---|
MicroformatsAnalyzer(UriCollector collector) |
MicroformatsAnalyzer(UriCollector collector,
com.kylewm.mf2j.Mf2Parser parser) |
| Modifier and Type | Field and Description |
|---|---|
private UriCollector |
HTMLScraperAnalyzer.collector |
| Constructor and Description |
|---|
HTMLScraperAnalyzer(UriCollector collector) |
HTMLScraperAnalyzer(UriCollector collector,
HtmlScraper htmlScraper) |
| Constructor and Description |
|---|
SimpleAnalyzerManager(UriCollector uriCollector,
String... analyzers)
Deprecated.
|
SimpleOrderedAnalyzerManager(UriCollector uriCollector)
Deprecated.
|
| Modifier and Type | Class and Description |
|---|---|
class |
SimpleUriCollector
Simple in-memory implementation of the
UriCollector interface based
on the given Serializer. |
class |
SqlBasedUriCollector
An implementation of the
UriCollector interface that is backed by a
SQL database. |
| Modifier and Type | Field and Description |
|---|---|
protected UriCollector |
WorkerImpl.collector |
| Constructor and Description |
|---|
WorkerImpl(org.dice_research.squirrel.frontier.Frontier frontier,
Fetcher fetcher,
org.dice_research.squirrel.sink.Sink sink,
Analyzer analyzer,
RobotsManager manager,
org.dice_research.squirrel.data.uri.serialize.Serializer serializer,
UriCollector collector,
long waitingTime,
String logDir,
boolean sendAliveMessages,
boolean storeMetadata)
Constructor.
|
Copyright © 2017–2020. All rights reserved.