org.ragna.comet.stream.extractors.file

Type members

Classlikes

sealed abstract class Charsets(val value: Charset)

Abstract class representing some Java accepted charsets

Abstract class representing some Java accepted charsets

See also:
Note:

Used as an enum-replacement for Scala 2 syntax

Companion:
object
Source:
Charsets.scala
object Charsets

Enumeration of common charsets from Java's API

Enumeration of common charsets from Java's API

Companion:
class
Source:
Charsets.scala
case class FileExtractor(files: Seq[Path], charset: Charset, format: DataFormat, inference: InferenceEngine, concurrentItems: Int, itemTimeout: Option[FiniteDuration]) extends StreamExtractor[String]

StreamExtractor capable of extracting RDF items from a list of Files, each file is expected to contain a single RDF item

StreamExtractor capable of extracting RDF items from a list of Files, each file is expected to contain a single RDF item

Inspired by https://fs2.io/#/getstarted/example

Value parameters:
charset

Charset to be used to operate the requested files

concurrentItems

Maximum number of items to be extracted and parsed for RDF in parallel (set it to 1 for sequential execution, bear in mind that high values won't necessarily translate into performance improvements unless you know what you are doing)

files

List of files to be processed, represented by their paths

format

Format of the RDF data arriving from the Stream, the Extractor expects all data items to share format

inference

Inference of the RDF data arriving from the Stream, the Extractor expects all data items to share inference

Note:

StreamExtractors type parameter is set to String since data read from files will be interpreted as Strings

Companion:
object
Source:
FileExtractor.scala