trinity.buffer.reader

Submodules

trinity.buffer.reader.file_reader module

Filed based buffer reader.

class trinity.buffer.reader.file_reader.SFTDataReader(meta: StorageConfig, config: BufferConfig)[source]

Bases: BufferReader

Reader for SFT file data.

__init__(meta: StorageConfig, config: BufferConfig)[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

class trinity.buffer.reader.file_reader.DPODataReader(meta: StorageConfig, config: BufferConfig)[source]

Bases: BufferReader

__init__(meta: StorageConfig, config: BufferConfig)[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

class trinity.buffer.reader.file_reader.RolloutDataReader(meta: StorageConfig, config: BufferConfig)[source]

Bases: BufferReader

__init__(meta: StorageConfig, config: BufferConfig)[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

reset()[source]

class trinity.buffer.reader.file_reader.RawDataReader(meta: StorageConfig, config: BufferConfig | None)[source]

Bases: BufferReader

__init__(meta: StorageConfig, config: BufferConfig | None)[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

trinity.buffer.reader.queue_reader module

Reader of the Queue buffer.

class trinity.buffer.reader.queue_reader.QueueReader(storage_config: StorageConfig, config: BufferConfig)[source]

Bases: BufferReader

Reader of the Queue buffer.

__init__(storage_config: StorageConfig, config: BufferConfig)[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

trinity.buffer.reader.sql_reader module

Reader of the SQL buffer.

class trinity.buffer.reader.sql_reader.SQLReader(meta: StorageConfig, config: BufferConfig)[source]

Bases: BufferReader

Reader of the SQL buffer.

__init__(meta: StorageConfig, config: BufferConfig) → None[source]

read(batch_size: int | None = None, strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

Module contents