trinity.buffer

Subpackages

Submodules

trinity.buffer.buffer module

The buffer module

trinity.buffer.buffer.get_buffer_reader(storage_config: StorageConfig, buffer_config: BufferConfig) → BufferReader[source]: Get a buffer reader for the given dataset name.

trinity.buffer.buffer.get_buffer_writer(storage_config: StorageConfig, buffer_config: BufferConfig) → BufferWriter[source]: Get a buffer writer for the given dataset name.

trinity.buffer.buffer_reader module

Reader of the buffer.

class trinity.buffer.buffer_reader.BufferReader[source]

Bases: ABC

Interface of the buffer reader.

abstract read(strategy: ReadStrategy | None = None) → List[source]: Read from buffer.

trinity.buffer.buffer_writer module

Writer of the buffer.

class trinity.buffer.buffer_writer.BufferWriter[source]

Bases: ABC

Interface of the buffer writer.

abstract write(data: List) → None[source]: Write to buffer.

abstract finish() → None[source]: Finish writing.

trinity.buffer.queue module

A queue implemented by Ray Actor.

trinity.buffer.utils module

trinity.buffer.utils.retry_session(session_maker, max_retry_times: int, max_retry_interval: float)[source]: A Context manager for retrying session.

Module contents

trinity.buffer.get_buffer_reader(storage_config: StorageConfig, buffer_config: BufferConfig) → BufferReader[source]: Get a buffer reader for the given dataset name.

trinity.buffer.get_buffer_writer(storage_config: StorageConfig, buffer_config: BufferConfig) → BufferWriter[source]: Get a buffer writer for the given dataset name.