trinity.service.data_juicer.client module

Contents

trinity.service.data_juicer.client module#

class trinity.service.data_juicer.client.DataJuicerClient(config: DataJuicerServiceConfig)[source]#

Bases: object

Client for interacting with the DataJuicer server.

__init__(config: DataJuicerServiceConfig)[source]#

initialize(config: dict)[source]#

process_experience(exps: List[Experience]) → Tuple[List[Experience], Dict][source]#

process_task() → Dict[source]#: Process a task using the Data-Juicer service.

close()[source]#: Close the DataJuicer client connection.

trinity.service.data_juicer.client.serialize_dataset_to_arrow(dataset)[source]#

trinity.service.data_juicer.client.deserialize_arrow_to_dataset(arrow_bytes)[source]#