trinity.service.data_juicer.client module

class trinity.service.data_juicer.client.DataJuicerClient(config: DataJuicerServiceConfig)[source]

Bases: object

Client for interacting with the DataJuicer server.

__init__(config: DataJuicerServiceConfig)[source]
initialize(config: dict)[source]
process_experience(exps: List[Experience]) → Tuple[List[Experience], Dict][source]
process_task() → Dict[source]

Process a task using the Data-Juicer service.

close()[source]

Close the DataJuicer client connection.

trinity.service.data_juicer.client.serialize_dataset_to_arrow(dataset)[source]
trinity.service.data_juicer.client.deserialize_arrow_to_dataset(arrow_bytes)[source]