trinity.service.data_juicer.client module

目录

trinity.service.data_juicer.client module#

class trinity.service.data_juicer.client.DataJuicerClient(config: DataJuicerServiceConfig)[源代码]#

基类：object

Client for interacting with the DataJuicer server.

__init__(config: DataJuicerServiceConfig)[源代码]#

initialize(config: dict)[源代码]#

process_experience(exps: List[Experience]) → Tuple[List[Experience], Dict][源代码]#

process_task() → Dict[源代码]#: Process a task using the Data-Juicer service.

close()[源代码]#: Close the DataJuicer client connection.

trinity.service.data_juicer.client.serialize_dataset_to_arrow(dataset)[源代码]#

trinity.service.data_juicer.client.deserialize_arrow_to_dataset(arrow_bytes)[源代码]#