data_juicer.ops.grouper.naive_reverse_grouper module¶

class data_juicer.ops.grouper.naive_reverse_grouper.NaiveReverseGrouper(batch_meta_export_path=None, *args, **kwargs)[source]¶

Split batched samples to samples.

__init__(batch_meta_export_path=None, *args, **kwargs)[source]¶

Initialization method.

Parameters:

batch_meta_export_path – the path to export the batch meta. Just drop the batch meta if it is None.
args – extra args
kwargs – extra args

process(dataset)[source]¶

Dataset –> dataset.