data_juicer.ops.grouper.naive_reverse_grouper module

class data_juicer.ops.grouper.naive_reverse_grouper.NaiveReverseGrouper(batch_meta_export_path=None, *args, **kwargs)[源代码]

基类:Grouper

Split batched samples to samples.

__init__(batch_meta_export_path=None, *args, **kwargs)[源代码]

Initialization method.

参数:
  • batch_meta_export_path -- the path to export the batch meta. Just drop the batch meta if it is None.

  • args -- extra args

  • kwargs -- extra args

process(dataset)[源代码]

Dataset --> dataset.

参数:

dataset -- input dataset

返回:

dataset of batched samples.