data_juicer.ops.mapper.punctuation_normalization_mapper module

class data_juicer.ops.mapper.punctuation_normalization_mapper.PunctuationNormalizationMapper(*args, **kwargs)

基类：Mapper

Mapper to normalize unicode punctuations to English punctuations in text samples.

__init__(*args, **kwargs)

Initialization method.

参数:

• args -- extra args

• kwargs -- extra args

process_batched(samples)