data_juicer.format.empty_formatter module

class data_juicer.format.empty_formatter.EmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)

Bases: BaseFormatter

The class is used to create empty data.

SUFFIXES = []

__init__(length, feature_keys: List[str] = [], *args, **kwargs)

Initialization method.

Parameters:

• length – The empty dataset length.

• feature_keys – feature key name list.

property null_value

load_dataset(*args, **kwargs)

class data_juicer.format.empty_formatter.RayEmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)

Bases: BaseFormatter

The class is used to create empty data for ray.

SUFFIXES = []

__init__(length, feature_keys: List[str] = [], *args, **kwargs)

Initialization method.

Parameters:

• length – The empty dataset length.

• feature_keys – feature key name list.

property null_value

load_dataset(*args, **kwargs)