trinity.algorithm.policy_loss_fn.sppo_loss_fn module

sPPO-token policy loss function. Relevant paper: https://arxiv.org/abs/2108.05828.

class trinity.algorithm.policy_loss_fn.sppo_loss_fn.sPPOPolicyLossFn(backend: str = 'verl', epsilon: float = 0.3, loss_agg_mode: str = 'token-mean')

基类：PolicyLossFn

__init__(backend: str = 'verl', epsilon: float = 0.3, loss_agg_mode: str = 'token-mean') → None

Initialize the policy loss function.

参数:

backend -- The training framework/backend to use (e.g., "verl")

classmethod default_args() → Dict

Get default initialization arguments for this loss function.

返回:

The default init arguments for the policy loss function.

返回类型:

Dict

property select_keys

Returns parameter keys mapped to the specific training framework's naming convention.