trinity.trainer.verl package

Submodules

• trinity.trainer.verl.dp_actor module
  • DataParallelPPOActor
    • DataParallelPPOActor.__init__()
    • DataParallelPPOActor.set_algorithm()
    • DataParallelPPOActor.update_policy()
• trinity.trainer.verl.fsdp_checkpoint_manager module
  • FSDPCheckpointManager
    • FSDPCheckpointManager.__init__()
    • FSDPCheckpointManager.upload_state_dict()
    • FSDPCheckpointManager.save_checkpoint()
    • FSDPCheckpointManager.wait_on_save_thread()
• trinity.trainer.verl.fsdp_workers module
  • ActorRolloutRefWorker
    • ActorRolloutRefWorker.__init__()
    • ActorRolloutRefWorker.init_model()
    • ActorRolloutRefWorker.setup_weight_sync_group()
    • ActorRolloutRefWorker.sync_weight()
    • ActorRolloutRefWorker.upload_state_dict()
    • ActorRolloutRefWorker.set_algorithm()
    • ActorRolloutRefWorker.update_actor()
    • ActorRolloutRefWorker.compute_log_prob()
    • ActorRolloutRefWorker.compute_ref_log_prob()
    • ActorRolloutRefWorker.save_checkpoint()
    • ActorRolloutRefWorker.load_checkpoint()
    • ActorRolloutRefWorker.clear_optimizer_state()
    • ActorRolloutRefWorker.wait_on_save_thread()
  • CriticWorker
    • CriticWorker.__init__()
    • CriticWorker.init_model()
    • CriticWorker.compute_values()
    • CriticWorker.update_critic()
    • CriticWorker.save_checkpoint()
    • CriticWorker.load_checkpoint()
    • CriticWorker.clear_optimizer_state()
    • CriticWorker.wait_on_save_thread()
• trinity.trainer.verl.utils module
  • to_data_proto()
  • compute_data_metrics()

Module contents