trinity.trainer.verl package

Submodules

• trinity.trainer.verl.core_algos module
• trinity.trainer.verl.dp_actor module
  • DataParallelPPOActor
    • DataParallelPPOActor.__init__()
    • DataParallelPPOActor.set_algorithm()
    • DataParallelPPOActor.update_policy()
• trinity.trainer.verl.fsdp_workers module
  • ActorRolloutRefWorker
    • ActorRolloutRefWorker.__init__()
    • ActorRolloutRefWorker.init_model()
    • ActorRolloutRefWorker.setup_weight_sync_group()
    • ActorRolloutRefWorker.sync_weight()
    • ActorRolloutRefWorker.upload_state_dict()
    • ActorRolloutRefWorker.set_algorithm()
    • ActorRolloutRefWorker.update_actor()
    • ActorRolloutRefWorker.compute_log_prob()
    • ActorRolloutRefWorker.compute_ref_log_prob()
    • ActorRolloutRefWorker.save_checkpoint()
    • ActorRolloutRefWorker.load_checkpoint()
    • ActorRolloutRefWorker.clear_optimizer_state()
    • ActorRolloutRefWorker.wait_on_save_thread()
  • CriticWorker
    • CriticWorker.__init__()
    • CriticWorker.init_model()
    • CriticWorker.compute_values()
    • CriticWorker.update_critic()
    • CriticWorker.save_checkpoint()
    • CriticWorker.load_checkpoint()
    • CriticWorker.clear_optimizer_state()
    • CriticWorker.wait_on_save_thread()
• trinity.trainer.verl.ray_trainer module

Module contents