trinity package

Subpackages

• trinity.buffer package
  • Subpackages
    • trinity.buffer.reader package
      • Submodules
      • Module contents
    • trinity.buffer.schema package
      • Submodules
      • Module contents
    • trinity.buffer.writer package
      • Submodules
      • Module contents
  • Submodules
    • trinity.buffer.buffer module
      • get_buffer_reader()
      • get_buffer_writer()
    • trinity.buffer.buffer_reader module
      • BufferReader
    • trinity.buffer.buffer_writer module
      • BufferWriter
    • trinity.buffer.queue module
      • linear_decay_priority()
      • QueueBuffer
      • AsyncQueue
      • AsyncPriorityQueue
    • trinity.buffer.ray_wrapper module
      • DBWrapper
      • FileWrapper
      • is_database_url()
      • is_json_file()
      • QueueWrapper
    • trinity.buffer.utils module
      • retry_session()
      • default_storage_path()
  • Module contents
    • BufferReader
      • BufferReader.read()
      • BufferReader.read_async()
    • BufferWriter
      • BufferWriter.write()
      • BufferWriter.write_async()
      • BufferWriter.acquire()
      • BufferWriter.release()
    • get_buffer_reader()
    • get_buffer_writer()
• trinity.common package
  • Subpackages
    • trinity.common.models package
      • Submodules
      • Module contents
    • trinity.common.rewards package
      • Submodules
      • Module contents
    • trinity.common.workflows package
      • Submodules
      • Module contents
  • Submodules
    • trinity.common.config module
      • FormatConfig
      • GenerationConfig
      • StorageConfig
      • OperatorConfig
      • ExperiencePipelineConfig
      • TaskPipelineConfig
      • DataProcessorConfig
      • ModelConfig
      • InferenceModelConfig
      • AlgorithmConfig
      • ClusterConfig
      • ExplorerInput
      • TrainerInput
      • BufferConfig
      • ExplorerConfig
      • TrainerConfig
      • MonitorConfig
      • SynchronizerConfig
      • DataJuicerServiceConfig
      • ServiceConfig
      • Config
      • load_config()
    • trinity.common.constants module
      • CaseInsensitiveEnumMeta
      • CaseInsensitiveEnum
      • PromptType
      • TaskType
      • ReadStrategy
      • StorageType
      • MonitorType
      • SyncMethodEnumMeta
      • SyncMethod
      • RunningStatus
      • OpType
      • SyncStyle
    • trinity.common.experience module
      • EID
      • CustomField
      • Experience
      • split_dpo_experience_to_single_turn()
      • Experiences
      • empty_experiences()
      • gather_token_ids()
      • gather_action_masks()
      • gather_attention_masks()
      • gather_logprobs()
      • gather_advantages()
      • gather_returns()
      • group_by()
      • to_hf_datasets()
      • from_hf_datasets()
    • trinity.common.schema module
    • trinity.common.verl_config module
      • Data
      • FusedKernelOptions
      • ActorModel
      • Optim
      • WrapPolicy
      • FSDPConfig
      • Checkpoint
      • Actor
      • Ref
      • Rollout
      • ActorRolloutRef
      • CriticModel
      • Critic
      • RewardModel
      • CustomRewardFunction
      • KL_Ctrl
      • Algorithm
      • Trainer
      • veRLConfig
      • load_config()
  • Module contents
• trinity.explorer package
  • Submodules
    • trinity.explorer.explorer module
      • Explorer
    • trinity.explorer.runner_pool module
    • trinity.explorer.workflow_runner module
      • Status
      • WorkflowRunner
  • Module contents
    • Explorer
      • Explorer.__init__()
      • Explorer.setup_weight_sync_group()
      • Explorer.prepare()
      • Explorer.get_weight()
      • Explorer.explore()
      • Explorer.explore_step()
      • Explorer.need_sync()
      • Explorer.need_eval()
      • Explorer.eval()
      • Explorer.benchmark()
      • Explorer.save_checkpoint()
      • Explorer.sync_weight()
      • Explorer.shutdown()
      • Explorer.is_alive()
      • Explorer.get_actor()
• trinity.manager package
  • Subpackages
    • trinity.manager.config_registry package
      • Submodules
      • Module contents
  • Submodules
    • trinity.manager.config_manager module
      • ConfigManager
    • trinity.manager.manager module
      • CacheManager
  • Module contents
    • CacheManager
      • CacheManager.__init__()
      • CacheManager.save_explorer()
      • CacheManager.load_explorer()
      • CacheManager.save_trainer()
      • CacheManager.load_trainer()
    • Synchronizer
      • Synchronizer.trainer_status
      • Synchronizer.explorer_status_counts
      • Synchronizer._ready_condition
      • Synchronizer.model_state_dict
      • Synchronizer.model_version
      • Synchronizer.checkpoint_shard_counter
      • Synchronizer.__init__()
      • Synchronizer.add_module()
      • Synchronizer.set_trainer_status()
      • Synchronizer.get_trainer_status()
      • Synchronizer.set_explorer_status()
      • Synchronizer.get_explorer_status_counts()
      • Synchronizer.set_model_state_dict_with_step_num()
      • Synchronizer.set_model_state_dict()
      • Synchronizer.get_model_state_dict()
      • Synchronizer.get_state_dict_meta()
      • Synchronizer.setup_weight_sync_group()
      • Synchronizer.wait_new_model_state_dict()
      • Synchronizer.ready_to_nccl_sync()
      • Synchronizer.get_actor()
• trinity.plugins package
  • Module contents
• trinity.trainer package
  • Subpackages
    • trinity.trainer.verl package
      • Submodules
      • Module contents
  • Submodules
    • trinity.trainer.trainer module
      • Trainer
      • TrainEngineWrapper
      • get_trainer_wrapper()
    • trinity.trainer.verl_trainer module
      • VerlPPOTrainerWrapper
  • Module contents
    • Trainer
      • Trainer.__init__()
      • Trainer.prepare()
      • Trainer.train()
      • Trainer.train_step()
      • Trainer.need_sync()
      • Trainer.sync_weight()
      • Trainer.shutdown()
      • Trainer.train_step_num
      • Trainer.is_alive()
      • Trainer.get_actor()
    • TrainEngineWrapper
      • TrainEngineWrapper.prepare()
      • TrainEngineWrapper.train_step_num
      • TrainEngineWrapper.train_step()
      • TrainEngineWrapper.save_checkpoint()
      • TrainEngineWrapper.sync_weight()
      • TrainEngineWrapper.upload_state_dict()
      • TrainEngineWrapper.save_state_dict()
    • get_trainer_wrapper()
• trinity.utils package
  • Submodules
    • trinity.utils.distributed module
      • is_ipv6_address()
      • get_available_port()
      • is_port_available()
      • init_process_group()
    • trinity.utils.dlc_utils module
      • ClusterStatus
      • get_dlc_env_vars()
      • is_running()
      • wait_for_ray_setup()
      • wait_for_ray_worker_nodes()
      • setup_ray_cluster()
      • stop_ray_cluster()
    • trinity.utils.eval_utils module
      • simple_answer_parser()
      • find_boxed_answer()
      • extract_solution()
      • validate_equation()
      • evaluate_equation()
      • validate_think_pattern()
      • compute_score()
      • is_equiv()
      • remove_boxed()
      • last_boxed_only_string()
      • remove_right_units()
    • trinity.utils.log module
      • NewLineFormatter
      • get_logger()
    • trinity.utils.monitor module
      • gather_metrics()
      • Monitor
      • TensorboardMonitor
      • WandbMonitor
      • MlflowMonitor
    • trinity.utils.plugin_loader module
      • load_plugins()
      • load_plugin_from_dirs()
      • load_from_file()
    • trinity.utils.registry module
      • Registry
  • Module contents

Module contents

Trinity-RFT (Reinforcement Fine-Tuning)