trinity.utils.distributed module
For distributed training with multiple process groups.
-
trinity.utils.distributed.is_ipv6_address(ip_str: str) → bool[source]
-
trinity.utils.distributed.get_available_port() → int[source]
-
trinity.utils.distributed.is_port_available(port: int, host='127.0.0.1') → bool[source]
-
trinity.utils.distributed.init_process_group(host: str, port: int, group_name: str, backend: str | Backend = 'nccl', timeout: float | None = None, world_size: int = -1, rank: int = -1, pg_options: Any | None = None, device_id: device | None = None)[source]
