U d@s,ddlmZmZddlZGdddeZdS))OptionalUnionNc@seZdZdZeeejfdddZe ddZ e eddd Z e e dd d Zejdd d ZddZddZddZdS)_remote_devicea@ Represents a device on a remote worker. Args: remote_device (str or torch.device): Represents a device on a remote worker. The string format should be one of the following: 1. "/", where the device field can be parsed as torch.device type. E.g., "trainer0/cpu", "trainer0", "ps0/cuda:0". In addition, the device field can be optional and the default value is "cpu". 2. "rank:/", where is the rank of the process and device can be parsed as torch.device type. E.g., "rank:0/cpu", "rank:0", "rank:0/cuda:0" 3. and are optional and formats like "cpu" and "cuda:1", just represent local devices. ) remote_devicecCsVd|d}d|_d|_d|_t|tjr2||_nt|tr|d}t|dkr`|\|_|_qt|dkrt |dr|d|_q|d|_d|_qt |nt dt ||jdk r|jst |t|j|_|jdk rR|jd }t|dkr<|dd kr2|dr2t|d|_d|_nt |nt|dkrRt |dS) NzCould not parse remote_device: zU. The valid format is '/' or 'rank:/' or ''/rcpuz Invalid type for remote_device: :rank) _worker_name_rank_device isinstancetorchdevicestrsplitlenr_is_valid_local_device ValueError TypeErrortypeisdigitint)selfr PARSE_ERRORfieldsrC/tmp/pip-unpacked-wheel-ua33x9lu/torch/distributed/remote_device.py__init__s<            z_remote_device.__init__cCs,zt|WdStk r&YdSXdS)NTF)rr Exception)rrrrrGs  z%_remote_device._is_valid_local_device)returncCs|jS)z Returns the name of remote worker representing the remote device. Returns ``None`` if no worker name is available. )r rrrr worker_namePsz_remote_device.worker_namecCs|jS)z Returns the rank of remote worker representing the remote device. Returns ``None`` if no rank is available. )r r#rrrr Wsz_remote_device.rankcCs|jS)z@ Returns the local device on the remote worker. )rr#rrrr^sz_remote_device.devicecCs|jdk rP|jdk r&|jd|jS|jdk rDd|jd|jSt|jSn,|jdk rb|jS|jdk rt|jStddS)Nrzrank:zInvalid state!)rr r r RuntimeErrorr#rrr__repr__ds      z_remote_device.__repr__cCs:t|tsdS|j|jkr6|j|jkr6|j|jkr6dSdS)NFT)rrr rr )rotherrrr__eq__ts    z_remote_device.__eq__cCst|jt|jAt|jAS)N)hashr rr r#rrr__hash__s z_remote_device.__hash__N)__name__ __module__ __qualname____doc__rrrrr staticmethodrrr$rr r&r(r*rrrrrs/ r)typingrrrobjectrrrrrs