U )d$ @sdZddlmZddlmZddlmZddlm Z zddl m Z Wne k rbddd Z YnXzdd l mZWnBe k rzdd lmZWne k rd d ZYnXYnXdd lZddgiZddgZedddZddZddZddZd S)z, Thin wrappers around `concurrent.futures`. )absolute_import)contextmanager)tqdm) TqdmWarning) length_hintcCs(z t|WStk r"|YSXdS)z,Returns `len(it)`, falling back to `default`N)len TypeError)itdefaultr ;/tmp/pip-unpacked-wheel-u8lm3wqg/tqdm/contrib/concurrent.pyrs r) cpu_countcCsdS)Nr r r r r rsrNz github.com/Z casperdcl thread_map process_mapccsPt|dd}|p|}t|||}|||V|dkrB|`n ||dS)z>get (create if necessary) and then restore `tqdm_class`'s lock_lockN)getattrZget_lockset_lockr) tqdm_class lock_nameZold_locklockr r r ensure_lock"s    rc Os|}d|kr t|d|d<|dt}|dtdtd}|dd}|d d }t||d } d|i} tjd d } | dkr| j |j | fdi} d| krdksn| j |d|f| 8} t || j |f|| f|W5QRW5QRSQRXW5QRXd S)a Implementation of `thread_map` and `process_map`. Parameters ---------- tqdm_class : [default: tqdm.auto.tqdm]. max_workers : [default: min(32, cpu_count() + 4)]. chunksize : [default: 1]. lock_name : [default: "":str]. totalrr max_workers r chunksizerr)rNr))Z initializerZinitargs)rr)r)r) copyrpop tqdm_autominrrsys version_infoupdaterlistmap)Z PoolExecutorfn iterables tqdm_kwargskwargsrrrrZlk pool_kwargs sys_versionZmap_argsexr r r _executor_map0s"      r2cOsddlm}t||f||S)a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ThreadPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ThreadPoolExecutor.__init__`. [default: max(32, cpu_count() + 4)]. r)ThreadPoolExecutor)concurrent.futuresr3r2)r+r,r-r3r r r rOs cOsvddlm}|rLd|krLttt|}|dkrLddlm}|d|tddd |krd|}d |d <t ||f||S) a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ProcessPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ProcessPoolExecutor.__init__`. [default: min(32, cpu_count() + 4)]. chunksize : int, optional Size of chunks sent to worker processes; passed to `concurrent.futures.ProcessPoolExecutor.map`. [default: 1]. lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: mp_lock]. r)ProcessPoolExecutorri)warnzIterable length %d > 1000 but `chunksize` is not set. This may seriously degrade multiprocess performance. Set `chunksize=1` or more.r) stacklevelrZmp_lock) r4r5maxr*rwarningsr6rr"r2)r+r,r-r5Zlongest_iterable_lenr6r r r ras   )r)r)__doc__ __future__r contextlibrautorr$Zstdroperatorr ImportErrorosrmultiprocessingr& __author____all__rr2rrr r r r s.