3 d$@sdZddlmZddlmZddlmZddlm Z yddl m Z Wne k rbddd Z YnXydd l mZWnBe k rydd lmZWne k rd d ZYnXYnXdd lZddgiZddgZedddZddZddZddZd S)z, Thin wrappers around `concurrent.futures`. )absolute_import)contextmanager)tqdm) TqdmWarning) length_hintc Cs"yt|Stk r|SXdS)z,Returns `len(it)`, falling back to `default`N)len TypeError)itdefaultr 7/tmp/pip-build-v9q4h5k9/tqdm/tqdm/contrib/concurrent.pyrsr) cpu_countcCsdS)Nr r r r r rsrNz github.com/Z casperdcl thread_map process_mapccsPt|dd}|p|j}t|||}|j||V|dkrB|`n |j|dS)z>get (create if necessary) and then restore `tqdm_class`'s lock_lockN)getattrZget_lockset_lockr) tqdm_class lock_nameZold_locklockr r r ensure_lock"s    rcOs|j}d|kr t|d|d<|jdt}|jdtdtd}|jdd}|jd d }t||d } d|i} tjd d } | dkr| j |j | fdi} d| kodkns| j |d|f|  } t || j |f|| f|SQRXWd QRXd S)a Implementation of `thread_map` and `process_map`. Parameters ---------- tqdm_class : [default: tqdm.auto.tqdm]. max_workers : [default: min(32, cpu_count() + 4)]. chunksize : [default: 1]. lock_name : [default: "":str]. totalrr max_workers r chunksizerr)rNr)Z initializerZinitargs)r)rr )rr)rr!) copyrpop tqdm_autominrrsys version_infoupdaterlistmap)Z PoolExecutorfn iterables tqdm_kwargskwargsrrrrZlk pool_kwargs sys_versionZmap_argsexr r r _executor_map0s"      r2cOsddlm}t||f||S)a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ThreadPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ThreadPoolExecutor.__init__`. [default: max(32, cpu_count() + 4)]. r)ThreadPoolExecutor)concurrent.futuresr3r2)r+r,r-r3r r r rOs cOsvddlm}|rLd|krLttt|}|dkrLddlm}|d|tddd |krd|j}d |d <t ||f||S) a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ProcessPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ProcessPoolExecutor.__init__`. [default: min(32, cpu_count() + 4)]. chunksize : int, optional Size of chunks sent to worker processes; passed to `concurrent.futures.ProcessPoolExecutor.map`. [default: 1]. lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: mp_lock]. r)ProcessPoolExecutorri)warnzIterable length %d > 1000 but `chunksize` is not set. This may seriously degrade multiprocess performance. Set `chunksize=1` or more.r) stacklevelrZmp_lock) r4r5maxr*rwarningsr6rr"r2)r+r,r-r5Zlongest_iterable_lenr6r r r ras    )r)r)__doc__ __future__r contextlibrautorr$Zstdroperatorr ImportErrorosrmultiprocessingr& __author____all__rr2rrr r r r s.