U
+È-eQ ã @ sF d Z ddlZddlmZmZ edƒZee eeee dœdd„ZdS )z9Contains a utility to iterate by chunks over an iterator.é N)ÚIterableÚTypeVarÚT)ÚiterableÚ
chunk_sizeÚreturnc c sh t |tƒr|dkrtdƒ‚t| ƒ}z t|ƒ}W n tk
rD Y dS X t |ft ||d ¡¡V q"dS )a† Iterates over an iterator chunk by chunk.
Taken from https://stackoverflow.com/a/8998040.
See also https://github.com/huggingface/huggingface_hub/pull/920#discussion_r938793088.
Args:
iterable (`Iterable`):
The iterable on which we want to iterate.
chunk_size (`int`):
Size of the chunks. Must be a strictly positive integer (e.g. >0).
Example:
```python
>>> from huggingface_hub.utils import chunk_iterable
>>> for items in chunk_iterable(range(17), chunk_size=8):
... print(items)
# [0, 1, 2, 3, 4, 5, 6, 7]
# [8, 9, 10, 11, 12, 13, 14, 15]
# [16] # smaller last chunk
```
Raises:
[`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError)
If `chunk_size` <= 0.
The last chunk can be smaller than `chunk_size`.
r z6`chunk_size` must be a strictly positive integer (>0).Né ) Ú
isinstanceÚintÚ
ValueErrorÚiterÚnextÚ
StopIterationÚ itertoolsÚchainÚislice)r r ÚiteratorZ next_item© r úc/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/huggingface_hub/utils/_chunk_utils.pyÚchunk_iterable s r )Ú__doc__r Útypingr r r r
r r r r r Ú s