U
(d @ s& d dl Z d dlZd dlZd dlmZ d dlmZmZmZm Z m
Z
m Z d dl Z ddl
mZ ddlmZmZmZ ddd d
Zd ZG d d
d
eZd ee
e e eeef ee f dddZeeeddddZd ee
e ddddZd ee
e eddddZd!ee
e e
ee eddd d ZdS )" N)contextmanager)AnyDictListIteratorOptionalTuple ) ImageFolder)check_integrityextract_archiveverify_str_arg)zILSVRC2012_img_train.tarZ 1d675b47d978889d74fa0da5fadfb00e)zILSVRC2012_img_val.tarZ 29b22e2961454d5413ddabcf34fc5622)z ILSVRC2012_devkit_t12.tar.gzZ fa75699e90414af021442c21a62c3abf)trainvaldevkitzmeta.binc s\ e Zd ZdZdeeedd fdd
Zdddd Zeedd
d Z edd d
Z
Z S )ImageNeta `ImageNet `_ 2012 Classification Dataset.
Args:
root (string): Root directory of the ImageNet Dataset.
split (string, optional): The dataset split, supports ``train``, or ``val``.
transform (callable, optional): A function/transform that takes in an PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
loader (callable, optional): A function to load an image given its path.
Attributes:
classes (list): List of the class name tuples.
class_to_idx (dict): Dict with items (class_name, class_index).
wnids (list): List of the WordNet IDs.
wnid_to_idx (dict): Dict with items (wordnet_id, class_index).
imgs (list): List of (image path, class_index) tuples
targets (list): The class_index value for each image in the dataset
r N)rootsplitkwargsreturnc s t j| }| _t|dd| _| t| jd t j | j
f| || _| j | _ | j
| _ fdd| j D | _ dd t| j D | _
d S )Nr )r r r c s g | ] } | qS r ).0wnidwnid_to_classesr A/tmp/pip-unpacked-wheel-vx7f76es/torchvision/datasets/imagenet.py
6 s z%ImageNet.__init__..c S s i | ]\}}|D ]
}||qqS r r )r idxclssclsr r r
7 s
z%ImageNet.__init__..)ospath
expanduserr r
r parse_archivesload_meta_filesuper__init__ split_folderclasseswnidsZ class_to_idxZ wnid_to_idx enumerate)selfr r r __class__r r r' * s zImageNet.__init__r c C sZ t tj| jts t| j tj| jsV| j dkrBt
| j n| j dkrVt | j d S )Nr r ) r r! r" joinr META_FILEparse_devkit_archiveisdirr( r parse_train_archiveparse_val_archiver, r r r r$ 9 s
zImageNet.parse_archivesc C s t j| j| jS N)r! r" r0 r r r6 r r r r( C s zImageNet.split_folderc C s dj f | jS )NzSplit: {split})format__dict__r6 r r r
extra_reprG s zImageNet.extra_repr)r ) __name__
__module__ __qualname____doc__strr r' r$ propertyr( r:
__classcell__r r r- r r s
r )r filer c C sD |d kr t }tj| |}t|r,t|S d}t||| d S )NzThe meta file {} is not present in the root directory or is corrupted. This file is automatically created by the ImageNet dataset.) r1 r! r" r0 r torchload RuntimeErrorr8 )r rB msgr r r r% K s
r% )r rB md5r c C s, t tj| ||s(d}t||| d S )Nz{The archive {} is not present in the root directory or is corrupted. You need to download it externally and place it in {}.)r r! r" r0 rE r8 )r rB rG rF r r r _verify_archiveZ s rH c s ddl m tttttf ttttdf f f dfdd }ttt ddd}ttt d d
d }t d }|dkr|d }|d
}t
| || | h}t t j
| || t j
|d}||\ } ||}
fdd|
D } t| | ft j
| t W 5 Q R X dS )a5 Parse the devkit archive of the ImageNet2012 classification dataset and save
the meta information in a binary file.
Args:
root (str): Root directory containing the devkit archive
file (str, optional): Name of devkit archive. Defaults to
'ILSVRC2012_devkit_t12.tar.gz'
r N.) devkit_rootr c s t j| dd}j|ddd tt d } fddt|D tt d d \}}}d
d |D }d d t||D }d
d t||D }||fS )Ndatazmeta.matT)Z
squeeze_meZsynsets c s g | ]\}}|d kr | qS )r r )r r Z num_childrenmetar r r r s z@parse_devkit_archive..parse_meta_mat.. c S s g | ]}t |d qS )z, )tupler )r r r r r r t s c S s i | ]\}}||qS r r )r r r r r r r u s z@parse_devkit_archive..parse_meta_mat..c S s i | ]\}}||qS r r )r r r r r r r v s )r! r" r0 Zloadmatlistzipr+ )rI ZmetafileZ
nums_childrenZidcsr* r) idx_to_wnidr )siorL r parse_meta_matn s z,parse_devkit_archive..parse_meta_matc S s: t j| dd}t|}| }W 5 Q R X dd |D S )NrJ z&ILSVRC2012_validation_ground_truth.txtc S s g | ] }t |qS r )int)r Zval_idxr r r r } s zKparse_devkit_archive..parse_val_groundtruth_txt..)r! r" r0 open readlines)rI rB Ztxtfhval_idcsr r r parse_val_groundtruth_txty s
z7parse_devkit_archive..parse_val_groundtruth_txtr/ c s s$ t } z
| V W 5 t| X d S r7 )tempfilemkdtempshutilrmtree)tmp_dirr r r get_tmp_dir s
z)parse_devkit_archive..get_tmp_dirr r ZILSVRC2012_devkit_t12c s g | ] } | qS r r )r r )rR r r r s z(parse_devkit_archive..)Zscipy.ioior? r r rU r r r ARCHIVE_METArH r r! r" r0 rC saver1 ) r rB rT rY r_ archive_metarG r^ rI r rX Z val_wnidsr )rR rS r r2 c s" 4 r2 r )r rB folderr c s t d }|dkr|d }|d }t| || tj| | ttj| | fddt D }|D ] }t|tj|d dd qjdS ) a Parse the train images archive of the ImageNet2012 classification dataset and
prepare it for usage with the ImageNet dataset.
Args:
root (str): Root directory containing the train images archive
file (str, optional): Name of train images archive. Defaults to
'ILSVRC2012_img_train.tar'
folder (str, optional): Optional name for train images folder. Defaults to
'train'
r Nr r c s g | ]}t j |qS r r! r" r0 )r archiveZ
train_rootr r r s z'parse_train_archive..T)Zremove_finished)ra rH r! r" r0 r listdirsplitext)r rB rd rc rG Zarchivesrf r rg r r4 s r4 r )r rB r* rd r c s t d }|dkr|d }|d }|dkr4t| d }t| || tj| | ttj| | t fddt D }t |D ]}t
tj | qt ||D ](\}}t
|tj |tj| qdS )af Parse the validation images archive of the ImageNet2012 classification dataset
and prepare it for usage with the ImageNet dataset.
Args:
root (str): Root directory containing the validation images archive
file (str, optional): Name of validation images archive. Defaults to
'ILSVRC2012_img_val.tar'
wnids (list, optional): List of WordNet IDs of the validation images. If None
is given, the IDs are loaded from the meta file in the root directory
folder (str, optional): Optional name for validation images folder. Defaults to
'val'
r Nr r c 3 s | ]}t j |V qd S r7 re )r imageZval_rootr r s z$parse_val_archive..)ra r% rH r! r" r0 r sortedrh setmkdirrQ r\ movebasename) r rB r* rd rc rG Zimagesr Zimg_filer rk r r5 s r5 )N)N)Nr )NNr ) r! r\ rZ
contextlibr typingr r r r r r rC rd r
utilsr r r
ra r1 r r? r% rH r2 r4 r5 r r r r s6 6, 6