U
(d~ @ sl d dl Zd dlmZmZmZmZmZ d dlZ d dl
m Z ddl m
Z
mZmZ ddlmZ G dd deZdS ) N)AnyCallableOptionalTuplecast)Image )check_integrity download_and_extract_archiveverify_str_arg)
VisionDatasetc s& e Zd ZdZdZdZdZdZdZdZ dd gd
d gd d
ggZ
ddgddggZ dZ d-e
e
ee ee ee edd fdd
Zee ee dddZeeeef d d d Zed d d!Zd.e
ee
eejeej f d"d#d$Zed d%d&Zdd d'd(Z e
d d)d*Z ee ddd+d,Z Z S )/STL10a `STL10 `_ Dataset.
Args:
root (string): Root directory of dataset where directory
``stl10_binary`` exists.
split (string): One of {'train', 'test', 'unlabeled', 'train+unlabeled'}.
Accordingly dataset is selected.
folds (int, optional): One of {0-9} or None.
For training, loads one of the 10 pre-defined folds of 1k samples for the
standard evaluation procedure. If no value is passed, loads the 5k samples.
transform (callable, optional): A function/transform that takes in an PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
download (bool, optional): If true, downloads the dataset from the internet and
puts it in root directory. If dataset is already downloaded, it is not
downloaded again.
Z stl10_binaryz9http://ai.stanford.edu/~acoates/stl10/stl10_binary.tar.gzzstl10_binary.tar.gzZ 91f7769df0f17e558f3565bffb0c7dfbzclass_names.txtzfold_indices.txtz train_X.binZ 918c2871b30a85fa023e0c44e0bee87fz train_y.binZ 5a34089d4802c674881badbb80307741zunlabeled_X.binZ 5242ba1fed5e4be9e1e742405eb56ca4z
test_X.binZ 7f263ba9f9e0b06b93213547f721ac82z
test_y.binZ 36f9794fa4beb8a2c72628de14fa638e)traintrain+unlabeled unlabeledtestr NF)rootsplitfolds transformtarget_transformdownloadreturnc s t j|||d t|d| j| _| || _|r<| n| sLt d| | jdkr|
| j d d | j d d \| _ | _
ttj| j
| _
| | n| jdkr>|
| j d d | j d d \| _ | _
ttj| j
| _
| | |
| j d d \}}t| j |f| _ t| j
td g|jd f| _
nj| jd
kr|
| j d d \| _ }td g| j jd | _
n(|
| jd d | jd d \| _ | _
tj| j| j| j} tj | rt | }
|
| _ W 5 Q R X d S ) N)r r r zHDataset not found or corrupted. You can use download=True to download itr r r r r )!super__init__r splitsr
_verify_foldsr r _check_integrity RuntimeError_STL10__loadfile
train_listdatalabelsr npndarray_STL10__load_foldsZ concatenateZasarrayshape test_listospathjoinr base_folderclass_names_fileisfileopenread
splitlinesclasses) selfr r r r r r Zunlabeled_data_Z
class_filef __class__ >/tmp/pip-unpacked-wheel-vx7f76es/torchvision/datasets/stl10.pyr . s6
( (
& (
zSTL10.__init__)r r c C sT |d kr |S t |tr:|tdkr&|S d}t||nd}t|t|d S )N
zDValue for argument folds should be in the range [0, 10), but got {}.z>Expected type None or int for argument folds, but got type {}.)
isinstanceintrange
ValueErrorformattype)r4 r msgr9 r9 r: r Z s
zSTL10._verify_folds)indexr c C sx | j dk r&| j| t| j | }}n| j| d }}tt|d}| jdk r\| |}| jdk rp| |}||fS )z
Args:
index (int): Index
Returns:
tuple: (image, target) where target is index of the target class.
N)r r r ) r$ r# r= r Z fromarrayr% transposer r )r4 rC imgtargetr9 r9 r: __getitem__f s
zSTL10.__getitem__)r c C s | j jd S )Nr )r# r( r4 r9 r9 r: __len__ s z
STL10.__len__) data_file labels_filer c C s d }|rFt j| j| j|}t|d}tj|tjdd }W 5 Q R X t j| j| j|}t|d.}tj|tjd}t |d}t
|d}W 5 Q R X ||fS )Nrb)dtyper )r ` rO )r r rN r ) r* r+ r, r r- r0 r% ZfromfileZuint8ZreshaperD ) r4 rJ rK r$ Zpath_to_labelsr6 Z path_to_dataZ
everythingZimagesr9 r9 r: Z
__loadfile s zSTL10.__loadfilec C sP | j }| j| j D ]8}|d |d }}tj|| j|}t||s dS qdS )Nr r FT)r r" r) r* r+ r, r- r )r4 r Zfentryfilenamemd5Zfpathr9 r9 r: r s
zSTL10._check_integrityc C s8 | rtd d S t| j| j| j| jd | d S )Nz%Files already downloaded and verified)rP rQ )r printr
urlr rP tgz_md5rH r9 r9 r: r s
zSTL10.downloadc C s dj f | jS )NzSplit: {split})r@ __dict__rH r9 r9 r:
extra_repr s zSTL10.extra_reprc C s |d kr d S t j| j| j| j}t|^}| | }t j
|t j dd}| j |d d d d d d f | _ | j
d k r| j
| | _
W 5 Q R X d S )N )rM sep)r* r+ r, r r- folds_list_filer0 r1 r2 r%
fromstringZint64r# r$ )r4 r Z
path_to_foldsr6 Zstr_idxZlist_idxr9 r9 r: Z __load_folds s
zSTL10.__load_folds)r NNNF)N) __name__
__module__ __qualname____doc__r- rS rP rT r. rY r" r) r strr r= r boolr r r r rG rI r% r& r! r r rV r'
__classcell__r9 r9 r7 r: r
sF , ( r
)os.pathr* typingr r r r r Znumpyr% ZPILr utilsr r
r Zvisionr r
r9 r9 r9 r: s