U (d*(@sddlZddlmZmZmZmZmZddlmZddl m Z m Z m Z m Z ddlmZGdddeZGd d d eZGd d d eZdS) N)AnyCallableListOptionalTuple)Image)check_integritydownload_and_extract_archive download_urlverify_str_arg) VisionDatasetc seZdZdZdZddddZddd d d d d dZddddZdZd'e e e e e e e e e dfdd Z e ejdddZddZddZd d!Ze d"d#d$Zd%d&ZZS)(_LFWzlfw-pyz http://vis-www.cs.umass.edu/lfw/)Zlfwzlfw.tgzZ a17d05bd522c52d84eca14327a23d494)Z lfw_funneledzlfw-funneled.tgzZ 1b42dfed7d15c9b2dd63d5e5840c86ad)zlfw-deepfunneledzlfw-deepfunneled.tgzZ 68331da3eb755a505a502b5aacb3c201)originalfunneledZ deepfunneledZ 9f1ba174e4e1c508ff7cdf10ac338a7dZ 5132f7440eb68cf58910c8a45a2ac10bZ 4f27cbf15b2da4a85c1907eb4181ad21Z 450f0863dd89e85e73936a6d71a3474bZ e4bf5be0a43b5dcd9dc5ccfcb8fb19c5Z 54eaac34beb6d042ed3a7d883e247a21Z a6d0a479bd074669f656265a6e693f6d)z pairs.txtzpairsDevTest.txtzpairsDevTrain.txtz people.txtzpeopleDevTest.txtzpeopleDevTrain.txt lfw-names.txtZDevTrainZDevTest)10foldtraintestrNF)rootsplit image_setview transformtarget_transformdownloadc stjtj||j||dt|d|j |_ |j|j \}|_ |_ t|dddg|_ t|dddd g|_|j |j|jd |_g|_|r||std tj|j||_dS) N)rrrrpeoplepairsrrrrz.txtzHDataset not found or corrupted. You can use download=True to download it)super__init__ospathjoin base_folderr lower file_dictkeysrfilenamemd5rr annot_file labels_filedatar_check_integrity RuntimeErrorr images_dir) selfrrrrrrrr/ __class__`_ Dataset. Args: root (string): Root directory of dataset where directory ``lfw-py`` exists or will be saved to if download is set to True. split (string, optional): The image split to use. Can be one of ``train``, ``test``, ``10fold`` (default). image_set (str, optional): Type of image funneling to use, ``original``, ``funneled`` or ``deepfunneled``. Defaults to ``funneled``. transform (callable, optional): A function/transform that takes in an PIL image and returns a transformed version. E.g, ``transforms.RandomRotation`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. download (bool, optional): If true, downloads the dataset from the internet and puts it in root directory. If dataset is already downloaded, it is not downloaded again. rrNFrrrrrrc s6t|||d|||||_|\|_|_dS)Nr)rr _get_classes class_to_idx _get_peopler,targetsr0rrrrrrr1r3r4r rs  zLFWPeople.__init__c Csgg}}ttj|j|j}|}|jdkrDt|ddfnd\}}t |D]}t||}dd||d||dD} ||d7}t | D]J\} \} } t dt| dD]*} | | | }| || |j | qqqTW5QRX||fS)Nrrr)rrcSsg|]}|dqS stripr.0liner3r3r4 sz)LFWPeople._get_people..)r7r!r"r#rr+ readlinesrrBrange enumeraterEappendrT)r0r,rVr9linesn_foldssfoldZn_linesrirCZnum_imgsnumr:r3r3r4rUs "  "    zLFWPeople._get_peoplec CsNttj|j|j}|}dd|D}W5QRXddt|D}|S)NcSsg|]}|dqS)rrZr\r3r3r4r_sz*LFWPeople._get_classes..cSsi|]\}}||qSr3r3)r]rhnamer3r3r4 sz*LFWPeople._get_classes..)r7r!r"r#rr=r`rb)r0r9rdr=rTr3r3r4rSs zLFWPeople._get_classesindexr5cCsJ||j|}|j|}|jdk r.||}|jdk rB||}||fS)z Args: index (int): Index Returns: tuple: Tuple (image, target) where target is the identity of the person. N)r;r,rVrr)r0rmr:targetr3r3r4 __getitem__s     zLFWPeople.__getitem__rFcstdt|jS)Nz Classes (identities): )rrHrIrTrGr1r3r4rHszLFWPeople.extra_repr)rrNNF)rKrLrM__doc__rNrrrOr rUrSrBrrrorHrPr3r3r1r4rQ^s$rQcs\eZdZdZdeeeeeeeedfdd Zd d Z e e e e e fd d d Z ZS)LFWPairsa`LFW `_ Dataset. Args: root (string): Root directory of dataset where directory ``lfw-py`` exists or will be saved to if download is set to True. split (string, optional): The image split to use. Can be one of ``train``, ``test``, ``10fold``. Defaults to ``10fold``. image_set (str, optional): Type of image funneling to use, ``original``, ``funneled`` or ``deepfunneled``. Defaults to ``funneled``. transform (callable, optional): A function/transform that takes in an PIL image and returns a transformed version. E.g, ``transforms.RandomRotation`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. download (bool, optional): If true, downloads the dataset from the internet and puts it in root directory. If dataset is already downloaded, it is not downloaded again. rrNFrRc s4t|||d|||||j\|_|_|_dS)Nr)rr _get_pairsr/ pair_namesr,rVrWr1r3r4r s zLFWPairs.__init__c Csggg}}}ttj|j|j~}|}|jdkrb|dd\}}t|t|}}ndt|d}}d} t |D]} dd|| | |D} dd|| || d|D} | d|7} | D]b} | | d| d| | d| dd}}}| | d| df| ||f| |q| D]d} | | d| d| | d| d d}}}| | d| df| ||f| |q:qW5QRX|||fS) NrrrYrcSsg|]}|dqSrXrZr\r3r3r4r_sz'LFWPairs._get_pairs..cSsg|]}|dqSrXrZr\r3r3r4r_s) r7r!r"r#rr+r`rrBrarErc)r0r/rsr,rVr9rdreZn_pairsrfrgZ matched_pairsZunmatched_pairspairimg1img2Zsamer3r3r4rrs. " 0 0zLFWPairs._get_pairsrlcCsl|j|\}}||||}}|j|}|jdk rN||||}}|jdk rb||}|||fS)z Args: index (int): Index Returns: tuple: (image1, image2, target) where target is `0` for different indentities and `1` for same identities. N)r,r;rVrr)r0rmrwrxrnr3r3r4ros    zLFWPairs.__getitem__)rrNNF)rKrLrMrprNrrrOr rrrBrrrorPr3r3r1r4rqs  rq)r!typingrrrrrZPILrutilsr r r r Zvisionr rrQrqr3r3r3r4s  TR