o
V h" @ s| d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZm Z m
Z
m Z m Z m
Z
mZ d dlZddlmZ ddlmZmZmZ dd d
d Zd ZG d
d deZd!deeef de e de
e eef e e f fddZdeeef dededdfddZd!deeef de e ddfddZ d"deeef de e deddfdd Z d#deeef de e d e e e deddf
d d Z dS )$ N)contextmanager)Path)AnyDictIteratorListOptionalTupleUnion ) ImageFolder)check_integrityextract_archiveverify_str_arg)zILSVRC2012_img_train.tar 1d675b47d978889d74fa0da5fadfb00e)zILSVRC2012_img_val.tar 29b22e2961454d5413ddabcf34fc5622)z ILSVRC2012_devkit_t12.tar.gz fa75699e90414af021442c21a62c3abf)trainvaldevkitzmeta.binc sf e Zd ZdZddeeef dededdf fdd
Zdd
d Z e
defd d
Z defddZ Z
S )ImageNeta< `ImageNet `_ 2012 Classification Dataset.
.. note::
Before using this class, it is required to download ImageNet 2012 dataset from
`here `_ and
place the files ``ILSVRC2012_devkit_t12.tar.gz`` and ``ILSVRC2012_img_train.tar``
or ``ILSVRC2012_img_val.tar`` based on ``split`` in the root directory.
Args:
root (str or ``pathlib.Path``): Root directory of the ImageNet Dataset.
split (string, optional): The dataset split, supports ``train``, or ``val``.
transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader,
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
loader (callable, optional): A function to load an image given its path.
By default, it uses PIL as its image loader, but users could also pass in
``torchvision.io.decode_image`` for decoding image data into tensors directly.
Attributes:
classes (list): List of the class name tuples.
class_to_idx (dict): Dict with items (class_name, class_index).
wnids (list): List of the WordNet IDs.
wnid_to_idx (dict): Dict with items (wordnet_id, class_index).
imgs (list): List of (image path, class_index) tuples
targets (list): The class_index value for each image in the dataset
r rootsplitkwargsreturnNc s t j| }| _t|dd| _| t| jd t j | j
fi | || _| j | _ | j
| _ fdd| j D | _ dd t| j D | _
d S )Nr )r r r c g | ]} | qS r ).0wnidwnid_to_classesr Q/var/www/vscode/kcb/lib/python3.10/site-packages/torchvision/datasets/imagenet.py
? z%ImageNet.__init__..c S s i | ] \}}|D ]}||qqS r r )r idxclssclsr r r!
@ z%ImageNet.__init__..)ospath
expanduserr r r parse_archivesload_meta_filesuper__init__ split_folderclasseswnids class_to_idx wnid_to_idx enumerate)selfr r r __class__r r! r/ 3 s zImageNet.__init__c C sd t tj| jtst| j tj| js.| j dkr"t
| j d S | j dkr0t | j d S d S d S )Nr r ) r
r) r* joinr META_FILEparse_devkit_archiveisdirr0 r parse_train_archiveparse_val_archiver6 r r r! r, B s
zImageNet.parse_archivesc C s t j| j| jS N)r) r* r9 r r r? r r r! r0 L s zImageNet.split_folderc C s dj di | jS )NzSplit: {split}r )format__dict__r? r r r!
extra_reprP s zImageNet.extra_repr)r )r N)__name__
__module__ __qualname____doc__r
strr r r/ r, propertyr0 rC
__classcell__r r r7 r! r s (
r r filer c C sD |d u rt }tj| |}t|rtj|ddS d}t||| )NT) weights_onlyzThe meta file {} is not present in the root directory or is corrupted. This file is automatically created by the ImageNet dataset.) r: r) r* r9 r
torchload RuntimeErrorrA )r rK msgr r r! r- T s r- md5c C s, t tj| ||sd}t||| d S )Nz{The archive {} is not present in the root directory or is corrupted. You need to download it externally and place it in {}.)r
r) r* r9 rO rA )r rK rQ rP r r r! _verify_archivec s
rR c
s( ddl m dtdttttf ttttdf f f ffdd }dtdtt fdd }tdtt fd
d }t d }|du rC|d }|d
}t
| || | :}t t j
| || t j
|d}||\ } ||}
fdd|
D } t| | ft j
| t W d dS 1 sw Y dS )aI Parse the devkit archive of the ImageNet2012 classification dataset and save
the meta information in a binary file.
Args:
root (str or ``pathlib.Path``): Root directory containing the devkit archive
file (str, optional): Name of devkit archive. Defaults to
'ILSVRC2012_devkit_t12.tar.gz'
r N devkit_rootr .c s t j| dd}j|ddd tt d } fddt|D tt d d \}}}d
d |D }d d t||D }d
d t||D }||fS )Ndatazmeta.matT)
squeeze_mesynsets c s g | ] \}}|d kr | qS )r r )r r$ num_childrenmetar r! r" { r( z@parse_devkit_archive..parse_meta_mat.. c S s g | ] }t |d qS )z, )tupler )r r% r r r! r" } c S i | ]\}}||qS r r )r r$ r r r r! r' ~ z@parse_devkit_archive..parse_meta_mat..c S r^ r r )r r r% r r r! r' r_ )r) r* r9 loadmatlistzipr5 )rS metafile
nums_childrenidcsr2 r1 idx_to_wnidr )siorY r! parse_meta_matw s z,parse_devkit_archive..parse_meta_matc S sN t j| dd}t| }| }W d n1 sw Y dd |D S )NrT z&ILSVRC2012_validation_ground_truth.txtc S s g | ]}t |qS r )int)r val_idxr r r! r" r# zKparse_devkit_archive..parse_val_groundtruth_txt..)r) r* r9 open readlines)rS rK txtfhval_idcsr r r! parse_val_groundtruth_txt s
z7parse_devkit_archive..parse_val_groundtruth_txtc s s. t } z | V W t| d S t| w r@ )tempfilemkdtempshutilrmtree)tmp_dirr r r! get_tmp_dir s
z)parse_devkit_archive..get_tmp_dirr r ILSVRC2012_devkit_t12c r r r )r r$ )rf r r! r" r# z(parse_devkit_archive..)scipy.ioiorH r r ri r r r ARCHIVE_METArR r r) r* r9 rM saver: ) r rK rh ro ru archive_metarQ rt rS r rn val_wnidsr )rf rg r! r; l s$ 6 "r; r folderc s t d }|du r |d }|d }t| || tj| | ttj| | fddt D }|D ]}t|tj|d dd q5dS ) a Parse the train images archive of the ImageNet2012 classification dataset and
prepare it for usage with the ImageNet dataset.
Args:
root (str or ``pathlib.Path``): Root directory containing the train images archive
file (str, optional): Name of train images archive. Defaults to
'ILSVRC2012_img_train.tar'
folder (str, optional): Optional name for train images folder. Defaults to
'train'
r Nr r c s g | ] }t j |qS r r) r* r9 )r archive
train_rootr r! r" r] z'parse_train_archive..T)remove_finished)ry rR r) r* r9 r listdirsplitext)r rK r} r{ rQ archivesr r r r! r= s r= r r2 c s t d }|du r |d }|d }|du rt| d }t| || tj| | ttj| | t fddt D }t |D ] }t
tj | qCt ||D ]\}}t
|tj |tj| qUdS )az Parse the validation images archive of the ImageNet2012 classification dataset
and prepare it for usage with the ImageNet dataset.
Args:
root (str or ``pathlib.Path``): Root directory containing the validation images archive
file (str, optional): Name of validation images archive. Defaults to
'ILSVRC2012_img_val.tar'
wnids (list, optional): List of WordNet IDs of the validation images. If None
is given, the IDs are loaded from the meta file in the root directory
folder (str, optional): Optional name for validation images folder. Defaults to
'val'
r Nr r c 3 s | ]
}t j |V qd S r@ r~ )r imageval_rootr r! s z$parse_val_archive..)ry r- rR r) r* r9 r sortedr setmkdirrb rr movebasename) r rK r2 r} r{ rQ imagesr img_filer r r! r> s "r> r@ )Nr )NNr ) r) rr rp
contextlibr pathlibr typingr r r r r r r
rM r} r utilsr
r r ry r: r rH r- rR r; r= r> r r r r! s> $ 8>"$ (6