o V h(@sddlZddlZddlmZddlmZmZmZmZm Z m Z m Z ddl m Z ddlmZmZddlmZgdZd d d d d ddZdddddddZGdddeZdS)N)Path)AnyCallableDictListOptionalTupleUnion)Image)download_and_extract_archiveverify_str_arg) VisionDataset)kingdomphylumclassorderfamilygenuszRhttps://ml-inat-competition-datasets.s3.amazonaws.com/2017/train_val_images.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2018/train_val2018.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2019/train_val2019.tar.gzzGhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train.tar.gzzLhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train_mini.tar.gzzEhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/val.tar.gz)201720182019 2021_train2021_train_mini 2021_valid 7c784ea5e424efaec655bd392f87301f b1c6952ce38f31868cc50ea72d066cc3 c60a6e2962c9b8ccbd458d12c8582644 e0526d53c7f7b2e3167b2b43bb2690ed db6ed8330e634445efc8fec83ae81442 f6f6e0e242e3d4c9569ba56400938afccseZdZdZ      d!deeefdedeeeefd ee d ee d e d ee eeefge fd dffdd Z d"ddZ d"ddZded ee e ffddZd efddZdeded efddZd e fddZd"dd ZZS)# INaturalistaX`iNaturalist `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory of dataset where the image files are stored. This class does not require/use annotation files. version (string, optional): Which version of the dataset to download/use. One of '2017', '2018', '2019', '2021_train', '2021_train_mini', '2021_valid'. Default: `2021_train`. target_type (string or list, optional): Type of target to use, for 2021 versions, one of: - ``full``: the full category (species) - ``kingdom``: e.g. "Animalia" - ``phylum``: e.g. "Arthropoda" - ``class``: e.g. "Insecta" - ``order``: e.g. "Coleoptera" - ``family``: e.g. "Cleridae" - ``genus``: e.g. "Trichodes" for 2017-2019 versions, one of: - ``full``: the full (numeric) category - ``super``: the super category, e.g. "Amphibians" Can also be a list to output a tuple with all specified target types. Defaults to ``full``. transform (callable, optional): A function/transform that takes in a PIL image and returns a transformed version. E.g, ``transforms.RandomCrop`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. download (bool, optional): If true, downloads the dataset from the internet and puts it in root directory. If dataset is already downloaded, it is not downloaded again. loader (callable, optional): A function to load an image given its path. By default, it uses PIL as its image loader, but users could also pass in ``torchvision.io.decode_image`` for decoding image data into tensors directly. rfullNFrootversion target_type transformtarget_transformdownloadloaderreturnc st|dt|_tjtj||||dtj |dd|r$| | s,t dg|_ i|_g|_t|ts=|g}|jdddkrSdd |D|_|n d d |D|_|g|_t|j D]\}} ttj|j| } | D] } |j|| fqxqg|ptj|_dS) Nr$)r&r'T)exist_okzHDataset not found or corrupted. You can use download=True to download it2021cSs g|] }t|ddgtRqS)r%r")r CATEGORIES_2021.0tr2T/var/www/vscode/kcb/lib/python3.10/site-packages/torchvision/datasets/inaturalist.py fs z(INaturalist.__init__..cSsg|]}t|ddqS)r%)r"super)r r/r2r2r3r4is)r DATASET_URLSkeysr$r5__init__ospathjoinmakedirsr( _check_exists RuntimeErrorall_categoriescategories_indexcategories_map isinstancelistr% _init_2021 _init_pre2021index enumeratelistdirr#appendr openr)) selfr#r$r%r&r'r(r) dir_indexdir_namefilesfname __class__r2r3r8Fs0   zINaturalist.__init__cCstt|j|_ddtD|_t|jD]c\}}|d}t |dkr-t d|d|d|dkrBt d |dd |di}t t|d d D]%\}}||j|vr`|j||}nt |j|}||j||<|||<qM|j |qd S)zInitialize based on 2021 layoutcSsi|]}|iqSr2r2)r0kr2r2r3 |sz*INaturalist._init_2021.._zUnexpected category name z, wrong number of piecesr05dzUnexpected category id z , expecting r N)sortedr9rHr#r?r.r@rGsplitlenr>ziprArI)rKrLrMpiecescat_mapcatnamecat_idr2r2r3rDvs"   zINaturalist._init_2021c CsTdii|_d}tt|j}t|D]\}}||jd|<tttj|j|}|D]f}|jdkr;|}|d7}nzt |}Wnt yOt d|w|t |j krvt |j }|j ig||d|jdg||d|j |rt d|d|i|j |<tj|||j|<q-qt|j D] \} } | st d| qd S) z$Initialize based on 2017-2019 layoutr5rrr z!Unexpected non-numeric dir name: zDuplicate category zMissing category N)r@rXr9rHr#rGr:r;r$int ValueErrorr>rZrAextendr?) rK cat_indexsuper_categoriessindexscat subcategoriessubcatsubcat_iold_lencindexcr2r2r3rEs:       zINaturalist._init_pre2021rFcCs|j|\}}|tj|j|j||}g}|jD]}|dkr'||q||j ||qt |dkrrename)rK base_root orig_dir_namer2r2r3r(s" zINaturalist.download)rr"NNFN)r*N)__name__ __module__ __qualname____doc__r strrrrrboolrr8rDrErbrrrrtrzr=r( __classcell__r2r2rPr3r! s@(   0 #r!)r9os.pathpathlibrtypingrrrrrrr PILr utilsr r visionrr.r6rr!r2r2r2r3s. $