o V h; @shddlmZddlmZmZmZmZmZddlZddlm Z m Z ddl m Z ddlmZmZddlmZdd lmZdd lmZd d lmZmZmZd d lmZd dlmZmZgdZ Gddde j!Z"Gddde j#Z$GdddZ%Gddde j#Z&dee%de'deede(dede&f ddZ)d ed!d"d#Z*Gd$d%d%eZ+Gd&d'd'eZ,Gd(d)d)eZ-Gd*d+d+eZ.eed,e+j/fd-dd.d/dee+de(dede&fd0d1Z0eed,e,j/fd-dd.d/dee,de(dede&fd2d3Z1eed,e-j/fd-dd.d/dee-de(dede&fd4d5Z2eed,e.j/fd-dd.d/dee.de(dede&fd6d7Z3dS)8)partial)AnyCallableListOptionalSequenceN)nnTensor) functional)Conv2dNormActivationPermute)StochasticDepth)ImageClassification)_log_api_usage_once)register_modelWeights WeightsEnum)_IMAGENET_CATEGORIES)_ovewrite_named_paramhandle_legacy_interface) ConvNeXtConvNeXt_Tiny_WeightsConvNeXt_Small_WeightsConvNeXt_Base_WeightsConvNeXt_Large_Weights convnext_tinyconvnext_small convnext_baseconvnext_largec@seZdZdedefddZdS) LayerNorm2dxreturncCs>|dddd}t||j|j|j|j}|dddd}|S)Nrr r)permuteF layer_normnormalized_shapeweightbiasepsselfr"r.O/var/www/vscode/kcb/lib/python3.10/site-packages/torchvision/models/convnext.pyforwardszLayerNorm2d.forwardN)__name__ __module__ __qualname__r r0r.r.r.r/r!sr!c sReZdZ d dededeedejfddffdd Zd e de fd d Z Z S) CNBlockN layer_scalestochastic_depth_prob norm_layer.r#c st|durttjdd}ttj||dd|ddtgd||tj|d|dd t tjd||dd tgd |_ t t |d d ||_t|d |_dS) Nư>r+r$T) kernel_sizepaddinggroupsr*)rr r$r) in_features out_featuresr*)rr$rr rrow)super__init__rr LayerNorm SequentialConv2dr LinearGELUblock Parametertorchonesr5rstochastic_depth)r-dimr5r6r7 __class__r.r/rC's    zCNBlock.__init__inputcCs&|j||}||}||7}|SN)r5rIrM)r-rQresultr.r.r/r0>s zCNBlock.forwardrR) r1r2r3floatrrrModulerCr r0 __classcell__r.r.rOr/r4&sr4c@s8eZdZdedeededdfddZdefdd ZdS) CNBlockConfiginput_channels out_channels num_layersr#NcCs||_||_||_dSrR)rXrYrZ)r-rXrYrZr.r.r/rCGs zCNBlockConfig.__init__cCs>|jjd}|d7}|d7}|d7}|d7}|jdi|jS)N(zinput_channels={input_channels}z, out_channels={out_channels}z, num_layers={num_layers})r.)rPr1format__dict__)r-sr.r.r/__repr__Qs zCNBlockConfig.__repr__)r1r2r3intrrCstrr`r.r.r.r/rWEs  rWcseZdZ     ddeedededed eed e j fd eed e j fd e d dffdd Z de d e fddZde d e fddZZS)rr8N block_settingr6r5 num_classesrI.r7kwargsr#c stt||stdt|trtdd|Ds!td|dur't}|dur1t t dd}g}|dj } | t d| d d d|dd d td d |D} d} |D]D} g} t| jD]}|| | d}| || j ||| d7} q]| tj| | jdur| t|| j tj| j | jdddqTtj||_td|_|d}|jdur|jn|j }t||tdt|||_|D] }t|tjtjfrtjj|jdd|jdurtj |jqdS)Nz%The block_setting should not be emptycSsg|]}t|tqSr.) isinstancerW).0r_r.r.r/ jsz%ConvNeXt.__init__..z/The block_setting should be List[CNBlockConfig]r8r9rr$r>T)r;strider<r7activation_layerr*css|]}|jVqdSrR)rZ)ricnfr.r.r/ sz$ConvNeXt.__init__..g?rr )r;rkg{Gz?)std)!rBrCr ValueErrorrhrall TypeErrorr4rr!rXappendr sumrangerZrrErYrFfeaturesAdaptiveAvgPool2davgpoolFlattenrG classifiermodulesinit trunc_normal_r)r*zeros_)r-rer6r5rfrIr7rglayersfirstconv_output_channelstotal_stage_blocksstage_block_idrmstage_sd_prob lastblocklastconv_output_channelsmrOr.r/rC[sp          zConvNeXt.__init__r"cCs"||}||}||}|SrR)rwryr{r,r.r.r/ _forward_impls   zConvNeXt._forward_implcCs ||SrR)rr,r.r.r/r0s zConvNeXt.forward)rcr8rdNN)r1r2r3rrWrTrarrrrUrrCr rr0rVr.r.rOr/rZs2 Nrrer6weightsprogressrgr#cKsR|durt|dt|jdt|fd|i|}|dur'||j|dd|S)Nrf categoriesr6T)r check_hash)rlenmetarload_state_dictget_state_dict)rer6rrrgmodelr.r.r/ _convnexts r) rzNhttps://github.com/pytorch/vision/tree/main/references/classification#convnexta These weights improve upon the results of the original paper by using a modified version of TorchVision's `new training recipe `_. )min_sizerrecipe_docsc @DeZdZedeedddieddddd id d d d ZeZdS)rz>https://download.pytorch.org/models/convnext_tiny-983f1562.pth crop_size resize_sizeiH< ImageNet-1KgzGT@gMbX X@zacc@1zacc@5gm@gV-G[@ num_params_metrics_ops _file_sizeurl transformsrN r1r2r3rrr _COMMON_META IMAGENET1K_V1DEFAULTr.r.r.r/r$ rc @r)rz?https://download.pytorch.org/models/convnext_small-0c510722.pthrriHZrgClT@g)X@rg|?5^!@g"~g@rrNrr.r.r.r/rrrc @r)rz>https://download.pytorch.org/models/convnext_base-6075fbad.pthrrihGrgU@gHz7X@rg(\µ.@g/$!u@rrNrr.r.r.r/rrrc @r)rz?https://download.pytorch.org/models/convnext_large-ea097f82.pthrrri rg"~U@gX9v>X@rg|?5.A@gK@rrNrr.r.r.r/r rr pretrained)rT)rrcKXt|}tdddtdddtdddtdddg}|dd }t||||fi|S) aConvNeXt Tiny model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Tiny_Weights :members: `r$ Nr6g?)rverifyrWpoprrrrgrer6r.r.r/r!      rcKr) aConvNeXt Small model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Small_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Small_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Small_Weights :members: rrr$rrNr6g?)rrrWrrrr.r.r/r@      rcKr) aConvNeXt Base model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Base_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Base_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Base_Weights :members: r$iirNr6?)rrrWrrrr.r.r/rarrcKr) aConvNeXt Large model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Large_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Large_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Large_Weights :members: rrr$rirNr6r)rrrWrrrr.r.r/r rr )4 functoolsrtypingrrrrrrKrr torch.nnr r&ops.miscr r ops.stochastic_depthrtransforms._presetsrutilsr_apirrr_metar_utilsrr__all__rDr!rUr4rWrrTboolrrrrrrrrrrr r.r.r.r/s       Y  **