o I h?&@slddlZddlmZmZmZmZmZmZmZm Z ddl m Z gdZ Gdddej jZGdddeZGd d d eZGd d d eZGd ddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdd d eZGd!d"d"eZGd#d$d$eZGd%d&d&eZGd'd(d(eZ dS))N) BatchNorm1d BatchNorm2d BatchNorm3dConv1dConv2dConv3dLinearReLU)type_before_parametrizations) ConvReLU1d ConvReLU2d ConvReLU3d LinearReLUConvBn1dConvBn2d ConvBnReLU1d ConvBnReLU2dConvBn3d ConvBnReLU3dBNReLU2dBNReLU3d LinearBn1dLinearLeakyReLU LinearTanh ConvAdd2d ConvAddReLU2dc@s eZdZdS) _FusedModuleN)__name__ __module__ __qualname__r r W/var/www/vscode/kcb/lib/python3.10/site-packages/torch/ao/nn/intrinsic/modules/fused.pyr&src eZdZdZfddZZS)r zThis is a sequential container which calls the Conv1d and ReLU modules. During quantization this will be replaced with the corresponding fused module.cDt|tkr t|tksJdt|t|t||dSNz!Incorrect types for input modules)r rr super__init__selfconvrelu __class__r r!r&. zConvReLU1d.__init__rrr__doc__r& __classcell__r r r+r!r *r cr")r zThis is a sequential container which calls the Conv2d and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rr r%r&r'r+r r!r&:r-zConvReLU2d.__init__r.r r r+r!r 6r1r cr")r zThis is a sequential container which calls the Conv3d and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rr r%r&r'r+r r!r&Fr-zConvReLU3d.__init__r.r r r+r!r Br1r cr")rzThis is a sequential container which calls the Linear and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rr r%r&)r(linearr*r+r r!r&Rr-zLinearReLU.__init__r.r r r+r!rNr1rcr")rzThis is a sequential container which calls the Conv 1d and Batch Norm 1d modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rrr%r&r(r)bnr+r r!r&^r-zConvBn1d.__init__r.r r r+r!rZr1rcr")rzThis is a sequential container which calls the Conv 2d and Batch Norm 2d modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rrr%r&r3r+r r!r&jr-zConvBn2d.__init__r.r r r+r!rfr1rcr")rzThis is a sequential container which calls the Conv 1d, Batch Norm 1d, and ReLU modules. During quantization this will be replaced with the corresponding fused module.cZt|tkrt|tkrt|tks#Jdt|t|t|t|||dSr$)r rrr r%r&r(r)r4r*r+r r!r&v  zConvBnReLU1d.__init__r.r r r+r!rrr1rcr")rzThis is a sequential container which calls the Conv 2d, Batch Norm 2d, and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr5r$)r rrr r%r&r6r+r r!r&r7zConvBnReLU2d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the Conv 3d and Batch Norm 3d modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rrr%r&r3r+r r!r&r-zConvBn3d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the Conv 3d, Batch Norm 3d, and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr5r$)r rrr r%r&r6r+r r!r&r7zConvBnReLU3d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the BatchNorm 2d and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rr r%r&r( batch_normr*r+r r!r&r-zBNReLU2d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the BatchNorm 3d and ReLU modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rr r%r&r8r+r r!r&r-zBNReLU3d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the Linear and BatchNorm1d modules. During quantization this will be replaced with the corresponding fused module.cr#r$)r rrr%r&)r(r2r4r+r r!r&r-zLinearBn1d.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the Linear and LeakyReLU modules. During quantization this will be replaced with the corresponding fused module.cHt|tkrt|tjjksJdt|t|t||dSr$)typertorchnn LeakyReLUr%r&)r(r2 leaky_relur+r r!r&zLinearLeakyReLU.__init__r.r r r+r!rr1rcr")rzThis is a sequential container which calls the Linear and Tanh modules. During quantization this will be replaced with the corresponding fused module.cr:r$)r;rr<r=Tanhr%r&)r(r2tanhr+r r!r&r@zLinearTanh.__init__r.r r r+r!rr1rc(eZdZdZfddZddZZS)rzThis is a sequential container which calls the Conv2d modules with extra Add. During quantization this will be replaced with the corresponding fused module.cst|||_dSN)r%r&add)r(r)rEr+r r!r&s  zConvAdd2d.__init__cCs||d||SNr)rEr(x1x2r r r!forwardszConvAdd2d.forwardrrrr/r&rJr0r r r+r!rs rcrC)rzThis is a sequential container which calls the Conv2d, add, Relu. During quantization this will be replaced with the corresponding fused module.cst|||_||_dSrD)r%r&rEr*)r(r)rEr*r+r r!r&s  zConvAddReLU2d.__init__cCs|||d||SrF)r*rErGr r r!rJszConvAddReLU2d.forwardrKr r r+r!rs r)!r<torch.nnrrrrrrrr torch.nn.utils.parametrizer __all__r= Sequentialrr r r rrrrrrrrrrrrrrr r r r!s,(