U (d$@sddlmZddlmZmZmZmZddlZddlmZm Z ddl m Z m Z ddl mZmZddlmZd d lmZmZd d lmZd d lmZmZd d lmZmZmZmZmZddl m!Z!m"Z"dddgZ#GdddeZ$GdddeZ%GdddeZ&eee'eee(e(ee&dddZ)GdddeZ*edddfddd d!d"eee*efe(e(ee&d#d$dZ+d d%lm,Z,d d&lm-Z-e,d'e*j.j/iZ0dS)()partial)AnyListOptionalUnionN)nnTensor) QuantStub DeQuantStub)Conv2dNormActivationSqueezeExcitation)ImageClassification) WeightsEnumWeights)_IMAGENET_CATEGORIES)handle_legacy_interface_ovewrite_named_param)InvertedResidualInvertedResidualConfig MobileNetV3_mobilenet_v3_confMobileNet_V3_Large_Weights) _fuse_modules _replace_reluQuantizableMobileNetV3#MobileNet_V3_Large_QuantizedWeightsmobilenet_v3_largecs\eZdZdZeeddfdd ZeedddZdee dd d d Z fd d Z Z S)QuantizableSqueezeExcitationrNargskwargsreturncs(tj|d<tj||tj|_dS)NZscale_activation)rZ Hardsigmoidsuper__init__ quantizedFloatFunctionalskip_mulselfr"r# __class__O/tmp/pip-unpacked-wheel-vx7f76es/torchvision/models/quantization/mobilenetv3.pyr&!s z%QuantizableSqueezeExcitation.__init__)inputr$cCs|j|||SN)r)mulZ_scale)r+r0r.r.r/forward&sz$QuantizableSqueezeExcitation.forwardis_qatr$cCst|ddg|dddS)NZfc1Z activationTZinplace)r)r+r5r.r.r/ fuse_model)sz'QuantizableSqueezeExcitation.fuse_modelc s|dd}t|dr|dks&|dkrtdgtdgtjdgtjdtjdgtjdtdgtdgd} | D] \} } || } | |kr|| || <q|t|||||||dS) Nversionqconfigrg?r)Zdtyper)z.scale_activation.activation_post_process.scalezFscale_activation.activation_post_process.activation_post_process.scalez3scale_activation.activation_post_process.zero_pointzKscale_activation.activation_post_process.activation_post_process.zero_pointz;scale_activation.activation_post_process.fake_quant_enabledz9scale_activation.activation_post_process.observer_enabled)gethasattrtorchZtensorZint32itemsr%_load_from_state_dict) r+Z state_dictprefixZlocal_metadatastrictZ missing_keysZunexpected_keysZ error_msgsr8Zdefault_state_dictkvZfull_keyr,r.r/r>,s2       z2QuantizableSqueezeExcitation._load_from_state_dict)N) __name__ __module__ __qualname___versionrr&rr3rboolr7r> __classcell__r.r.r,r/r s r cs6eZdZeeddfdd ZeedddZZS)QuantizableInvertedResidualNr!cs&tj|dti|tj|_dS)NZse_layer)r%r&r rr'r(skip_addr*r,r.r/r&Usz$QuantizableInvertedResidual.__init__xr$cCs(|jr|j|||S||SdSr1)Zuse_res_connectrJaddblockr+rLr.r.r/r3Ysz#QuantizableInvertedResidual.forward)rCrDrErr&rr3rHr.r.r,r/rISsrIcsLeZdZeeddfdd ZeedddZd eeddd d Z Z S) rNr!cs"tj||t|_t|_dS)zq MobileNet V3 main class Args: Inherits args from floating point MobileNetV3 N)r%r&r quantr dequantr*r,r.r/r&aszQuantizableMobileNetV3.__init__rKcCs"||}||}||}|Sr1)rPZ _forward_implrQrOr.r.r/r3ls   zQuantizableMobileNetV3.forwardr4cCsv|D]h}t|tkrZddg}t|dkrHt|dtjkrH|dt|||ddqt|tkr| |qdS)N01r r2Tr6) modulestyper lenrZReLUappendrr r7)r+r5mZmodules_to_fuser.r.r/r7rs    z!QuantizableMobileNetV3.fuse_model)N) rCrDrErr&rr3rrGr7rHr.r.r,r/r`s )inverted_residual_setting last_channelweightsprogressquantizer#r$cKs|dk r:t|dt|jdd|jkr:t|d|jd|dd}t||fdti|}t||r|jddtj j ||_ tj j j |dd|dk r||j|d |rtj j j|dd||S) NZ num_classes categoriesbackendqnnpackrNT)r5r6)r])rrWmetapoprrIrr7r<ZaoZ quantizationZget_default_qat_qconfigr9Z prepare_qatZload_state_dictZget_state_dictconverteval)rZr[r\r]r^r#r`modelr.r.r/_mobilenet_v3_model}s"   rgc @sDeZdZedeeddddeddejdd d d id d dZ e Z dS)rzUhttps://download.pytorch.org/models/quantized/mobilenet_v3_large_qnnpack-5bcacf28.pth)Z crop_sizeiS)rrrazUhttps://github.com/pytorch/vision/tree/main/references/classification#qat-mobilenetv3z ImageNet-1KgK7A@R@gxV@)zacc@1zacc@5z These weights were produced by doing Quantization Aware Training (eager mode) on top of the unquantized weights listed below. )Z num_paramsZmin_sizer_r`ZrecipeZ unquantizedZ_metricsZ_docs)urlZ transformsrbN) rCrDrErrrrr IMAGENET1K_V1IMAGENET1K_QNNPACK_V1DEFAULTr.r.r.r/rs$ Z pretrainedcCs|ddrtjStjS)Nr^F)r:rrkrrj)r#r.r.r/s rm)r\TF)r\r]r^)r\r]r^r#r$cKs4|rtnt|}td|\}}t|||||f|S)a MobileNetV3 (Large) model from `Searching for MobileNetV3 `_. .. note:: Note that ``quantize = True`` returns a quantized model with 8 bit weights. Quantized models only support inference and run on CPUs. GPU inference is not yet supported. Args: weights (:class:`~torchvision.models.quantization.MobileNet_V3_Large_QuantizedWeights` or :class:`~torchvision.models.MobileNet_V3_Large_Weights`, optional): The pretrained weights for the model. See :class:`~torchvision.models.quantization.MobileNet_V3_Large_QuantizedWeights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool): If True, displays a progress bar of the download to stderr. Default is True. quantize (bool): If True, return a quantized version of the model. Default is False. **kwargs: parameters passed to the ``torchvision.models.quantization.MobileNet_V3_Large_QuantizedWeights`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.quantization.MobileNet_V3_Large_QuantizedWeights :members: .. autoclass:: torchvision.models.MobileNet_V3_Large_Weights :members: :noindex: r)r)rrverifyrrg)r\r]r^r#rZr[r.r.r/rs,) _ModelURLs) model_urlsZmobilenet_v3_large_qnnpack)1 functoolsrtypingrrrrr<rrZtorch.ao.quantizationr r Zops.miscr r Ztransforms._presetsrZ_apirrZ_metar_utilsrrZ mobilenetv3rrrrrutilsrr__all__r rIrintrGrgrrrorprkriZquant_model_urlsr.r.r.r/sb   5  $ +