U (d.B@sddlZddlmZddlmZmZmZmZmZddl Z ddl m Z m Z ddl m Z mZddlmZddlmZd d lmZmZd d lmZd d lmZmZmZd ddddgZGdddeZGdddZGddde jZ Gdd d e jZ!d.e"e#e$e$edddZ%eee&eee$ee!ddd Z'd!ed"Z(Gd#ddeZ)Gd$ddeZ*ed%e)j+fd&dd'd(ee)e$ee!d)d*dZ,ed%e*j+fd&dd'd(ee*e$ee!d)d+dZ-d d,lm.Z.e.e)j+j/e*j+j/d-Z0dS)/N)partial)AnyCallableListOptionalSequence)nnTensor)Conv2dNormActivationSqueezeExcitation)ImageClassification)_log_api_usage_once) WeightsEnumWeights)_IMAGENET_CATEGORIES)handle_legacy_interface_ovewrite_named_param_make_divisible MobileNetV3MobileNet_V3_Large_WeightsMobileNet_V3_Small_Weightsmobilenet_v3_largemobilenet_v3_smallcs*eZdZdZdeedfdd ZZS)r Z DEPRECATED)input_channelssqueeze_factorcsDt||d}tj||tjd|j|_t|dt dt dS)NZscale_activation activationzThis SqueezeExcitation class is deprecated since 0.12 and will be removed in 0.14. Use torchvision.ops.SqueezeExcitation instead.) rsuper__init__r Hardsigmoidr Zreludelattrwarningswarn FutureWarning)selfrrsqueeze_channels __class__B/tmp/pip-unpacked-wheel-vx7f76es/torchvision/models/mobilenetv3.pyr"s zSqueezeExcitation.__init__)r)__name__ __module__ __qualname____doc__intr" __classcell__r,r,r*r-r sr c @s>eZdZeeeeeeeeed ddZeeedddZ dS)InvertedResidualConfig) rkernelexpanded_channels out_channelsuse_ser stridedilation width_multc CsP||| |_||_||| |_||| |_||_|dk|_||_||_dS)NHS) adjust_channelsrr5r6r7r8use_hsr9r:) r(rr5r6r7r8r r9r:r;r,r,r-r"*s  zInvertedResidualConfig.__init__Zchannelsr;cCst||dS)Nr)rr?r,r,r-r=?sz&InvertedResidualConfig.adjust_channelsN) r.r/r0r2boolstrfloatr" staticmethodr=r,r,r,r-r4(s r4csXeZdZeeejdfeedej fedej fdfdd Z e e dddZ Z S) InvertedResidualr.)cnf norm_layerse_layerc s$td|jkr dks*ntd|jdko>|j|jk|_g}|jrRtj ntj }|j |jkr| t |j|j d||d|jdkrdn|j}| t |j |j |j||j|j ||d|jrt|j dd}| ||j || t |j |jd|ddtj||_|j|_|jdk|_dS)Nrr zillegal stride value kernel_sizerFactivation_layer)rIr9r:groupsrFrJrr)r!r"r9 ValueErrorrr7use_res_connectr>r HardswishZReLUr6appendr r:r5r8r SequentialblockZ_is_cn)r(rErFrGlayersrJr9r)r*r,r-r"FsX     zInvertedResidual.__init__)inputreturncCs||}|jr||7}|SN)rQrM)r(rSresultr,r,r-forward~s zInvertedResidual.forward)r.r/r0rSElayerrr#r4rModuler"r rWr3r,r,r*r-rDDs   8rDc sreZdZd eeeeeedej feedej fe e ddfdd Z e e dd d Ze e dd d ZZS)rN皙?.)inverted_residual_setting last_channel num_classesrQrFdropoutkwargsrTc stt||s tdn$t|trsz(MobileNetV3.__init__..zDThe inverted_residual_setting should be List[InvertedResidualConfig]NgMbP?g{Gz?)ZepsZmomentumrr )rIr9rFrJrrHT)inplace)prhZfan_out)mode)"r!r"rrLrarall TypeErrorrDrrZ BatchNorm2drrOr rNr7rPfeaturesZAdaptiveAvgPool2davgpoolZLinearZDropout classifiermodulesZConv2dinitZkaiming_normal_ZweightZbiasZzeros_Z GroupNormZones_Znormal_)r(r\r]r^rQrFr_r`rRZfirstconv_output_channelsrEZlastconv_input_channelsZlastconv_output_channelsmr*r,r-r"sr             zMobileNetV3.__init__)xrTcCs.||}||}t|d}||}|S)Nr)rmrntorchflattenror(rsr,r,r- _forward_impls     zMobileNetV3._forward_implcCs ||SrU)rwrvr,r,r-rWszMobileNetV3.forward)rZNNr[)r.r/r0rr4r2rrrrYrBrr"r rwrWr3r,r,r*r-rs [ ?F)archr; reduced_taildilatedr`c Ks|rdnd}|rdnd}tt|d}ttj|d}|dkr|dddddddd|ddd d dddd|d dd d dddd|d d d d dddd|d d dd dddd|d d dd dddd|d ddddddd|dddddddd|dddddddd|dddddddd|dddddddd|dddddddd|dd dd|ddd||d|d d|d|ddd||d|d d|d|ddd|g} |d|} n"|dkr|dddddddd|ddd d dddd|d ddd dddd|d d dd dddd|d d dd dddd|d d dd dddd|d d dddddd|dd dddddd|dd d d|ddd||d|d d!|d|ddd||d|d d!|d|ddd|g } |d"|} ntd#|| | fS)$Nr r)r;rreFZRE@H(TxPr<ipiiirX`0i i@izUnsupported model type )rr4r=rL) ryr;rzr{r`Zreduce_dividerr:Z bneck_confr=r\r]r,r,r-_mobilenet_v3_confsL          r)r\r]weightsprogressr`rTcKsJ|dk rt|dt|jdt||f|}|dk rF||j|d|S)Nr^ categories)r)rlenmetarZload_state_dictZget_state_dict)r\r]rrr`modelr,r,r- _mobilenet_v3 s r)rr)Zmin_sizerc @sneZdZedeeddedddddd id d d Zed eedddedddddd idd d ZeZ dS)rzChttps://download.pytorch.org/models/mobilenet_v3_large-8738ca79.pth crop_sizeiS^https://github.com/pytorch/vision/tree/main/references/classification#mobilenetv3-large--small ImageNet-1Kg R@g(\V@zacc@1zacc@5zJThese weights were trained from scratch by using a simple training recipe.Z num_paramsZrecipeZ_metricsZ_docsurlZ transformsrzChttps://download.pytorch.org/models/mobilenet_v3_large-5c1a4163.pth)rZ resize_sizezHhttps://github.com/pytorch/vision/issues/3995#new-recipe-with-reg-tuninggK7R@gNbX9$W@a/ These weights improve marginally upon the results of the original paper by using a modified version of TorchVision's `new training recipe `_. N) r.r/r0rrr _COMMON_META IMAGENET1K_V1Z IMAGENET1K_V2DEFAULTr,r,r,r-r8s:  c @s>eZdZedeeddedddddd id d d ZeZd S)rzChttps://download.pytorch.org/models/mobilenet_v3_small-047dcff4.pthrri&rrgnP@g}?5^U@rz} These weights improve upon the results of the original paper by using a simple training recipe. rrN) r.r/r0rrr rrrr,r,r,r-r`s Z pretrained)rT)rr)rrr`rTcKs*t|}td|\}}t||||f|S)a Constructs a large MobileNetV3 architecture from `Searching for MobileNetV3 `__. Args: weights (:class:`~torchvision.models.MobileNet_V3_Large_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.MobileNet_V3_Large_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.resnet.MobileNetV3`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.MobileNet_V3_Large_Weights :members: r)r)rverifyrrrrr`r\r]r,r,r-rvs cKs*t|}td|\}}t||||f|S)a Constructs a small MobileNetV3 architecture from `Searching for MobileNetV3 `__. Args: weights (:class:`~torchvision.models.MobileNet_V3_Small_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.MobileNet_V3_Small_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.resnet.MobileNetV3`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.MobileNet_V3_Small_Weights :members: r)r)rrrrrr,r,r-rs ) _ModelURLs)rr)rxFF)1r% functoolsrtypingrrrrrrtrr Zops.miscr r rXZtransforms._presetsr utilsrZ_apirrZ_metar_utilsrrr__all__r4rYrDrrArBr@rr2rrrrrrrrrZ model_urlsr,r,r,r-s     Ak 2 (