U d3@sdZddlZddlZddlZddlmZmZddlmZm Z m Z m Z ddl m Z e e ee e fee ee e ffe fZGdddZejjejjejjejjejjejjejjejjejjejjejjejjejjejjejjhZ ejj!j"ejj!j#ejj!j$ejj!j%ejj!j&ejj!j'ejj!j(ejj!j)ejj!j*ejj!j+ejj!j,ejj!j-ejj!j.ejj!j/ejj!j0ejj!j1ejj!j2ejj!j3ejj!j4ej5ej6ej4ej7ej8ej9ej:ej;ejdd d d d d ddddddddddddddddddhZ?d d!Z@d"d#ZAd$d%ZBd&d'ZCe eDe d(d)d*ZEd+d,ZFd-d.ZGd/d0ZHd1d2ZId3d4ZJd5d6ZKd7d8ZLd9d:ZMd;d<ZNd=d>ZOePd?d@dAZQdBdCZRdDdEZSejTejTePdFdGdHZUeVeVePejWePeeVeVfdIdJdKZXdLdMZYdNdOZZdS)Pz? Utils shared by different modes of quantization (eager/graph) N) QuantTypequant_type_to_str)TupleAnyUnionCallable)is_parametrizedc@seZdZdZdS) MatchAllNodezo A node pattern that matches all nodes, used in defining fusion patterns in FX Graph Mode Quantization N)__name__ __module__ __qualname____doc__rr?/tmp/pip-unpacked-wheel-ua33x9lu/torch/ao/quantization/utils.pyr sr reluZrelu_ contiguousdetachZdetach_ hardsigmoidZ hardsigmoid_Zpermuterepeatrepeat_interleaveZreshapeZresize_shapesigmoidZsigmoid_sizesqueezeZsqueeze_tanhZtanh_ transpose unsqueezeZ unsqueeze_viewcCsR|jdko|jtk}|jdko&|jtk}|jdkoFt|t|jtk}|||fS)N call_functionZ call_methodZ call_module)optarget func_list method_listtypestrmodule_type_list)nodemodulesZis_call_functionZis_call_methodZis_call_modulerrr check_nodebs r(cCs|}|||SN)copyupdate)Z default_dictZadditional_dictdrrrget_combined_dictis r-cCs|tjkp|tjkSr))torchper_tensor_affineZper_tensor_symmetricqschemerrr is_per_tensorns r2cCs|tjtjtjfkSr))r.per_channel_affineZ per_channel_affine_float_qparamsper_channel_symmetricr0rrris_per_channelrsr5)objfqnreturncCstt|d|S)zO Given an obj and a fqn such as "foo.bar.baz", returns gm.foo.bar.baz. .) functoolsreducegetattrsplit)r6r7rrrgetattr_from_fqnwsr>cCst|dr|jnd}|j}||d}|s,|St|r|dk s t|}|}t|dr,|jnd}|j|j|fS)zk returns the qconfig tuple for qconfig: (activation_dtype, weight_dtype, activation_compute_dtype) N compute_dtype)rGrKrMrBr`r?)rIrKrMr`rrrrTs  rTcCs|dk s t|}|}tjtjtjg}|j|krf|j|krFtj St |dr`|j |kr`tj Stj S|jtjkr|jtjkrtj S|jtjkrtj Std|j|jdS)Nr`zKUnrecognized dtype combination in get_quant_type: activation({}),weight({}))rGrKrMr.rOrPr\r?rZSTATICrBr`ZDYNAMICZ WEIGHT_ONLYrQrU ExceptionrH)rIrKrMZ static_dtypesrrrrEs&      rE)min_valmax_valr8cCs|dks|dkr&tddS|dks>|dkr~|tdkrd|tdkrdtddS||kstd||nt||kstd||dS)z Checks if the given minimum and maximum values are valid, meaning that they exist and the min value is less than the max value. rzMmust run observer before calling calculate_qparams. Returning default values.Finfz-infz!min {} should be less than max {}T) ZnumelwarningswarnZdimrUrGrHr.all)rbrcrrrcheck_min_max_valid s* rh) quant_min quant_maxhas_customized_qranger? reduce_ranger8c Cs&|r|tjkrd\}}nd\}}||}}|dk rD|dk rD||}}||d} |tjkrzd| krndksntdn(|tjkrd| krdksntd |r|d |d }}nd|tjkr|rd \}}nd \}}nB|tjkr|rd \}}nd\}}n|tjkrd\}}nd\}}||fS)ztCalculates actual qmin and qmax based on the quantization range, observer datatype and if range is reduced. )r)rNrzRquantization range should be positive and not exceed the maximum bit range (=256).lzYquantization range should be positive and not exceed the maximum bit range (=4294967296).)i?)i)rrs)irm)r)r.rZrPrGrO) rirjrkr?rlZinitial_quant_minZinitial_quant_maxZcustom_quant_minZcustom_quant_maxZ qrange_lenrrrcalculate_qmin_qmax*sP                rucCs8|dd}t|dkr$d|dfS|d|dfSdS)z, Turn 'foo.bar' into ['foo', 'bar'] r9rorN)rsplitlen)r rrrr _parent_name_s   rzcCs:t|jdkrdSt|r2t|jdko0d|jkSdSdS)z Checks if module._modules is empty or if module is a parametrization, checks that module._modules only has the 'parametrizations' module rTroZparametrizationsFN)rxZ_modulesr)modulerrr)has_no_children_ignoring_parametrizationsis r|)[r rer:r.Z torch.ao.quantization.quant_typerrtypingrrrrZtorch.nn.utils.parametrizerPatternr nnZReLUZReLU6ZAdaptiveAvgPool1dZAdaptiveAvgPool2dZAdaptiveAvgPool3dZ AvgPool1dZ AvgPool2dZ AvgPool3dZ MaxPool1dZ MaxPool2dZ MaxPool3dZIdentityZ HardsigmoidZSigmoidZTanhr%Z functionalZadaptive_avg_pool1dZadaptive_avg_pool2dZadaptive_avg_pool3dZeluZ hardswishZ instance_normZ layer_normZ leaky_reluZsiluZmishZdropoutZ max_pool1dZ max_pool2dZ max_pool3drZhardtanhZ hardtanh_rrrrrstacksumrrcatr!Zmeanr"r(r-r2r5r$r>rDrJrLrNrSrXrYr[r]r^boolr_rTrEZTensorrhintr?rurzr|rrrrs (     5