U d0Z@sUddlZddlZddlmZddlmmZddlmmZddl mmm Z ddl mmm m ZddlmmmZddlmm Zddlmm mZddlmm m ZddlmmZddlmmm ZddlmZmZm Z m!Z!m"Z"m#Z#ddl$m%mZ&ddl'm(Z(m)Z)ddl*m+Z+m,Z,ddl-m.Z.ddl/m0Z0e(ej1e)ej2ej3ej3ej4ej4ej5ej5ej6ej6ej7ej7ej8ej8ej9ej9ej:ej:ej;ej;ejej>ej?ej?iZ@e e"e#feAd<e(ej1e)ej2ejBejBejCejCejDejDej4ej4ej5ej5ej6ej6ej7ej7ej8ej8ej9ej9ejEejEej:ej:ej;ej;ejFejFejGejGejHejHejIejIejJejJejKejKejLejLejMjNjOej3ej3ej3ejPejPejDejDejQejRejSe jSejTe jTejUe jUejVe jVejWe jWejXe jXejYej4ejZej5ej[ej6ej\e jUej]e jVej^e jWejVe jVejWe jWejXe jXej_ej3ej3ej3ej5ej5ej6ej6i-Z`e e"e#feAd <ej5ej5ej6ej6ej3ej3ejMjNjOej3ejYejYejZejZej[ej[ej\ej\ej]ej]ej^ej^ejVejVejWejWejXejXej_ej_iZae e"e#feAd <ejej>ejXejXej;ej;ej:ej:i Zce e"e#feAd <ejdhZee!e"eAd <ejfejgj jfejhejgj jhejiejgj jiejjejgj jjejkejgj jkejlejgj jliZme ee"enfe"feAd <ejoe+ejpe+ejqe+ejre,iZse e"e"feAd<ej3e&jtj j3iZue e"e#feAd<ej3e&jtj j j3iZve e"e#feAd<e!e#dddZwe e"e#fdddZxe e"e#fdddZye e"e#fdddZze e"e#fdddZ{d9e"ee e"e#fe|e#dddZ}d:e"ee e"e#fe#d d!d"Z~e e"e#fdd#d$Ze e"e#fdd%d&Ze e"e#fdd'd(Ze e"e#fdd)d*Ze!e"dd+d,Ze!e"dd-d.Ze ee"enfe"fdd/d0Zee"enfe"d1d2d3Zejjee"d4d5d6Zejje|d4d7d8ZdS);N)nn)OptionalUnionDictSetCallableAny) QuantStub DeQuantStub)+default_fixed_qparams_range_0to1_fake_quant.default_fixed_qparams_range_neg1to1_fake_quant)get_combined_dict)type_before_parametrizations.DEFAULT_REFERENCE_STATIC_QUANT_MODULE_MAPPINGS$DEFAULT_STATIC_QUANT_MODULE_MAPPINGSDEFAULT_QAT_MODULE_MAPPINGS%DEFAULT_DYNAMIC_QUANT_MODULE_MAPPINGS_INCLUDE_QCONFIG_PROPAGATE_LIST,DEFAULT_FLOAT_TO_QUANTIZED_OPERATOR_MAPPINGS"DEFAULT_MODULE_TO_ACT_POST_PROCESS+DEFAULT_STATIC_SPARSE_QUANT_MODULE_MAPPINGS,DEFAULT_DYNAMIC_SPARSE_QUANT_MODULE_MAPPINGS)returncCsttjjtjjg}|S)z8These modules cannot have observers inserted by default.)setrZ quantizableLSTMZMultiheadAttention)Z no_observersrO/tmp/pip-unpacked-wheel-ua33x9lu/torch/ao/quantization/quantization_mappings.pyno_observer_sets rcCs ttS)z> Get module mapping for post training static quantization )copydeepcopyrrrrr(get_default_static_quant_module_mappingssr cCs ttS)zH Get reference module mapping for post training static quantization )rrrrrrr2get_default_static_quant_reference_module_mappingssr!cCs&tt}tj|tj<tj|tj<|S)z= Get module mapping, including mapping for embedding QAT )rrrnnq EmbeddingBagnnqat Embeddingmappingrrr*get_embedding_static_quant_module_mappingss   r(cCs ttS)zE Get module mapping for post training static sparse quantization )rrrrrrr/get_default_static_sparse_quant_module_mappingssr)F)float_module_classadditional_static_quant_mapping is_referencercCsR|dkr i}t|rtnt|}||d}|dk sHtdt|dt|S)zen Get the statically quantized module class corresponding to the floating point module class NFloating point module class {}5 does not have a corresponding quantized module class) r rrgetAssertionErrorformatstrrr)r*r+r, all_mappingsZstatic_quant_module_classrrrget_static_quant_module_classs   r4)r* additional_dynamic_quant_mappingrcCsJ|dkr i}tt|}||d}|dk s@tdt|dt|S)zfn Get the dynamically quantized module class corresponding to the floating point module class Nr-r.)r rr/r0r1r2rr)r*r5r3Zdynamic_quant_module_classrrrget_dynamic_quant_module_classs    r6cCs ttS)z@ Get default module mapping for quantization aware training )rrrrrrrget_default_qat_module_mappingssr7cCs&tt}tj|tj<tj|tj<|S)z Get module mapping for quantization aware training This is includes default values in addition to enabling qat for embeddings. )rrrr$r#rr%r&rrr!get_embedding_qat_module_mappingss   r8cCstS)z? Get module mapping for post training dynamic quantization )rrrrr)get_default_dynamic_quant_module_mappingssr9cCstS)zF Get module mapping for post training dynamic sparse quantization )rrrrr0get_default_dynamic_sparse_quant_module_mappingssr:cCs2ttttBttBtB}t|S)z` Get the default list of module types that we'll attach qconfig attribute to in prepare )rrkeysrrrrr)Z#QCONFIG_PROPAGATE_MODULE_CLASS_LISTrrr$get_default_qconfig_propagation_lists   r<cCsVttttBttBttBttBttBtB}t|S)zT Get list of module class types that we will record output in numeric suite ) rrvaluesrrr;rrr)Z.NUMERIC_SUITE_COMPARE_MODEL_OUTPUT_MODULE_LISTrrr&get_default_compare_output_module_lists       r>cCs ttSN)rrrrrrr0get_default_float_to_quantized_operator_mappings#sr@)float_oprcCs*t|d}|dk s&tdt||S)zD Get the quantized operator corresponding to the float operator Nz4Operator {} does not have corresponding quantized op)rr/r0r1r2)rAZ quantized_oprrrget_quantized_operator(s    rB)modulercCstt|dS)z Get the special activation post process for `module`, this has higher priority than the activation post process in `qconfig` e.g. input: torch.nn.Sigmoid output: default_affine_fixed_qparam_fake_quant N)rr/rrCrrr_get_special_act_post_process0srEcCs|jot|tkSr?)ZtrainingtyperrDrrr_has_special_act_post_process9srG)NF)N)rZtorchrZtorch.nn.functionalZ functionalFZtorch.nn.intrinsicZ intrinsicZnniZtorch.nn.intrinsic.quantizedZ quantizedZnniqZ$torch.nn.intrinsic.quantized.dynamicZdynamicZnniqdZtorch.nn.intrinsic.qatZqatZnniqatZtorch.nn.quantizedr"Ztorch.nn.quantized._referenceZ _referenceZnnqrZtorch.nn.quantized.dynamicZnnqdZ torch.nn.qatr$Ztorch.nn.qat.dynamicZnnqatdtypingrrrrrrZ torch.ao.nnZaoZao_nnZtorch.ao.quantization.stubsr r Z#torch.ao.quantization.fake_quantizer r Ztorch.ao.quantization.utilsr Ztorch.nn.utils.parametrizerZQuantizeZ DeQuantizeZLinearZConv1dZConv2dZConv3dZConvTranspose1dZConvTranspose2dZConvTranspose3dr%r#ZGRUCellZLSTMCellZRNNCellrr__annotations__Z BatchNorm2dZ BatchNorm3dZDropoutZELUZ GroupNormZ HardswishZInstanceNorm1dZInstanceNorm2dZInstanceNorm3dZ LayerNormZ LeakyReLUmodulesZlinearZNonDynamicallyQuantizableLinearZReLU6ZFloatFunctionalZ QFunctionalZBNReLU2dZBNReLU3dZ ConvReLU1dZ ConvReLU2dZ ConvReLU3dZ LinearReLUZConvBn1dZConvBn2dZConvBn3dZ ConvBnReLU1dZ ConvBnReLU2dZ ConvBnReLU3dZ LinearBn1drrZGRUrZ SequentialrZeluopsZ hardswishZ instance_normZ layer_normZ leaky_reluZdropoutrr2Z HardsigmoidZSigmoidZSoftmaxZTanhrsparserrrr r!r(r)boolr4r6r7r8r9r:r<r>r@rBModulerErGrrrrs    5