U d%@s<ddlmZmZmZmZmZmZmZddlm Z ddl Z ddl Z ddl m Z ddlmZeee jee jfZee jefZee jjZee jjZeeZdddhZed d d d Zed d eee jjfe jjed ddZed d e jjedddZed d GdddZ ed d e jj!dddZ"dS))ListTupleUnionDictAnySetMapping) dataclassN)_get_qualified_name) compatibility call_module call_functionZ call_methodF)Zis_backward_compatiblecCsLt|tr|S|jr*d|jkr*d|jS|j}|r8|ndd|jSdS)Nacc_opsacc_ops..) isinstancestr __module____name__)kmoduler@/tmp/pip-unpacked-wheel-ua33x9lu/torch/fx/passes/tools_common.pyget_acc_ops_names   r) submodulesnodereturncCs|jtks(tddtd|j|jdkrdt|jtsBt||j}t|dt|}t |S|jdkr|j}|j dk rd|j krd |j St |St|jtst|jSdS) a, Given a `node` returns its target typename. For "call_method" node, return node.target which is the name of that method being called. This could potential lead to conflict but should be okay because normally it's on a tensor. For "call_function" node, return typename of node.target. For "call_module" node, return typename of the module that node.target point to. If seeing "_VariableFunctionsClass" in the target name string, it will be replaced by "torch". e.g. _VariableFunctionsClass.relu would become torch.relu. zExpect op types of z, z , but found r Z_base_class_originr Nrr) opCALLABLE_NODE_OPSAssertionErrorjoinrtargetrgetattrtyperrrr )rrZsubmodZ submod_typer"rrrget_node_targets$    r%)rrcCs"|jdd}|dk o t|tjS)aChecks if the node output produces a Tensor or not. NOTE: This requires to run `ShapeProp` on the containing fx graph before calling this function. This is because it works by checking the `type` metadata on the node. This metadata is produced by the `ShapeProp`. r$N)metaget issubclasstorchTensor)rtype_rrris_node_output_tensorAsr,c@sheZdZdZejjedddZe GdddZ de ee fdd d Z eejjefd d d ZdS)FxNetAccFusionsFinderz Finds groups of connected ACC nodes that pass non-tensor data between each other. Such groups are called fusion groups. )r acc_nodescCs||_t|jj|_||_dSN)rlistgraphnodesr.)selfrr.rrr__init__SszFxNetAccFusionsFinder.__init__c@s6eZdZUeed<eed<eed<eed<ddZdS)!FxNetAccFusionsFinder.FusionGroup top_node_idxr2inputsnodes_need_processcsR|jkrdSj|j|j|jfdd|jDdS)z5 Add a node to fusion group. Ncs$h|]}|jtkr|jkr|qSr)rrr2).0nr3rr qs z=FxNetAccFusionsFinder.FusionGroup.add_node..)r2r8addr7discardupdateall_input_nodes)r3rrr;radd_nodefs     z*FxNetAccFusionsFinder.FusionGroup.add_nodeN)rr __qualname__int__annotations__NodeSetrArrrr FusionGroupXs rFr5) fusion_groupr7cCs\|D]R}|jtkrq|j||jkr(q||jkr8dS|||jr||dSqdS)z Start from inputs and going reverse topological order. If any upstream node is in the fusion group, add all the nodes in this path to fusion group. TF)rrr2indexr6recursive_add_noder@rA)r3rGr7argrrrrIxs    z(FxNetAccFusionsFinder.recursive_add_node)rcCsri}t|j}|D]X}||kr"q|jtkr.qd|jkr:q||jkrFq|j|j||ht|j |hd}|j r0|j }| ||j d|jkr|jD]4}|jtkrq||jkrq||| ||j q|j D]V}|jtkrqd|jkrq||jkrq||t|j|j||_| ||j qqjt|j|jksT|j|j8_q|jD]}|j||<qZq|S)NZ tensor_meta)r6r2r7r8)r0r.rrr&rFr2rHsetr@r8poprIr7ZusersrAminr6)r3resultr.rrGuserrJr:rrr__call__s\                   zFxNetAccFusionsFinder.__call__N)rrrB__doc__r)fx GraphModulerEr4r rFrNodeListrIrNoderPrrrrr-Ls! r-)gmc sdd|jjD}tj}i|D]$\}}|s(||fdd|<q(D] }||=qV|rg}|D]H\}}d}|D]}|krd}q|rr||fdd|<||qr|D] }||=qqb||_dS) a Replace the graph of the given GraphModule with one that contains the same nodes as the original, but in topologically sorted order. This is used by the merge_matmul transformation below, which disturbs the topologically sorted order of its input GraphModule, so that this order is restored before further transformation. Arguments: gm: The graph module to topologically sort. It is modified in-place. cSsi|]}||jqSr)r@copy)r9rrrr sz"legalize_graph..cs|Sr/rr:Z value_remaprrz legalize_graph..TFcs|Sr/rrYrZrrr[r\N) r1r2r)rRZGraphitemsZ node_copykeysappend) rVZ dependenciesZ new_graphrdepsZ copied_nodeZcopied_this_roundZall_deps_copieddeprrZrlegalize_graphs*    rb)#typingrrrrrrrZ dataclassesr r)Ztorch.fxZ torch.fx.noder Ztorch.fx._compatibilityr r*ZTensorsZTensorOrTensorsrRrUrTrErZNamesrrnnModuler%boolr,r-rSrbrrrrs,$       $#