U *-e@sddlmZmZmZmZmZddlZddlmZddl m Z ddl m Z ddl mZmZmZddlmZdd d d d gZed de eeeedddZed dGdd d eZed dde eeejdddd Zed deeddd Zed de eeddd ZdS))AnyDictList NamedTupleOptionalN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapePropreplace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)Zis_backward_compatible) fx_moduleold_op old_targetnew_op new_targetc st}i|jjD]}|j|kr|j|krt|jfdd}t|jfdd}t|t s`t t|t snt | |||||j |<q||fdd|<q||_dS)zModifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and targetcs|SNnZval_maprc/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/torch/fx/passes/graph_manipulation.pyz+replace_target_nodes_with..cs|Srrrrrrr rcs|Srrrrrrr'rN)rgraphnodesoptargetr argskwargs isinstancetupleAssertionErrordictZ create_nodenameZ node_copy) rrrrrZ new_graphnoder$r%rrrrs"   c@seZdZUeed<eed<dS)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rrrrr+s )rr$returncCsF|dk rt|j|d}|jjD]}|jdkr4qBt|||_q"dS)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNgoutput)r propagater r!r"rr)rr$Ztotal_size_of_graphr+rrrr1s  )r+r3cCs$|jd}|s td|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r+r6rrrrDs   )rr+r3c Csd}|jdkrFt|}||j}|}|D]\}}||7}q0t|}|j} || 7}|jr|t j g|j d } nt j g|j d } | |} | | } t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size rZ call_module)dtype)r"r)Z named_modulesr#Znamed_parametersZnumelrshapeZ is_quantizedtorchZ_empty_affine_quantizedr:Z element_sizeZtensorr) rr+Ztotal_num_of_elemsZsubmodule_dict submodule parametersr*pr6Z output_elemZsize_per_elem_bytesr-r,rrrrQs&      )N)typingrrrrrr<Ztorch.fx._compatibilityrZtorch.fx.graphrZtorch.fx.graph_moduler Z torch.fx.noder r r Ztorch.fx.passes.shape_propr __all__strrrZTensorrrrrrrrs: