o 0 h17@s,dZddlmZddlZddlZddlZddlmZmZddlm Z ddl Z ddl m Z ddl m Z ddlmZed Zd d hZejGd d d ZddddNddZdddOdd ZdPd!d"Z #dQdRd0d1Zd2d3ZdSd6d7ZdTdd?ZdVdAdBZdWdEdFZdXdHdIZdXdJdKZ dXdLdMZ!dS)YzFUtilities for manipulating the torch.Graph object and the torchscript.) annotationsN)IterableSequence)Any)_C)GLOBALS) registrationz^(.+)_(([ifstgz])|(ty))$inplaceatenc@seZdZUdZded<ded<ded<ded <d ed <d ed <ded<ejedZded<d*ddZ ddd+dd Z d!d"d,d%d&Z e Z ddd-d'd(Z d)S). GraphContextaExtra context for symbolic functions with all methods from torch.Graph. NOTE: This class is not meant for external consumption. Please do not depend on it outside of torch.onnx as the interface may evolve. Attributes: graph: The _C.Graph being constructed. block: The current _C.Block being constructed. opset: The opset version. original_node: Current node that is being converted from. params_dict: Mapping from graph initializer name to IValue. env: Mapping from Torch domain graph Value to ONNX domain graph Value. values_in_env: Set of all values in env, for constant-time lookups. new_nodes: List that tracks all new nodes that are added (used to make sure metadata is propagated to all new nodes). z_C.Graphgraphz_C.Blockblockintopset_C.Node original_nodezdict[str, _C.IValue] params_dictzdict[_C.Value, _C.Value]envz set[_C.Value] values_in_env)default_factoryz list[_C.Node] new_nodesnamestrreturnrcCs t|j|SN)getattrr )selfrrR/var/www/vscode/kcb/lib/python3.10/site-packages/torch/onnx/_internal/jit_utils.py __getattr__7s zGraphContext.__getattr__outputsopnameraw_argstorch.Tensor | _C.Valuer"cOst||g|Rd|i|S)aCreates an ONNX operator "opname", taking "raw_args" as inputs and "kwargs" as attributes. The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md Args: opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). r")_add_op)rr#r"r$kwargsrrrop:s#zGraphContext.op) overload_nameoperatorr*cOs|jdg|R||d|S)z~Generates an ONNX ATen op node. This function is for backward compatibility with the old symbolic functions. z aten::ATen) operator_soverload_name_s)r()rr+r*argsr'rrraten_op_szGraphContext.aten_opcOsH|jjd|j}|jj}t|||t||g|Rd|i|S)aCreates an ONNX operator from onnx-script function, taking "raw_args" as inputs and "kwargs" as attributes. onnx-script repository: https://github.com/microsoft/onnx-script Args: onnx_fn: ONNXFunction from onnx-script; An example can be found at https://github.com/microsoft/onnx-script#example raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). ::r")rdomainrversionrcustom_onnx_symbolicr&)ronnx_fnr"r$r' symbolic_name opset_versionrrr onnxscript_opps#zGraphContext.onnxscript_opN)rrrr)r#rr$r%r"r)r+rr*r)r$r%r"r)__name__ __module__ __qualname____doc____annotations__ dataclassesfieldlistrrr(r/atr7rrrrr s"  %r r )r"n_blocks graph_contextr#rinputs_C.Valuer"rrAr-tuple[Any, tuple[GraphContext, ...], _C.Node]c Os||j|g|Rd|i|}t|tr|d}n|}g}t|D]} |} tj|| d} || q$|t ||fS)aPCreates an ONNX operator "opname", taking inputs and attributes. Args: graph_context: The context for the current graph. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. inputs: The inputs to the operator. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. n_blocks: The number of sub-blocks to create in the node. attributes: The attributes of the ONNX operator. Returns: A tuple of (output_values, new_contexts, node) where: output_values: One or more output value of this operator (see the `outputs` keyword argument for multi-return nodes). new_contexts: A tuple of new graph contexts for each sub-block. node: The node representing the operator. r"r)r ) r( isinstancernoderangeaddBlockr=replaceappendtuple) rBr#r"rArC attributes output_valuesrG new_contexts_ new_block new_contextrrradd_op_with_blockss   rSr!r.r%c s|fdd|D}dd|D}d|vrd|}tj|||jj|tjd}j||dkr8| St | S) a@Creates an ONNX operator "opname", taking "args" as inputs and attributes "kwargs". The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md This function is monkey-patched onto Graph. Args: graph_context: The Torch Graph or Block. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: (Union[_C.Value, Tuple[_C.Value, ...]]) The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). csg|]}t|qSr)_const_if_tensor).0argrBrr sz_add_op..cSsi|] \}}|dur||qSrr)rUkvrrr sz_add_op..r0zonnx::)rr6 n_outputsshape_inferencer ) items _create_noder rrronnx_shape_inferencerrKoutputrLr")rBr#r"r.r'rCrMrGrrWrr&s$&  r&cCs*|dur|St|tjr|St|d|dS)Nzonnx::Constant)value_z)rFrValuer&)rBrVrrrrT s  rTTgraph_or_block_C.Graph | _C.Block domain_oprrMdictrr6r\r]boolrcCst|tjr|}||||} || } nt|tjr3|} | ||} |dkr3td|D]} | q,t | } t | |ksAJ| d} t |D]\}}|tvrUqLt| ||| dqL|rgt| ||| S)z:Creates an node 'domain_op', taking inputs and attributes.r zaten::)r )rFrGraphcreate insertNodeBlockaddNoderH addOutputrLr"len startswithsortedr^_SKIP_NODE_ATTRIBUTES_add_attribute(_jit_pass_onnx_node_shape_type_inference)rdrfrCrMrr6r\r]r rGr rP node_outputsr keyvaluerrrr_s(       r_cCst|tot|tttjf Sr)rFrrbytestorchTensor)rwrrr _is_onnx_list9s  r{x torch.TensorcCs|dksJ|dS)z,Convert a scalar tensor into a Python value.r r)numelr|rrr_scalar?srrGrvrwrcCs^t|}|durtd|d|d|d}}t|r$|d7}t||d||S)z7Initializes the right attribute based on type of value.NzInvalid attribute specifier 'z<' names must be suffixed with type, e.g. 'dim_i' or 'dims_i'r srP) _ATTR_PATTERNmatch ValueErrorgroupr{r)rGrvrwr mrkindrrrrsEs  rscCs|tjSr)type isSubtypeOfr TensorTypegetrrrr _is_tensorUsrtorch.device | NonecCs&t|sdSttj|}|Sr)rtypingcastrrrdevice)rw tensor_typerrrget_device_from_valueYsrrtuple[str, str]cCsHd|vr td|d|dd\}}d|vr td|d||fS)z(Parse node kind into domain and Op name.r0z Node kind: z& is invalid. '::' is not in node kind.r z) is invalid. '::' should only apear once.)rsplit)rr1r#rrrparse_node_kind`s rr1cC|dkS) Check if the domain is official.r rr1rrris_atenjrcCr)rprimrrrrris_primorrcCr)ronnxrrrrris_onnxtrr) rBr r#rrCrDr"rrArrrE)rBr r#rr.r%r"r)rBr )T)rdrerfrrCrrMrgrrgr6rr\rr]rhrr)r|r})rGrrvrrwrr rh)r|rDrrh)rwrDrr)rrrr)r1rrrh)"r; __future__rr=rercollections.abcrrrryrtorch.onnx._globalsrtorch.onnx._internalrcompilerrr dataclassr rSr&rTr_r{rrsrrrrrrrrrrsB      3 ? '