o I h+@s<ddlZddlZddlZddlmZddlmZmZmZddl m Z ddl Z ddl Z ddl mZddlmZeeZded ed efd d Zd ed efddZded eded eeeeeffddZd eee jffddZd eedffddZdede j d eeeffddZ!dedee j d eeeffddZ"deded eeeffdd Z#ded eeeffd!d"Z$de jd eeeffd#d$Z%de j&d eeeffd%d&Z'de j(d eeeffd'd(Z)ddd)d)d*ded ededed+edefd,eed-eeefd.eeeefd/eeeefd0ed1ed efd2d3Z*dS)4N)Path)AnyCallableOptional)mock) is_cpu_device) cache_dir namespacedevicereturncCsttd||S)N aoti_eager)rr )r r rN/var/www/vscode/kcb/lib/python3.10/site-packages/torch/_inductor/aoti_eager.pyaoti_eager_cache_dirrop_func_name_with_overloadcCsBddlm}m}ddlm}|d}|}|tj|||dS)Nr) get_lock_dir LOCK_TIMEOUT)FileLockz.lock)timeout)torch._inductor.codecacherrtorch.utils._filelockrospathjoin)rrrrop_conf_lock_filelock_dirrrraoti_eager_op_conf_locks   rns device_typec Cst||}||d}|sgSzt|t|}t|}|D]~}||d}||d<|sIgWdWdWS|dD]T} | drXtdd| vrf| ddkrfd| d <d D]} | | vr|t t | |  d d| | <qhd | vrt t | d  d d| d <d | vrt t | d  d d| d <qMq$|WdWdWS1swYWdWdS1swYWdSt y} zd| } t | gWYd} ~ Sd} ~ ww)N.json kernel_path meta_info is_dynamic!Only support static shape for nowr cpu device_index)dtype dtype_value. layout_valuememory_format_valuez!Failed to load aoti eager cache: )rexistsropenjsonloadas_posixgetNotImplementedErrorgetattrtorchsplit Exceptionlog exception) rrr device_kernel_cacheop_conff json_dataitemkernel_lib_abs_pathmetadata dtype_keyeerr_msgrrrload_aoti_eager_cache sd        &%  rEcCsttjttjttjiSN)intr6int32floatboolrrrr#supported_builtin_dtype_torch_dtypeTrrK.cCst}t|SrF)rKtuplekeys)type_to_torch_dtyperrrsupported_scalar_typesXs rOdynamicinputcCsi}||d<t|tjsJ|jj|d<t|grd|d<n|jj|d<|j|d<t| |d<t| |d<|j |d<tj ||d <|S) Nr$r r'r(r)sizesstrides requires_graddispatch_key_set) isinstancer6Tensorr typerindexr)listsizestriderT_C_dispatch_keysraw_repr)rPrQrArrrextract_tensor_metadata]s     r`cCs>g}|D]}t|tjsJ|t||qi}||d<|S)N tensor_list)rVr6rWappendr`)rPrQ metadata_listr?rArrrextract_tensor_list_metadataosrdcCs\t|tsJi}d|d<||d<|dkrdnd|d<t}|t||d<||d <|S) NFr$r r&r'rr(r) scalar_value)rVrOrKrX)r rQrArNrrrextract_scalar_metadata}srfcCst|tsJi}||d<|S)N string_value)rVstrrQrArrrextract_string_metadatasrjcC"t|tjsJi}||d<|S)Nr*)rVr6r)rirrrextract_dtype_metadata rlcCs.t|tjsJi}|j|d<|j|d<|S)Ndevice_type_valuedevice_index_value)rVr6r rXrYrirrrextract_device_metadatas   rpcCrk)Nr,)rVr6layoutrirrrextract_layout_metadatarmrrF)dynamic_shapesoptionsremove_runtime_assertionsdisable_constraint_solverr=argskwargsrsrtrurvc Cs|rJdt|t|} tdd| Ds'd| } t| t| | D]} t| trGtdd| DsGd| } t| t| q)t||}|sW|j dd|d }|sc| t j t jd |iiz?tjj||||| | d d }t|tsJg}t| D]o\}} t| tjrt|| }nVt| trtd d| DsJt|| }n@t| trt|| }n4t| trt| }n*t| tjrt| }nt| tjrt| }nt| tj rt!| }n tdt"| ||d<|#|qi}||d<t$|%||d<g}d}||d}|r"dnd}t&|yt'||=}zt()|}Wn t*yBg}Ynwt|tsKJ|D]}t|t sWJ|d|krbd }nqMWdn 1sowY|r|#|t'|d}t(j+||ddWdn 1swYWdn 1swY|WWdSt*y}zd|d|} t| WYd}~WddSd}~ww1swYdS)zO Compile the given function with persistent cache for AOTI eager mode. r%c ss2|]}t|ttjtttjtjtjfVqdSrF) rVrOr6rWrZrhr)r rq).0rQrrr s  z5aoti_compile_with_persistent_cache..zUnsupported input types: cs|] }t|tjVqdSrFrVr6rWryr?rrrrzs  z<_impl_with_aoti_compile encounters unsupported input types: T)parentslibTORCHINDUCTOR_CACHE_DIRF)rsrurvsame_signaturecsr{rFr|r}rrrrzszUnsupported input type: arg_orderr#r"r!rwN)indentzFailed to compile z: ),rZvaluesallr9r:r4rVrr.mkdirrpatchdictrenvironabsoluter2r6_export aot_compilerh enumeraterWr`rdrOrfrjr)rlr rprqrrrXrbr relative_torr/r0r1r8dump)rrr rPr=rwrxrsrtrurvflattened_inputsrDrQpersistent_cachepersistent_cache_libkernel_lib_pathkernel_metadata_itemsidxrAkernel_meta_infor> update_jsonr<mode op_conf_filer?rCrrr"aoti_compile_with_persistent_caches                            J  Jr)+r0loggingrpathlibrtypingrrrunittestrr6 torch._exporttorch._inductor.utilsrruntime.runtime_utilsr getLogger__name__r9rhrrrZrrErXr)rKrLrOrJrWr`rdrfrjrlr rprqrrrrrrrs       4