o I h, @spddlZddlZddlZddlZddlZddlZddlmZddlm Z m Z m Z m Z ddl mZddlZddlZddlmmZddlmZddlmZmZddlmZddlmZd d lmZmZm Z m!Z!e"e#Z$Gd d d Z%Gd ddZ&de'de(e'de'de'fddZ)dede e(e'e*e'e(e'ffdefddZ+GdddZ, d!dede'de-de,fdd Z.dS)"N)Path)AnyIOOptionalUnion)Self)config)BuildOptionsBase CppBuilder)reorder_kwargs)FileLike)AOTINDUCTOR_DIRARCHIVE_VERSION CONSTANTS_DIRCUSTOM_OBJ_FILENAME_PREFIXc@sjeZdZdeddfddZdefddZddd Zd ed e e efddfd d Z d ededdfddZ dS)PT2ArchiveWriter archive_pathreturnNcC||_d|_dSNr archive_fileselfrrS/var/www/vscode/kcb/lib/python3.10/site-packages/torch/_inductor/package/package.py__init__ zPT2ArchiveWriter.__init__cCsD|jdusJtj|jdtjd|_|dtt|dd|S)Nw compressionversionarchive_formatpt2)rzipfileZipFiler ZIP_STOREDwritestrstrrrrrr __enter__#s  zPT2ArchiveWriter.__enter__cGs"|jdusJ|jd|_dSrrcloserargsrrr__exit__,s zPT2ArchiveWriter.__exit__namedatacCs |jdusJ|j||dSr)rr()rr1r2rrrr(2szPT2ArchiveWriter.writestr file_pathcCs<t|s J|d|jdusJ|jj||ddS)z Copy a file into the archive. name: The destination file inside the archive. file_path: The source file on disk. z is not a valid file pathN)arcname)ris_filerwrite)rr1r3rrr write_file6szPT2ArchiveWriter.write_filerN) __name__ __module__ __qualname__r rrr+r0r)rbytesr(r7rrrrrs  rc@seZdZdeddfddZdefddZddd Zd edefd d Z d ededefddZ deddfddZ de efddZ dS)PT2ArchiveReaderrrNcCrrrrrrrrBrzPT2ArchiveReader.__init__cCstj|jdtjd|_|S)Nrr )r%r&rr'rr*rrrr+Fs zPT2ArchiveReader.__enter__cGs|jdur |jdSrr,r.rrrr0Ls  zPT2ArchiveReader.__exit__r1cCs|jdusJ|j|Sr)rread)rr1rrrr?Qs zPT2ArchiveReader.readmemberpathcCs|jdusJ|j||Sr)rextract)rr@rArrrextract_to_pathUsz PT2ArchiveReader.extract_to_pathcCs|jdusJ|j|dSr)r extractall)rrArrrrDYszPT2ArchiveReader.extractallcCs|jdusJ|jSr)rnamelistr*rrrget_file_names]s zPT2ArchiveReader.get_file_namesr8)r9r:r;r)rrr+r0r<r?rCrDlistrFrrrrr=As r=aoti_dir aoti_filesso_pathrcsdtdtffdd }tj||d}tj||d}tj|d}t|d }t|}Wdn1s;wYtdi|d t i} t ||| d } | } | t|d  }t|} Wdn1srwYtdi| d t i} t tj|d | |g| |d }| }| |d}|vrt|d }|}Wdn1swYt|d}|}|dd|d||Wd|S1swY|S)Nsuffixrcs*D] }||r |Sqtd|)Nz Unable to find file with suffix )endswith RuntimeError)rKfilerIrrget_aoti_file_with_suffixcs  z-compile_so..get_aoti_file_with_suffix.cppz.orz_compile_flags.jsonuse_relative_path)r1sources BuildOptionz_linker_flags.json)r1rSrT output_dirz_serialized_weights.binrbza+b i@r)r)osrAjoinsplitextopenjsonloadr r is_fbcoder get_target_file_pathbuildsplitr?tellr6)rHrIrJrPcpp_fileconsts_o file_namef compile_flagscompile_optionsobject_builderoutput_o linker_flagslinker_options so_builder output_soserialized_weights_filename f_weightsserialized_weightsf_soso_sizerrOr compile_sobs`       rurc Cst|tr d|i}t|tsJdt|tjtfr"|r"|s9t|tt j fr2t | ds9Jd|t |s}|D]f\}}d}d}|D][}|dkrSqL| drh|d7}|dkrhtd |d | d r}|d7}|dkr}td |d t j|}|trt jt|} nt jt||} td || |t| |qLqBWdn1swYt|tjtfr|d|S)a_ Saves the AOTInductor generated files to the PT2Archive format. Args: archive_file: The file name to save the package to. aoti_files: This can either be a singular path to a directory containing the AOTInductor files, or a dictionary mapping the model name to the path to its AOTInductor generated files. modelzPlease pass a list of AOTI generated files to be packaged or a dictionary mapping model names to their list of AOTI generated files. You can get this list of files through calling `torch._inductor.aot_compile(..., options={aot_inductor.package=True})`.pt2zMExpect archive file to be a file ending in .pt2, or is a buffer. Instead got rz.sor zMultiple .so files found in zQ. You might need to clear your cache directory before calling aoti_compile again.rQzMultiple .cpp files found in z.Saving AOTI generated file %s to archive in %sN) isinstancerGdictioIOBaserwritableseekabler)rYPathLikefspathrLritemsrMrAbasename startswithrrZrrlogdebugr7seek) rrIarchive_writer model_namefiles num_so_files num_cpp_filesrNfilename new_filepathrrr package_aotisj         ' rc@seZdZdZdejjjddfddZddZ de e e ffd d Z d e e ej fd eddfd dZdee fddZdee eefddfddZdS)AOTICompiledModelz8 Callable AOT Inductor loaded model from a .pt2 loaderrNcCs ||_dSr)r)rrrrrr zAOTICompiledModel.__init__cOsd|j}t|d}t|d}t|t||fd}dd|D}|j|}t||S)Nrr cSsg|] }t|tjr|qSr)rytorchTensor).0xrrr sz.AOTICompiledModel.__call__..)r get_call_specpytreetreespec_loads tree_flattenr boxed_runtree_unflatten)rr/kwargs call_specin_specout_spec flat_inputs flat_outputsrrr__call__s   zAOTICompiledModel.__call__cC |jSr)r get_metadatar*rrrrrzAOTICompiledModel.get_metadata constants_mapcheck_full_updatecCs|j|d|dS)a Given a mapping of constant fqns to tensors, load the constants into the model. You can use ``get_constant_fqns`` to get the list of constant fqns that are needed in the compiled model. Args: constants_map: A mapping of constant fqns to tensors. check_full_update: Whether to add check to see if all the constants are updated and have values. FN)rload_constants)rrrrrrrsz AOTICompiledModel.load_constantscCrr)rget_constant_fqnsr*rrrrrz#AOTICompiledModel.get_constant_fqnsmemocCstdt|jS)NzOAOTICompiledModel deepcopy warning: AOTICompiledModel.loader is not deepcopied.)rwarningrr)rrrrr __deepcopy__s zAOTICompiledModel.__deepcopy__)r9r:r;__doc__r_C_aotiAOTIModelPackageLoaderrrrzr)rrboolrrGrrrrrrrrrs   "rrvFrArrun_single_threadedcCst|tjtfr|r|s't|ttjfr t | ds'Jd|t|tjtfrft j dd)}| ||dtd|jtjj|j||}t|WdS1sawYt |}tjj|||}t|S)NrwzTUnable to load package. Path must be a buffer or a file ending in .pt2. Instead got )rKrz)Writing buffer to tmp file located at %s.)ryr{r|rreadabler~r)rYrrrLtempfileNamedTemporaryFiler6r?rrrr1rrrrr)rArrrgrrrr load_packages6  r)rvF)/r{r]loggingrYrr%pathlibrtypingrrrrtyping_extensionsrrtorch._inductortorch.utils._pytreeutils_pytreerrtorch._inductor.cpp_builderr r torch.export._tree_utilsr torch.typesr pt2_archive_constantsrrrr getLoggerr9rrr=r)rGrurzrrrrrrrrsN      #!; P1