o h@s<ddlZddlmZddlZddlmZddlZddlZdZ zddl m Z ddl mZWn ey9dZ dZYnwzddlmZddlm mZWn eyVdZ YnwejjZdZdZdZd Zd d Zd d ZddZddZddZ ejj!e ddddZ"ejj!e ddddZ#ejj!e ddddZ$dS)N) timedeltaFInMemoryKmsClientTs0123456789112345 footer_keys1234567890123450col_keycCstgdgdgddS)N)irir)r r d)FlamingoParrotDogHorsez Brittle stars Centipede)yearn_legsanimal)patablerrY/var/www/vscode/kcb/lib/python3.10/site-packages/pyarrow/tests/test_dataset_encryption.pycreate_sample_table4s rcCs$tjtdtddgidtddddS) NFrr AES_GCM_V1g@)minutes)rplaintext_footer column_keysencryption_algorithmcache_lifetimedata_key_length_bits)peEncryptionConfigurationFOOTER_KEY_NAME COL_KEY_NAMErrrrrcreate_encryption_configEs r&cCs tjddS)Ni,)r )r"DecryptionConfigurationrrrrcreate_decryption_configQs r(cCs tjttdttdidS)NzUTF-8)custom_kms_conf)r"KmsConnectionConfigr$ FOOTER_KEYdecoder%COL_KEYrrrrcreate_kms_connection_configUs   r.cCst|SNr)kms_connection_configurationrrr kms_factory^sr1z+Parquet Encryption is not currently enabled)reasonc CsJt}t}t}t}tt}t|||}t |||}t j }|j |d}t} | dtj|d||| dt j }tjtddtj d|| dWdn1s\wYtj|d} t j j | d }tj d|| d} || sJ|||} tj| d } t j j | d }tj d|| d} || sJdS) Nencryption_config/sample_dataset)database_dirformat file_options filesystemz no decryption)matchr9r;decryption_configdefault_fragment_scan_options)decryption_properties)rr&r(r.r" CryptoFactoryr1dsParquetEncryptionConfigParquetDecryptionConfigrdatasetParquetFileFormatmake_write_optionsfs_MockFileSystem create_dir write_datasetpytestraisesIOErrorParquetFragmentScanOptionsequalsto_tablefile_decryption_properties) rr4r?kms_connection_configcrypto_factoryparquet_encryption_cfgparquet_decryption_cfgpformat write_optionsmockfs pq_scan_optsrGrBrrr"test_dataset_encryption_decryptionbsR     r]z'Parquet Encryption is currently enabledcCsFtj}tt|jdd}WddS1swYdS)zTest write_dataset with ParquetFileFormat and test if an exception is thrown if you try to set encryption_config using make_write_optionsz some valuer3N)rrGrHrNrONotImplementedErrorrI)rY_rrr-test_write_dataset_parquet_without_encryptions "r`csBGdddtjd}tjjtjddt|Dtdgdgd}t}t fd d }tj d d dgid d dd}t |||}t ||t}t j|d}t j|d}|j|d} ||} t} | dd} t j|| || | d| d} tj| | | d}||ksJt j| || d}|}||ksJdS)z9Test encryption and decryption of a large number of rows.c@s8eZdZdededefddZdededefddZd S) z;test_large_row_encryption_decryption..NoOpKmsClient key_bytesr_returncSt|}|Sr/)base64 b64encode)selfrar_brrrwrap_key zDtest_large_row_encryption_decryption..NoOpKmsClient.wrap_key wrapped_keycSrcr/)rd b64decode)rfrjr_rgrrr unwrap_keyrizFtest_large_row_encryption_decryption..NoOpKmsClient.unwrap_keyN)__name__ __module__ __qualname__bytesstrrhrlrrrr NoOpKmsClientsrricSsg|]}tqSr)random).0r_rrr sz8test_large_row_encryption_decryption..)typefoo)namescsSr/r)r_rrrrsz6test_large_row_encryption_decryption..UNIMPORTANT_KEYTF)rrdouble_wrappingrr!r>r@r3r5zlarge-row-test-dataset)r9r:r;z/part-0.parquet)rBr;r=N)r" KmsClientrTable from_arraysarrayrangefloat32r*rCr#rDrErFr'rQrHrIrTrJrKrLrMpq ParquetFilereadrGrS) row_countr kms_configrVr4 pqe_config pqd_config scan_options file_formatrZrTr[path file_path new_tablerGrryr$test_large_row_encryption_decryptionsZ         r)%rddatetimerrs pyarrow.fsrJpyarrowrrNencryption_unavailablepyarrow.parquetparquetrpyarrow.datasetrGrD ImportError pyarrow.tests.parquet.encryptionrpyarrow.parquet.encryption encryptionr"mark pytestmarkr+r$r-r%rr&r(r.r1skipifr]r`rrrrrsT         9