o h; @sddlmZmZddlmZmZzddlmZmZm Z m Z m Z m Z m Z mZmZWney?Zz edeedddZ[wwzddlmZddlmZWney`Gdd d ZeZYnwdd d Zddd d efddZd efddZddZefddZdddZdS))Table RecordBatch) Expressionfield) DeclarationExecNodeOptionsTableSourceNodeOptionsFilterNodeOptionsProjectNodeOptionsAggregateNodeOptionsOrderByNodeOptionsHashJoinNodeOptionsAsofJoinNodeOptionsz@The pyarrow installation is not built with support for 'acero' ()N)ScanNodeOptionsc@s(eZdZGdddZGdddZdS)DatasetModuleStubc@ eZdZdS)zDatasetModuleStub.DatasetN__name__ __module__ __qualname__rrA/var/www/vscode/kcb/lib/python3.10/site-packages/pyarrow/acero.pyDataset3rc@r)z!DatasetModuleStub.InMemoryDatasetNrrrrrInMemoryDataset6rrN)rrrrrrrrrr2srTFcCsntdt|||d}dd|jjD}t|tdt|g}|jd}|dur5t|tdt|g}|S)Nscan use_threadsrequire_sequenced_outputcSsg|]}t|qSr)r).0frrr Bsz$_dataset_to_decl..projectfilter) rrschemanames from_sequencer _scan_optionsgetr )datasetrrdecl projections filter_exprrrr_dataset_to_decl;s r.c  s~t|ttjfstdt|t|ttjfs"tdt|it|ttfs.|g}t|D]\} } | | <q2it|ttfsG|g}t|D]\} } | | <qK|j j } |j j } |dksd|dkrgg} n*|dkso|dkrrg} n|dksz|dkrfdd | D} n |d krfd d | D} i}t| D] \} }||vr| ||<qi}t| D] \} }||vr| ||<qt|tjrt ||d }nt d t |}t|tjrt ||d }nt d t |}|rt|||| | |pd|pdd}n t||||pd|pdd}t d|||gd}|r|dkrt| }t| }t| }g}g}t| | D]n\} }| t| krW||vrW|||||}|tdt| t||gq%| |krc||vrcq%|rt| |krt||vrt||7}|r| |kr||vr||7}|||t| q%t dt||}t ||g}|j|d }| tkr|S| tjkrt|Std)a\ Perform join of two tables or datasets. The result will be an output table with the result of the join operation Parameters ---------- join_type : str One of supported join types. left_operand : Table or Dataset The left operand for the join operation. left_keys : str or list[str] The left key (or keys) on which the join operation should be performed. right_operand : Table or Dataset The right operand for the join operation. right_keys : str or list[str] The right key (or keys) on which the join operation should be performed. left_suffix : str, default None Which suffix to add to left column names. This prevents confusion when the columns in left and right operands have colliding names. right_suffix : str, default None Which suffix to add to the right column names. This prevents confusion when the columns in left and right operands have colliding names. use_threads : bool, default True Whether to use multithreading or not. coalesce_keys : bool, default False If the duplicated keys should be omitted from one of the sides in the join result. output_type: Table or InMemoryDataset The output type for the exec plan result. Returns ------- result_table : Table or InMemoryDataset Expected Table or Dataset, got z left semiz left antiz right semiz right antiinnerz left outercg|]}|vr|qSrrr col)right_keys_orderrrr"z!_perform_join..z right outercr1rrr2)left_keys_orderrrr"r5r table_source)output_suffix_for_leftoutput_suffix_for_righthashjoinoptionsinputsz full outercoalescer#Unsupported output type) isinstancerdsr TypeErrortypetuplelist enumerater%r&r.rrr setlenappendr_call_fieldr r'to_tabler) join_type left_operand left_keys right_operand right_keys left_suffix right_suffixr coalesce_keys output_typeidxkey left_columns right_columnsleft_column_keys_indicescolnameright_column_keys_indices left_source right_source join_optsr+left_columns_setright_columns_setright_operand_indexprojected_col_namesr,r3right_key_index projection result_tabler)r6r4r _perform_joinRs(                     ric sTt|ttjfstdt|t|ttjfs"tdt|t|ttfs,|g}tttfs6gfdd|jj D} t |jj t | @} | rUt d | t|tjrct ||dd} ntdt|} t|tjrxt ||dd} ntdt|} t|||} td| | | gd }|j|d }|tkr|S|tjkrt|Std ) a- Perform asof join of two tables or datasets. The result will be an output table with the result of the join operation Parameters ---------- left_operand : Table or Dataset The left operand for the join operation. left_on : str The left key (or keys) on which the join operation should be performed. left_by: str or list[str] The left key (or keys) on which the join operation should be performed. right_operand : Table or Dataset The right operand for the join operation. right_on : str or list[str] The right key (or keys) on which the join operation should be performed. right_by: str or list[str] The right key (or keys) on which the join operation should be performed. tolerance : int The tolerance to use for the asof join. The tolerance is interpreted in the same units as the "on" key. output_type: Table or InMemoryDataset The output type for the exec plan result. Returns ------- result_table : Table or InMemoryDataset r/csg|] }|gvr|qSrrr2right_byright_onrrr"/s z&_perform_join_asof..zOColumns {} present in both tables. AsofJoin does not support column collisions.Trr8asofjoinr=r7rA)rBrrCrrDrErFrGr%r&rI ValueErrorformatr.rrrrNr)rPleft_onleft_byrRrlrk tolerancerrWr[columns_collisionsr_r`rar+rhrrjr_perform_join_asofs\!        rtcCshd}t|trt|g}d}ttdt|dtdt|dg}|jdd}|r2| d}|S)a}Filter rows of a table based on the provided expression. The result will be an output table with only the rows matching the provided expression. Parameters ---------- table : Table or RecordBatch Table that should be filtered. expression : Expression The expression on which rows should be filtered. Returns ------- Table FTr8)r>r$r7r) rBrr from_batchesrr'rr rNcombine_chunks to_batches)table expressionis_batchr+resultrrr _filter_table^s   r|cKst|tjr t|dd}ntdt|}tdt|fi|}t||g}|jdd}|t kr2|S|tj krs>0     4 [