o I h~@s@ddlZddlZddlmZddlmZdgZGdddZdS)N)wraps)BaseSparsifier BaseSchedulerc@sZeZdZdddZddZddZd d Zd d ZdddZddZ dddZ ddZ d S)rFcCszt|tstt|jd||_dd|jD|_||_dd}||jj |j_ d|j_ d|_ ||_ d|_ | dS)Nz6 is not an instance of torch.ao.pruning.BaseSparsifiercSg|]}|dqSsparsity_level.0groupr r ]/var/www/vscode/kcb/lib/python3.10/site-packages/torch/ao/pruning/scheduler/base_scheduler.py z*BaseScheduler.__init__..csNt|ddr|St|j|jj~tfdd}d|_|S)N _with_counterFcs.}|jd7_|}||i|S)N) _step_count__get__)argskwargsinstancewrappedclsfunc instance_refr r wrapper+s z=BaseScheduler.__init__..with_counter..wrapperT)getattrweakrefref__self____func__ __class__rr)methodrr rr with_counters  z,BaseScheduler.__init__..with_counterrF) isinstancer TypeErrortype__name__ sparsifiergroupsbase_sl last_epochsteprverbose_get_sl_called_within_step)selfr)r,r.r$r r r __init__s  zBaseScheduler.__init__cCsdd|jDS)zReturns the state of the scheduler as a :class:`dict`. It contains an entry for every variable in self.__dict__ which is not the sparsifier. cSsi|] \}}|dkr||qS)r)r )r keyvaluer r r Gsz,BaseScheduler.state_dict..)__dict__itemsr0r r r state_dictAszBaseScheduler.state_dictcCs|j|dS)zLoads the schedulers state. Args: state_dict (dict): scheduler state. Should be an object returned from a call to :meth:`state_dict`. N)r5update)r0r8r r r load_state_dictKszBaseScheduler.load_state_dictcCs|jS)z9Return last computed sparsity level by current scheduler.)_last_slr7r r r get_last_slTszBaseScheduler.get_last_slcCs|jstdt)NzUTo get the last sparsity level computed by the scheduler, please use `get_last_sl()`.)r/warningswarnNotImplementedErrorr7r r r get_slXs zBaseScheduler.get_slNcCsP|r&|durtd|d|dddStd|dd|d|dddSdS) z#Display the current sparsity level.Nz"Adjusting sparsity level of group z to z.4e.zEpoch 5dz$: adjusting sparsity level of group )print)r0 is_verboser slepochr r r print_slcszBaseScheduler.print_slcCsD|jjd}|d7}|d|jd7}|d|jd7}|d7}|S)Nz ( z Sparsifier z base_sl: ))r"r(r)r+)r0 format_stringr r r __repr__ms zBaseScheduler.__repr__cCs|jdkrt|jjdstdtn |jjdkrtdt|jd7_Gddd}|||jd7_|}Wdn1sGwYt t |jj |D]\}}|\}}||d<| |j |||qUdd |jj D|_d |j_dS) NrrzSeems like `sparsifier.step()` has been overridden after sparsity scheduler initialization. Please, make sure to call `sparsifier.step()` before `scheduler.step()`.zDetected call of `scheduler.step()` before `sparsifier.step()`. You have to make sure you run the sparsifier.step() BEFORE any calls to the scheduler.step().c@s$eZdZddZddZddZdS)z/BaseScheduler.step.._enable_get_sl_callcSs ||_dSN)o)r0rMr r r r1s z8BaseScheduler.step.._enable_get_sl_call.__init__cSs d|j_|S)NTrMr/r7r r r __enter__sz9BaseScheduler.step.._enable_get_sl_call.__enter__cSs d|j_dS)NFrN)r0r'r3 tracebackr r r __exit__s z8BaseScheduler.step.._enable_get_sl_call.__exit__N)r( __module__ __qualname__r1rOrQr r r r _enable_get_sl_calls rTrcSrrr r r r r rrz&BaseScheduler.step..T)rhasattrr)r-r=r> UserWarningr,r@ enumeratezipr*rGr.r;enable_mask_update)r0rFrTvaluesidata param_grouprEr r r r-us.     zBaseScheduler.stepcCsPt|jj}t|ttfs|g|St||kr$td|dt|t|S)zPUtility that extends it to the same length as the .groups, ensuring it is a listzExpected variable of length z , but got )lenr)r*r%listtuple ValueError)r0varnr r r _make_sure_a_lists   zBaseScheduler._make_sure_a_list)rFrL) r(rRrSr1r8r:r<r@rGrKr-rdr r r r r s 3     -)r=r functoolsr+torch.ao.pruning.sparsifier.base_sparsifierr__all__rr r r r s