o DDic$@sUdZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z m Z ddl mZddlmZddlmZddlmZddlmZmZmZmZmZmZmZmZmZdd lm Z dd l!m"Z"m#Z#dd l$m%Z%dd l&m'Z'dd l(m)Z)ddl*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2ddl3m4Z4ddl5m6Z6dddZ7e8e9d<dee8dedefddZ:de0ddfddZ;dddee8d ed'ee8de8f d(d)Z?de7dd*dd+d,e%de8d-eee%ee%fd9e8d'e8d?ee8eCfd@ee8eCfd;ee6de%fdAdBZEd'e8dCeBdeeAeFffdDdEZGd>ee%ee%fd'e8dCeBd?ee8eCfdFeee8eCfd;ee6deAfdGdHZHGdIdJdJZIdKeAdLeIdMedMee>d-e_s   zgather_files..z*.py*) ospathisfileappendisdirextendrrglobsorted)rErDretfdr2rCr3 gather_filesQs     rXfilenameoldcodenewcodecontextrZcCs\||krdS|rtj|d|d||d|d}ntj|d|dd|d}d|S)a Given two strings representing a module before and after a codemod, produce a unified diff of the changes with ``context`` lines of context. Optionally, assign the ``filename`` to the change, and if it is not available, assume that the change was performed on stdin/stdout. If no change is detected, return an empty string instead of returning an empty unified diff. This is comparable to revision control software which only shows differences for files that have changed. r! )fromfiletofilelinetermn)rarb)difflib unified_diffsplitjoin)r[r\r]rZ difflinesr2r2r3 diff_codejs   rhr2)include_generatedgenerated_code_marker format_coder$python_version transformrirjrkrlc Cs|s||vrtdtjd|St|||d}t|tttfr dn|j}|durO|rOzt ||}Wnt yN} zd}t| t |j d}WYd} ~ nd} ~ wwt||S)a# Given an instantiated codemod and a string representing a module, transform that code by executing the transform, optionally invoking the formatter and finally printing any generated warnings to stderr. If the code includes the generated marker at any spot and ``include_generated`` is not set to ``True``, the code will not be modified. If ``format_code`` is set to ``False`` or the instantiated codemod does not modify the code, the code will not be formatted. If a ``python_version`` is provided, then we will parse the module using this version. Otherwise, we will use the version of the currently executing python binary. In all cases a module will be returned. Whether it is changed depends on the input parameters as well as the codemod itself. zMWARNING: Code is generated and we are set to ignore generated code, skipping!r6rlNr<r@r8)r9r:r;rr-rrrr%r4r, traceback format_excr8rB) rmr%rirjrkr$rlr5 maybe_codeexr2r2r3exec_transform_with_prettyprints2   rtT)frozenc@s&eZdZUeed<eed<eed<dS)ExecutionResultrZchangedtransform_resultN)__name__ __module__ __qualname__rI__annotations__boolrr2r2r2r3rvs  rvc@seZdZUdZeeed<dZeed<dZ eeed<e Z eed<dZ eed<dZ eeed <dZeeed <dZeeed <dS) ExecutionConfigr2blacklist_patternsFrkr$rjriNrl repo_rootrd)ryrzr{rrrIr|rkr}r$r#rjrirlr rrdintr2r2r2r3r~s    r~rscratch repo_managerc Cstz t||}|j}|j}Wn#ty0}ztd|d|tjdd}d}WYd}~nd}~wwt|||||dS)Nz$Failed to determine module name for : r6)rrZfull_module_namefull_package_namemetadata_manager)rnamepackage ValueErrorr9r:r;r)rrZrrmodule_name_and_packagemod_namepkg_namersr2r2r3_prepare_contexts"  r transformeroriginal_scratchcodemod_kwargscCs>t|tr|ddt||i|i|St||t|||_|S)Nr]r2)r-typerrr])rrrZrrrr2r2r3_instantiate_transformers   rconfigc Cs|jD]}t||rt|dttjd|dddSqt|d }|}Wdn1s2wY|j sN|j d|vrNt|dttj dddS|S) NFzBlacklisted by pattern .) skip_reasonskip_descriptionrZrwrxrbr'zGenerated file.) rre fullmatchrvrr BLACKLISTEDopenreadrirjencode GENERATED)rZrpatternfpr[r2r2r3_check_for_skips4     r codemod_argsc Csg}zt||}t|tr|WSt||jpd|||pi|}z(t||jdur.tt|jdntd} | | } | j } | j } | |j jWn)tyo} z| |j jt|dttjt| |ddWYd} ~ WSd} ~ ww|jr}| |kr}t|j| } || k}|jrt|| | | |j|d} n|rt|d }|| Wdn1swYd } t||t|| d dWStyt|dt|d dYSty} zt|dt| t !|d dWYd} ~ Sd} ~ ww) NrrnrF)rrr8rrYwbr!)r8r%)r8ro)"rr-rvrrrrlrrIrr.r*rSr]warningsrrrOTHERrkr4r$rdrhr?rwriterKeyboardInterruptrr,rrprq)rrZrrrrrr[transformer_instance input_tree output_treer\r*rsrwrr2r2r3_execute_transform&s           rc@seZdZUdZeed<dededdfddZd eddfd d Z d e ee fdefd dZ de dededefddZ dddZdS)Progressz ERASE_CURRENT_LINEenabledtotalr&NcCs2||_||_tt|jdd|_t|_dS)Nd)rrr+rIpretty_precisiontime started_at)selfrrr2r2r3__init__szProgress.__init__finishedc Cs|jsdS|j|}dt|t|j}tt|jd}t|j||d|d|j dd| |||d|d d t j d dS) NgY@r rfz % complete, z estimated for z files to go...r!endr7) rrfloatmaxrrr9r_human_secondsrestimate_completionr:r;)rrleftpercent elapsed_timer2r2r3r9s < zProgress.printsecondscCsht|d\}}t|d\}}|dkr |dd|dd|ddS|dkr.|dd|ddS|ddS) zt This returns a string which is a human-ish readable elapsed time such as 30.42s or 10m 31s <rz.0fzh z02.0fzm sz02.2f)divmod)rrminuteshoursr2r2r3rs zProgress._human_secondselapsed_secondsfiles_finished files_leftcCs.|dks|dkr dS||}||}||S)zp Computes a really basic estimated completion given a number of operations still to do. rz [calculating])r)rrrrfpsestimated_seconds_leftr2r2r3rs  zProgress.estimate_completioncCs |jsdSt|jdtjddS)Nr!r)rr9rr:r;)rr2r2r3clearszProgress.clear)r&N)ryrzr{rrIr|r}rrr9rrrrrr2r2r2r3rs    r exec_resultprogressrdshow_successeshide_generatedhide_blacklistedcCsJ|j}|j}t|trB|jtjur|s>|jtjur|s@|t d|t j dt |t d|d|j dt j ddSdSdSt|trf|t d|t j dt |t d|dt j ddSt|tr|sp|jr|t d|t j dt |t d||jrdndt j d|r|jrt |jdSdSdSdS) Nz Codemodding r6zSkipped codemodding rr^zFailed to codemod zSuccessfully codemodded z with warnings )rZrxr-rrrrrrr9r:r;rBrrrr8r%)rrrdrrrrZr5r2r2r3_print_parallel_resultsD         rc@s2eZdZUdZeed<eed<eed<eed<dS)ParallelTransformResulta The result of running :func:`~libcst.codemod.parallel_exec_transform_with_prettyprint` against a series of files. This is a simple summary, with counts for number of successfully codemodded files, number of files that we failed to codemod, number of warnings generated when running the codemod across the files, and the number of files that we skipped when running the codemod. successesfailuresrskipsN)ryrzr{__doc__rr|r2r2r2r3rs   r)jobsrdrirjrkr$rrr hide_progressrrlrrfilesrrrc sttr tdtddtdd|D}t|}t| |d}d}t|dur)|ntt||d |}|d kr>t d |d krJt d d d d d Sd|durit j |}td tjdt||tdtjdt||||||| | d|d ks|d krd }t}n4ttdddrd dlm}tj||d}td| durt| dntdn d dlm}tj||d}d }d }d }d }ttrtjj ni|ozafdd|D}t!|D]H}|"}t#||t$||| | d||||t|j%t&r|d 7}nt|j%t'r|d 7}n t|j%t(t)fr)|d 7}|t|j%j*7}qW|+n|+wWdn 1sHwYt ||||d S)aD Given a list of files and a codemod we should apply to them, fork and apply the codemod in parallel to all of the files, including any configured formatter. The ``jobs`` parameter controls the maximum number of in-flight transforms, and needs to be at least 1. If not included, the number of jobs will automatically be set to the number of CPU cores. If ``unified_diff`` is set to a number, changes to files will be printed to stdout with ``unified_diff`` lines of context. If it is set to ``None`` or left out, files themselves will be updated with changes and formatting. If a ``python_version`` is provided, then we will parse each source file using this version. Otherwise, we will use the version of the currently executing python binary. A progress indicator as well as any generated warnings will be printed to stderr. To supress the interactive progress indicator, set ``hide_progress`` to ``True``. Files that include the generated code marker will be skipped unless the ``include_generated`` parameter is set to ``True``. Similarly, files that match a supplied blacklist of regex patterns will be skipped. Warnings for skipping both blacklisted and generated files will be printed to stderr along with warnings generated by the codemod unless ``hide_blacklisted`` and ``hide_generated`` are set to ``True``. Files that were successfully codemodded will not be printed to stderr unless ``show_successes`` is set to ``True``. We take a :class:`~libcst.codemod._codemod.Codemod` class, or an instantiated :class:`~libcst.codemod._codemod.Codemod`. In the former case, the codemod will be instantiated for each file, with ``codemod_args`` passed in to the constructor. Passing an already instantiated :class:`~libcst.codemod._codemod.Codemod` is deprecated, because it leads to sharing of the :class:`~libcst.codemod._codemod.Codemod` instance across files, which is a common source of hard-to-track-down bugs when the :class:`~libcst.codemod._codemod.Codemod` tracks its state on the instance. zPassing transformer instances to `parallel_exec_transform_with_prettyprint` is deprecated and will break in a future version. Please pass the transformer class instead.) stacklevelcSsh|]}tj|qSr2)rNrOabspath)rKrr2r2r3 Hsz;parallel_exec_transform_with_prettyprint..)rrNrz&Must have at least one job to process!r)rrrrz!Calculating full-repo metadata...r6zExecuting codemod...)rrdrirjrkr$rrl_is_gil_enabledcSsdS)NTr2r2r2r2r3zsz:parallel_exec_transform_with_prettyprint..)ProcessPoolExecutor) max_workersr!rnr)ThreadPoolExecutorc s$g|]}jt|dqS))rrZrrrr)submitr)rKrZrrexecutorrrrmr2r3 s z.)rdrrr),r-rrDeprecationWarningrUr+rminrr,rrNrOrr9r:r;r get_inherited_dependencies resolve_cacher~rgetattrconcurrent.futuresr functoolspartialrrrrr]rrr5rr}rxrrrrr8r)rmrrrdrirjrkr$rrrrrrlrrrr chunksize pool_implrrrrrrfuturesfuturer5r2rr3(parallel_exec_transform_with_prettyprint s 3           )r)Mrrcros.pathrNrr/r:rrprrrcopyr dataclassesrmultiprocessingrpathlibrtypingrr r r r r rrrrrlibcstrrlibcst.codemod._codemodrlibcst.codemod._contextrlibcst.codemod._dummy_poolrlibcst.codemod._runnerrrrrrrrrlibcst.helpersrlibcst.metadatar r#rIr|r4rBr}rXrrhrtrvr~objectrrr.rrrrrrr2r2r2r3sv    ,    (    $ :         !  `> 0