o EDiX@sUdZddlmZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddl mZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlm Z ddl!m"Z"e#e$e%e&e&e%ee%fZ'e(e)Z*ej+hZ,de-d<de-d<ej.d6ddZ/d7d d!Z0d8d%d&Z1Gd'd(d(Z2Gd)d*d*Z3d9d.d/Z4d:d4d5Z5dS);z$Checker Manager and Checker classes.) annotationsN) Generator)Sequence)Any)Optional)defaults) exceptions) processor)utils) FSTRING_START) TSTRING_START) expand_paths) parse_args)Checkers) LoadedPlugin)StyleGuideManagerr _mp_pluginsargparse.Namespace _mp_optionspluginsoptionsreturnGenerator[None]ccs$||aazdVWbbdSbbwN)rr)rrrG/var/www/Datamplify/venv/lib/python3.10/site-packages/flake8/checker.py _mp_prefork4s  rargv Sequence[str]NonecCsLttjtjzttfWdSty%t|\}}|j|aaYdSwr)signalSIGINTSIG_IGNrr NameErrorrcheckers)rrrrrr_mp_initAs  r%filenamestr#tuple[str, Results, dict[str, int]]cCst|ttdS)Nr&rr) FileCheckerrr run_checksr&rrr_mp_runOs r-c@steZdZdZd%d d Zd&d d Zd'ddZd(ddZd)ddZd&ddZ d&ddZ d&ddZ d&d d!Z d&d"d#Z d$S)*ManageraRManage the parallelism and checker instances for each plugin and file. This class will be responsible for the following: - Determining the parallelism of Flake8, e.g.: * Do we use :mod:`multiprocessing` or is it unavailable? * Do we automatically decide on the number of jobs to use or did the user provide that? - Falling back to a serial way of processing files if we run into an OSError related to :mod:`multiprocessing` - Organizing the results of each checker so we can group the output together and make our output deterministic. style_guiderrrrrrrcCsV||_|j|_||_||_ddddd|_g|jj|jjR|_||_g|_ dS)z Initialize our Manager instance.r)files logical linesphysical linestokensN) r/rr _job_countjobs statisticsexcludeextend_excluderresults)selfr/rrrrr__init__hs  zManager.__init__cCsP|jD]\}}}tjD] }|j|||7<q q|jdt|j7<dS)Nr0)r9rSTATISTIC_NAMESr6len filenames)r:_r6 statisticrrr_process_statistics}s  zManager._process_statisticsintcCsPt|jjrtddS|jj}|jr%zt WSt y$YdSw|j S)Nz]The --jobs option is not compatible with supplying input using - . Ignoring --jobs arguments.r) r is_using_stdinrr>LOGwarningr5is_automultiprocessing cpu_countNotImplementedErrorn_jobs)r:r5rrrr4s  zManager._job_countr&r'r9Resultsc Cs<|j}d}|D]\}}}}} ||j|||||| d7}q|S)Nr)coder& line_number column_numbertext physical_line)r/ handle_error) r:r&r9r/reported_results_count error_coderMcolumnrOrPrrr_handle_resultss zManager._handle_resultstuple[int, int]c Csd}}|jjtdd|jD]3\}}}|jtddd|j|||||7}Wdn1s9wY|t|7}q||fS)aReport all of the errors found in the managed file checkers. This iterates over each of the checkers and reports the errors sorted by line number. :returns: A tuple of the total results found and the results reported. r)keyN)r9sortoperator itemgetterr/processing_filerUr=)r:results_reported results_foundr&r9r?rrrreports zManager.reportcCst|j|jt|j|j}Wdn1swY|dur(|dSd}z#t|t |j |_ | | d}W|sL|| dSdS|sY|| ww)zRun the checkers in parallel.NFT)rrr_try_initialize_processpoolr5r run_seriallistimap_unorderedr-r>r9closejoin terminate)r:pool pool_closedrrr run_parallels&  zManager.run_parallelcsfddjD_dS)zRun the checkers in serial.cs"g|] }t|jjdqS)r))r*rrr+).0r&r:rr sz&Manager.run_serial..N)r>r9rlrrlrrbs  zManager.run_serialcCsXz|jdkrt|jdkr|WdS|WdSty+tdt dw)a#Run all the checkers. This will intelligently decide whether to run the checks in parallel or whether to run them in serial. If running the checks in parallel causes a problem (e.g., :issue:`117`) this also implements fallback to serial processing. rXz"Flake8 was interrupted by the userzEarly quit while running checksN) r5r=r>rjrbKeyboardInterruptrDrEr EarlyQuitrlrrrruns    z Manager.runcCsFtdtt|jj|jj|jj|jd|_t t |j|j |_ dS)zStart checking files. :param paths: Path names to check. This is passed directly to :meth:`~Manager.make_checkers`. zMaking checkers)pathsstdin_display_namefilename_patternsr7N) rDinfotupler rr>rrr&r7minr=r5rlrrrstarts z Manager.startcCs |dS)zStop checking files.N)rArlrrrstop z Manager.stopN)r/rrrrrrrrr)rrB)r&r'r9rKrrB)rrV)__name__ __module__ __qualname____doc__r;rAr4rUr`rjrbrprwrxrrrrr.Us        r.c@seZdZdZd9d d Zd:d d Zd;ddZdd"d#Z d?d$d%Z d?d&d'Z d@d)d*Z d?d+d,ZdAd.d/ZdBd1d2ZdCd6d7Zd8S)Dr*z;Manage running checks for a file and aggregate the results.r&r'rrrrrrcCsx||_||_||_g|_dddd|_||_||_d|_|jdur:|jj|_|j |_t |jj |jd<dSdS)zInitialize our file checker.r)r3r1r2FNr2) rr&rr9r6_make_processorr display_nameshould_processshould_ignore_filer=lines)r:r&rrrrrr; s    zFileChecker.__init__cCs d|jS)z)Provide helpful debugging representation.zFileChecker for r,rlrrr__repr__%ryzFileChecker.__repr__processor.FileProcessor | Nonec CsZz t|j|jWSty,}z|dddt|jd|WYd}~dSd}~ww)NE902r: )r FileProcessorr&rOSErrorr`typer{)r:errrr)s zFileChecker._make_processorrS str | NonerMrBrTrOcCsX|dur |dd\}}t|dr|jdur|j|}nd}|j|||||f|S)z2Report an error by storing it in the results list.N rXr )splithasattrr noqa_line_forr9append)r:rSrMrTrOlinerrrr`6szFileChecker.reportpluginr argumentsrc Ks|jdus J|jz |j|j|}Wnty(}ztj|j|dd}~wwz |jdi||WSt yS}zt j d|jddtj |j|j|dd}~ww)z!Run the check in a single plugin.N) plugin_name exceptionz(Plugin %s raised an unexpected exceptionT)exc_info)r&rrr) r r&keyword_arguments_for parametersAttributeErrorr PluginRequestedUnknownParametersrobj ExceptionrDcriticalPluginExecutionFailed)r:rrparamsaeall_excrrr run_checkKs4zFileChecker.run_checkrrrVc Cst|jdkr#|jdr#t|jddkr#|jd}|dd\}}n&t|tjrCt|jdkrCt|jddkrCd}|jd\}}nd}d\}}|dkr|rt|trt|dkrd}d}|d}|dur|dd}t|d}|d}t|} || kr| }||8}||8}||fS) NrXrYr)rXrr )r=args isinstancetokenize TokenError SyntaxErrorrstripr) rtokenrowrT column_offset row_offsetrPr logical_linelogical_line_lengthrrr_extract_syntax_informationdsB     z'FileChecker._extract_syntax_informationc Cs|jdus J|j|j}|jjD]-}|j||d}z|}Wn ty-|}Ynw|D]\}}}}|jd|||dq0qdS)z1Run all checks expecting an abstract syntax tree.N)treerSrMrTrO) r r& build_astrrrrprr`) r:astrcheckerrunnerrMoffsetrOr?rrrrun_ast_checkss$    zFileChecker.run_ast_checksc Cs|jdusJ|j\}}}|sdS|j|td||jjD]:}|j||j ||dp5d}|D]&\}}t ||\}} || krMdkrUnnt d||j d|| |dq8q%|j dS)z(Run all checks expecting a logical line.NzLogical line: "%s")rrrz#position of error out of bounds: %sr)r build_logical_line update_staterDdebugrrrupdate_checker_state_forr find_offsetrEr`next_logical_line) r:commentsrmappingrr9rrOrMrrrrrun_logical_checkss*      zFileChecker.run_logical_checksrPc Cs|jdusJ|jjD]C}|j||j||d}|durNd}z|d}Wn ttfy1Ynwt|tr:|f}|D]}|\}}|j d|jj ||dqsT                    5 B