o ;DiB@s&ddlmZmZmZddlmZmZmZmZddl m Z ddl m Z m Z ddlmZmZmZmZddlmZddZee_d d Zee_d d Zee_d dZee_ddZee_d$ddZee_GdddeZddZddZddZddZee_ddZ e e_ d d!Z!e!e_!d"d#Z"e"e_"dS)%)absolute_importprint_functiondivision)next integer_types string_types text_typeN) ArgumentErrorFieldSelectionError)Tableexpr fieldnamesRecord) numparsercOsd}t|dkr n>t|dkr|d}n3t|dkrGt}|d}t|dkr,|d}n|dd}t|ttfrC|D]}|||<q;n|||<t||fi|S)aTransform values under one or more fields via arbitrary functions, method invocations or dictionary translations. E.g.:: >>> import petl as etl >>> table1 = [['foo', 'bar', 'baz'], ... ['A', '2.4', 12], ... ['B', '5.7', 34], ... ['C', '1.2', 56]] >>> # using a built-in function: ... table2 = etl.convert(table1, 'bar', float) >>> table2 +-----+-----+-----+ | foo | bar | baz | +=====+=====+=====+ | 'A' | 2.4 | 12 | +-----+-----+-----+ | 'B' | 5.7 | 34 | +-----+-----+-----+ | 'C' | 1.2 | 56 | +-----+-----+-----+ >>> # using a lambda function:: ... table3 = etl.convert(table1, 'baz', lambda v: v*2) >>> table3 +-----+-------+-----+ | foo | bar | baz | +=====+=======+=====+ | 'A' | '2.4' | 24 | +-----+-------+-----+ | 'B' | '5.7' | 68 | +-----+-------+-----+ | 'C' | '1.2' | 112 | +-----+-------+-----+ >>> # a method of the data value can also be invoked by passing ... # the method name ... table4 = etl.convert(table1, 'foo', 'lower') >>> table4 +-----+-------+-----+ | foo | bar | baz | +=====+=======+=====+ | 'a' | '2.4' | 12 | +-----+-------+-----+ | 'b' | '5.7' | 34 | +-----+-------+-----+ | 'c' | '1.2' | 56 | +-----+-------+-----+ >>> # arguments to the method invocation can also be given ... table5 = etl.convert(table1, 'foo', 'replace', 'A', 'AA') >>> table5 +------+-------+-----+ | foo | bar | baz | +======+=======+=====+ | 'AA' | '2.4' | 12 | +------+-------+-----+ | 'B' | '5.7' | 34 | +------+-------+-----+ | 'C' | '1.2' | 56 | +------+-------+-----+ >>> # values can also be translated via a dictionary ... table7 = etl.convert(table1, 'foo', {'A': 'Z', 'B': 'Y'}) >>> table7 +-----+-------+-----+ | foo | bar | baz | +=====+=======+=====+ | 'Z' | '2.4' | 12 | +-----+-------+-----+ | 'Y' | '5.7' | 34 | +-----+-------+-----+ | 'C' | '1.2' | 56 | +-----+-------+-----+ >>> # the same conversion can be applied to multiple fields ... table8 = etl.convert(table1, ('foo', 'bar', 'baz'), str) >>> table8 +-----+-------+------+ | foo | bar | baz | +=====+=======+======+ | 'A' | '2.4' | '12' | +-----+-------+------+ | 'B' | '5.7' | '34' | +-----+-------+------+ | 'C' | '1.2' | '56' | +-----+-------+------+ >>> # multiple conversions can be specified at the same time ... table9 = etl.convert(table1, {'foo': 'lower', ... 'bar': float, ... 'baz': lambda v: v * 2}) >>> table9 +-----+-----+-----+ | foo | bar | baz | +=====+=====+=====+ | 'a' | 2.4 | 24 | +-----+-----+-----+ | 'b' | 5.7 | 68 | +-----+-----+-----+ | 'c' | 1.2 | 112 | +-----+-----+-----+ >>> # ...or alternatively via a list ... table10 = etl.convert(table1, ['lower', float, lambda v: v*2]) >>> table10 +-----+-----+-----+ | foo | bar | baz | +=====+=====+=====+ | 'a' | 2.4 | 24 | +-----+-----+-----+ | 'b' | 5.7 | 68 | +-----+-----+-----+ | 'c' | 1.2 | 112 | +-----+-----+-----+ >>> # conversion can be conditional ... table11 = etl.convert(table1, 'baz', lambda v: v * 2, ... where=lambda r: r.foo == 'B') >>> table11 +-----+-------+-----+ | foo | bar | baz | +=====+=======+=====+ | 'A' | '2.4' | 12 | +-----+-------+-----+ | 'B' | '5.7' | 68 | +-----+-------+-----+ | 'C' | '1.2' | 56 | +-----+-------+-----+ >>> # conversion can access other values from the same row ... table12 = etl.convert(table1, 'baz', ... lambda v, row: v * float(row.bar), ... pass_row=True) >>> table12 +-----+-------+--------------------+ | foo | bar | baz | +=====+=======+====================+ | 'A' | '2.4' | 28.799999999999997 | +-----+-------+--------------------+ | 'B' | '5.7' | 193.8 | +-----+-------+--------------------+ | 'C' | '1.2' | 67.2 | +-----+-------+--------------------+ >>> # conversion can use a custom function >>> def my_func(val, row): ... return float(row.bar) + row.baz ... >>> table13 = etl.convert(table1, 'foo', my_func, pass_row=True) >>> table13 +------+-------+-----+ | foo | bar | baz | +======+=======+=====+ | 14.4 | '2.4' | 12 | +------+-------+-----+ | 39.7 | '5.7' | 34 | +------+-------+-----+ | 57.2 | '1.2' | 56 | +------+-------+-----+ Note that either field names or indexes can be given. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. The ``pass_row`` keyword argument can be given, which if True will mean that both the value and the containing row will be passed as arguments to the conversion function (so, i.e., the conversion function should accept two arguments). When multiple fields are converted in a single call, the conversions are independent of each other. Each conversion sees the original row:: >>> # multiple conversions do not affect each other ... table13 = etl.convert(table1, { ... "foo": lambda foo, row: row.bar, ... "bar": lambda bar, row: row.foo, ... }, pass_row=True) >>> table13 +-------+-----+-----+ | foo | bar | baz | +=======+=====+=====+ | '2.4' | 'A' | 12 | +-------+-----+-----+ | '5.7' | 'B' | 34 | +-------+-----+-----+ | '1.2' | 'C' | 56 | +-------+-----+-----+ Also accepts `failonerror` and `errorvalue` keyword arguments, documented under :func:`petl.config.failonerror` The ``trusted`` keyword argument can be used to specify whether the expression is trusted. See `:func:`petl.util.base.expr` for details. Nr)lendict isinstancelisttupleFieldConvertView)tableargskwargs convertersfieldconvfrS/var/www/Datamplify/venv/lib/python3.10/site-packages/petl/transform/conversions.pyconvert s$G        r!cOst|t|g|Ri|S)aT Convenience function to convert all fields in the table using a common function or mapping. See also :func:`convert`. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. )r!r )rrrrrr convertalls r"cKst||||ifi|S)aO Convenience function to replace all occurrences of `a` with `b` under the given field. See also :func:`convert`. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. r!)rrabrrrr replaces r&cKst|||ifi|S)aK Convenience function to replace all instances of `a` with `b` under all fields. See also :func:`convertall`. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. r")rr$r%rrrr replacealls r(c st||fddfi|S)z Convenience function to convert a field to a fixed value. Accepts the ``where`` keyword argument. See also :func:`convert`. csSNrvvaluerr 'szupdate..r#)rrr-rrr,r update sr/FcKst|t|fi|S)ao Convenience function to convert all field values to numbers where possible. E.g.:: >>> import petl as etl >>> table1 = [['foo', 'bar', 'baz', 'quux'], ... ['1', '3.0', '9+3j', 'aaa'], ... ['2', '1.3', '7+2j', None]] >>> table2 = etl.convertnumbers(table1) >>> table2 +-----+-----+--------+-------+ | foo | bar | baz | quux | +=====+=====+========+=======+ | 1 | 3.0 | (9+3j) | 'aaa' | +-----+-----+--------+-------+ | 2 | 1.3 | (7+2j) | None | +-----+-----+--------+-------+ )r"r)rstrictrrrr convertnumbers-sr1c@s*eZdZ  d ddZddZdd ZdS) rNFTcCs||_|dur t|_n#t|tr||_nt|ttfr)tddt|D|_ntd||dur6tj n||_ ||_ ||_ ||_ ||_ dS)NcSsg|]\}}||fqSrr.0ir+rrr Rsz-FieldConvertView.__init__..zunexpected converters: %r)sourcerrrrr enumerater config failonerror errorvaluewherepass_rowtrusted)selfr6rr9r:r;r<r=rrr __init__Js    zFieldConvertView.__init__cCs"t|j|j|j|j|j|j|jSr))iterfieldconvertr6rr9r:r;r<r=)r>rrr __iter__\szFieldConvertView.__iter__cCs||j|<dSr))r)r>keyr-rrr __setitem__`zFieldConvertView.__setitem__)NNNNFT)__name__ __module__ __qualname__r?rArCrrrr rHs   rc #st|}zt|}ttt|t|VWn ty$g}Ynwt|D]w\} } t | t sHz | } Wn t yGt | wt | tsSJd| t| r\| | <q,t | trht| | <q,t | ttfrt | dtr| d} | dd} t| g| R| <q,t | trt| | <q,| durq,td| | ffdd|rfdd} nfd d} t |trt||d }n|durt|sJd ||s|rfd d |D}|dur|D]}| |VqdS|D]}||r| |Vq|VqdS)Nzexpected integer, found %rrrz2unexpected converter specification on field %r: %rc sl|vr|Sz ||g|RWSty5}zdkr%|WYd}~Sr)|WYd}~Sd}~ww)Ninline) Exception)r4r+re)converter_functionsr:r9rr transform_valuesz)iterfieldconvert..transform_valuecstfddtDS)Nc3s |] \}}||VqdSr)rr2)_rowrLrr s:iterfieldconvert..transform_row..rr7rMrLrQr transform_rowsz'iterfieldconvert..transform_rowcstfddt|DS)Nc3s|] \}}||VqdSr)rr2rRrr rNsrOrPrQrRrr rSs )r=z0expected callable for "where" argument, found %rc3s|]}t|VqdSr))r)r3row)fldsrr rNsz#iterfieldconvert..)iterrrmaprr StopIterationritemsrrindex ValueErrorr intcallabler methodcaller dictconverterr r )r6rr9r:r;r<r=ithdrkcmethnmmethargsrSrTr)rKr:r9rUrLr r@dsl               r@csfddS)Ncst|Sr))getattrr*rnmrr r.szmethodcaller..r)rhrrrgr r^rDr^csfdd}|S)Ncs0z |vr |WS|WSty|YSwr)) TypeErrorr*drr rs  zdictconverter..convr)rkrrrjr r_s  r_c fdd}t|||fi|S)a< Convenience function to format all values in the given `field` using the `fmt` format string. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. c |Sr)formatr*fmtrr r. zformat..r#rrrqrrrrpr ro roc fdd}t||fi|S)a5 Convenience function to format all values in all fields using the `fmt` format string. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. crmr)rnr*rprr r.rrzformatall..r'rrqrrrrpr formatall rwc rl)a: Convenience function to interpolate all values in the given `field` using the `fmt` string. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. c|Sr)rr*rprr r. zinterpolate..r#rsrrpr interpolatertr{c ru)a3 Convenience function to interpolate all values in all fields using the `fmt` string. The ``where`` keyword argument can be given with a callable or expression which is evaluated on each row and which should return True if the conversion should be applied on that row, else False. cryr)rr*rprr r.rzz interpolateall..r'rvrrpr interpolateallrxr|)F)# __future__rrr petl.compatrrrr petl.configr8 petl.errorsr r petl.util.baser r r rpetl.util.parsersrr!r"r&r(r/r1rr@r^r_rorwr{r|rrrr s>  ] f