o 8Di @sddlmZddlZddlZddlZddlZddlmZm Z ddl m Z ddl m Z ddlmZddlmZddlmZmZdd lmZmZmZmZmZmZmZdd lmZmZ dd l!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(m)Z)m*Z*ddl+m,Z,ej-e j.e j/e j0e j1e j2fZ3ej-e j.e j1e j0fZ4ej-e j5e j6fZ7ej8rddl9m:Z:m;Z;mZ>ej?ej@e;ejAe>e;ge;ffZBeCdZDdddddddddZEdMdd ZFGd!d"d"eGeZHGd#d$d$eGeZIGd%d&d&eJZKGd'd(d(eLZMGd)d*d*eMd+ZNej-eGeNej@eNdfZOdNd/d0ZPed1dOd6d7ZQ dPdQd c bdddBdCZddEdFZddHdIZddKdLZdS() annotationsN)Enumauto)reduce)exp)DIALECT_MODULE_NAMES) ParseError) Generatorunsupported_args)AutoNameflattenis_intseq_get subclassessuggest_closest_match_and_failto_bool)JSONPathTokenizerparse)Parser) TIMEZONES format_timesubsecond_precision)Token Tokenizer TokenType)new_trie)BEF) TypeAnnotatorsqlglot     \)z\az\bz\fz\nz\rz\tz\vz\\ data_typeexp.DataType.Typereturn!t.Callable[[TypeAnnotator, E], E]c fddS)Ncs ||SN)_annotate_with_typeselfer)Q/var/www/Datamplify/venv/lib/python3.10/site-packages/sqlglot/dialects/dialect.py? z+annotate_with_type_lambda..r4r3r4r3r5annotate_with_type_lambda> r8c@seZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZ dZ!d Z"d!S)"DialectszDialects supported by SQLGLot.athenabigquery clickhouse databricksdorisdremiodrilldruidduckdbdunefabrichive materializemysqloraclepostgresprestoprqlredshift risingwave snowflakesparkspark2sqlite starrockstableauteradatatrinotsqlexasolN)#__name__ __module__ __qualname____doc__DIALECTATHENABIGQUERY CLICKHOUSE DATABRICKSDORISDREMIODRILLDRUIDDUCKDBDUNEFABRICHIVE MATERIALIZEMYSQLORACLEPOSTGRESPRESTOPRQLREDSHIFT RISINGWAVE SNOWFLAKESPARKSPARK2SQLITE STARROCKSTABLEAUTERADATATRINOTSQLEXASOLr4r4r4r5r:BsBr:c@s6eZdZdZeZ eZ eZ eZ eZ dS)NormalizationStrategyzKSpecifies the strategy according to which identifiers should be normalized.N) rZr[r\r]r LOWERCASE UPPERCASECASE_SENSITIVECASE_INSENSITIVECASE_INSENSITIVE_UPPERCASEr4r4r4r5r}gsr}cseZdZdfdd ZZS)Version version_strt.Optional[str]csX|r |d}|dgdt|tddd|D}ntj}tt| ||S)N.0r;cSsg|]}|dqS)r)zfill).0pr4r4r5 z#Version.__new__..) splitextendlenintjoinsysmaxsizesuperr__new__)clsrargskwargspartsv __class__r4r5r{s  zVersion.__new__)rr)rZr[r\r __classcell__r4r4rr5rzsrcsxeZdZUiZded<dddZdd d Zed d Ze d ddZ e d!ddZ e d"d#ddZ fddZ ZS)$_Dialectzt.Dict[str, t.Type[Dialect]]_classesothert.Anyr+boolcCs>||urdSt|tr|||uSt|tr|t|uSdS)NTF) isinstancestrgetDialecttype)rrr4r4r5__eq__s   z_Dialect.__eq__rcCst|jSr.)hashrZlower)rr4r4r5__hash__z_Dialect.__hash__cCs,ttt|jkrtD]}||q |jSr.)rrr _try_loadrkeyr4r4r5classess z_Dialect.classesrstr | DialectsNonecCs0t|tr|j}|tvrtd|dSdS)Nzsqlglot.dialects.)rr:valuer importlib import_modulerr4r4r5rs z_Dialect._try_loadrt.Type[Dialect]cCs||jvr |||j|Sr.)rrrr4r4r5 __getitem__s   z_Dialect.__getitem__Ndefaultt.Optional[t.Type[Dialect]]cCs"||jvr |||j||Sr.)rrr)rrrr4r4r5rs  z _Dialect.getc st||||tj|}|j|dur|jn|<t j _ j r-t j nj _ ddj D_t j_ddj D_t j_ddjD_t|d}t|dtf}t|dtf}t|dtf}t|d tf} jd td |i_jd td |i_jd td |i_jd td | i_ t!jj"d\_#_$t!jj%d\_&_'dfdd } | t(j)\_*_+| t(j,\_-_.| t(j/\_0_1| t(j2\_3_4djj5vrit6j6_6ddj6D_7djj8v_9|dvr dj _:|dvr-dj _;dj _<|dvrHj j=>} dD] } | ?| dq:| j _=|dvrajj@t(jAhBj_@jjBt(jAhBj_B|dvrjdj _CjDszjjBt(jEt(jFhBj_BS) NcSi|]\}}||qSr4r4rkrr4r4r5 rz$_Dialect.__new__..cSrr4r4rr4r4r5rrcSrr4r4rr4r4r5rs rtokenizer_classjsonpath_tokenizer_class parser_classgenerator_classrrrr token_typerr+)t.Tuple[t.Optional[str], t.Optional[str]]cs tfddjjDdS)Nc3s(|]\}\}}|kr||fVqdSr.r4)rsr2trr4r5 s z:_Dialect.__new__..get_start_end..NN)nextr_FORMAT_STRINGSitemsrklassrr5 get_start_ends   z'_Dialect.__new__..get_start_endr(cSrr4r4rr4r4r5rrz(+))r;r=r4)r;r<rLrWrDF)r;r?rGrQrR)cluster distributesort)r;r@rI)r;r?rJrNrPrQ)rrr+r)Grrr: __members__rupperrrrr TIME_MAPPING TIME_TRIEFORMAT_MAPPING FORMAT_TRIErINVERSE_TIME_MAPPINGINVERSE_TIME_TRIEINVERSE_FORMAT_MAPPINGINVERSE_FORMAT_TRIECREATABLE_KIND_MAPPINGINVERSE_CREATABLE_KIND_MAPPINGrgetattrrrrr __dict__rrrrrlist_QUOTES QUOTE_START QUOTE_END _IDENTIFIERSIDENTIFIER_STARTIDENTIFIER_ENDr BIT_STRING BIT_STARTBIT_END HEX_STRING HEX_STARTHEX_END BYTE_STRING BYTE_STARTBYTE_ENDUNICODE_STRING UNICODE_START UNICODE_ENDSTRING_ESCAPESUNESCAPED_SEQUENCESESCAPED_SEQUENCESKEYWORDSSUPPORTS_COLUMN_JOIN_MARKS SELECT_KINDS TRY_SUPPORTEDSUPPORTS_UESCAPE AFTER_HAVING_MODIFIER_TRANSFORMScopypop ID_VAR_TOKENS STRAIGHT_JOINTABLE_ALIAS_TOKENSSUPPORTS_DECODE_CASESUPPORTS_SEMI_ANTI_JOINANTISEMI) rclsnamebasesattrsenumbasebase_tokenizerbase_jsonpath_tokenizer base_parserbase_generatorrmodifier_transformsmodifierrrr5rs                  z_Dialect.__new__rrr+rr+r)rrr+r)rrr+rr.)rrrrr+r)rZr[r\r__annotations__rrpropertyr classmethodrrrrrr4r4rr5rs      rc/@s eZdZUdZ dZ dZ dZ dZ ej Z dZ dZ dZ dZ dZ dZ dZ dZded< dZded< dZd ed < d Z dZ dZ dZ dZ d Zd ZdZiZded< iZded< iZ ded< e!Z"ded< dZ# dZ dZ$ dZ% dZ& dZ' dZ( dZ) dZ* dZ+d ed< dZ, dZ- dZ. dZ/ded< dZ0 e1j2de1j3de1j4diZ5ded< iZ6ded< dZ7e8Z9e:Z;eZ?iZ@ded<iZAded<iZBded<iZCded<iZDded <iZEded!<iZFded"<iZGded#<d$ZHd$ZId%ZJd%ZKd&ZLd'ed(<d&ZMd'ed)<d&ZNd'ed*<d&ZOd'ed+<d&ZPd'ed,<d&ZQd'ed-<d&ZRd'ed.<d&ZSd'ed/<id0d1d2d1d3d1d4d1d5d1d6d1d7d1d8d9d:d9d;d9dd?d>d@d>dAd>dBdCdDdCidEdCdFdCdGdHdIdHdJdHdKdLdMdLdNdLdOdPdQdPdRdPdSdPdTdPdUdVdWdVdXdVdYdZid[dZd\dZd]dZd^d_d`d_dad_dbd_dcd_dddedfdedgdedhdedidedjdkdldkdmdkdndkidodpdqdpdrdpdsdpdtdpdudpdvdpdwdpdxdpdydzd{dzd|dzd}dzd~dzddzddzddzidddddddddddddddddddddddddddddddddddddddddZTe1jUjVjWe1jXe1jYe1jZe1j[e1j\e1j]e1j^he1jUjVj_e1j`he1jUjVjae1jbe1jce1jde1jee1jfe1jge1jhe1jihe1jUjVjje1jke1jle1jme1jne1joe1jpe1jqe1jrhe1jUjVjse1jte1jue1jve1jwhe1jUjVjxe1jye1jze1j{e1j|e1j}e1j~e1je1je1je1je1je1je1je1je1je1jhe1jUjVje1je1je1je1je1je1je1je1je1je1jh e1jUjVje1je1jhe1jUjVje1jhe1jUjVje1je1je1je1jhe1jUjVje1jhe1jUjVje1je1je1je1je1je1jhe1jUjVje1je1je1je1je1jhe1jUjVje1je1je1je1je1je1je1je1je1je1je1je1je1je1je1je1je1je1je1je1jhiZded<iddee1je1je1jfDddee1je1jƃDdde ǡDie1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jUddie1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jddie1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jdde1jddZded<iZded<ddhZed$ddZed%ddZd&ddZd'ddZd(ddZd)ddZd*ddZd+d,ddZd-d.ddZd/ddZd0ddZd1dd Zd-d2d d Zd3ddZ d4ddZ d5ddZ d6ddZ d7ddZ d8ddZd9d"d#Zd&S(:rrFTrz bool | strNORMALIZE_FUNCTIONSrPRESERVE_ORIGINAL_NAMESzt.Optional[bool]LOG_BASE_FIRSTnulls_are_smallz '%Y-%m-%d'z'%Y%m%d'z'%Y-%m-%d %H:%M:%S'zt.Dict[str, str]rrrz t.Set[str] PSEUDOCOLUMNSARRAY_AGG_INCLUDES_NULLSHEX_STRING_IS_INTEGER_TYPEz0t.Dict[t.Type[exp.Expression], t.Optional[bool]]SET_OP_DISTINCT_BY_DEFAULTzdict[str, str]rzt.Dictrrrrrrrr'"NrrrrrrrrrYYEARYYYYYYYYYYRYEARSYRSMMMONTHMONMONSMONTHSDDAYDDDAYS DAYOFMONTHz DAY OF WEEK DAYOFWEEKWEEKDAYDOWDW WEEKDAY_ISO DAYOFWEEKISODOW_ISODW_ISOz DAY OF YEAR DAYOFYEARDOYDYWWEEKWK WEEKOFYEARWOYWYWEEK_ISOWEEKISO WEEKOFYEARISOWEEKOFYEAR_ISOQQUARTERQTRQTRSQUARTERSHHOURHHHRHOURSHRSMMINUTEMIMINMINUTESMINSSSECONDSECSECONDSSECSMS MILLISECONDMSECMSECSMSECONDMSECONDSMILLISEC MILLISECS MILLISECON MILLISECONDSUS MICROSECONDUSECUSECSMICROSEC MICROSECSUSECONDUSECONDS MICROSECONDSNS NANOSECONDNSECNANOSECNSECONDNSECONDSNANOSECS EPOCH_SECONDEPOCH EPOCH_SECONDSEPOCH_MILLISECONDSEPOCH_MILLISECONDEPOCH_MICROSECONDSEPOCH_MICROSECONDEPOCH_NANOSECONDSEPOCH_NANOSECONDTZH TIMEZONE_HOURTZMTIMEZONE_MINUTEDECDECADEDECSDECADESMIL MILLENIUMCENTURY)MILSMILLENIACCENTCENTS CENTURIESz8t.Dict[exp.DataType.Type, t.Set[t.Type[exp.Expression]]]TYPE_TO_EXPRESSIONScCi|]}|ddqS)cS ||Sr.)_annotate_unaryr0r4r4r5r6 Dialect..r4r expr_typer4r4r5rzDialect.cCr)cSrr.)_annotate_binaryr0r4r4r5r6rrr4rr4r4r5rrcCs$i|]\}}|D]}|t|qqSr4)r8)rr) expressionsrr4r4r5r scC ||dSNthis_annotate_by_argsr0r4r4r5r6r7zDialect.cC||tjjjSr.r/rDataTypeTypeUNKNOWNr0r4r4r5r6cC|j|dddS)NrTarrayrr0r4r4r5r6cCrrrr0r4r4r5r6r7cCr)NrTrrr0r4r4r5r6rcC||ddSNrrrr0r4r4r5r6cCrrrr0r4r4r5r6r7cCrr._annotate_by_array_elementr0r4r4r5r6rcCrr.rr0r4r4r5r6rcCrrrr0r4r4r5r6r7cCrrrr0r4r4r5r6r7cCrr.)_annotate_bracketr0r4r4r5r6rcC|||jdSNtor/rr0r4r4r5r6rcCr)Nrifsrr0r4r4r5r6rcCrrrr0r4r4r5r6rcC*|||jdrtjjjStjjjS)Nbig_int)r/rrrrrBIGINTINTr0r4r4r5r6s cCs|||Sr.)r/rr0r4r4r5r6 rcCrr._annotate_timeunitr0r4r4r5r6!rcCrr.rr0r4r4r5r6"rcCrr.rr0r4r4r5r6#rcCr)Nrrr0r4r4r5r6$r7cCrr.) _annotate_divr0r4r4r5r6%rcCrr.) _annotate_dotr0r4r4r5r6&rcCrr.)_annotate_exploder0r4r4r5r6'rcCrr.)_annotate_extractr0r4r4r5r6(rcCrrrr0r4r4r5r6)r7cCs|j|dddddS)NstartendstepTrrr0r4r4r5r6*s cC||tjdS)Nz ARRAYr/rrbuildr0r4r4r5r6- cCr)NzARRAYrr0r4r4r5r60rcCrrrr0r4r4r5r63rcCrNtruefalserr0r4r4r5r64rcCrrrr0r4r4r5r65rcCrr.)_annotate_literalr0r4r4r5r66rcCrrrr0r4r4r5r67r7cCrr. _annotate_mapr0r4r4r5r68rcCrrrr0r4r4r5r69rcCrrrr0r4r4r5r6:rcCrr.)r/rrrNULLr0r4r4r5r6;rcCr)Nr expressionrr0r4r4r5r6<rcCr)Nrrr0r4r4r5r6=r7cCrr.rr0r4r4r5r6>rcCrr.)_annotate_structr0r4r4r5r6?rcCs|j|ddddS)NrrT)promoterr0r4r4r5r6@rcCrrrr0r4r4r5r6Ar7cCr)Nwith_tz)r/rrrrr TIMESTAMPTZ TIMESTAMPr0r4r4r5r6Bs cCrr.)_annotate_to_mapr0r4r4r5r6FrcCrrrr0r4r4r5r6GrcCrr.)_annotate_unnestr0r4r4r5r6HrcCrr.rr0r4r4r5r6IrcCrrrr0r4r4r5r6Jr7AnnotatorsType ANNOTATORSz3t.Dict[exp.DataType.Type, t.Set[exp.DataType.Type]] COERCES_TOnormalization_strategyversiondialect DialectTyper+c Cs|s|St|tr |St|tr|St|trz:|d^}}dd|D}i}|D]%}|d}d}t|dkr?d}n t|dkrK|d}t|||<q,Wntybtd |d w| |} | stt d |t t | duszJ| di|Std |d t |d)az Look up a dialect in the global dialect registry and return it if it exists. Args: dialect: The target dialect. If this is a string, it can be optionally followed by additional key-value pairs that are separated by commas and are used to specify dialect settings, such as whether the dialect's identifiers are case-sensitive. Example: >>> dialect = dialect_class = get_or_raise("duckdb") >>> dialect = get_or_raise("mysql, normalization_strategy = case_sensitive") Returns: The corresponding Dialect instance. ,css|]}|dVqdS)=N)r)rkvr4r4r5rqsz'Dialect.get_or_raise..rNTzInvalid dialect format: 'z@'. Please use the correct format: 'dialect [, k1 = v2 [, ...]]'.rzInvalid dialect type for 'z': 'z'.r4)rrrrrstriprr ValueErrorrrrrr) rr dialect_name kv_stringskv_pairsrpairrrresultr4r4r5 get_or_raiseVs>          zDialect.get_or_raiser t.Optional[str | exp.Expression]t.Optional[exp.Expression]cCsRt|trtjt|dd|j|jS|r'|jr'tjt|j |j|jS|S)zRConverts a time format in this dialect to its equivalent Python `strftime` format.r) rrrLiteralstringrrr is_stringr)rrr4r4r5rs  zDialect.format_timercKsjt|dd|_|dd}|dur|j|_nt||_||_||j D] }t d||j q)dS)Nrrsetting) rrrNORMALIZATION_STRATEGYrr}rsettingskeysSUPPORTED_SETTINGSr)r1rrunsupported_settingr4r4r5__init__s  zDialect.__init__rrcCs t||kSr.)r)r1rr4r4r5r zDialect.__eq__rcCs tt|Sr.)rrr1r4r4r5rrzDialect.__hash__rcCsft|tjr1|jtjur1|jr|jtjtjfvr1|jtj tjfvr&|j n|j }| d||S)a Transforms an identifier in a way that resembles how it'd be resolved by this dialect. For example, an identifier like `FoO` would be resolved as `foo` in Postgres, because it lowercases all unquoted identifiers. On the other hand, Snowflake uppercases them, so it would resolve it as `FOO`. If it was quoted, it'd need to be treated as case-sensitive, and so any normalization would be prohibited in order to avoid "breaking" the identifier. There are also dialects like Spark, which are case-insensitive even when quotes are present, and dialects like MySQL, whose resolution rules match those employed by the underlying operating system, for example they may always be case-sensitive in Linux. Finally, the normalization behavior of some engines can even be controlled through flags, like in Redshift's case, where users can explicitly set enable_case_sensitive_identifier. SQLGlot aims to understand and handle all of these different behaviors gracefully, so that it can analyze queries in the optimizer and successfully capture their semantics. r)rr Identifierrr}rquotedrrrrrrset)r1r normalizedr4r4r5normalize_identifiers(     zDialect.normalize_identifiertextrcs>|jtjurdS|jtjurtjntjtfdd|DS)zTChecks if text contains any case sensitive characters, based on the dialect's rules.Fc3s|]}|VqdSr.r4)rcharunsafer4r5rsz)Dialect.case_sensitive..)rr}rrrislowerisupperany)r1rr4rr5case_sensitives  zDialect.case_sensitivesafeidentify str | boolcCs,|dus|dkr dS|dkr|| SdS)agChecks if text can be identified given an identify option. Args: text: The text to check. identify: `"always"` or `True`: Always returns `True`. `"safe"`: Only returns `True` if the identifier is case-insensitive. Returns: Whether the given text can be identified. TalwaysrF)r)r1rrr4r4r5 can_identifys   zDialect.can_identifycCsHt|tjr"t|jtjs"|j}|d|p ||p tj | |S)as Adds quotes to a given identifier. Args: expression: The expression of interest. If it's not an `Identifier`, this method is a no-op. identify: If set to `False`, the quotes will only be added if the identifier is deemed "unsafe", with respect to its characters and this dialect's normalization strategy. r) rrrparentFuncrrrSAFE_IDENTIFIER_REmatch)r1rrnamer4r4r5quote_identifiers zDialect.quote_identifierpathc Cst|tjr@|j}|jrd|d}zt||WSty?}z|jr4t dt |WYd}~|SWYd}~|Sd}~ww|S)N[]zInvalid JSON path syntax. ) rrrr is_numberparse_json_pathrSTRICT_JSON_PATH_SYNTAXloggerwarningr)r1r path_textr2r4r4r5 to_json_paths    zDialect.to_json_pathsql"t.List[t.Optional[exp.Expression]]cKs|jdi||||SNr4)parserrtokenizer1roptsr4r4r5rz Dialect.parseexpression_type exp.IntoTypecKs |jdi|||||Sr)r parse_intor)r1r#rr!r4r4r5r%"s zDialect.parse_intoexp.ExpressionrcKs|jdi|j||dS)N)rr4) generatorgenerate)r1rrr!r4r4r5r('zDialect.generate t.List[str]c sfdd|DS)Ncs*g|]}|rj|fddindqS)rFr;)r()rrr!r1r4r5r+sz%Dialect.transpile..)rr r4r+r5 transpile*s zDialect.transpile t.List[Token]cKs|jdi||Sr) tokenizerrr r4r4r5r0zDialect.tokenizercK|jdid|i|SNrr4)rr1r!r4r4r5r.3zDialect.tokenizerrcKr0r1)rr2r4r4r5jsonpath_tokenizer6r3zDialect.jsonpath_tokenizerrcKr0r1)rr2r4r4r5r9r3zDialect.parserr cKr0r1)rr2r4r4r5r'<r3zDialect.generator exp.Valuest.List[exp.Identifier]cCsddt|jdjDS)NcSs g|] \}}td|qS)_col_)r to_identifier)ri_r4r4r5r@sz3Dialect.generate_values_aliases..r) enumeraterr1rr4r4r5generate_values_aliases?szDialect.generate_values_aliases)rrr+r)rrr+r)r+rrr)rrr+r)rrr+r)r)rrrrr+rT)rrrrr+r)rrr+r)rrr+r)r#r$rrr+r)rr&rrr+r)rrr+r*)rrr+r-)r+r)r+r)r+r)r+r )rr5r+r6(rZr[r\ INDEX_OFFSET WEEK_OFFSETUNNEST_COLUMN_ONLYALIAS_POST_TABLESAMPLETABLESAMPLE_SIZE_IS_PERCENTr}r~r IDENTIFIERS_CAN_START_WITH_DIGITDPIPE_IS_STRING_CONCATSTRICT_STRING_CONCATSUPPORTS_USER_DEFINED_TYPESrrCOPY_PARAMS_ARE_CSVrrrr NULL_ORDERINGTYPED_DIVISION SAFE_DIVISIONCONCAT_COALESCE HEX_LOWERCASE DATE_FORMATDATEINT_FORMAT TIME_FORMATrrrrrPREFER_CTE_ALIAS_COLUMNFORCE_EARLY_ALIAS_REF_EXPANSION(EXPAND_ALIAS_REFS_EARLY_ONLY_IN_GROUP_BYSUPPORTS_ORDER_BY_ALLHAS_DISTINCT_ARRAY_CONSTRUCTORSSUPPORTS_FIXED_SIZE_ARRAYSrON_CONDITION_EMPTY_BEFORE_ERRORr!PROMOTE_TO_INFERRED_DATETIME_TYPESUPPORTS_VALUES_DEFAULT#NUMBERS_CAN_BE_UNDERSCORE_SEPARATEDrREGEXP_EXTRACT_DEFAULT_GROUPrExcept IntersectUnionrr(ALTER_TABLE_ADD_REQUIRED_FOR_EACH_COLUMNrrrrrrr rrrrrrrrrrrrrrrrrrrrrDATE_PART_MAPPINGrrrApproxDistinct ArraySizeCountIfInt64LengthUnixDate UnixSecondsBINARY FromBase64BOOLEANBetweenBooleanEndsWithIn LogicalAnd LogicalOr RegexpLike StartsWithDATE CurrentDateDate DateFromParts DateStrToDateDiToDate StrToDate TimeStrToDate TsOrDsToDateDATETIMECurrentDatetimeDatetime DatetimeAdd DatetimeSubDOUBLEApproxQuantileAvgExpLnLogPowQuantileRound SafeDivideSqrtStddev StddevPop StddevSampToDoubleVariance VariancePoprCeil DatetimeDiffDateDiff TimestampDiffTimeDiffDateToDi LevenshteinSign StrPosition TsOrDiToDiINTERVALInterval MakeIntervalJSON ParseJSONTIME CurrentTimeTimeTimeAddTimeSubrCurrentTimestampLTZrCurrentTimestamp StrToTime TimeStrToTime TimestampAdd TimestampSub UnixToTimeTINYINTDayMonthWeekYearQuarterVARCHAR ArrayConcat ArrayToStringConcatConcatWsChr DateToDateStrDPipe GroupConcatInitcapLower SubstringString TimeToStr TimeToTimeStrTrimToBase64TsOrDsToDateStr UnixToStr UnixToTimeStrUpperrrUnaryAliasBinaryrAbs AnonymousArrayAnyValueArrayAggArrayConcatAgg ArrayFirst ArrayLast ArrayReverse ArraySliceBracketCastCaseCoalesceCountDateAddDateSub DateTruncDistinctDivDotExplodeExtractFilterGenerateSeriesGenerateDateArrayGenerateTimestampArrayGreatestIfLeastr LastValueMapMaxMinNullNullif PropertyEQSliceStructSum SortArray TimestampToMapTryCastUnnestVarMapWindowrrrrrrrrrrrr rrrr%r(r,rr.r4rr'r=r4r4r4r5rsV                                 !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUV_     |                    ! " # $ % & ' ( ) * - 0 3 4 5 6 7 8 9 : ; < = > ? @ A B F G H I J N7  ,  r) metaclassrr,t.Callable[[Generator, exp.Expression], str]cr-)Ncs|jgt|jRSr.)funcr rvaluesr<rr4r5r6Jszrename_func..r4rr4rr5 rename_funcIr9raccuracyr1r rexp.ApproxDistinctcC|d|jS)NAPPROX_COUNT_DISTINCTrrr<r4r4r5approx_count_distinct_sqlMsrIF false_value t.Optional[exp.Expression | str]$t.Callable[[Generator, exp.If], str]cd fdd }|S) Nr1r rexp.Ifr+rcs&||j|jd|jdpSrrrrrr<rrr4r5_if_sqlUs  zif_sql.._if_sql)r1r rr r+rr4)rrrr4r r5if_sqlRsrJSON_EXTRACT_TYPEcCsT|j}|jrt|tjr|jr|t|tjj j | |t|tj r'dSdS)Nz->z->>) r!JSON_TYPE_REQUIRED_FOR_EXTRACTIONrrrrreplacecastrrrbinary JSONExtract)r1rrr4r4r5arrow_json_extract_sql`sr exp.ArraycCsd|j|ddddddS)NrT)dynamicnew_line skip_first skip_lastrrr<r4r4r5inline_array_sqlhsrcCs:t|jd}t|tjr|tjr|d|St||S)NrARRAY) rrrr ExpressionfindQueryrr)r1relemr4r4r5inline_array_unless_queryls   r# exp.ILikecCs(|tjtj|jdtj|jddS)Nrrr)like_sqlrLikerrrr<r4r4r5 no_ilike_sqlss r)exp.CurrentDatecCs||d}|r d|SdS)NrzCURRENT_DATE AT TIME ZONE CURRENT_DATEr)r1rzoner4r4r5no_paren_current_date_sql{s r.exp.WithcCs*|jdr|dd|jd<||S)N recursivezRecursive CTEs are unsupportedF)rr unsupportedwith_sqlr<r4r4r5no_recursive_cte_sqls    r3exp.TableSamplecCs|d||jS)NzTABLESAMPLE unsupported)r1rrr<r4r4r5no_tablesample_sqls  r5 exp.PivotcC|ddS)NzPIVOT unsupportedr;r1r<r4r4r5 no_pivot_sql r9 exp.TryCastcCrr.)cast_sqlr<r4r4r5no_trycast_sqls r=exp.CommentColumnConstraintcCr7)Nz#CommentColumnConstraint unsupportedr;r8r<r4r4r5 no_comment_column_constraint_sqls r?exp.MapFromEntriescCr7)NzMAP_FROM_ENTRIES unsupportedr;r8r<r4r4r5no_map_from_entries_sqlr:rA exp.PropertycCs |j|ddd||dS)NT) string_keyrr) property_namerr<r4r4r5 property_sql rESTRPOSFTexp.StrPosition func_namesupports_positionrsupports_occurrenceuse_ansi_positioncCs2|j}|jd}|jd}|jd} tjd} tjd} |r+| r+|r+|s+| }|o/| } | r9tj||d}|dkrM|rMtj|tj||dgd } n,|d vrU||gn||g}|r`| || rr|rj| | n| |d tj||d } | rtj | || d }tj | | | |d }||S|| S)Nsubstrposition occurrencerrrrPOSITION)rfieldrr)LOCATE CHARINDEXz+ does not support the occurrence parameter.r&)rrr)rrrrrnumberrrrnappendr1Subreqr)r1rrIrJrKrLrrMrNrOzeroonetranspile_positionrrfunc_with_offset func_wrappedr4r4r5strposition_sqls4           r_exp.StructExtractcCs&||dd|t|jjS)Nrr)rrr8rrr<r4r4r5struct_extract_sqls$raMAPexp.Map | exp.VarMap map_func_namecCs|jd}|jd}t|tjrt|tjs$|d||||Sg}t|j|jD]\}}| | || | |q-|j|g|RS)Nrrz&Cannot convert array columns into map.) rrrrrr1rziprrWr)r1rrdrrrrrr4r4r5 var_map_sqls   rf exp_class t.Type[E]rrt.Optional[bool | str]t.Callable[[t.List], E]csdfdd }|S)a-Helper used for time expressions. Args: exp_class: the expression class to instantiate. dialect: target sql dialect. default: the default format, True being time. Returns: A callable that can be used to return the appropriately formatted time expression. rt.ListcsBt|dtt|dpdurtjdSpddS)NrrT)rformat)rrrrPrrrrgr4r5_builders z&build_formatted_time.._builderN)rrkr4)rgrrror4rnr5build_formatted_times rprGt.Callable[[Generator, exp.UnixToStr | exp.StrToUnix], t.Optional[str]]cd fdd }|S) Nr1r rexp.UnixToStr | exp.StrToUnixr+rcs"||}|tjkr|SdS)z Returns the time format for a given expression, unless it's equivalent to the default time format of the dialect of interest. N)rrrrP)r1r time_formatrr4r5 _time_formats z!time_format.._time_format)r1r rrsr+rr4)rrvr4rur5rtsrtr. unit_mappingt.Optional[t.Dict[str, str]] default_unitrsupports_timezonecsdfdd }|S)Nrrkr+rcst|dk}t|dk}|r|dnt|d}d}|sr:|r#|dntj}r8t|j|jn|}|t|d|d}rP|rP| d|d|S) Nrrrrrrunitr-r) rrrrrvarrrrr)r unit_based has_timezonerr}rryrgrzrwr4r5ros  "z"build_date_delta.._builder)rrkr+rr4)rgrwryrzror4rr5build_date_deltas rexpression_class#t.Callable[[t.List], t.Optional[E]]csdfdd }|S)Nrrkr+ t.Optional[E]csLt|dkrdS|d}t|tjstd|d|d|jt|dS)Nrrz&INTERVAL expression expected but got 'rrr|)rrrrrr unit_to_str)rintervalrr4r5ro)s  z0build_date_delta_with_interval.._builder)rrkr+rr4)rror4rr5build_date_delta_with_interval&s rrrk"exp.DateTrunc | exp.TimestampTrunccCsFt|d}t|d}t|tjr|drtj||dStj||dS)Nrrdate)r}rrr})rrrris_typerTimestampTrunc)rr}rr4r4r5date_trunc_to_time7s  rkindcr ) Nr1r rr&r+rc sB||d}tj|jt|d}dd|d||dS)Nrrr:(, ))rrrr unit_to_var)r1rrrr)rr4r5rCs "z#date_add_interval_sql..funcr1r rr&r+rr4)r)rrr4rr5date_add_interval_sql@srr-0t.Callable[[Generator, exp.TimestampTrunc], str]crr) Nr1r rexp.TimestampTruncr+rcs6t||jg}r||jd|jdg|RS)Nr- DATE_TRUNC)rrrWrrr)r1rrr-r4r5_timestamptrunc_sqlLsz/timestamptrunc_sql.._timestamptrunc_sql)r1r rrr+rr4)r-rr4rr5timestamptrunc_sqlKsr exp.TimestampcCs|jd}|s%ddlm}|||jdjptjjj }| t |j |S|j tvr>| tjt |j tjjj |dS|d|j |S)Nr-rannotate_typesrurr-r)rr sqlglot.optimizer.annotate_typesrrrrrrrrrrrrr AtTimeZoner)r1rr-r target_typer4r4r5no_timestamp_sqlUs  rexp.TimecCsBt|jtjjj}ttj||jddtjjj }| |S)Nr-r) rrrrrrrrrrrr1rrexprr4r4r5 no_time_sqlhs  r exp.DatetimecCs|j}|j}|jtvr)t|tjjj }ttj ||dtjjj }| |St|tjjj }t|tjjj}| ttj||dtjjj S)Nrr&)rrrrrrrrrrrrrrsrAddrr4r4r5no_datetime_sqlqs "rexp.LeftcCs"|tj|jtjd|jdS)Nr)rrlength)rrrrrrVrr<r4r4r5left_to_substring_sqls rc Cs0|tj|jtj|jdt|jddS)Nr%rrP)rrrrreparenrr<r4r4r5right_to_substring_sqls rexp.TimeStrToTimeinclude_precisioncCstj|jdrtjjjntjjj}t|j tj r9|r9t |j j }|dkr9tjj|j tj tj |dgd}|tj|j ||jdS)Nr-rr%rru)rrrrrrrrrrrrr DataTypeParamrVrrr)r1rrdatatype precisionr4r4r5timestrtotime_sqls   rexp.DateStrToDatecCs|t|jtjjjSr.)rrrrrrrsr<r4r4r5datestrtodate_sqlr)rr&rcCsR|jd}|r|jdkr|d|d|||j|r&|jdSdS)Ncharsetzutf-8z"Expected utf-8 character set, got rr)rrrrr1rr)r1rrrrr4r4r5encode_decode_sqls "rexp.MincC|jrdnd}t|||S)NLEASTrUrrr1rrr4r4r5 min_or_leastrexp.MaxcCr)NGREATESTMAXrrr4r4r5max_or_greatestrr exp.CountIfc CsB|j}t|jtjr|jjd}|d|dtd|ddS)Nrz9DISTINCT is not supported when converting COUNT_IF to SUMsumifr)rrrrrr1r)r1rcondr4r4r5count_if_to_sums   rr;exp.Trimdefault_trim_typecCs||d}||dp |}||d}||d}|s!||S|r(|dnd}|r1|dnd}|s7|r9dnd}|rBd|nd}d |||||d S) NrrNr collation r;zFROM z COLLATE zTRIM(r)rtrim_sql)r1rrtarget trim_type remove_charsr from_partr4r4r5rs    rcCs|d|j||S)NSTRPTIME)rrrr<r4r4r5str_to_time_sqlr/r exp.ConcatcCs|tdd|jS)NcSstj||dSNr&rrxyr4r4r5r6rz%concat_to_dpipe_sql..)rrrr<r4r4r5concat_to_dpipe_sqlr/r exp.ConcatWscs"|j^}|tfdd|S)Ncstj|tj|ddSrrrdelimr4r5r6z(concat_ws_to_dpipe_sql..)rrr)r1r rest_argsr4rr5concat_ws_to_dpipe_sqls  rrNrO parameters(exp.RegexpExtract | exp.RegexpExtractAllcCs>|jd}|r|jt|jjkrd}|||j|j |S)Ngroup) rrrrrr[rsql_namerr)r1rrr4r4r5regexp_extract_sqls r modifiersexp.RegexpReplacecCs|d|j|j|jdS)NREGEXP_REPLACE replacement)rrrrr<r4r4r5regexp_replace_sqlsr aggregationst.List[exp.Expression]r*cCsPg}|D]!}t|tjr||jq |dd}||j|ddq|S)NcSs t|tjrtj|jddS|S)NF)rr)rrrr)noder4r4r5r6s z$pivot_column_names..r)rnormalize_functions)rrrrWalias transformr)rrnamesaggagg_all_unquotedr4r4r5pivot_column_namess rr t.Type[B]t.Callable[[t.List], B]cr-)Ncst|dt|ddS)Nrrr&)rrmrr4r5r6rz&binary_from_function..r4rr4rr5binary_from_functionr9rrcCstjt|dt|ddS)Nrrr)rrrrmr4r4r5build_timestamp_truncr)r exp.AnyValuecCr)Nrrr<r4r4r5any_value_to_max_sql"rrexp.Xorc Cs6||j}||j}d|d|d|d|d S)Nrz AND (NOT z )) OR ((NOT z) AND r)rleftright)r1rabr4r4r5 bool_xor_sql&s  rcCs"t|tjpt|tjo|dS)Njson)rrrrrrr4r4r5 is_parse_json,s rcCs tjtjt|dtddS)Nrr&r%)rParenIsrnullrmr4r4r5isnull_to_is_null2rFr 'exp.GeneratedAsIdentityColumnConstraintcCs2||dpd}||dpd}d|d|dS)Nr1 incrementz IDENTITY(rrr,)r1rrrr4r4r5'generatedasidentitycolumnconstraint_sql6sr5t.Callable[[Generator, exp.ArgMax | exp.ArgMin], str]cstdd fdd }|S) Ncountr1r rexp.ArgMax | exp.ArgMinr+rcs||j|jSr.)rrrr<rr4r5_arg_max_or_min_sql?sz4arg_max_or_min_no_count.._arg_max_or_min_sql)r1r rrr+r)r )rrr4rr5arg_max_or_min_no_count>sr exp.TsOrDsAddcCsJ|j}|j}|tjjjrt|tjjj }|j t|||Sr.) rr return_typerrrrrsrrr)rrrr4r4r5ts_or_ds_add_castFs rr.t.Callable[[Generator, DATE_ADD_OR_DIFF], str]cr ) Nr1r rDATE_ADD_OR_DIFFr+rcs0r t|tjr t|}|t||j|jSr.)rr TsOrDsAddrrrrrr<rrr4r5 _delta_sqlTsz"date_delta_sql.._delta_sql)r1r rrr+rr4)rrrr4rr5date_delta_sqlSs rrcCsB|jd}t|tjr|S|rtj|jS|rtj|SdS)Nr})rrrr Placeholderrrrrrr}r4r4r5rbs  rcCs6|jd}t|tjtjfr|S|rtj|dSdS)Nr}r%)rrrrVarrrr4r4r5rls rpartexp.VarcCdSr.r4r!rr4r4r5 map_date_parttsr%cCr#r.r4r$r4r4r5r%yscCsD|rt|j|jnd}|r |jrtj |St |S|Sr.) rrr`rrrrrrrr~)r!rmappedr4r4r5r%s  exp.LastDaycCsHtdd|j}td|dd}td|dd}|t|tjjjS)N date_truncmonthdate_addrdate_subday)rrrrrrrrs)r1rtrunc_curr_dateplus_one_month minus_one_dayr4r4r5no_last_day_sqlsr0 exp.Mergec s|jjd}d fdd }||jjh}|r|||j|jdjD]]}|jd }|rt|tjrZ|tj D]}|j}t|tj rY||jd |vrY| t |jq;t|tj r|j} t| tjr| jD]} || jd |vr| t | jqlq%|S) z2Remove table refs from columns in when statements.r identifiert.Optional[exp.Identifier]r+rcs|r j|jSdSr.)rrr)r2rr4r5 normalizer/z+merge_without_target_sql..normalizewhensthentableN)r2r3r+r)rrraddrrrUpdatefind_allEQColumnrcolumnInsertTuple merge_sql) r1rrr4targetswhenr6equals equal_lhs column_listr=r4rr5merge_without_target_sqls0       rF t.Type[F]zero_based_indexingarrow_req_json_typet.Callable[[t.List], F]csdfdd }|S)Nrrkr+rcstg}|ddD]8}t|tjs|S|j}t|r:r&|js:t|}| tj r2|n|ddq | tj |dq |dd=t |dtj |ddS)Nrr%rrr)rronly_json_types)r JSONPathRootrr from_arg_listrr rrrWJSONPathSubscript JSONPathKeyrJSONPath)rsegmentsargrindexrIrrHr4r5ros"    z)build_json_extract_path.._builder)rrkr+rr4)rrHrIror4rTr5build_json_extract_pathsrU quoted_indexop/t.Callable[[Generator, JSON_EXTRACT_TYPE], str]csd fdd }|S) Nr1r rrr+rcs|j}t|tjst||S|jd}g}|jD]/}||}|rJt|tj rEs2t|tj sE|r9| |}|j j ||j j}||qr]dd||jg|S|j|jg|RS)Nescaper)rrrrPrrrrr JSONPathPartrN escape_strrrrrWrrr)r1rrrYrQsegmentrrWrVr4r5_json_extract_segmentss*         z5json_extract_segments.._json_extract_segmentsr1r rrr+rr4)rrVrWr^r4r]r5json_extract_segmentssr`exp.JSONPathKeycCst|jtjr |d|jS)Nz.Unsupported wildcard in JSONPathKey expression)rrrJSONPathWildcardr1rr<r4r4r5json_path_key_only_names rc!exp.ArrayFilter | exp.ArrayRemovecCs|j}t|tjrt|jdkr|jd}|j}n!t|tjr"d}nt|tjr3d}tj ||jd}n| ddStj |jgd}t | tj|d|gd|}|tj|gdS) Nrr_ur&zUnsupported filter conditionr;r)r7)rrrLambdarrr Predicate ArrayRemoveNEQr1rselectfrom_alias_whererr)r1rrrunnestfilteredr4r4r5filter_array_using_unnests    $rpexp.ArrayRemovecCs<td}tj||jd}|tj|jtj||gddS)Nrer&rS)rr8rirr ArrayFilterrrf)r1r lambda_idrr4r4r5remove_from_array_using_filters rt exp.ToNumbercCs"|d|j|jd|jdS)N TO_NUMBERrlnlsparamr r<r4r4r5to_number_with_nls_params   rxrt.Optional[int]scale(t.Callable[[exp.DataType], exp.DataType]csdfdd }|S)Ndtype exp.DataTyper+csD|jsdur |Sdurdnd}tjd|dS)Nrr;zDECIMAL(r)rrrr)r|paramsrrzr4r5ro%sz,build_default_decimal_type.._builder)r|r}r+r}r4)rrzror4rr5build_default_decimal_type"srexp.FunccCs&t|dkr tjd|dStj|S)NrTIMESTAMP_FROM_PARTSrS)rrrTimestampFromPartsrMrmr4r4r5build_timestamp_from_parts/s  rexp.SHA2cCs|d|dp d|jS)NSHAr256)rrrr<r4r4r5 sha256_sql8r"r*exp.GenerateSeries | exp.GenerateDateArraycCs|jd}|jd}|jd}t|tjr|j}n t|tjr&|j}nd}|rL|rL|rL|ddrLt|tjrF||jurFt||}nt||}|d|||S)Nrrrr timestampSEQUENCE) rrrrrrrrr)r1rrrrrr4r4r5 sequence_sql<s      r t.Callable[[t.List, Dialect], E]crr) Nrrkrrr+rcs6t|dt|dt|dptj|jt|ddS)Nrrrr)rrrr)rrrrVr[)rrrr4r5roRs z&build_regexp_extract.._builder)rrkrrr+rr4)rror4rr5build_regexp_extractQsr exp.Lateralc CsPt|jtjr#|tjtj|jjg|jdt|jtj dddS| |S)Nr)rroffsetcross)rr) rrrrrJoinrrr Posexplode lateral_sqlr<r4r4r5explode_to_unnest_sql]s   r$exp.DatetimeDiff | exp.TimestampDiffcCs|d|j|j|jS)N TIMESTAMPDIFF)rr}rrr<r4r4r5timestampdiff_sqllr/rrexp.MakeIntervalsepcCsVg}|jD]\}}t|tjr|j}||d|qd|j|d|idS)Nrz INTERVAL 'rr)rrrrKwargrrW format_args)r1rrrr}rr4r4r5no_make_interval_sqlps  r exp.LengthcCs"|jdrdnd}|||jS)NrLENGTH CHAR_LENGTH)rrrr)r1r length_funcr4r4r5length_or_char_length_sql{srLISTAGGrexp.GroupConcat within_group on_overflowc Cs|j}||jdptj|}||d}|r!|r!d|nd}|tj} | r3| jr3| j }| |||} tj || gd} | ra|rQtj | | d} n| d| |j|jdg|| S) N separatorrz ON OVERFLOW r;rSr&rr)rrrrrrrr Orderrrr WithinGroupr) r1rrIrrrrron_overflow_sqlorderrlistaggr4r4r5groupconcat_sqls      rexp.TimeToStr | exp.ToCharcCslt|dkr0|d}|jsddlm}|||d|jtjjr0|jj }t tj |dd|Stj |S)NrrrruT)r)rrrrrrrTEMPORAL_TYPESrrZrrprToCharrM)rrrrrr4r4r5build_timetostr_or_tochars     r exp.ReplacecCs.tjt|dt|dt|dptjddS)Nrrrr;)rrr)rReplacerrrrmr4r4r5'build_replace_with_optional_replacements r exp.SpacecCs|tjtjd|jdS)Nr)rtimes)rrRepeatrrrr<r4r4r5 space_sqls  r)r)r*r+r,)rrr+r)r1r rrr+r)rN)rrrrr+r r_)r1r rrr+r)r1r rr$r+r)r1r rr*r+r)r1r rr/r+r)r1r rr4r+r)r1r rr6r+r)r1r rr;r+r)r1r rr>r+r)r1r rr@r+r)r1r rrBr+r)rGFFT)r1r rrHrIrrJrrKrrLrr+r)r1r rr`r+r)rb)r1r rrcrdrr+rr.)rgrhrrrrir+rj)rrr+rq)Nr.F) rgrhrwrxryrrzrr+rj)rrhr+r)rrkr+r)r)rrrr+r)F)r-rr+r)r1r rrr+r)r1r rrr+r)r1r rrr+r)r1r rrr+r)r1r rrrrr+r)r1r rrr+rr>) r1r rr&rrrrr+r)r1r rrr+r)r1r rrr+r)r1r rrr+r)r;)r1r rrrrr+rr)r1r rrr+r)r1r rrr+r)r1r rrr+r)r1r rrr+r)rrrrr+r*)rrr+r)rrkr+r)r1r rrr+r)r1r rrr+r)rr&r+r)rrkr+r&)r1r rr r+r)rrr+r)rrr+r)rrrrr+r)r.)rr&rrr+r)r!r&rrr+r")r!rrrr+r)rr)r1r rr'r+r)r1r rr1r+r)TF)rrGrHrrIrr+rJ)TN)rrrVrrWrr+rX)r1r rrar+r)r1r rrdr+r)r1r rrqr+r)r1r rrur+rr)rryrzryr+r{)rrkr+r)r1r rrr+r)r1r rrr+r)rrhr+r)r1r rrr+r)r1r rrr+r)r)r1r rrrrr+r)r1r rrr+r)rrTF) r1r rrrrrrrrr+r)rrkrrr+r)rrkr+r)r1r rrr+r) __future__rrloggingtypingrrr rr functoolsrr rsqlglot.dialectsrsqlglot.errorsrsqlglot.generatorr r sqlglot.helperr r r rrrrsqlglot.jsonpathrrrsqlglot.parserr sqlglot.timerrrsqlglot.tokensrrr sqlglot.trierr^rrrr TsOrDsDiffrDATE_ADD_OR_SUBrJSONExtractScalarr TYPE_CHECKINGsqlglot._typingrrrrrDictrCallabler getLoggerrrr8rr:r}rrrrrrrrrrrr#r)r.r3r5r9r=r?rArEr_rarfrprtrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrroverloadr%r0rFrUr`rcrprtrxrrrrrrrrrrrrrr4r4r4r5s@     $   "  %-              +                            %