o NDiY@srddlmZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z m Z ddlmZmZmZddlmZdd lmZdd lmZd Zed d dgZeeZeddZddZd8ddZd8ddZ d9ddZ!d9ddZ"ddZ#d:ddZ$d9d d!Z%d"d#Z&d9d$d%Z'd:d&d'Z(d(d)Z)d*d+Z*d9d,d-Z+d.d/Z,d9d0d1Z-d:d2d3Z.d9d4d5Z/d6d7Z0dS);) namedtupleN)product)metadata)CQLEngineException)columnsquery)execute get_clusterformat_log_context)Model) NamedTable)UserTypeCQLENG_ALLOW_SCHEMA_MANAGEMENTFieldnametypesystemschema_columnfamiliescCsZ|r t|ttfs td|rt|ttfstd|r|ndg}|r%|ndg}t||S)z!Return all the execution contextsz$keyspaces must be a list or a tuple.z&connections must be a list or a tuple.N) isinstancelisttuple ValueErrorr) keyspaces connectionsrW/var/www/Datamplify/venv/lib/python3.10/site-packages/cassandra/cqlengine/management.py _get_context(s rTcCst||dd|i|ddS)a Creates a keyspace with SimpleStrategy for replica placement If the keyspace already exists, it will not be modified. **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** *There are plans to guard schema-modifying functions with an environment-driven conditional.* :param str name: name of keyspace to create :param int replication_factor: keyspace replication factor, used with :attr:`~.SimpleStrategy` :param bool durable_writes: Write log is bypassed if set to False :param list connections: List of connection names SimpleStrategyreplication_factorrN_create_keyspace)rrdurable_writesrrrrcreate_keyspace_simple9s r#cCst||d||ddS)a Creates a keyspace with NetworkTopologyStrategy for replica placement If the keyspace already exists, it will not be modified. **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** *There are plans to guard schema-modifying functions with an environment-driven conditional.* :param str name: name of keyspace to create :param dict dc_replication_map: map of dc_names: replication_factor :param bool durable_writes: Write log is bypassed if set to False :param list connections: List of connection names NetworkTopologyStrategyrNr )rdc_replication_mapr"rrrr create_keyspace_network_topologyMsr&cCsdtsdS|rt|ttfstdddd}|r)|D] }||||||dqdS|||||dS)N&Connections must be a list or a tuple.cSsdt|}||jjvr&ttd|d|t||||}t||ddSttd|d|dS)NzCreating keyspace %s connectionz2Not creating keyspace %s because it already exists) r rrloginfor KeyspaceMetadatar as_cql_query)rr"strategy_classstrategy_optionsr)clusterks_metarrr__create_keyspacehs  z+_create_keyspace..__create_keyspacer(N_allow_schema_modificationrrrr)rr"r.r/rr2r)rrrr!`s  r!cCsVtsdS|rt|ttfstdddd}|r%|D]}|||qdS||dS)a Drops a keyspace, if it exists. *There are plans to guard schema-modifying functions with an environment-driven conditional.* **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** :param str name: name of keyspace to drop :param list connections: List of connection names Nr'cSs4t|}||jjvrtdt||ddSdS)NzDROP KEYSPACE {0}r()r rrrformat protect_name)rr)r0rrr_drop_keyspaces z%drop_keyspace.._drop_keyspacer3r4)rrr8r)rrr drop_keyspaceys    r9cCsLt|}|d|g}|jD]}t|j}|d|vr#|jSqdS)z; Find the index name for a given table and column. z values(%s)targetN)rr7indexesvaluesdict index_optionsgetr)table column_nameprotected_namepossible_index_valuesindex_metadataoptionsrrr_get_index_name_by_columns    rFc CVt||}|D]!\}}tj||d}t||dWdn1s#wYqdS)a5 Inspects the model and creates / updates the corresponding table and columns. If `keyspaces` is specified, the table will be synched for all specified keyspaces. Note that the `Model.__keyspace__` is ignored in that case. If `connections` is specified, the table will be synched for all specified connections. Note that the `Model.__connection__` is ignored in that case. If not specified, it will try to get the connection from the Model. Any User Defined Types used in the table are implicitly synchronized. This function can only add fields that are not part of the primary key. Note that the attributes removed from the model are not deleted on the database. They become effectively ignored by (will not show up on) the model. **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** *There are plans to guard schema-modifying functions with an environment-driven conditional.* keyspacer(N)rr ContextQuery _sync_tablemodelrrcontextr)rImrrr sync_tables  rPc stsdSt|tstd|jrtd|}|}|}|p&|}t |}z|j j |}Wnt yHt d|d}t|||w|j}t|jD]} g} t| | fdd| DD] } t|| |dqgqT||vrtt d||d|t|} zt| |dWnty} z d t| vrWYd} ~ nd} ~ wwtt d ||d|||}t|||j}t}|jD]\\}} | j}||||vr||}|j| j krt d ||d}||||j| j }t!"|t#|q| j$s| j$rt d ||d}t||||d || %}t||dq|&|}|rz_sync_table..z sync_table creating new table %srIr)z)Cannot add already existing column familyz%sync_table checking existing table %szsExisting table {0} has column "{1}" with a type ({2}) differing from the model type ({3}). Model should be updated.zHCannot add primary key '{0}' (with db_field '{1}') to existing table {2}zALTER TABLE {0} add {1}z1Table {0} has fields not referenced by model: {1}cSsg|] \}}|jr|qSr)index)rSncrrrrWsz CREATE INDEXzON {0}z("{0}") )+r5 issubclassr r __abstract__column_family_name_raw_column_family_name _get_keyspace_get_connectionr rrKeyErrorr r6tablesset_columnsr<r resolve_udts _sync_typer*debug_get_create_tablerstr _validate_pkitems db_field_nameaddcql_typedb_typewarningswarnwarning primary_keyget_column_defsymmetric_differencer+_update_optionsrFjoin)rMr)cf_name raw_cf_nameks_namer0rImsgrecoludtsudtqsex table_meta table_columns model_fields model_namedb_namecol_metardb_fields_not_in_modelr@r;column index_namerrUrrKs                rKc Csdd|jD}dd|jD}dd|jD}dd|jD}||ks,||krBdd}td||||||||dS) NcSg|]}|jqSrrorSr\rrrrW#z _validate_pk..cSrrrrrrrrW$rcSrrrrrrrrW%rcSrrrrrrrrW&rcSs&dd||rdd|SdS)NPRIMARY KEY (({0}){1}), )r6rz) partition clusteringrrr _pk_string)s&z _validate_pk.._pk_stringz|Model {0} PRIMARY KEY composition does not match existing table {1}. Model: {2}; Table: {3}. Update model or drop the table.)_partition_keysr< partition_key_clustering_keysclustering_keyrr6r`)rMrmodel_partitionmeta_partitionmodel_clusteringmeta_clusteringrrrrrm"s rmcCs.tsdSt|tstdt|||ddS)aE Inspects the type_model and creates / updates the corresponding type. Note that the attributes removed from the type_model are not deleted on the database (this operation is not supported). They become effectively ignored by (will not show up on) the type_model. **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** *There are plans to guard schema-modifying functions with an environment-driven conditional.* Nz)Types must be derived from base UserType.r()r5r^r rri)r} type_modelr)rrr sync_type2s   rcs|pt|jD]#}g}t||fdd|DD]}t|||d|qq |}d||f}t|} | j j |} | j } || vrnt td||d|t||} t| |d| |||j||ddS| |} | j}t}|jD]C}||j|j|vrtd|||dq}| j||j}||jkrtd||d}|||j||j}t|t |q}|j||dt|t|krt td ||d|dS||}|rtd ||d}t |||dSdS) NcrQrrrRsyncd_sub_typesrrrWMrXz_sync_type..r(z%s.%szsync_type creating new type %srYzALTER TYPE {0} ADD {1}z~Existing user type {0} has field "{1}" with a type ({2}) differing from the model user type ({3}). UserType should be updated.z'Type %s did not require synchronizationz.Type %s has fields not referenced by model: %s) rf_fieldsr<rrhrirp type_namer rr user_typesr*rjr get_create_typerrefresh_user_type_metadataregister_for_keyspace field_namesror6rw field_typesrZrrrsrtrulenr+rx)r}r omit_subtypesr)fieldrrrtype_name_qualifiedr0rI defined_typescql type_metadefined_fieldsr field_typer~rrrrriGsX              ricCs<t||dd|jDdd|jD}|S)Ncs|]}|jVqdSr3r)rSfrrr z"get_create_type..csrr3)rr)rSvrrrrr)rr rrr<r-)rrIrrrrr|s rc s|}d|g}gggfdd}|jD]\}}||qddr7ddp8d|ddg7}g}dd |jD}|r_|d d||tj |j pgi7}|rw|d d |g7}d |S)NzCREATE TABLE {0}cs<|}|jr|jr n}|d|j|dS)Nz"{0}")rwrvrappendr6ro)rskeysckeyspkeysqtypesrr add_columns z%_get_create_table..add_columnrrrz({0})cSs g|] }d|j|jp dqS)z "{0}" {1}ASC)r6roclustering_orderrrrrrWs z%_get_create_table..zCLUSTERING ORDER BY ({0})zWITH {0} AND r]) r`r6rgrnrrzrr<rTableMetadataV3_make_option_strings __options__)rM ks_table_name query_stringsrrrproperty_strings_orderrrrrks$  * rkcCs.t|}|}|}|jj|j|}|Sr3)r rbrarrre)rMr)r0ksr@rrr_get_table_metadatas rcCspi}|D]1}|d\}}|d}|dkr+|||dddd}t|}n|}|||<q|S)N={r}'")splitfindrfindreplacejsonloadsstrip)option_stringsrEoptionrvalueirrr_options_map_from_stringss  rc CsV|}td||d}t|||jpi}t||d}t||j}t |}t j |}t |}i} | D]U\} } z|| } Wnt yZtd||d}t || |fwt| tri| | krh| | | <q8z| D]\} }| | |kr~| | | <nqnWq8t y| | | <Yq8w| rdt j | }d||}t||ddSdS) a Updates the table options for the given model if necessary. :param model: The model to update. :param connection: Name of the connection to use :return: `True`, if the options were modified in Cassandra, `False` otherwise. :rtype: bool z"Checking %s for option differencesrYr(z-Invalid table option: '%s'; known options: %srzALTER TABLE {0} WITH {1}TF)rbr r*rjrrrfrrErrrrnrdrrrlrzr6r`r)rMr)r}r~ model_optionsrexisting_option_stringsexisting_optionsmodel_option_stringsupdate_optionsrrexisting_valuekrrErrrrrysJ            ryc CrG)a Drops the table indicated by the model, if it exists. If `keyspaces` is specified, the table will be dropped for all specified keyspaces. Note that the `Model.__keyspace__` is ignored in that case. If `connections` is specified, the table will be synched for all specified connections. Note that the `Model.__connection__` is ignored in that case. If not specified, it will try to get the connection from the Model. **This function should be used with caution, especially in production environments. Take care to execute schema modifications in a single context (i.e. not concurrently with other clients).** *There are plans to guard schema-modifying functions with an environment-driven conditional.* rHr(N)rrrJ _drop_tablerLrrr drop_tables  rcCsrtsdS|p |}t|j}|}|}z|j|j|td | |dWdSt y8YdSw)NzDROP TABLE {0};r() r5rcr rrbrarrerr6r`rd)rMr)metar}r|rrrr s   rcCs*ttstd}t|t|dS)Nz| environment variable is not set. Future versions of this package will require this variable to enable management functions.T)osgetenvrrsrtr*ru)r~rrrr5s   r5)TNr3)NN)1 collectionsrrloggingrrs itertoolsr cassandrarcassandra.cqlenginerrrcassandra.cqlengine.connectionrr r cassandra.cqlengine.modelsr cassandra.cqlengine.namedr cassandra.cqlengine.usertyper rr getLogger__name__r*rrr#r&r!r9rFrPrKrmrrirrkrrryrrr5rrrrsH              b  5 &  2