o RDi@sddlmZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZmZe eZdd d ZGdddZdS)) annotationsN)BytesIO) getLogger)IO)default_backend)hashes)UTF8kilobytereturnintcCstj||ddS)Ni)mode)osopen)pathflagsrV/var/www/Datamplify/venv/lib/python3.10/site-packages/snowflake/connector/file_util.pyowner_rw_openersrc@s`eZdZedddZedd d ZedddZedddZedddZedddZ dS)SnowflakeFileUtilsrc IO[bytes]r tuple[str, int]cCsrdt}t}t}t||} ||}|dkrn||qt|  t }| }| d||fS)zGets stream digest and size. Args: src: The input stream. Returns: Tuple of src's digest and src's size in bytes. @Tr)r rrSHA256Hashreadupdatebase64standard_b64encodefinalizedecoder tellseek)r CHUNK_SIZEbackend chosen_hashhasherchunkdigestsizerrrget_digest_and_sizes     z%SnowflakeFileUtil.get_digest_and_size src_streamtuple[IO[bytes], int]cCs(t|}|dt|t|fS)zCompresses a stream of bytes with GZIP. Args: src_stream: bytes stream Returns: A tuple of byte stream and size. r)gzipcompressrr$rlen)r-compressed_datarrrcompress_with_gzip_from_stream3s z0SnowflakeFileUtil.compress_with_gzip_from_stream file_namestrtmp_dirc Cstj|}tj||d}td||t|d(}t|d}t j ||dt dWdn1s7wYWdn1sFwYt |t|}||jfS)zCompresses a file with GZIP. Args: file_name: Local path to file to be compressed. tmp_dir: Temporary directory where an GZIP file will be created. Returns: A tuple of gzip file name and size. z_c.gzz gzip file: %s, original file: %srbwbr)lengthN)rrbasenamejoinloggerdebugrr/GzipFileshutil copyfileobjr rnormalize_gzip_headerstatst_size)r4r6 base_namegzip_file_namefrfwstatinforrrcompress_file_with_gzipAs     z)SnowflakeFileUtil.compress_file_with_gziprENonecCs<t|d}|dd|d}td|d}|dd|tdd|d@r||d d|d@rJ|d }td |d}|d ||d}|rtd|d}|dkr^n.|d d|tdd|d}|sQWddSWddSWddSWddS1swYdS)aNormalizes GZIP file header. For consistent file digest, this removes creation timestamp and file name from the header. For more information see http://www.zlib.org/rfc-gzip.html#file-format Args: gzip_file_name: Local path of gzip file. zr+brrBzs