]jdZddlZddlZddlZddlZddlZddlmZddlZddl m Z ddl m Z ddl mZddlmZej"eZ ddZdd ZGd d eZGd d eZedZdZy)zThis file and its contents are licensed under the Apache License 2.0. Please see the included NOTICE for copyright information and LICENSE for a copy of the license. N)urlparse) ClientError)get_env)settings) TLDExtractc|xs td}|xs td}|xs td}tjd|d|r|dddzndd|tj||| }d |xstd xsd i}|xs td }|r||d<|j ddtj jdi|}|jddtj jdi|}||fS)NAWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEYAWS_SESSION_TOKENz(Create boto3 session with access key id=z , secret key=z...z, session token=)aws_access_key_idaws_secret_access_keyaws_session_token region_name S3_regionz us-east-1 S3_ENDPOINT endpoint_urlconfigs3v4)signature_version)s3) rloggerdebugboto3SessionclientsessionConfigresource) r rrr s3_endpointrrrrs K/root/env/lib/python3.12/site-packages/label_studio/io_storages/s3/utils.pyget_client_and_resourcer"s1*IW5H-I1UW=T5U)IW5H-I LL *+,;P+BQ/%7VZ[\*+ - mm+3+G {Qgk.BQkRH7!7K#. W^^ d)=)=PV)=)W d[c dFwhU]]-A-ATZ-A-[h_ghH 8 cLt|d}|j}|jjd}|s^|j ||}|ddd}d|zd zt j |d jjd z} | S ||d} tj|\}} |r|| d <|jd | |} tjdj| || S#t$r$} tj!d| |cYd} ~ Sd} ~ wwxYw)NF)allow_fragments/BucketKeyResponseMetadata HTTPHeadersz content-typezdata:z;base64,Bodyzutf-8ResponseContentType get_object) ClientMethodParams ExpiresInz1Presigned URL {presigned_url} generated for {url}) presigned_urlurlz&Can't generate presigned URL. Reason: )rnetlocpathlstripr.base64 b64encodereaddecode mimetypes guess_typegenerate_presigned_urlrrformatrwarning)r3rpresign expires_inr bucket_namekeyobject content_type object_b64params_r2excs r!resolve_s3_urlrK-s5e,A((K &&-- C ""+3"?01-@P |+j86;K;KFSYNL_L_La;b;i;ijq;rr '4 $..s3 a ,8F( )55/"3&;"3'' IFA""+3"?< VT" '.r#c|j\}}|rtj|}tj|}|j rNd|j j ddzi}|jsd|d<|jjdi|}n |j}|jtjj}t|D]i\} } | j} | j!drt"j%| dz<|s?|j'| sQt"j%| dzyy) a7 Validate pattern against S3 Storage :param storage: S3 Storage instance :param pattern: Pattern to validate :param glob_pattern: If True, pattern is a glob pattern, otherwise it is a regex pattern :return: Message if pattern is not valid, empty string otherwise Prefixr& Delimiterz" is skipped because it is a folderz matches file patternz3No objects found matching the provided glob pattern)get_client_and_bucketfnmatch translaterecompileprefixrstriprecursive_scanobjectsfilter page_sizer)CLOUD_STORAGE_CHECK_FOR_RECORDS_PAGE_SIZEall enumeraterDendswithrrmatch) rQstoragepattern glob_patternrbucketregex list_kwargs bucket_iterindexobjrDs r!validate_patternzAWS.validate_patternrs!668 ''0G 7# >>#W^^%:%:3%?#%EFK))+. K(/&..//>+>K ..K!++H,^,^_cce #K0 JE3''C||C  S#GGHS) S#::; Er#)NNNNNN)T)__name__ __module__ __qualname__ classmethodstrrSrrrXr#r!rMrMNsQ "     D E Er#rMc eZdZy)S3StorageErrorN)rsrtrurXr#r!ryrysr#ryrX)suffix_list_urlscfd}|S)z For S3 storages - if s3_endpoint is not on a known domain, catch exception and raise a new one with the previous context suppressed. See also: https://peps.python.org/pep-0409/ c |g|i|S#t$r}|jrtjt |jj j x}tjDcgc]}|j ncc}wc}vr*tjd|dtd|dd|d}~wwxYw)Nz'Exception from unrecognized S3 domain: T)exc_infoz.wrappers .t.v. . #228Drs}  ! +% !   8 $os4BEE&EEP Y  + r#