]ji d Z ddlZddlZddlZddlZddlZddlmZ ddlmZm Z ddl
m Z ddl m
Z
ddlmZ ddlZddlZddlZddlZddlZddlmZ dd lmZ dd
lmZ dd l m Z dd l m Z dd
l m!Z! ddl"m#Z# ddl$m%Z% ddl&Z'ddl+ ddl,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5 ejl dejn ejp d d Z9 ejp d d Z: ejp d d Z; ejp d d Z< ejp d Z= ejp d d Z> ejp d d! Z? ejp dd"# d$ Z@ ejp d d% ZA ejp d d& ZBd' ZC ejp d d( ZD ejp d d) ZE ejp d d* ZF ejp d d+ ZG ejp d d, ZH ejp d d- ZI ejp d d. ZJd/ ZK ejp d0 ZL ejp d1 ZM ejp d d2 ZN ejp d d3 ZO ejp d d4 ZPejp d5 ZQ ejp d d6 ZR ejp d78 d9 ZS ejp d d: ZTd; ZU G d< d= ZVd> ZWd? ZXd@ ZYdndAZZejp dB Z[ejp dC Z\ejp dD Z]ejp dE Z^ ejp dF Z_ejp dG Z`ejp dH Zaejp dI Zb ejp dJdKgL dM Zcejp dN Zd ejp dO8 dP Ze ejp dQdR dS Zf ejp dTdR dU Zg ejp dd"# dV Zh ejp dW8 dX Zi ejp dY8 dZ Zj ejp d[8 d\ Zk ejp d]8 d^ Zl ejp d_8 d` Zm ejp da8 db Znejp dodc Zo ejp dd8 de Zpdaqdar ejp df8 dg ZsdpdhetdidfdjZudkevdidfdlZwdm Zxy# e($ r e)d e*d Y w xY w)qzThis file and its contents are licensed under the Apache License 2.0. Please see the included NOTICE for copyright information and LICENSE for a copy of the license.
N)deepcopy)datetime timedelta)Path)SimpleNamespace) MagicMock ClientErrorsettings) freeze_time)mock_s3) Organization)Project)Task)Userz(
!!! Please, pip install pytest-env
i)* ) azure_client_mockcreate_businessgcs_client_mockimport_from_url_mock make_projectml_backend_mockredis_client_mockregister_ml_backend_mocksigninzbotocore.credentialsT)autousec dg| _ y)zM
Set the password hasher to less expensive MD5 for testing purposes.
z-django.contrib.auth.hashers.MD5PasswordHasherN)PASSWORD_HASHERSr s E/root/env/lib/python3.12/site-packages/label_studio/tests/conftest.pyset_test_password_hasherr" 4 s
"Q QH Fc d| _ y )NT)USE_ENFORCE_CSRF_CHECKSr s r! enable_csrfr& < s
'+H$r# c d| _ y )Nr )LABEL_STREAM_HISTORY_LIMITr s r! label_stream_history_limitr) A s
*+H'r# c d| _ d | _ y )Nr ) SENTRY_RATE
SENTRY_DSNr s r! disable_sentryr- F s H Hr# c d| _ y )NF)DEBUG_MODAL_EXCEPTIONSr s r! debug_modal_exceptions_falser0 L s
&+H#r# function)scopec 0 dt _ dt _ y )Nr zIhttps://44f7a50de5ab425ca6bc406ef69b2122@o227124.ingest.sentry.io/5820521)r r+ r, r# r!
enable_sentryr5 Q s HeHr# c dt j d< dt j d< dt j d< dt j d< y)z Mocked AWS Credentials for moto.testingAWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEYAWS_SECURITY_TOKENAWS_SESSION_TOKENNosenvironr4 r# r! aws_credentialsr? X s@ '0BJJ"#*3BJJ&''0BJJ#$&/BJJ"#r# session)r r2 c P dt j d< dt j d< y)zMocked Azure credentialsr7 AZURE_BLOB_ACCOUNT_NAMEAZURE_BLOB_ACCOUNT_KEYNr< r4 r# r! azure_credentialsrD a s" -6BJJ()+4BJJ'(r# c # | K t 5 t j dd d d d y # 1 sw Y y xY ww)Ns3 us-east-1 region_name)r boto3client)r? s r! rF rF h s0 :ll4[99: : :s <0 <9<c # K d}| j | | j |dd | j |dd | j |dd | j |d
d | y w)
z
Bucket structure:
s3://pytest-s3-images/image1.jpg
s3://pytest-s3-images/subdir/image1.jpg
s3://pytest-s3-images/subdir/image2.jpg
pytest-s3-imagesBucket
image1.jpg123rO KeyBodysubdir/image1.jpg456subdir/image2.jpg789subdir/another/image2.jpg0abN
create_bucket
put_objectrF bucket_names r! s3_with_imagesr` n sn %KK(MM,UMCMM*=EMJMM*=EMJMM*EEMR
Hs A*A,c d} t j dd }|j | d |j | d |j | d |j | d |j |
y ) z!
Remove pytest-s3-images
rM rF rG rH rP )rO rS rU rW rY rN )rJ rK
delete_object
delete_bucket)r_ _s3s r! s3_remove_bucketrf s| %K
,,t
5C[l;[.AB[.AB[.IJ[)
r# c # K d}| j | | j |dt j ddi | y w)Nzpytest-s3-jsonsrN test.json image_urlzhttp://ggg.com/image.jpgrR r\ r] jsondumpsr^ s r!
s3_with_jsonsrm sB #KK(MM+DJJ UoGprR rj r^ s r! s3_with_hypertext_s3_linksrq sO -KK(MM
ZZ
k l
Hrn c # K d}| j | | j |dt j ddi | y w)Nz pytest-s3-json-partially-encodedrN rh rp z_rR rj r^ s r! "s3_with_partially_encoded_s3_linksrs sQ 4KK(MM
ZZ{
Hrn c # d K d}| j | | j |dd | y w)Nz pytest-s3-jsons-unexisted_linksrN zsome-existed-image.jpgqwertyrR r[ r^ s r! s3_with_unexisted_linksrv s4 3KK(MM*BMR
Hs .0c # < K d}| j | | y w)Nzpytest-export-s3-bucketrN )r\ r^ s r! s3_export_bucketrx s! +KK(
Hs c
#
K d}| j | ddddd| d| dgd d
d iid dddd| d| dgd
d
diid dddd| d| dgdddiid gd}| j |t j | | y w)Nz pytest-export-s3-bucket-with-sserN
2012-10-17Denyr s3:PutObject
arn:aws:s3:::/*StringNotEquals s3:x-amz-server-side-encryptionAES256Effect PrincipalActionResource ConditionNulltrues3:*Boolaws:SecureTransportfalseVersion StatementrO Policyr\ put_bucket_policyrk rl rF r_ policys r! s3_export_bucket_sser s 4KK( ! ( ,[M :mK=XZ<[ \ /2SU]1^ _
! ( ,[M :mK=XZ<[ \ $'H&&Q R
! ,[M :mK=XZ<[ \ $'
test label_configtitler4 r s r! project_rankerr s
E
"F 33r# c d} | ddS )zQSimple project with dialog configs
:return: config of project with task
z
r r r4 r s r! project_dialogr s
E "F 33r# c d} | ddS )NaF
r r r4 r s r! project_choicesr s
E& "F 33r# c t | } d}d}t } | }t j j | }|j | t
| t j ||j } |r+d| j _ | j j | |_
|j |rdt | || j dk( sJ t! j" 5 }
|
j% dt' j( d t+ j, d d
i |
j% d t' j( d
t+ j, d di | j/ |j0 | } t3 d| j | j dk( sJ d ddd t4 j j7 |d j9 } |j; | j< t3 d| j> | | _ || _! || _" || _# | | _$ | S # 1 sw Y xY w)a Create new test@gmail.com user, login via client, create test project.
Project configs are thrown over params and automatically grabs from functions names started with 'project_'
:param client: fixture with http client (from pytest-django package) and simulation of http server
:param project_template: dict with project config
:param do_auth: make authorization for creating user
ztest@gmail.comr email
created_byr T. POSTz ml\.heartex\.net/\d+/validatestatusokrp GETzml\.heartex\.net/\d+/healthUP)dataz Project create with status code: z9Create project result should be redirect to the next pageNr )r z Project id:)%r r r objectscreate set_passwordr r create_organization
first_namejwtlegacy_api_tokens_enabledsaveactive_organizationr status_code
requests_mockMocker register_urirecompilerk rl postr printr filterfirstr r idprojectuserurlsproject_configorg)
rK project_templatedo_authr r passwordr0 r1 r/ r2 r rr. s
r!
setup_projectr7 s f
F EH 6D%'N << U +Dh D
*
*d$//
RC ,0) "D IIKfeX.::cAAA
!
!
# eq
NN62::.N#OVZV`V`bjlpaqVrN s
NN5"**-K"LSWS]S]_gim^nSoN p D / /n EA 4amm D==C' d)d d' e //((~g/F(GMMO $
mWZZ( FKFK *FFJ M% e es
5CIIc " t | t S r r7 r rK s r! setup_project_dialogr; 00r# c ( t | t dd S )NFT)r4 r r9 r: s r! setup_project_for_tokenr> " s Z^ __r# c " t | t S r )r7 r r: s r! setup_project_rankerr@ ' r< r# c " t | t S r )r7 r r: s r! setup_project_choicesrB , s 11r# c < d| _ d| _ d| _ d| _ y)z
Configure settings for contextlog tests in CI.
Be sure that responses is activated in any testcase where this fixture is used.
TFN)COLLECT_ANALYTICSCONTEXTLOG_SYNCTEST_ENVIRONMENTDEBUG_CONTEXTLOGr s r! contextlog_test_configrH 1 s$ "&H #H %H %H r# c p t | } d}d}t j j | }|j | t | }|j
t j ||j }d|j _ |j j
|r|n t | | _
|rd n t d | _ || _ || _ || _ |j% j& | _ || _ t- | || j. d k7 rt1 d
| d | S ) Nbusiness@pytest.netpytestr
r T)adminr )r- r User failed to login!)r r r r r r r! r r r r r r businessteamrL annotatorr/ reset_tokenkeyapi_key organizationr r# r* )rK r r5 r/ rO r2 s r! business_clientrV > s f
F !EH << U +Dh t$HIIK
*
*d$//
RC(,CGG%GGLLN"*hd0KFO"$1(=FKFLFFK%%'++FN F
feX&22c9
dV,-. Mr# c l t | } d}d}t j j | }|j | |j t
| t j ||j t | || j dk7 rt d| d || _
|| _ | S )Nzannotator@pytest.netrK r
r r rM rN r r r r r r! r r r r r r# r* r/ rQ rK r r5 r/ s r! annotator_clientrZ Y s f
F "EH << U +Dh IIKD$$DOOL
feX&22c9
dV,-.FKF Mr# c l t | } d}d}t j j | }|j | |j t
| t j ||j t | || j dk7 rt d| d || _
|| _ | S )Nzannotator2@pytest.netrK r
r r rM rN rX rY s r! annotator2_clientr\ k s f
F #EH << U +Dh IIKD$$DOOL
feX&22c9
dV,-.FKF Mr# rO rQ )paramsc H | j dk( r|S | j dk( r|S y )NrO rQ )param)requestrV rZ s r!
any_clientra } s+ }}
" + %
&r# c ^ t dd }ddddddg}t j j d
}t ||d }|j
j
j d k( sJ t j j |D cg c] }t ||
c} |S c c}w )NTestab
)r r z meta info Aztext A) meta_inforp z meta info Bztext BrJ r
r r )r r. )
dictr r r+ r ml_backendsr, r r bulk_create)rV rZ *_project_for_text_choices_onto_A_B_classes _2_tasks_with_textA_and_textBusersr. tasks r! configured_projectrl s 15 2. $X6#X6%!
LL &; ij N js
B*django_live_urlc # ( K | j y wr )r ) live_servers r! get_server_urlrp s
//s 9ff_front_dev_1682_model_version_dropdown_070622_short_off)r r c # K ddl m fd} t j d| 5 d d d d y # 1 sw Y y xY ww)Nr flag_setc & | d dk( ry | i |S )Nr 5ff_front_dev_1682_model_version_dropdown_070622_shortFr4 r r rt s r!
fake_flag_setzPff_front_dev_1682_model_version_dropdown_070622_short_off..fake_flag_set s# 7M M(((r# ztasks.serializers.flag_setwrapscore.feature_flagsrt mockr rx rt s @r! rq rq s7 +)
0
F
#A 4 A =A async_import_offc # K ddl m fd} t j d| 5 d d d d y # 1 sw Y y xY ww)Nr rs c | i |S r r4 rw s r! rx z'async_import_off..fake_flag_set s (((r# zdata_import.api.flag_setry r{ r~ s @r! r r s7 +)
.m D
r c * dt j d< y)z[
Automatically set the environment variable for all tests, including Tavern tests.
r 1fflag_feat_utc_210_prediction_validation_15082025Nr< r4 r# r! set_feature_flag_envvarr s
GMBJJBCr# Lfflag_feat_back_lsdv_3958_server_side_encryption_for_target_storage_short_onc # K ddl m fd} t j d| 5 d d d d y # 1 sw Y y xY ww)Nr rs c & | d dk( ry | i |S )Nr Ifflag_feat_back_lsdv_3958_server_side_encryption_for_target_storage_shortTr4 rw s r! rx zcfflag_feat_back_lsdv_3958_server_side_encryption_for_target_storage_short_on..fake_flag_set s# 7a a(((r# z io_storages.s3.models.flag_setry r{ r~ s @r! r r s7 +)
4M J
r Afflag_fix_all_lsdv_4813_async_export_conversion_22032023_short_onc # K ddl m fd} t j d| 5 d d d d y # 1 sw Y y xY ww)Nr rs c & | d dk( ry | i |S )Nr >fflag_fix_all_lsdv_4813_async_export_conversion_22032023_shortTr4 rw s r! rx zXfflag_fix_all_lsdv_4813_async_export_conversion_22032023_short_on..fake_flag_set s# 7V V(((r# data_export.api.flag_setry r{ r~ s @r! r r 7 +)
.m D
r Gff_back_dev_4664_remove_storage_file_on_export_delete_29032023_short_onc # K ddl m fd} t j d| 5 d d d d y # 1 sw Y y xY ww)Nr rs c & | d dk( ry | i |S )Nr Dff_back_dev_4664_remove_storage_file_on_export_delete_29032023_shortTr4 rw s r! rx z^ff_back_dev_4664_remove_storage_file_on_export_delete_29032023_short_on..fake_flag_set s# 7\ \(((r# r ry r{ r~ s @r! r r r r local_files_storagec d| _ t t j t d z }|t d z }t j
t
| d t dj d }t j t
| t
|t d z t j t
| t
|t d z y ) NTfilessubdir)exist_okz(tests/test_suites/samples/test_image.png/ztest_image1.pngztest_image2.png)
LOCAL_FILES_SERVING_ENABLEDr tempfile
gettempdirr= makedirsstrsplitshutilcopyfile)r tempdirr
test_images r! r r s +/H(8&&()DM9G
tH~
%FKKF d+AGGLMJ
OOC
OS48I3J)J%KL
OOC
OS$7H2I)I%JKr# !local_files_document_root_tempdirc ` t t j }|j | _ y r )r r r rootLOCAL_FILES_DOCUMENT_ROOTr r s r! r r s! 8&&()G)0 H&r# local_files_document_root_subdirc v t t j t d z }t | | _ y )Nr )r r r r r r s r! r r s* 8&&()DM9G),W H&r# c # 6 K d}t j d 5 }|j d| ddddd d
dddd d
dddd d
d ddd d
d ddd d
g |j | d
t j
ddi | d d d y # 1 sw Y y xY ww)Nzhttp://localhost:9090T) real_httpr z/setupversion1r r r rk r# version2version3z/healthr r r )r$ r% r& getrk rl )r r r s r! mock_ml_auto_updater s
!C -
e6N+5FWZ[+5FWZ[+5FWZ[+5FWZ[+5FWZ[
WoDJJ$/?$@A
s BA)B
B
BB$mock_ml_backend_auto_update_disabledc # K t d 5 } | j ddddddd d
dddd g | d d d y # 1 sw Y y xY ww) Nr )r r zhttp://localhost:9090/setuprb r r r r 2)r r& r s r! r r s] Z 8 A )+->sS+.$?PST
s
A
&> A
AA
freeze_clockc # K t j at t at j d t j d ad ay wr )r nowr
freezerstartstopr4 r# r! r r * s>
,,.C# G MMO LLNG
Cs AAsecondsreturnc t j t t | z
at t a t j y )N)r )r r r r r
r )_r s r!
tick_clockr < s/ LLN9W %%C# G MMOr# utc_timec j t j t | a t j y r )r r r
r )responser s r! freeze_datetimer E s LLN(#G MMOr# c g }g }|D ]A }d|j v sd|j v r|j | 1|j | C ||z |d d y )Nr r ) fixturenamesappend)configitems
mock_tests other_testsitems r! pytest_collection_modifyitemsr L sf JK % !T%6%6 6:PTXTeTe:e d # t $ % Z'E!Hr# )TF)r )r )yr loggingr= r' r r copyr r r pathlibr typesr
unittest.mockr rJ r} rK r$ ujsonrk botocore.exceptionsr
django.confr freezegunr
motor organizations.modelsr projects.modelsr tasks.modelsr users.modelsr pytest_env.plugin
pytest_envr r* exit label_studio.tests.sdk.fixturesutilsr r r r r r r r r set_stream_loggerDEBUGfixturer" r& r) r- r0 r5 r? rD rF r` rf rm rq rs rv rx r r r r r r r r r r r r r r r r r r7 r; r> r@ rB rH rV rZ r\ ra rl rp rq r r r r r r r r r r r r r intr r r r r4 r# r! r s
( ! #
+ ! - #
.
.
> R R , , , ,
, , j!f "f j!0 "0 I.5 /5 j!: ":
"
"
J "
"
J J J J J
4 4n
&' (
- -4
4 4.0f 1 1 ` ` 1 1 2 2 & & 4 " "
K01 2 8 &' ( PZ^_ ` '6 7 I.M /M cd e XY Z ^_ ` *+L ,L 896 :6
786 96
$ ;<
=
^$ %"3 t ([
89Js <U3 3V V