]jJ>*dZddlZddlmZddlmZmZmZddlm Z ddl Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZdd lmZd Zej6eZGddeZdZ dZ!dZ"dZ#dZ$dZ%dZ&dee'e(ffdZ)dedede*fdZ+y)zThis file and its contents are licensed under the Apache License 2.0. Please see the included NOTICE for copyright information and LICENSE for a copy of the license. N) OrderedDict)AnyIterableTuple)unquote)flag_set)int_from_request)View) PrepareParams)settings)get_object_or_404)Tasktasks:c eZdZy)DataManagerExceptionN)__name__ __module__ __qualname__M/root/env/lib/python3.12/site-packages/label_studio/data_manager/functions.pyrrsrrcdgi}g}d}t}i}|jjD]\}}d|vs |||<|j|j|jj } t jd|jd| d|| r%|j| Dcic] }||vs|d c}t jd|jd|t|dkDr |jtjdt jd|jd|d |t|jD]q\}} ||tjk7r|nd | d vr| nd d d d||vxs|tjk(ddd} |dj| |j| d|dz }stdd} d d dd |dd} |dxxddddd dddddgz cc<|dxxddddd dddddgz cc<| rg}n|j j#dd }|dxxd!d"d#d d$ddddd%d&d'dd d(ddddd%d)d*dd d+ddddd%d,d-dd d.ddddd%d/d0dd d1d2| sd3d4|iiniddddd5d6d7d d d8ddddd%d9d:d d d;ddddd%dddddd%d?d@dd dA|j%ddBdddddCdDdEd d dFddddd%dGdHd d dIddddd%dJdKd d dLddddd%dMdNd#d dOddddd%dPdQd#d dRddddd%dSdTdd dUd2| sd3d4|iiniddddd5dVdWdXdYd ddddddZd[d\d]d dddddgz cc<|dj| |Scc}w)^z/Make columns info for the frontend data managercolumnsr[zget_all_columns: project_id=z all_data_columns=z data_types=UnknownNz project_data_types=data)ImageAudio AudioPlusVideorStringtasksT)explorelabeling)idtitletypetargetparentvisibility_defaultsproject_definedr%3fflag_feat_fit_449_datamanager_filter_members_shortauto)userListF)r%r&r'r(childrenr+IDNumberzTask ID)r%r&r'helpr(r*r+inner_idzInner IDz8Internal task ID starting from 1 for the current project)flat completed_at CompletedDatetimezLast annotation date)r%r&r'r(r4r*r+total_annotations AnnotationszTotal annotations per taskcancelled_annotations Cancelledz%Total cancelled (skipped) annotationstotal_predictions PredictionszTotal predictions per task annotatorsz Annotated byz All users who completed the task)r%r&r'r(r4schemaitems)r*r+annotations_resultszAnnotation resultsz/Annotation results stacked over all annotationsannotations_idszAnnotation IDsz+Annotation IDs stacked over all annotationspredictions_scorezPrediction scorez2Average prediction score over all task predictionspredictions_model_versionszPrediction model versionsz.Model versions aggregated over all predictions)rBmultiple)r%r&r'r(r4rAr*r+predictions_resultszPrediction resultsz/Prediction results stacked over all predictions file_uploadzUpload filenamezFilename of uploaded filestorage_filenamezStorage filenamezFilename from import storage created_atz Created atzTask creation time updated_atz Updated atzTask update time updated_byz Updated byz!User who did the last task update avg_lead_timez Lead TimeTimez&Average lead time over all annotations draft_existsDraftsBooleanz.True if at least one draft exists for the task)r data_typesrBupdatesummaryall_data_columnsloggerinfor%lenpopr DATA_UNDEFINED_NAMElistappendr all_members values_listget_model_versions)project_resulttask_data_childrenirSproject_data_typeskeyvaluerV data_typecolumnremove_members_schema data_rootproject_memberss rget_all_columnsrnse_F AJ((..0, U c>&+ s # , (..0177 KK.wzzl:M_` KK.wzzl-J=IJ "x33T: KK.wzzl-J=H]J\I^_`z//12Y8#?#??SV!*.a!aIgo#55\@\@\9\$ $   y  (!!&,/ Q"%%Zagh& I 9/3#G$    9N/4%#H$   !--99$T9J 9  */3#G$ &"0/3#F$ * ;/3#G$ &"0/3#G$ #6 >S7O45XZ 04#G$ ()E/4%#H$ $%A/4%#H$ &'H/4%#H$ /0D ' : : <$O/4%#H$ ()E/4%#H$  &//4%#H$ %'2/4%#H$ !(/4%#H$ !&/4%#H$ !7 >S7O45XZ 05%#H$ " </4%#H$ !D/4%#H$ i]]~ 9Y' MI`s / M9Mcht|jddxst|jdd}|dkDrZtt|}|j j |j k7r td|jd}||_ |Sd|jvr,tjt|jd}n |j}|jddgd }t|tsAt|t r tj|}ntd t)|d||jdd }|jdg} t+|j,|||| |}|S#t"$r+}t$j'd |td |d }~wwxYw)zThis function extract prepare_params from * view_id if it's inside of request data * selectedItems, filters, ordering if they are in request and there is no view id viewr)pkzProject and View mismatchT)add_selected_itemsquery selectedItems)allexcludedzError parsing selectedItems: z{selectedItems must be JSON encoded string for dict: {"all": [true|false], "excluded | included": [...task_ids...]}. Found: NzhselectedItems must be dict: {"all": [true|false], "excluded | included": [...task_ids...]}. Found type: z with value: filtersordering)rartrrwrxrequest)r GETrr r rarqrget_prepare_tasks_paramsryjsonloadsrget isinstancedictstr ExceptionrWerrorr'r r%) ryraview_idrpprepare_paramsrselectederwrxs rget_prepare_paramsrs w{{FA6c:J7<"2-zK ((9d+88J+&JJhT7]eov  %!LL#@!DE.""*-s E== F1&F,,F1c^t||}tjj|}|S)N)r)rrprepared only_filtered)ryrarquerysets rget_prepared_querysetrIs*'9N}}**.*IH Orch|sy|dj}|j}|r|j|Sy)z Call the given ML backend to retrieve predictions with the task queryset as an input. If backend is not specified, we'll assume the tasks' project only has one associated ML backend, and use that backend. Nr)r")ra ml_backend predict_tasks)r"rabackends revaluate_predictionsrOs@ AhG  G$$5$11rcp|jdxs$|jdxs|jdS)Nrwrxrt)r~)rs r%filters_ordering_selected_items_existr`s- 88I  S$((:"6 S$((?:SSrcyNr)argskwargss rcustom_filter_expressionsrdsrc|Srr)_filterrbs rpreprocess_filterrhs Nrreturnc|}d}|jdrd}|dd}ddg}|D]"}|j|s|t|d}$|r|jdrd}|dd}|jdr|jdd }|jj}t|j j dk(xr||j j vxs-t|j j d k(xr|d k(}|r+|r)tj|vrd tj}||fS|jdd }||fS) aTransform a field name (as specified in the datamanager views endpoint) to a django ORM field name. Also handle dotted accesses to task.data. Edit with care; it's critical that this function not be changed in ways that introduce vulnerabilities in the vein of the ORM Leak (see #5012). In particular it is not advisable to use `replace` or other calls that replace all instances of a string within this function. Returns: Django ORM field name: str, Sort is ascending: bool T-Fr,Nzfilter:rzdata.rrdata__) startswithrYreplacerUcommon_data_columnsrSkeysr r[) raw_field_namera field_name ascendingoptional_prefixesprefix real_namerreal_name_suitables rpreprocess_field_namerls JIS! ^ #H-#3   (#CKM2J3 Z**3/ ^ W%&&w3 %ooAA ""'') *a / 7W//4466 $7%%**,-2$V#  #,,0CC!(">">!?@J y  $++GX>J y  rrB separatorcg}|D]$}|j||j|&|r|j|S)z Create a list with a separator between each item in the passed iterable `items` for example, intersperse(['one', 'two', 'three'], 0) == ['one', 0, 'two', 0, 'three'] )r]rZ)rBroutputitems r interspersersCF! d i ! Mr),__doc__logging collectionsrtypingrrr urllib.parserujsonr|core.feature_flagsrcore.utils.commonr data_manager.modelsr data_manager.prepare_paramsr django.confr rest_framework.genericsr tasks.modelsrTASKS getLoggerrrWrrrnrrrrrrrboolrr\rrrrrs#'' '.$5 5   8 $ 9 {|/d 2"T 6!eCI6F6!rxCDr