This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get Inter-Annotator Agreement (IAA) matrix for a project, showing agreement between all annotators. Parameters ---------- id : int expand : typing.Optional[str] Comma-separated list of fields to expand per_label : typing.Optional[bool] Calculate IAA per label std : typing.Optional[bool] Include standard deviation in results task : typing.Optional[str] Comma-separated list of task IDs to filter by request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[IaaStatsResponse] Inter-Annotator Agreement matrix r1 /stats/IAAr4 r\ rP r] r^ rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- r\ rP r] r^ r, rK rL rM s r' iaazRawStatsClient.iaa s V ((55== ,R 01 < & , > ti++1c1 $" . ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get ground truth agreement statistics for multiple users within a project. Parameters ---------- id : int ids : str Comma separated list of user IDs to get ground truth agreement for per_label : typing.Optional[bool] Per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[UsersGroundTruthAgreementStatsResponse] Ground truth agreement statistics for multiple users r1 /stats/agreement-groundtruthr4 rd rP rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- rd rP r, rK rL rM s r' users_ground_truth_agreementz+RawStatsClient.users_ground_truth_agreement s F ((55== ,R 011M N & , > ti++1c1 :" D ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement statistics for a specific annotator within a project. Parameters ---------- id : int user_id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[AgreementAnnotatorStatsResponse] Individual annotator agreement statistics r1 /stats/agreement_annotator/r4 r5 r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- rk r, rK rL rM s r' agreement_annotatorz"RawStatsClient.agreement_annotatorB s 4 ((55== ,R 011LM]^eMfLg h + > ti++1c1 3" = ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement statistics for multiple annotators within a project. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get agreement scores for request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[AgreementAnnotatorsStatsResponse] Multiple annotator agreement statistics r1 /stats/agreement_annotatorsr4 rd rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- rd r, rK rL rM s r' agreement_annotatorsz#RawStatsClient.agreement_annotatorsp s 6 ((55== ,R 011L Ms , > ti++1c1 4" > ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get statistics about user data filters and their usage within a project. Parameters ---------- id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[DataFiltersStatsResponse] User data filter statistics r1 /stats/data_filterr4 r5 r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- r, rK rL rM s r' data_filterszRawStatsClient.data_filters s 0 ((55== ,R 011C D + > ti++1c1 ," 6 ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get statistics about finished tasks for a project. Parameters ---------- id : int user_pk : typing.Optional[int] User ID to filter statistics by (optional) request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[FinishedTasksStatsResponse] Finished tasks statistics r1 /stats/finishedr4 r{ rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- r{ r, rK rL rM s r' finished_tasksz RawStatsClient.finished_tasks s 6 ((55== ,R 01 A7 , > ti++1c1 ." 8 ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get lead time statistics across the project, including average annotation time. Parameters ---------- id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[LeadTimeStatsResponse] Lead time statistics r1 /stats/lead_timer4 r5 r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rw s r' lead_timezRawStatsClient.lead_time s 0 ((55== ,R 011A B + > ti++1c1 )" 3 ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Overall or per-label total agreement across the project. NOTE: due to an open issue in Fern, SDK clients will raise ApiError upon handling a 204 response. As a workaround, wrap call to this function in a try-except block. Parameters ---------- id : int per_label : typing.Optional[bool] Return agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[TotalAgreementStatsResponse] Total agreement r1 /stats/total_agreementr4 rP rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r& r- rP r, rK rL rM s r' total_agreementz RawStatsClient.total_agreement, s B ((55== ,R 011G HY , > ti++1c1 /" 9 ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Start stats recalculation for given project Parameters ---------- id : int stat_type : typing.Optional[str] Stat type to recalculate. Possible values: label, stats request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[typing.Dict[str, typing.Any]] Successful response returns job id r1 /update-statsr4 r rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF DictstrAnyr rG r r r rH rA rI r& r- r r, rK rL rM s r' update_statszRawStatsClient.update_statsd s# > ((55== ,R 01 ?Y , > ti++1c1 KKVZZ0" $kk#vzz/ : ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get prediction agreement statistics for multiple annotators within a project. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get agreement scores for per_label : typing.Optional[bool] Per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[UsersPredictionAgreementStatsResponse] Prediction agreement statistics for multiple annotators r1 /user-stats/predictionr4 rg rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rh s r' users_prediction_agreementz)RawStatsClient.users_prediction_agreement s F ((55== ,R 011G H & , > ti++1c1 9" C ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get review score and performance score statistics for multiple annotators within a project. Only allowed for accounts with reviewing features enabled. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get review scores for per_label : typing.Optional[bool] Per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[UsersReviewScoreStatsResponse] Review scores and performance scores for multiple annotators r1 /user-stats/review_scorer4 rg rS r7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rh s r' users_review_scorez!RawStatsClient.users_review_score s F ((55== ,R 011I J & , > ti++1c1 1" ; ) 0 $YUCC &^^ -N 9#8#8$yGXGXBY`noo ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement between a given model version and ground truth annotations in the project for overlapping tasks. Parameters ---------- id : int model_version : str per_label : typing.Optional[bool] Calculate agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[ModelVersionGroundTruthAgreementStatsResponse] Model-version ground truth agreement r1 r2 rR r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rU s r' rV z8AsyncRawStatsClient.model_version_ground_truth_agreement s D ..;;CC ,R 01 ?OP]?^>__u vY , D ti++1c1 A" K ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement between a given model version and all other model versions in the project for overlapping tasks. Parameters ---------- id : int model_version : str per_label : typing.Optional[bool] Calculate agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[ModelVersionPredictionAgreementStatsResponse] Model-version prediction agreement r1 r2 rY r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rU s r' rZ z6AsyncRawStatsClient.model_version_prediction_agreement' s D ..;;CC ,R 01 ?OP]?^>__j kY , D ti++1c1 @" J ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get Inter-Annotator Agreement (IAA) matrix for a project, showing agreement between all annotators. Parameters ---------- id : int expand : typing.Optional[str] Comma-separated list of fields to expand per_label : typing.Optional[bool] Calculate IAA per label std : typing.Optional[bool] Include standard deviation in results task : typing.Optional[str] Comma-separated list of task IDs to filter by request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[IaaStatsResponse] Inter-Annotator Agreement matrix r1 r` r4 ra rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rb s r' rc zAsyncRawStatsClient.iaa` s V ..;;CC ,R 01 < & , D ti++1c1 $" . ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo1 , ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement statistics for a specific annotator within a project. Parameters ---------- id : int user_id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[AgreementAnnotatorStatsResponse] Individual annotator agreement statistics r1 rm r4 r5 Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rn s r' ro z'AsyncRawStatsClient.agreement_annotator s 4 ..;;CC ,R 011LM]^eMfLg h + D ti++1c1 3" = ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo% ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get agreement statistics for multiple annotators within a project. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get agreement scores for request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[AgreementAnnotatorsStatsResponse] Multiple annotator agreement statistics r1 rq r4 rd rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rr s r' rs z(AsyncRawStatsClient.agreement_annotators s 6 ..;;CC ,R 011L Ms , D ti++1c1 4" > ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get statistics about user data filters and their usage within a project. Parameters ---------- id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[DataFiltersStatsResponse] User data filter statistics r1 rv r4 r5 Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rw s r' rx z AsyncRawStatsClient.data_filters@ s 0 ..;;CC ,R 011C D + D ti++1c1 ," 6 ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo% ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get statistics about finished tasks for a project. Parameters ---------- id : int user_pk : typing.Optional[int] User ID to filter statistics by (optional) request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[FinishedTasksStatsResponse] Finished tasks statistics r1 r} r4 r{ rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r~ s r' r z"AsyncRawStatsClient.finished_tasksl s 6 ..;;CC ,R 01 A7 , D ti++1c1 ." 8 ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get lead time statistics across the project, including average annotation time. Parameters ---------- id : int request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[LeadTimeStatsResponse] Lead time statistics r1 r r4 r5 Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rw s r' r z AsyncRawStatsClient.lead_time s 0 ..;;CC ,R 011A B + D ti++1c1 )" 3 ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo% ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Overall or per-label total agreement across the project. NOTE: due to an open issue in Fern, SDK clients will raise ApiError upon handling a 204 response. As a workaround, wrap call to this function in a try-except block. Parameters ---------- id : int per_label : typing.Optional[bool] Return agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[TotalAgreementStatsResponse] Total agreement r1 r r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r s r' r z#AsyncRawStatsClient.total_agreement s B ..;;CC ,R 011G HY , D ti++1c1 /" 9 ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Start stats recalculation for given project Parameters ---------- id : int stat_type : typing.Optional[str] Stat type to recalculate. Possible values: label, stats request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[typing.Dict[str, typing.Any]] Successful response returns job id r1 r r4 r rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r r r rG r r r rH rA rI r s r' r z AsyncRawStatsClient.update_stats s1 > ..;;CC ,R 01 ?Y , D ti++1c1 KKVZZ0" $kk#vzz/ : ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get prediction agreement statistics for multiple annotators within a project. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get agreement scores for per_label : typing.Optional[bool] Per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[UsersPredictionAgreementStatsResponse] Prediction agreement statistics for multiple annotators r1 r r4 rg rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rh s r' r z.AsyncRawStatsClient.users_prediction_agreement8 s F ..;;CC ,R 011G H & , D ti++1c1 9" C ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo- ( ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get review score and performance score statistics for multiple annotators within a project. Only allowed for accounts with reviewing features enabled. Parameters ---------- id : int ids : str Comma separated list of annotator user IDs to get review scores for per_label : typing.Optional[bool] Per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[UsersReviewScoreStatsResponse] Review scores and performance scores for multiple annotators r1 r r4 rg rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI rh s r' r z&AsyncRawStatsClient.users_review_scores s F ..;;CC ,R 011I J & , D ti++1c1 1" ; ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo- ( ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get prediction agreement statistics for a specific user within a project. Parameters ---------- id : int user_pk : int per_label : typing.Optional[bool] Calculate agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[UserPredictionAgreementStatsResponse] Individual user prediction agreement statistics r1 r rY r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r s r' r z-AsyncRawStatsClient.user_prediction_agreement s D ..;;CC ,R 01 >Nw>W=XXc dY , D ti++1c1 8" B ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get review score statistics for a specific user within a project. Only allowed for accounts with reviewing features enabled. Parameters ---------- id : int user_pk : int per_label : typing.Optional[bool] Calculate agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[UserReviewScoreStatsResponse] Individual user review score statistics r1 r r r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r s r' r z%AsyncRawStatsClient.user_review_score s D ..;;CC ,R 01 >Nw>W=XXe fY , D ti++1c1 0" : ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
Get ground truth agreement statistics for a specific user within a project. Parameters ---------- id : int user_pk : int per_label : typing.Optional[bool] Calculate agreement per label request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[UserGroundTruthAgreementStatsResponse] Individual user ground truth agreement statistics r1 r rf r4 rP rS Nr7 r8 r9 r< r? )r$ rC rD r r@ rE rF r r rG r r r rH rA rI r s r' r z/AsyncRawStatsClient.user_ground_truth_agreement s D ..;;CC ,R 019I'9R8SSo pY , D ti++1c1 9" C ) 0 ))%HH &^^ -N 9#8#8$yGXGXBY`noo+ & ty'<'