]j6dZddlZddlmZddlmZmZmZddlmZm Z m Z ddl m Z ddl mZddlmZdd lmZdd lmZej,eZee d d Zed ZedZee ddZee ddZee ddZde de!fdZ"d*de deede#fdZ$de deefdZ%de fdZ&de fdZ'de#fdZ(dee fdZ)d*deee de#fd Z*de#fd!Z+dee dee,fd"Z-dee de#fd#Z.d*d$e de,fd%Z/d&ee,de,fd'Z0d+d(e#de#fd)Z1y),z Redis-based user activity tracking system and background tasks for synchronization. This module provides functionality to cache user last_activity timestamps in Redis with batch synchronization to the database to reduce database load. N)datetime)ListOptionalSet)_redisredis_connectedstart_job_async_or_sync)settings)get_user_model) transaction)timezone)get_connectionUSER_ACTIVITY_REDIS_KEY_PREFIX user_activity_counter_batchUSER_ACTIVITY_BATCH_SIZEdUSER_ACTIVITY_SYNC_THRESHOLD2USER_ACTIVITY_REDIS_TTLiQuser_idreturnctd|S)z Get Redis key for user activity.:)USER_ACTIVITY_KEY_PREFIX)rs T/root/env/lib/python3.12/site-packages/label_studio/users/functions/last_activity.py_get_user_activity_keyr!s& 'q 22 timestampctsy|tj} |j}t |}t }|j |t||jt||jttt}tjd||y#t$r!}tjd||Yd}~yd}~wwxYw)z Set user last activity timestamp in Redis. Args: user_id: User ID timestamp: Activity timestamp (defaults to current time) Returns: True if successfully set, False otherwise FNz+Updated activity for user %s, counter at %sTz+Failed to set user activity for user %s: %s)rdjango_timezonenow isoformatrrsetex REDIS_TTLsaddUSER_ACTIVITY_BATCH_KEYexpireincrement_activity_counterloggerdebug Exceptionerror)rr timestamp_str redis_key redis_client current_countes rset_user_last_activityr4&s  #'') !++- *73 &'  9i? 17;3Y?34  BG][  BGQOsB B11 C:CCc*ty t|}t}|j|}|r6t |t r|j d}tj|Sy#t$r!}tjd||Yd}~yd}~wwxYw)z Get user last activity timestamp from Redis with database fallback. Args: user_id: User ID Returns: Last activity timestamp or None if not found Nzutf-8z+Failed to get user activity for user %s: %s) rrrget isinstancebytesdecoder fromisoformatr-r+r.)rr0r1r/r3s rget_user_last_activityr;Rs~ P*73 %' $((3 -/ - 4 4W = ))-8 8  P BGQOOPsAA(( B1B  Bctsy t}|jt}|j tt t jd||S#t$r }t jd|Yd}~yd}~wwxYw)zj Increment activity counter and return current count. Returns: Current counter value rz"Activity counter incremented to %sz(Failed to increment activity counter: %sN) rrincrUSER_ACTIVITY_COUNTER_KEYr)r&r+r,r-r.)r1r2r3s rr*r*oss   %' $))*CD 5yA 9=I  ?CsAA B'BBctsy t}|jt}| t |SdS#t $r }t jd|Yd}~yd}~wwxYw)zY Get current activity counter value. Returns: Current counter value rNz"Failed to get activity counter: %s)rrr6r>intr-r+r.)r1countr3s rget_activity_counterrBsa  %'   !:;".s5z5A5  91=s+;; A$AA$ctsy t}|jtd|j tt t jdy#t$r }t jd|Yd}~yd}~wwxYw)zh Reset activity counter to 0. Returns: True if successfully reset, False otherwise FrzActivity counter reset to 0Tz$Failed to reset activity counter: %sN) rrsetr>r)r&r+r,r-r.)r1r3s rreset_activity_counterrEsn   %' 2A65yA 23  ;Q?sAA B&BBc4ts tS t}|jt}|Dchc]}|st |j  c}Scc}w#t$r*}tjd|tcYd}~Sd}~wwxYw)zc Get all user IDs from batch set. Returns: Set of user IDs to be synchronized z Failed to get batch user IDs: %sN) rrDrsmembersr(r@r9r-r+r.)r1user_idsuidr3s rget_batch_user_idsrJsv  u %' (()@A-5=cCJJL!===  7;u s4#A$AAA$A$$ B-B BBrHctsy t}|r|r-|jtg|n|j tt j d|xsdy#t$r }t jd|Yd}~yd}~wwxYw)z Clear user IDs from batch set. Args: user_ids: Specific user IDs to remove (if None, clears all) Returns: True if successfully cleared, False otherwise FzCleared batch user IDs: %sallTz"Failed to clear batch user IDs: %sN) rrsremr(deleter+r,r-r.)rHr1r3s rclear_batch_user_idsrOs  %' ! !!"9EHE    7 8 183DuE  91=sAA## B ,BB cft}|tk\}|rtjd|t|S)z Check if activities should be synchronized to database. Returns: True if sync threshold is reached, False otherwise z Sync threshold reached: %s >= %s)rBSYNC_THRESHOLDr+info)r2 should_syncs rshould_sync_activitiesrTs0)*M>1K 6 ~V rctsgSg}|D]$} t|}|r|j||d&|S#t$r!}tj d||Yd}~Nd}~wwxYw)z Get user activities from Redis for database synchronization. Args: user_ids: Set of user IDs to get activities for Returns: List of dictionaries with user_id and last_activity )r last_activityz2Failed to get activity for user %s during sync: %sN)rr;appendr-r+r.)rH activitiesrr r3s rget_user_activities_for_syncrYsx   J .w7I!!g "RS     LLMwXY Z  s!: A$AA$c8tsy t}|Dcgc] }t|}}|r|j|t |t j dt|ycc}w#t$r }t jd|Yd}~yd}~wwxYw)z Clean up Redis activity data for given user IDs. Args: user_ids: Set of user IDs to clean up Returns: True if successfully cleaned, False otherwise Fz"Cleaned up Redis data for %s usersTz)Failed to cleanup Redis activity data: %sN) rrrrNrOr+r,lenr-r.)rHr1rkeys_to_deleter3s rcleanup_redis_activity_datar]s  %' JRRg09RR  L   0 X& 93x=IS  @!Ds'A0A+=A0+A00 B9BB max_userscF|t}tjd t}|stjddddddSt ||kDr-t t |d|}tjd|tjd t |t|}|s:tjd t |t|ddt |d dSt|}|d rRt|t}|rt |tkr)ttjd t |tjd||S#t$r5}tjd|dddddt|dcYd}~Sd}~wwxYw)z Synchronize user activities from Redis to database. Args: max_users: Maximum number of users to process (defaults to BATCH_SIZE) Returns: Dictionary with sync results Nz'Starting user activity sync to databasezNo user activities to syncTrzNo activities to syncsuccess processederrorsmessagezLimited batch to %s userszSyncing activities for %s usersz#No activity data found for %s userszNo activity data foundrazBReset activity counter after successful sync (remaining users: %s)zActivity sync completed: %sz"Failed to sync user activities: %sexc_infoFz Sync failed: ) BATCH_SIZEr+rRrJr[rDlistrYwarningr]_bulk_update_user_activitiesrQrEr-r.str)r^rHrX sync_resultremaining_usersr3s rsync_user_activities_to_dbro0sv  KK9:+d%' KK4 5#!qMde e x=9 $4>*956H KK3Y ? 5s8}E2(;  NN@#h- P ' 1#!s8}Yqr r3:> y ! ' 112O"c/&:^&K&( `befubvw 1;? d 91t L qAMZ]^_Z`YaJbccds+'E"B E"(A9E"" F +*FF F rXc|sddddSd}d} tj5t}|Dcgc]}|d }}|jj dj |j dd}|Dcic]}|j|}}g} |D]}|d} |d} |j| }|ra|j| |jkDr| |_ | j||d z }Ytjd | | |j|d z }tjd | |d z }| r>|jj| dgd tjdt!| d||t!| dcd d d Scc}wcc}w#1swYy xYw#t"$r8} tj%d| dd||d zdt'| dcYd } ~ Sd } ~ wwxYw)z Bulk update user activities in database. Args: activities: List of activity dictionaries Returns: Dictionary with update results Tr)rarbrcr) skip_locked)id__inidrVNrgz0Skipping outdated activity for user %s: %s <= %szUser %s not found in databaser) batch_sizezBulk updated %s users)rarbrcupdatedz)Failed to bulk update user activities: %sreFzBulk update failed: r`)r atomicr objectsselect_for_updatefilteronlyrsr6rVrWr+r,rj bulk_updaterRr[r-r.rl) rXrbrcUseractivityrHexisting_usersuser user_dictusers_to_updater new_activityr3s rrkrkms a1==I F2    !( p!#Dr(rhrQr&r@rlrboolr4r;r*rBrErJrOrTdictrYr]rorkrrrrs&&GG .!4$   8 $#8-M_78A56f=X93 ? #A2F H7 ? 3C3C3 )C)HX4F)RV)XPCPHX,>P:C0c(,CH(8CH#5@   3s8T 6#c(t@:d#:d:dzB T$ZB DB J$4r