]jddlmZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z dd lmZdd lmZdd lmZGd d Zy))Iterable)Optional)uuid4)Redis)Pipeline)Queue)NoSuchGroupError)Job) EnqueueData)as_textc eZdZdZdZdZddedeefdZ dZ d e e d e fd Zd Zdd ede dd edfdZdefdZdded edfdZeddedeefdZededefdZedddedfdZededefdZeddZy)GroupzKA Group is a container for tracking multiple jobs with a single identifier.z rq:group:z rq:groupsN connectionnamec|r|nttj|_||_|j |j|_yN)strrhexrrREDIS_GROUP_NAME_PREFIXkey)selfrrs 2/root/env/lib/python3.12/site-packages/rq/group.py__init__zGroup.__init__s: Dc%'++&6 $223DII;?c"d|jdS)Nz Group(id=))r)rs r__repr__zGroup.__repr__s499+Q''rjobspipelinec|j|jg|Dcgc]}|jc}|j|j|j|j ycc}w)zAdd jobs to the groupN)saddridREDIS_GROUP_KEYrexecute)rrr jobs r _add_jobszGroup._add_jobssQ dhh:D!9S#&&!9: d**DII6":sA- c8|jj5}t|jj|jDcgc] }t |}}|s dddyg}|D]&}|j tj|(|j}t|D]\}}|r |j|||r-|j|jg||jdddycc}w#1swYyxYw)zDelete jobs from the group's job registry that have been deleted or expired from Redis. We assume while running this that alive jobs have all been fetched from Redis in fetch_jobs methodN) rr listsmembersrr existsr key_forr% enumerateappendsrem)rpiper&job_idsexpired_job_idsresultsi key_existss rcleanupz Group.cleanup$s__ % % ' 4/3DOO4L4LTXX4V/WXws|XGX  !O . CKK,- .llnG!*7!3 7 :!#**71:6 7 $((5_5   X  s+1D D D,AD=AD DDqueue job_datasr rc|r|n|jj}|j||j|}|j ||||j |S)N)group_idr )r )rr enqueue_manyrr'r%)rr7r8r r0rs rr;zGroup.enqueue_many7sW#x)A)A)C!!)dii$!O td+   LLN rreturnc|j|jj|jDcgc] }t |}}t j ||jDcgc]}|| c}Scc}wcc}w)z4Retrieve list of job IDs from the group key in Redis)r6rr*rr r fetch_many)rr&r1s rget_jobszGroup.get_jobsCsb +/??+C+CDHH+MNC73<NN"~~gtG[3?[[O[sA=.B6Bjob_idc|r|n|jj}|j|j|||j yyr)rr r/rr%)rr@r r0s r delete_jobzGroup.delete_jobIs>#x)A)A)C $((F#   LLN rc|||S)Nrr)clsrrs rcreatez Group.createOs44rc|||}|jtj|jst|S)z"Fetch an existing group from RedisrD)r+rget_keyrr )rFrrgroups rfetchz Group.fetchSs6*5  uzz!:;" " rrc |j|jDcgc] }t|}}g}|D]%} |j|j ||'|Scc}w#t $r|j |j|YVwxYw)z"Returns an iterable of all Groups.r)r*r$r r.rKr r/)rFrr group_keysgroupss rallz Group.all[s/9.A.A#BUBU.VWsgclW W :C : cii iCD :  X $ : 3 3S9 :sA "A%%%B  B c |j|zS)z9Return the Redis key of the set containing a group's jobs)r)rFrs rrIz Group.get_keygs**T11rctj|}|j5}|D]}|j|j |D]}|j |j |j }g}t|D]&\}}|r |j||j(|r|j|jg||j dddy#1swYyxYw)zLoop through groups and delete those that have been deleted. If group still has jobs in its registry, delete those that have expiredrMN) rrPr r6r%r+rr-r.rr/r$) rFrrOprJr3expired_group_idsr4r5s rclean_registrieszGroup.clean_registrieslsj1  " a   IIK $# $iikG " !*7!3 = :!%,,VAY^^< =!s**?->? IIK   sA/C/AC//C8r)rr)__name__ __module__ __qualname____doc__rr$rrrrrrr rr'r6r r;r)r?rB classmethodrGrKrPrIrUrErrrrs;U)!O@5@ @ (hsmx & % H]4K W_`jWk \$\ 0D 55Xc]55% W g  232322rrN)collections.abcrtypingruuidrredisr redis.clientrr exceptionsr r&r r7r utilsr rrErrrcs/$!(ppr