]jD dZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z ddl mZmZmZmZmZmZmZddlmZddlmZerddlmZdd lmZdd lmZdd lm Z ed Z!ed e"Z#ee#e$fZ%ejLe'Z(de)ee$ffdZ*de ee!de+e!fdZ,dee-e$fde$fdZ.ddde/ee-e$fefde0de/e$effdZ1de$dedeffdZ2de$de3dfdZ4de$de3dfd Z5de$de3d!fd"Z6d#e$de$fd$Z7d%e$de$fd&Z8dejfd'Z9d(Z:d)ejde$fd*Z;d+e$dejfd,Zed-dde+dfd0Z>ed-ede$e ede$ffde+ede$ffd1Z>ed-e e#de+e#fd2Z>ed-e#de+e#fd3Z>d4Z>de?fd5Z@dNde3fd6ZAd7ee-e$fdejfd8ZBd9eee?eCe$fdee?fd:ZDd;dZFd?e e!d@e?de e e!ddffdAZGdNdBe$dCee?de$fdDZH dNdEee$dFedGe/eefdCee?dee$f dHZIdIe ee$d!fde+e$fdJZJdIe ee$d!fded<fdKZKdLe$de)e$e$ffdMZLy)Oz Miscellaneous helper functions. The formatter for ANSI colored console output is heavily based on Pygments terminal colorizing code, originally by Georg Brandl. N) GeneratorIterableSequence) TYPE_CHECKINGAnyCallableOptionalTypeVarUnionoverload) ResponseError)TimeoutFormatError)RedisJobQueueWorker_T_O)boundreturnctj|r|j|jfStj|stj |rd|j d|jfSt|tr dt|fStj|st|dr|dfStd|)aResolve a function reference into instance and function name components. Args: func: The function reference to resolve - can be a method, function, builtin, string path, or callable class instance. Returns: A tuple of (instance, func_name) where: - instance: The object instance (for methods/callable instances) or None - func_name: The string representation of the function name/path Raises: TypeError: If func is not a valid callable or string reference. N.__call__z*Expected a callable or a string, but got: )inspectismethod__self____name__ isfunction isbuiltin __module__ __qualname__ isinstancestras_textisclasshasattr TypeError)funcs 2/root/env/lib/python3.12/site-packages/rq/utils.pyresolve_function_referencer.1s}}dmm++   D !W%6%6t%<($*;*;)<=== D# WT]"" __T "wtZ'@ZDTFKLLlstc2|Dcgc]}|| c}Scc}w)zExcludes `None` values from a list-like object. Args: lst (list): A list (or list-like) object Returns: object (list): The list without None values )r0items r-compactr4Ls! 5TD$4D 55 5svct|tr|jdSt|tr|St dt |z)zConverts a bytes value to a string using `utf-8`. Args: v (Union[bytes, str]): The value (bytes or string) Raises: ValueError: If the value is not bytes or string Returns: value (str): The decoded string zutf-8zUnknown type %r)r&bytesdecoder' ValueErrortype)r5s r-r(r(XsA!Uxx  As *T!W455r/F) decode_valueshr;c|r td|jDStd|jDS)aDecodes the Redis hash, ensuring that keys are strings Most importantly, decodes bytes strings, ensuring the dict has str keys. Args: h (Dict[Any, Any]): The Redis hash decode_values (bool): If True, also decode values to strings using as_text(). Defaults to False. Returns: Dict[str, Any]: The decoded Redis data (Dictionary) When decode_values=True, returns Dict[str, str] c3NK|]\}}t|t|fywNr(.0kr5s r- z$decode_redis_hash..ys!CAWQZ,Cs#%c3<K|]\}}t||fywr?r@rAs r-rDz$decode_redis_hash..zs6DAqQ6s)dictitems)r<r;s r-decode_redis_hashrHls5CCCC 6AGGI6 66r/name.c|jd}|dd|dg}}d}t|r( dj|}tj|} | t|Sdj|}t||r t||S|j}dj|} t||}t||std|zt||S#t $r#|j d|jYnwxYwt|r#t$rtd|wxYw#td|zxYw)a#Returns an attribute from a dotted path name. Example: `path.to.func`. When the attribute we look for is a staticmethod, module name in its dotted path is not the last-before-end word E.g.: package_a.package_b.module_a.ClassA.my_static_method Thus we remove the bits from the end of the name until we can import it Args: name (str): The name (reference) to the path. Raises: ValueError: If no module is found or invalid attribute name. Returns: Any: An attribute (normally a Callable) rNrzInvalid attribute name: zInvalid attribute name: %s) splitlenjoin importlib import_module ImportErrorinsertpop __builtins__KeyErrorr9r*getattr) rI name_bitsmodule_name_bitsattribute_bitsmodule module_nameattribute_nameattribute_owner_nameattribute_owners r-import_attributer_}si& 3I'0"~ " n F   =((#34K,,[9F ~ @% %XXn-Nv~&v~..#'')N88N3H!&*>? ?N 35<== ?N 33/ =  ! !!%5%9%9%; < =   @7v>? ? @H5FGGs)&CD) D2)DDD/2Erct|}t|tstd|ddlm}t ||std||S)z.Import a worker class from a dotted path name.zInvalid worker class: rr)r_r&r:r9workerr issubclass)rIclsrs r-import_worker_classrdsN 4 C c4 1$899 c6 "1$899 Jr/rct|}t|tstd|ddlm}t ||std||S)z+Import a job class from a dotted path name.zInvalid job class: rr)r_r&r:r9jobrrb)rIrcrs r-import_job_classrgsN 4 C c4 .tf566 c3 .tf566 Jr/rct|}t|tstd|ddlm}t ||std||S)z-Import a queue class from a dotted path name.zInvalid queue class: rr)r_r&r:r9queuerrb)rIrcrs r-import_queue_classrjsN 4 C c4 0788 c5 !0788 Jr/ config_pathcLtjj|vxs|jd}|s|S|}|jdr|dd}|j tjjr|dd}|j tjjd}|S)a"Normalize configuration path to dotted module path format. Converts file paths like 'directory/config_file.py' or 'directory.config_file' to dotted module paths like 'directory.config_file' for use with importlib.import_module(). Args: config_path: Either a file path (e.g., 'app/cron_config.py', 'app/cron_config') or a dotted module path (e.g., 'app.cron_config') Returns: A dotted module path suitable for importlib.import_module() Examples: normalize_config_path('app/cron_config.py') -> 'app.cron_config' normalize_config_path('app/cron_config') -> 'app.cron_config' normalize_config_path('app.cron_config') -> 'app.cron_config' normalize_config_path('/abs/path/to/config.py') -> 'abs.path.to.config' z.pyNrr)ospathsependswith startswithreplace)rk is_file_path normalizeds r-normalize_config_pathrvs(77;;+-L1E1Ee1LL J5!_ RWW[[)^ ##BGGKK5J r/ file_pathctjj|std|dtjj |st d|d|S)amValidate that an absolute file path exists and points to a file. Args: file_path: The absolute file path to validate Returns: The same file path if validation passes (for chaining) Raises: FileNotFoundError: If the file does not exist IsADirectoryError: If the path points to a directory instead of a file Examples: validate_absolute_path('/path/to/config.py') # Returns '/path/to/config.py' validate_absolute_path('/path/to/missing.py') # Raises FileNotFoundError validate_absolute_path('/path/to/directory') # Raises IsADirectoryError z!Configuration file not found at ''z7Configuration path points to a directory, not a file: ')rnroexistsFileNotFoundErrorisfileIsADirectoryError)rws r-validate_absolute_pathr~ sW$ 77>>) $"CI;a PQQ 77>>) $"YZcYdde fgg r/cptjjtjjS)zReturn now in UTC)datetimenowtimezoneutcr2r/r-rr%s%    !2!2!6!6 77r/z%Y-%m-%dT%H:%M:%S.%fZdtc>|jttSr?)strftimer(_TIMESTAMP_FORMAT)rs r- utcformatr-s ;;w01 22r/stringc tjj|t}|j tj j S#t$r#tjj|d}YUwxYw)Nz%Y-%m-%dT%H:%M:%SZ)tzinfo)rstrptimerr9rsrr)rparseds r-utcparser1slJ""++F4EF >>!2!2!6!6> 77 J""++F4HIJs$A)A<;A<objcHt|txrt|t S)zReturns whether the obj is an iterable, but not a string Args: obj (Any): _description_ Returns: bool: _description_ )r&rr'rs r-is_nonstring_iterabler:s  c8 $ AZS-A)AAr/cyr?r2rs r-ensure_job_listrFs,/r/cyr?r2rs r-rrHs03r/cyr?r2rs r-rrJsehr/cyr?r2rs r-rrLs47r/cyr?r2rs r-rrNs*-r/c^t|trt|ts t|S|gS)zWhen passed an iterable of objects, convert to list, otherwise, it returns a list with just that object in it. Args: obj (Any): _description_ returns: List: _description_ )r&rr'listrs r-rrRs)#31*S#:N49YUXTYYr/cXtjtjS)zKReturns current UTC timestamp Returns: int: _description_ )calendartimegmr utctimetupler2r/r-current_timestampras ??35--/ 00r/cX| t||St|tr t|S|S)aGet a backend class using its default attribute name or an override Args: holder (_type_): _description_ default_name (_type_): _description_ override (_type_, optional): _description_. Defaults to None. Returns: _type_: _description_ )rVr&r'r_)holder default_nameoverrides r- backend_classrjs1v|,, Hc "))r/date_strc|s tdt|trt|j St|S)Nz#Empty string or bytestring provided)r9r&r7rr8)rs r- str_to_dater}s8 >?? h &HOO-. .H% %r/timeoutcVt|tjs| t|}|S| t|SdS#t$ret|t sJ|dd|ddj }}ddddd} t|||z}n#ttf$r tdwxYwY|wxYw) zGTransfer all kinds of timeout format to an integer representing secondsNrKiQi<r)dr<mszTimeout must be an integer or a string representing an integer, or a string with format: digits + unit, unit can be "d", "h", "m", "s", such as "1h", "23m".) r&numbersIntegralintr9r'lowerrUr)rdigitunit unit_seconds r- parse_timeoutrs gw// 0W5H 'lGN#.3w<8D8 gs+ ++!#2,(<(<(>4E %DrBK e*{4'88) (+  s' ::B(5BB(B""B('B( connectionrct t|ddst|jdd}|jdddDcgc] }t |}}t |dkr |j dt |dkr t|dt|t|dScc}w#t$rYywxYw) a/ Returns tuple of Redis server version. This function also correctly handles 4 digit redis server versions. Args: connection (Redis): The Redis connection. Returns: version (Tuple[int, int, int]): A tuple representing the semantic versioning format (eg. (5, 0, 9)) __rq_redis_server_versionNserver redis_versionrr)r ) rVr'inforLrrMappendsetattrtupler )r version_stri version_partss r- get_versionrsz#>Ejooh7HIK-8->->s-CBQ-GHSVHMHm$q($$Q'm$q( +m$  z#>??I s*AB+B&/B+!B+&B++ B76B7c| |z S)zCeiling division. Returns the ceiling of the quotient of a division operation Args: a (_type_): _description_ b (_type_): _description_ Returns: _type_: _description_ r2)abs r-ceildivrsR1W:r/a_list segment_sizec#VKtdt||D] }||||zyw)zSplits a list into multiple smaller lists having size `segment_size` Args: a_list (Sequence[Any]): A sequence to split segment_size (int): The segment size to split into Yields: list: The splitted listed rN)rangerM)rrrs r- split_listrs61c&k< 0+Q\)**+s')data max_lengthc:||St||kDr|d|dzS|S)aTruncate arguments with representation longer than max_length Args: data (str): The data to truncate max_length (Optional[int], optional): The max length. Defaults to None. Returns: truncated (str): The truncated string Nz...)rM)rrs r-truncate_long_stringrs1 *-d)j*@D*  %JdJr/ func_nameargskwargsc H|y|Dcgc] }ttt||"}}|jDcgc](\}}|dttt||*}}}|t |z }dj |}|d|dScc}wcc}}w)a Returns a string representation of the call, formatted as a regular Python function invocation statement. If max_length is not None, truncate arguments with representation longer than max_length. Args: func_name (str): The function name args (Any): The function arguments kwargs (Dict[Any, Any]): The function kwargs max_length (int, optional): The max length. Defaults to None. Returns: str: A string representation of the function call. N=z, ())r(rreprrGsortedrN) rrrrargarg_listrCr5 list_kwargss r-get_call_stringrs"PTU,T#Y CDUHU[a[g[g[ijSWSTVWaS'"6tAw "KLMNjKj {##H 99X D[$q !! Vjs %B-Bqueues_or_namescddlm}g}|D]D}t||r|j|j+|jt |F|S)z;Given a iterable of strings or queues, returns queue namesrr)rirr&rrIr')rrnames queue_or_names r- parse_namesrsM E(- mU + LL++ , LL]+ , - Lr/cRddlm}|D]}t||s|jcSy)z7Given a list of strings or queues, returns a connectionrrN)rirr&r)rrrs r-get_connection_from_queuesrs/(, mU + ++ +, r/ composite_keyc|jd}t|dk(r$tjd|t|ddfS|\}}||fS)zMethod returns a parsed composite key. Args: composite_key (str): the composite key to parse Returns: tuple[str, str]: tuple of job id and the execution id :rz4Composite key must contain job_id:execution_id, got r)rLrMwarningswarnDeprecationWarning)rresultjob_id execution_ids r-parse_composite_keyrs`  %F 6{a  B=/ R  q 2!FL L !!r/r?)M__doc__rrrOrloggingrrnrcollections.abcrrrtypingrrrr r r r redis.exceptionsr exceptionsrredisrrfrrirrarrobjectrr'ObjOrStr getLoggerr!loggerrr.rr4r7r(rFboolrHr_r:rdrgrjrvr~rrrrrrrrrrfloatrrrrrrrrrr2r/r-rsM 99+* T] T  S>   8 $Mc3hM6 6(2,' 6DH 66uUCZ 6S6(QV7eE3J/4577Z^_bdg_gZh7"243248CH#524j c d8n  3 4;  S T'] (s(s(Vcc68X  8 ,3(##338S8X..8 Bs Bt B //c/ / 334;3 3 huc8E%*4E+FFGhDQVW\^aWaQbLch h 7"7$r(7 7 --R- - Z131$&&%s +&0A0A&98E#uc/$:;9 9,Gc3m(<<  +x| +3 +9Xb\SWY]E];^ + Ks K K K ^b"}"$'"15c3h"MUVY]" c]": %W *=!> 49 sG|9L0MRZ[bRc"s"uS#X"r/