\jd0 vddlZddlmZddlZddlmZddlmZddlmZm Z m Z m Z m Z ddl mZddlmZmZddlmZdd lmZerdd lmZmZmZdd lmZ ddlZdd lmZmZmZddZddZ d dZ!d dZ" d!dZ# d!dZ$ddde%ddddddf dZ&GddeZ'y#e$r ed wxYw)"N) TYPE_CHECKING)consts)record_token_usage)get_start_span_functionset_data_normalizedtruncate_and_annotate_messagestransform_openai_content_part&truncate_and_annotate_embedding_inputs)SPANDATA) DidNotEnable Integration)should_send_default_pii)event_from_exception)AnyDictList)datetime)input_callbacksuccess_callbackfailure_callbackzLiteLLM not installedkwargsDict[str, Any]returnc^|jdi}|jd}|i}||d<|S)z,Get the metadata dictionary from the kwargs.litellm_paramsmetadata) setdefaultget)rrrs I/root/env/lib/python3.12/site-packages/sentry_sdk/integrations/litellm.py_get_metadata_dictr sA&&'7t"j@t"jBt"jDt"jFt"jHd}|jKD]&\}}|j |}|t!|||(y#t$r|}d}YkwxYw)zHandle the start of a request.Nmodelunknown call_type embedding aembedding embeddingschat )opnameorigin _sentry_spaninputF)unpackr+)r2stream max_tokenspresence_penaltyfrequency_penalty temperaturetop_p)& sentry_sdk get_clientget_integrationLiteLLMIntegrationrlitellmget_llm_provider ExceptionrrOP GEN_AI_CHATGEN_AI_EMBEDDINGSr= __enter__r rr GEN_AI_SYSTEMGEN_AI_OPERATION_NAMErinclude_promptsget_current_scoper&r(r GEN_AI_EMBEDDINGS_INPUTr0rGEN_AI_REQUEST_MESSAGESGEN_AI_REQUEST_MODELGEN_AI_RESPONSE_STREAMINGGEN_AI_REQUEST_MAX_TOKENSGEN_AI_REQUEST_PRESENCE_PENALTY GEN_AI_REQUEST_FREQUENCY_PENALTYGEN_AI_REQUEST_TEMPERATUREGEN_AI_REQUEST_TOP_Pitems)r integration full_modelr2provider_r5 operationspanembedding_inputscope input_list messages_datar+paramskey attributevalues r_input_callbackrnEs'')99:LMKGR(J ' 8 8 DxA  ;-IK9 #<   % " $F" II ! !,,{!E7 #!(( D NN26v~.h44h?h<xu U  ,' 88%$ ..4488$DD%FF::..F!,,.8Y 3   i 78[ sJ33 KKc Kt|SwN)rn)rs r_async_input_callbackrqs 6 ""s  start_timerend_timec t|}|jd}|ytjj t }|y t |dr%t|tj|jtry|jrlt |dr_g}|jD]0}t |dst |jdr*|j|jj!Qt |jdr*|j|jj#i} t |jdr|jj$| d<t |jd r|jj&| d <t |jd r|jj(| d <|j| 3|rt|tj*|t |d r<|j,} t/|t1| d dt1| d dt1| dd|jd} | dusd|vsd|vr)|j3dd}||j5dddyyy#|jd} | dusd|vsd|vr)|j3dd}||j5dddwwwxYw)zHandle successful completion.r>Nr2choicesr, model_dumpr'roler# tool_callsusage prompt_tokenscompletion_tokens total_tokens) input_tokens output_tokensr|rATcomplete_streaming_response!async_complete_streaming_response)r rrGrHrIrJhasattrrr GEN_AI_RESPONSE_MODELr2rrTrur,r*rvr'rwr#rxGEN_AI_RESPONSE_TEXTryrgetattrpop__exit__) rcompletion_responserrrsrrer`response_messageschoicemsgry is_streamings r_success_callbackrs"&)H << 'D |'')99:LMK60 & 0 h446I6O6O  # $)D)D*I6$&!199:Fvy1"6>><@-44V^^5N5N5PQ$V^^V<-44V^^5H5H5JK#%C&v~~v>.4nn.A.AF &v~~yA171G1GI&v~~|D4:NN4M4ML 1-44S9:"%'h;;=N & 0'--E $UOTB%e-@$G$UNDA  zz(+   $,62f<<<5D dD$/ = zz(+   $,62f<<<5D dD$/ =s A4JFJAKc&Kt||||Swrp)r)rrrrrss r_async_success_callbackrs!   s exceptioncHt|jd}|y t|tjj ddd\}}tj |||jt||dy#|jt||dwxYw)zHandle request failure.r>NrKF)typehandled)client_options mechanism)hint) r rrrGrHoptions capture_eventrr)rrrrrsreeventrs r_failure_callbackrs f % ) ). 9D | 8* %002::(U; t   T2 d9oy$7 d9oy$7s ABB!cFeZdZdZdZdeZd dddeddfdZed d Z y) rJa" LiteLLM integration for Sentry. This integration automatically captures LiteLLM API calls and sends them to Sentry for monitoring and error tracking. It supports all 100+ LLM providers that LiteLLM supports, including OpenAI, Anthropic, Google, Cohere, and many others. Features: - Automatic exception capture for all LiteLLM calls - Token usage tracking across all providers - Provider detection and attribution - Input/output message capture (configurable) - Streaming response support - Cost tracking integration Usage: ```python import litellm import sentry_sdk # Initialize Sentry with the LiteLLM integration sentry_sdk.init( dsn="your-dsn", send_default_pii=True integrations=[ sentry_sdk.integrations.LiteLLMIntegration( include_prompts=True # Set to False to exclude message content ) ] ) # All LiteLLM calls will now be monitored response = litellm.completion( model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}] ) ``` Configuration: - include_prompts (bool): Whether to include prompts and responses in spans. Defaults to True. Set to False to exclude potentially sensitive data. rKzauto.ai.selfrTrNc||_yrp)rT)rrTs r__init__zLiteLLMIntegration.__init__Gs .r!ctxsgt_ttjvr#tjjtttjvr#tjjtt xsgt_t tj vr#tj jt ttj vr#tj jttxsgt_ttjvr$tjjtyy)z(Set up LiteLLM callbacks for monitoring.N) rrKrnr*rqrrrrrr!r setup_oncezLiteLLMIntegration.setup_onceJs"0!52 '"8"8 8  " " ) )/ : (>(> >  " " ) )*? @#3#9r G$<$< <  $ $ + +,= > "'*B*B B  $ $ + +,C D#3#9r G$<$< <  $ $ + +,= > =r!)T)rN) __name__ __module__ __qualname____doc__ identifierr=boolr staticmethodrrr!rrJrJsJ*XJ | $F/+/d/d/??r!rJ)rrrr)r+List[Dict[str, Any]]rr)rrrN) rrrrrrrrsrrN)(r$typingrrGrsentry_sdk.ai.monitoringrsentry_sdk.ai.utilsrrrr r sentry_sdk.constsr sentry_sdk.integrationsr r sentry_sdk.scopersentry_sdk.utilsrrrrrrKrrr ImportErrorr r0rnrqrrrMrrJrr!rrs( 7'=41&&!0JJ 6[8|#G0 G0G0G0 G0  G0T        8 888 8  80D?D?{0 . //0s B**B8