+ Wj=ZRt^RIHt^RIt^RIt^RIHt^RIHtH t ^RI H t H t ^RI Ht^RIHtHt]P$!]4tRCtRDtREtRFtR R R R /tR t^@tRtRt]P<!R4tRt RRlt!RRlt"RRlt#RRlt$RRlt%RRlt&RRlt'RR lt(]!R!R"44t)]!R#R$44t*R%R&lt+]!R'R(44t,]!R)R*44t-R+R,lt.R-R.lt/R/R0lt0R1R2lt1R3R4lt2R5R6lt3R7R8lt4R9R:lt5R;R<lt6R=R>lt7R?R@lt8RARBlt9R#)GaEfficiency shared metrics: what one user turn costs, what users throw away, and where Hermes spends tokens it did not have to (spilled tool output, idle tool schemas, prompt-cache breaks). Per-turn state lives on the relay runtime's task/session objects (see ``TurnCost`` and ``SessionEfficiency``); the agent-side entry points below run on the agent thread and are no-ops unless shared metrics are enabled. Provider/model always go through the catalog helpers. ) annotationsN)deque) dataclassfield)AnyIterable)shared_metrics_contract)_bucket_non_negative_numbersuccess completed cancelled interruptedgr@_shared_metrics_tool_outputszR\[[A-Z_ ]{1,32} TRUNCATED - [\d,]{1,20} chars omitted out of ([\d,]{1,20}) total\]c V^8dQhRRRR/#)tokens int | Nonereturnstr)formats"fC:\Users\johnn\AppData\Local\hermes\hermes-agent\hermes_cli\observability\shared_metrics_efficiency.py __annotate__r3saa*aacDVfR#\\^V4\R4#)Nunknowngte_1m)r max_TOKEN_THRESHOLDSrs&r tokens_bucketr#3s"9`GC6NDUW_,``rc V^8dQhRRRR/#)rcountintrrr)rs"rrr7sHH3H3HrcJ\\^\V44\R4#)gte_101)r r r&_ACTIVITY_THRESHOLDS)r%s&ractivity_bucketr+7s 3q#e*%';Y GGrc V^8dQhRRRR/#)rsizerrrr)rs"rrr;seeZeCercDVfR#\\^V4\R4#)Nrgte_500k)r r _OUTPUT_SIZE_THRESHOLDS)r-s&routput_size_bucketr1;s" 9d'#a,@WYc*ddrc V^8dQhRRRR/#)rrr&rrr)rs"rrr?sMMMMrcJ\\^\V44\R4#)r(gte_40k)r r r&_SCHEMA_TOKEN_THRESHOLDSr"s&rschema_tokens_bucketr6?s 3q#f+&(@) LLrc V^8dQhRRRR/#)rvaluerrrr)rs"rrrCs333 3rc:\V4pVfR#\V4#N)r r&)r8numbers& r_intr<Cs !% (F>42s6{2rc V^8dQhRRRR/#)rusagerrrr)rs"rrrHs a as az arcj\V\4'gR#\VPR44pVeV#RUu.uFp\VPV44NK pp\;QJdRV4F 'gK RM RM !RV44'd\ RV44#R#uupi)z\Prompt (cache reads/writes included) plus completion tokens of one call; None without usage.N total_tokensc3("TFqRJxK R#5ir:r.0ps& r call_tokens..Qs8VPU1$PUsTFc30"TF qfKVxK R#5ir:rrBs& rrErFQs1%Qqq%s ) input_tokens output_tokenscache_read_tokenscache_write_tokens) isinstancedictr<getanysum)r>totalkeypartss& r call_tokensrTHs eT " " >* +E  .T U.TcT%))C. !.TE U58S8VPU8VSSS8VPU8V5V5V31%1 1`\`` Us#B0c V^8dQhRRRR/#)rtoolsetrrrr)rs"rrrTskkkkrc`\V\4'dV\P9dV#R#)zUA shipped toolset's own name; MCP servers, plugins and user toolsets read ``custom``.custom)rLrcontractBUILTIN_TOOLSET_NAMES)rVs&rtoolset_metric_namer[Ts' #..7h>\>\3\7jbjjrc V^8dQhRRRR/#)rroutedict[str, str] | Nonerdict[str, str]r)rs"rrrYs=='=N=rcF^RIHpV'd \V4#V!RR4#) model_routeN)shared_metrics_modelrcrM)r]rcs& r_routereYs14;<[t%<rrNoner)rs"rrTurnCost.__annotate__ks!nSTrc tWn\V4pVe#V;PV, unRVnR#R#NT)r]rTrrj)selfr]r>rs&&& radd_callTurnCost.add_callks1 U#   KK6 !KDJ rcV^8dQhRR/#)rrrr)rs"rrrmrsBBBrc \\VP'dVP4#R4#r:)r#rjr)rps&rbucketTurnCost.bucketrs!DJJJT[[AADAAr)rjr]) __name__ __module__ __qualname____firstlineno____doc__ri__annotations__rrjr]rqru__static_attributes__rrrrgrgasCCItFCOE4#'E 'BBrrgc:]tRt^vt$R]R&R]R&RtR]R&RtR #) _SpentTurnr_r]rr#FrhwastedrN)rwrxryrzr|rr}rrrrrvs FDrrc$V^8dQhRRRRRR/#)rreasonrturnrrtuple[str, dict[str, str]]r)rs"rrr}s'nnn:n2Lnrc^\P/VPCRVRVP/C3#)rr#)rYWASTED_TOKENS_MARKr]r#)rrs&&r _wasted_rowr}s/  & &(m4::(mxZ^ZlZl(m mmrc]tRt^t$RtRtR]R&RtR]R&]!4t R]R &^t R ]R &^t R ]R &R t R]R&] !]R7tR]R&RRltRRltRRltRtR #) ToolUsagezWWhat the session paid to carry tool definitions, and which shipped toolsets it touched.Frhobservedrrsurfacefrozenset[str]enabled_toolsetsr& enabled_count schema_tokensNztuple[str, ...] | Nonenamesdefault_factoryzset[str]usedc ,V^8dQhRRRRRRRRRR /#) rrztuple[str, ...]toolsetsrrr&rrrhr)rs"rrToolUsage.__annotate__s2_WZknswrc VPRJ;'dWP8gpRVuVnVnVPV,Vn\VPV4VuVnVnV#)zORecord the tools one request sent; True when a later request changed the array.NT)rrrr rr)rprrrrchangeds&&&&& robserveToolUsage.observesg**D(@@Ujj-@$(%! tz $ 5 5 @14T5G5G1WYf.D.rc V^8dQhRRRR/#)rotherrrrlr)rs"rrrs  I $ rc ~VP'gR#RVPuVnVnVPVP,Vn\VPVP4Vn\VP VP 4VnV;P VP ,unR#ro)rrrr rrr)rprs&&rabsorbToolUsage.absorbs~~~ &*EMM# t| $ 5 58N8N N !3!3U5H5HI !3!3U5H5HI UZZ rcV^8dQhRR/#)rr list[tuple[str, dict[str, str]]]r)rs"rrrs  6 rc  4aSP'g.#\PR\P!SP4RSP R\ SP4/3.pVPV3Rl\SP444V#)enabled_tool_count_bucketexecution_surfacetool_schema_tokens_bucketc3v<"TF.p\PRTRVSP9dRMR/3xK0 R#5i)rVryesnoN)rYTOOL_ENABLED_UNUSED_MARKr)rCnamerps& rrE!ToolUsage.rows..s> 5 . .D&SW[_[d[dSd%jn0o p5s69) rrYTOOL_OVERHEAD_MARK size_bucketrrr6rextendsortedr)rprowssf rrToolUsage.rowss}}}I,, ')=)=d>P>P)Q  ')=d>P>P)Q/     t445   r)rrrrrr)rwrxryrzr{rr|r frozensetrrrrrsetrrrrr}rrrrrshaHdGS'0{n2M3M3$(E !(3/D(/   rrc]tRt^t$]!RR7tR]R&]!]R7tR]R&Rt R]R &^t R ]R &Rt R ]R &^t R ]R&RRlt RRltRRltRtR#)SessionEfficiencyc "\\R7#))maxlen)r_SPENT_TURNS_KEPTrrrSessionEfficiency.s UJ[=\rrzdeque[_SpentTurn]spentrtoolsNztuple[int, int, int] | None tools_keyr& cache_readr^ cache_routecache_ended_nsc 0V^8dQhRRRRRRRRR RR R /#) rcostrgterminalr_r]r^ model_callsr& tool_callsrrr)rs"rrSessionEfficiency.__annotate__s>(6BW&) *rc  \\VP;'gT4VP44p\P /VPCR\ V4R\PVPRR4R4RVPR\ V4/C3.pVPR4R8Xd#R Vn VP\R V44VPPV4V#) zYtask_cost for one user turn the user saw end; an interrupt also counts its tokens wasted.api_calls_bucketoutcomefailedr#tool_calls_bucket end_reasonuser_cancelledT interrupt)rrer]rurYTASK_COST_MARKr+_TASK_COST_OUTCOMESrNr#rappendrr)rprrr]rrrrs&&&$$$ r finish_turnSessionEfficiency.finish_turns &!4!4u5t{{}E((+ jj+  < *..x||Ir/JHU T// !< +    << %)9 9DK KK K6 7 $ rc(V^8dQhRRRRRRRR/#) rrrturnsr&fallback_router_rrr)rs"rrrs)C^Xxrc  N.p\\^\\V4\444FrpVP 'dVP P 4M\\V4R4pVP'dKXVP\W44Kt V#)zAn /undo or /retry threw away the newest ``turns`` turns: one row per turn not already counted (an interrupted turn the user then undoes was wasted once, at the interrupt).r) ranger minr&rrpoprrerrr)rprrrr_rs&&&& r discard_turnsSessionEfficiency.discard_turnssts1c#e*.?@ABA'+zzz4::>>#z&BXZc7dD;;; K56C rc 0V^8dQhRRRRRRRRRR R R /#) rr]r_r>r started_nsr&ended_nsexpectedrhrz str | Noner)rs"rrrsD V V# V,/ V=@ VLO V^b V  Vrc ^\V\4'd\VPR44MRpVfR#VPVP VP rpWaVuVnVnVnV'gV'gV'dW8wdR#W9, R, p V \8dR#R#)zA cold primary read after a warm one on the same route is a break Hermes did not announce (``expected``: Hermes already counted the cause); a gap past the cache TTL is plain expiry.rJNgeA cache_expiredprovider_reported_miss)rLrMr<rNrrr CACHE_TTL_S) rpr]r>rrrread prev_read prev_route prev_endedidle_ss &&&&&$ r observe_cacheSessionEfficiency.observe_caches 8B%7N7NtEII123TX <,0OOT=M=MtObObz AEh>)4+> t9 0C)S0"(K"7U=UUr)rrr)rwrxryrzrrr|rrrrrrrrrr}rrrrrsb$5\]E ]Y7E97-1I*1J)-K&-NC& V Vrrc$V^8dQhRRRRRR/#)rcauserr]r^rrr)rs"rrrs(HH3H'<HA[HrcD\P/\V4CRV/C3#)r)rYCACHE_BREAK_MARKre)rr]s&&rcache_break_rowrs$  $ $&G&G&G GGrc V^8dQhRRRR/#)ragentrrrhr)rs"rrrsOO3O4Orc"\VRR4R8H#)zLHermes-owned forks (background review, curator) share the user's session id._memory_write_originNbackground_review)getattr)rs&r_internal_agentrs 50$ 7;N NNrc V^8dQhRRRR/#)rrrrr_r)rs"rrrsXXXXrcL^RIHpV!\VRR4\VRR44#)rarbproviderNmodel)rdrcr)rrcs& r _agent_routers%1 wuj$7QU9V WWrcV^8dQhRR/#)rrrhr)rs"rrrs$rc^RIHpV!4#)raenabled)relay_shared_metricsrrs r_enabledrs - 9rc 0V^8dQhRRRRRRRRRRRR/#) rrr tool_name tool_call_idraw persistedrrlr)rs"rrrs@ L LC LC Ls L LY\ Lae Lrc\V4'g\4'gR#VPP\/4p\ V4\ 8dR#\V4wrg\P!RV/4Yg;'gWCJ.T\T;'g \V44&R# \d\PRRR7R#i;i)zIRemember one committed tool result until its batch's turn budget has run.Nrz$Shared-metrics tool output not notedTexc_info)rr__dict__ setdefault_PENDING_OUTPUTS_ATTRlen_PENDING_OUTPUTS_MAX _result_sizerYtool_metric_namerid Exceptionloggerdebug)rrrrr pendingr- cut_in_tools&&&&& rnote_tool_resultrs L 5 ! ! ..++,A2F w</ / (-  % %{I&> ?GjGjV_Vj7 L11ByM23 L ;d KLs"!B.4B.?B.B.."CCc V^8dQhRRRR/#)rresultrrztuple[int | None, bool]r)rs"rrr s I I I!8 Irc \V\4'd0VPR4;'g.p\RV44R3#\V\4'gR#\ V4\ 8d\PV4MRpVf\ V4R3#\\ V4\VP^4PRR444R3#) zO(characters the tool produced, whether the tool itself already truncated them).contentc3"TFYp\V\4'gKVPR4R8XgK3\VPR4;'gR4xK[ R#5i)typetextrN)rLrMrNrrBs& rrE_result_size..sLnUjD>Q+VWV[V[\bVcgmVm+3quuV}**++UsA#A#A#A#FN,rT)NF) rLrMrNrPrr_NOTICE_MIN_CHARS_TOOL_TRUNCATION_NOTICEsearchr r&groupreplace)rrSnotices& rrr s&$ 9%++nUnnpuuu fc " "7:6{FW7W $ + +F 3]aF ~6{E!! s6{C Q 7 7R @A BD HHrc(V^8dQhRRRRRRRR/#) rrrbatchz list[dict]contents_beforez list[Any]rrlr)rs"rrrs/ZZSZZiZTXZrc @VPP\R4pV'd\4'gR#\ W4FZwrETP \ VP R4;'gR44pVfK>VP R4VJgKURV^&K\ ^RIHpVP4F6wrp T!\PR\V 4RTR V 'dR MR /4K8 R# \d\PR RR 7R#i;i)zOne row per tool result of the batch: truncated when the per-result cap or the per-turn budget replaced it (the budget runs after the cap, so a result is judged once, here).NrrrT)record_process_markoriginal_size_buckettool truncatedrrz2Shared-metrics tool output truncation not recordedr )r rrrziprNrrr.valuesrYTOOL_OUTPUT_TRUNCATION_MARKr1rrr) rr+r,rmessagebeforeentryr.r0r-r1s &&& rrecord_tool_batchr8sZ..$$%:DAhjj "5:OGKKGKK$?$E$E2 FGE W[[%;6%Ia ; >%,^^%5 !D  D D&(:4(@&$P[fo]buyG &6 Z ITX YZs)'C7C7AC7C7AC77"DDc$V^8dQhRRRRRR/#)rrr tools_for_apirrlr)rs"rrr,s& Q Q QS QT Qrc 4\VRR4'g"\V4'g\4'gR#^RIHpT!\ \VRR4;'gR4Y;'g.4R# \ d\PRRR 7R#i;i) zZThe tool definitions one primary request carries (evidence for trimming default toolsets)._persist_disabledFN)record_session_tools session_idrz)Shared-metrics tool overhead not observedTr ) rrrrr=rrrr)rr:r=s&& robserve_request_toolsr?,s|Q 5-u 5 59O9OW_WaWa >S b!A!G!GRH%QdQdbde Q @4 PQs"4A1 A1A1(A11"BBc$V^8dQhRRRRRR/#)rrrr:listrz0tuple[tuple[str, ...], frozenset[str], int, int]r)rs"rrr8s' t t tT t6f trc a ^RIHp^RIHo \ \ V44p\ \ \VRR4;'gT44p\VRR4;'gRp\V4VUu0uFp\V\4'gKVkK up,p\V 3RlV44pY8\V4V'd V!V43#^3#uupi)zY(sent tool names, enabled shipped toolsets, enabled tool count, estimated schema tokens).)_estimate_tools_tokens_rough)get_toolset_for_toolrNvalid_tool_namesc3F<"TFp\S!V44xK R#5ir:)r[)rCnrDs& rrE tool_snapshot..As ]}!,-A!-DEE}s!r) agent.model_metadatarC model_toolsrDtuple _tool_namesrArrrLrrr) rr:rCrrextrarG enabled_namesrrDs && @r tool_snapshotrO8sA0 +m, -E;wugt<MM NOG E-t 4 : :ELu#Ku! 1c8JAAu#KKM]}]]H C ._l0L]0[ ssrs ss$Ls 0C Cc V^8dQhRRRR/#)rrz Iterable[Any]rz Iterable[str]r)rs"rrrEs}rc#^"T;'gRFp\V\4'dVPR4MRp\V\4'dVPR4M(\V\4'dVPR4MRp\V\4'gKVxK R#5i)functionNrr)rLrMrNr)rr0fnrs& rrLrLEs{  %/d%;%;TXXj !!+B!5!5rvvf~PZ[_aePfPfDHHVrz'Shared-metrics cache break not recordedTr ) rYCACHE_BREAK_CAUSESrrrrrVrrrrr)rrrVs&& rrecord_cache_breakrXMs O 33 3wuFY[`7a7a  5 ! ! B  U(;SP\^`AaAgAgeg=hi O > NOs(B!B7B"B.-B.c ,V^8dQhRRRRRRRRRR/#) rrr stored_prompt stored_staterrebuiltrrlr)rs"rrr[s8WWWSWWVYW^bWrcTaaaaVR 9d\SR4R#VR8wgS'dVS8XdR#^RIHo\;QJd"VVVV3RlR 4F 'gK RM RM!VVVV3RlR 44p\SV'd R4R#R4R# \dRpL-i;i) zZA continuing conversation rebuilt its system prompt instead of replaying the stored bytes.system_prompt_rebuildN stale_runtime)identity_line_valuec 3<"TFKwrS!SV4;o;'d2S\\SVR4;'gR4P48gxKM R#5i)rN)rrstrip)rClabelattrrr`storedrZs& rrE(record_prompt_rebuild..es[ M +=%@ @V { {fPST[\acgikTlTrTrprPsPyPyP{F{ {MsAAATF model_switch)nullempty))Modelr)Providerr)rXagent.surface_switchr`rOr)rrZr[r\switchedr`resff&& @@rrecord_prompt_rebuildrn[s((5"9:&mw-?W<3 M 333 M   unV>UV sBBB B'&B')ilt_2k)' 2k_to_10kiP 10k_to_50k)i@  50k_to_200k)i@B 200k_to_1m)ra0)r1)2)3_to_5) 6_to_10)11_to_25)326_to_50)e 51_to_100))r lt_1k)rq 1k_to_10krs)i 50k_to_100k)i  100k_to_500k)rwro)i2k_to_5k)rq 5k_to_10k)i N 10k_to_20k)i@ 20k_to_40k):r{ __future__rloggingre collectionsr dataclassesrrtypingrrrrrYr r getLoggerrwrr!r*r0r5rrrrrcompiler%r$r#r+r1r6r<rTr[rergrrrrrrrrrrr8r?rOrLrXrnrrrrsz# ( 1B   8 $!+{MJ 6**%z{aHeM3 ak = BB B(   n (( (V 2V2V 2VjH O X  L IZ* Q t OWr