+ WjQha0t$Rt^RIHt^RIt^RIt^RIt^RIt^RIt ^RI H t H t ^RI Ht^RIHtHtHtHtHt^RIHtHtHtHtHt^RIHt^RIHt]P>!] 4t!] !R R 7!R R 44t"] !R R 7!R R44t#] !R R 7!RR44t$] !R R 7!RR44t%RRlt&Rt'Rt(Rt)Rt*RPR/t+RQR/t,RRlt-RRRR /R!R"llt.RRRR /R#R$lllt/R%t0^t1RSt2]Pf!4t4Rs5R&]6R'&R(R)lt7/R*]8R3bR+]8R3bR,]8R3bR-]8R3bR.]8^3bR/]8^3bR0]9R3bR1]9R3bR2]8^3bR3]8^3bR4]:/3bR5];R63bR7]8^3bR8]]8^3R?];R63/Ct=R@RAlt>RBRClt?]?!4s@RD]6RE&RTRFRGlltARHRIltBRJRKltCRLRMltDRNROltER#)UuCurated starter catalog for the managed local runtime. Every entry carries the estimator inputs (measured on real GGUFs) so the picker can price a model BEFORE the user downloads gigabytes; once a file is on disk, profile_from_gguf() is the authority. Builds proven end-to-end on real hardware are marked validated; day-0 entries ship without the flag — ensure_model_ready's touch generation still gates every first load at runtime. ) annotationsN) dataclassfield) PurePosixPath)FLOORRUNTIME_OVERHEAD_BYTES TARGET_WINDOW LaunchPlan plan_launch)HardwareBudget LayerKind ModelProfilePhysicsRefusal as_loaded)model_id_from_stem)is_nvidia_n1x_pci_idT)frozencp]tRt^t$RtR]R&R]R&RtR]R&RtR]R &R tR]R &] R R l4t Rt R#) AssetFileuOne downloadable file: repo-relative path and exact bytes (feeds the estimator and the progress bar; no download-time integrity check by design — a corrupt file surfaces as a llama.cpp load error). ``local`` overrides the on-disk name (repos reuse generic names like mmproj-BF16.gguf). Non-model extras live under the models dir's assets/ subdirectory so the router never lists them. strpathint size_bytesNz str | NonelocalrepomainrevisioncV^8dQhRR/#returnr)formats"TC:\Users\johnn\AppData\Local\hermes\hermes-agent\hermes_cli\local_runtime\catalog.py __annotate__AssetFile.__annotate__-s;;C;c hVP;'g \VP4P#N)rrrnameselfs&r# local_nameAssetFile.local_name,s#zz::]4995:::r&r!) __name__ __module__ __qualname____firstlineno____doc____annotations__rrrpropertyr,__static_attributes__r!r&r#rrsC IOE:D*Hc ;;r&rc]tRt^1t$RtR]R&R]R&RtR]R&^tR ]R &]R R l4t ]R Rl4t ]RRl4t Rt R#) QuantVariantzbOne downloadable build. Split GGUFs list every part in files; the model loads from the first part.rquanttuplefilesFbool validatedr lazy_bytescV^8dQhRR/#rr!)r"s"r#r$QuantVariant.__annotate__>s``#`r&c \\VP^,P4PP R44#)z.gguf)rrr:rr) removesuffixr*s&r#model_idQuantVariant.model_id=s2!- 1 0B0B"C"H"H"U"UV]"^__r&cV^8dQhRR/#rr rr!)r"s"r#r$r?Bs55C5r&c :\RVP44#)c38"TFqPxK R#5ir(r.0fs& r# *QuantVariant.size_bytes..Cs4A<<)sumr:r*s&r#rQuantVariant.size_bytesAs4444r&cV^8dQhRR/#rFr!)r"s"r#r$r?Fs11s1r&c <VPVP, #)uPre-download estimate of the weights the engine loads: GGUF bytes ≈ tensor bytes + a <2% header, less the tensors it reads from disk on demand — slightly conservative until profile_from_gguf reads the real table.)rr=r*s&r# weights_bytesQuantVariant.weights_bytesEs 00r&r!N) r.r/r0r1r2r3r<r=r4rCrrTr5r!r&r#r7r71se J LItJ ``5511r&r7c]tRt^Mt$R]R&R]R&R]R&R]R&R]R&R]R &R]R &R]R &R]R &^tR]R &^tR]R&RtR]R&RtR]R&^t R]R&^t R]R&Rt R]R&Rt R]R&Rt R]R&RtR]R&^tR]R&RtR]R&RtR]R&]!]R 7tR!]R"&RtR]R#&^tR]R$&R%tR&]R'&R(tR]R)&]R*R+l4t]R,R-l4tR.R/ltR0R1ltR2R3ltR4R5ltR6R7lt R8t!R#)9 CatalogEntryrid display_name descriptionrr9variantsr n_ctx_train full_layersrecurrent_layers per_layer_f16 swa_layers swa_windowFr;moemtpmtp_draft_depthn_vocab architectureNAssetFile | Nonemmprojdraft draft-dsparkdraft_spec_type draft_depthdraft_min_enginemtp_head)default_factorydictsampling min_enginequality?floatdecode_fractionT recommendcV^8dQhRR/#)rr r;r!)r"s"r#r$CatalogEntry.__annotate__s55T5r&c FVP;'gVPRJ#)zKMTP spec decode runs, from heads built into the model or shipped beside it.N)rcror*s&r# mtp_capableCatalogEntry.mtp_capablesxx444==44r&cV^8dQhRR/#rFr!)r"s"r#r$rzsXXXr&c R\RVPVP344#)zQCompanion files the engine loads beside the weights (vision projector, MTP head).c3D"TFqfKVPxK R#5ir(rIrKas& r#rM/CatalogEntry.companion_bytes..sW)EA<1<<)Es  )rPriror*s&r#companion_bytesCatalogEntry.companion_bytess"W$++t}})EWWWr&c V^8dQhRRRR/#)rvariantr7r r r!)r"s"r#r$rzsVV|V Vr&c \PVP3.VP,\PVP3.VP ,,\P ^3.VP,,p\VPVP^VPY PVPVPVPVP 'dRMRVP"R7 #)rAg333333?ru) r)rTembd_table_bytesr\layersrarbrgrekv_scaler=)r FULLr_r]SWAr` RECURRENTr^r rCrTr\rarbrgrer|r=)r+rrs&& r#profileCatalogEntry.profilesNND$6$6784;K;KKmmT%7%789DOOKL))1-.1F1FFG!!1F1FYZ((OOY]YaYa**DLL ,,,S#'BTBT V Vr&c$V^8dQhRRRRRR/#)rrr7budgetr r r r!)r"s"r#r$rzs&YY<YYJYr&c \\VPV4V4W P\VP ,R7#))r|fixed_overhead)r rrr|rr)r+rrs&&&r# launch_planCatalogEntry.launch_plans99T\\'%:FCVYiYi*@4CWCW*WY Yr&c V^8dQhRRRR/#rrr7r r9r!)r"s"r#r$rzs--l-u-r&c \;QJd5.RVPVPVP34FNK 5M.!RVPVPVP344p\VP4V,#)z=Everything a download job fetches for this variant, in order.c30"TF qfKVxK R#5ir(r!rs& r#rM.CatalogEntry.download_files..s\"JQqq"J )r9rirjror:r+rextrass&& r#download_filesCatalogEntry.download_filessZ\4;; DMM"J\\4;; DMM"J\\W]]#f,,r&c V^8dQhRRRR/#)rrr7r rr!)r"s"r#r$rzsGGlGsGr&c D\RVPV444#)c38"TFqPxK R#5ir(rIrJs& r#rM.CatalogEntry.download_bytes..sF)EA<<)ErO)rPr)r+rs&&r#download_bytesCatalogEntry.download_bytessF)<).sP">Qqq">r)r9riror:rs&& r# install_filesCatalogEntry.install_filessPP4;; ">PP4;; ">PPW]]#f,,r&r!)"r.r/r0r1r3r`rarbrcrdrergrirjrlrmrnrorrqrrrsrtrwrxr4r|rrrrrrr5r!r&r#rWrWMsO G IOJJCCOSGSL##F #"E "*OS)Kc"&H%40Hd0J GS!OU It 55XXVY - G--r&rWc:]tRt^t$RtR]R&R]R&R]R&RtR #) VariantChoicezjWhich build this machine should download and why. reason_key is a UI-copy discriminator, not display text.r7rr; zero_spillr reason_keyr!N)r.r/r0r1r2r3r5r!r&r#rrs(Or&rc$V^8dQhRRRRRR/#)rentryrWrr r zVariantChoice | Noner!)r"s"r#r$r$s'FF,FFCWFr&c`VPR,pVPW!4Pp\V\4'dR#VP 'd\ VRRR7#VP\\VP;'g\48dRMRp\ VRVR7#) a"Fit the entry's one Q4-class build to this machine; headroom buys a bigger window, never a bigger quant. "best-large-window": zero-spill at TARGET_WINDOW; "best-fits": zero-spill at the 64K floor; "smallest-fits-spilled": weights spill to host RAM, priced honestly; None: physics refuses. NFzsmallest-fits-spilled)rrzbest-large-windowz best-fitsT) r[rdecision isinstancerspilledrwindowminrr\r)rrrrreasons&& r#select_variantrsnnR G  1::H(N++WCZ[[$,OOs=%J[J[JdJd_d7e$e kvF Tf EEr&g@@g@j@gT@g4@ qwen3.8-27bgfffff5@c$V^8dQhRRRRRR/#)rrr backendrr ztuple[str, str, str]r!)r"s"r#r$r$s" : :. :3 :;O :r&cVPPR4^,pVPe \VP4'dRMRpVR8Xd V'dRMTpVPW23#)zq(platform, backend, reference GPU name) for the shipped tables; the name is empty when the GPU is not recognized.z (NVIDIA RTX Spark N1Xrfautocuda)gpu_name partition gpu_pci_idrplatform)rrreffective_backends&& r# _hardware_keyrsc((.q1H $-A&BSBS-T-T)Z\")V"3g OO. 99r&rFrrc 0V^8dQhRRRRRRRRR R R R /#) rrrWrr7rr rr;rrr rvr!)r"s"r#r$r$s9 - -, - -~ -$( -;> -LQ -r&c.\W$4OVPNVPNVPN5pVP'd6VP 'd$V'g\ PV4;peV#V'd\MVP'd\M\p\RVPVP,4pVR,V, #)zMShipped measured baseline where matched, otherwise the memory-bound estimate.rugeA)rrXr8rdumarc_MEASURED_DECODE_TOK_Sget_HOST_BANDWIDTH_GB_S_UMA_BANDWIDTH_GB_S_DISCRETE_BANDWIDTH_GB_Smaxrrw) rrrrrkeymeasured bandwidthbytes_per_tokens &&&$$ r#predicted_decode_tok_srs \M& * [EHH [gmm [UEZEZ [C zzzeiiiAWA[A[\_A`5`X4m)0%-3ZZZ).#w11E4I4IIJO s?_ ,,r&c(V^8dQhRRRRRRRR/#) rrr entriesztuple[CatalogEntry, ...] | Nonerrr ztuple[CatalogEntry, str] | Noner!)r"s"r#r$r$s+!!n!>!SV!:!r&caaa\;QJd.RVf\MT4FNK 5M!RVf\MT44pVUu.uFp\VS4;pfKWE3NK ppV'gR#R VV3RllpVUUu.uFwrEVP'gKWE3NK ppp\P \ SS44p VFwrV PV 8XgKV R3u# VU u.uFq!V 4\8gKV NK p p V 'd_\V RR7^,o\;QJdV3RlV4F 'gK R M RM!V3RlV44pSV'dR 3#R 3#R#uupiuuppiuup i) atThe catalog's default pick for THIS machine, with its reason key. Callers pass pre-filtered entries when some are ineligible for reasons the catalog can't know (engine too old). Entries marked ``recommend: false`` are never picked. Reasons: product-default (the product's maker chose this entry and it runs resident); best-quality-resident (quality won among resident entries clearing the pleasant floor); speed-gated-quality (same, but the floor eliminated a HIGHER quality candidate). Returns None when no eligible entry runs resident at the pleasant floor; slower and spilled models remain available for explicit selection. c3L"TFqP'gKVxK R#5ir()rx)rKes& r#rM$recommended_entry..sUDqDs$ $NFcT<\V^,V^,PSVSR7#)rA)rr)rr)trrrs&&r#speed recommended_entry..speeds#%adAaDLL&'[bccr&zproduct-defaultcdV^,PV^,PP)3#)rA)rtrr)rs&r##recommended_entry..#s"AaDLL1Q4<<;R;R:R+Sr&)rc3Z<"TF wrVPSP8xK" R#5ir()rt)rKr_picks& r#rMr$s Hxtq!))dll2xs(+Tzspeed-gated-qualityzbest-quality-residentF) r9CATALOGrr_PRODUCT_DEFAULTSrrrXPLEASANT_FLOOR_TOK_Srany)rrrpoolrcfittingrresidentproduct_defaultrrrpleasant floor_gatedrsf&d @r#recommended_entryrsQ 5UWWDU55UWWDU UD#Tt!^Av-F(FvvtGT dd$+;741all7H;'++M&',JKO 88 &,- -$H8auQx3G'G8HH8!STUVWcHxHcccHxHH {+XX@WXX 'U< Is$E1E1E6E6*E<E<zfhttps://raw.githubusercontent.com/NousResearch/hermes-agent/main/hermes_cli/local_runtime/catalog.jsonz float | None_last_refresh_attemptc V^8dQhRRRR/#)rdz dict | Noner rhr!)r"s"r#r$r$=sMM;M#3Mr&c V'gR#\VR,\VR,4VPR4VPR4VPRR4R7#)Nrrrrrr)rrrrr)rrr)rs&r# _asset_fromr=sK  !F)AlO0DAEERYN%%-!%% F2K MMr&r\r]r^r_r`rarbrcrdrerrrsrfrtrwrurgrxrlrkrmrnc V^8dQhRRRR/#)rdocrqr tuple[CatalogEntry, ...]r!)r"s"r#r$r$Qst 8r&c \VPR^44\8wd'\RVPR4: R\ R24h.pVR,EFp\;QJd.RVR,4FNK 5M!RVR,44p\ P 4UUUu/uF+wpwrVYE!Vf W$,MVPWF44bK- ppppVP\RRVR,R VR ,R VR ,R VR ,RVR \VPR 44R \VPR 44R\VPR44/VB4EK \ V4#uupppi)zParse a catalog document. Unknown fields are ignored (newer catalogs stay readable by older apps); a major schema bump is the signal that they wouldn't be, and the caller skips it.schema_versionzcatalog schema z (this build reads )modelsc 3 "TFp\VR,\VPR44\;QJd.RVR,4FNK 5M!RVR,44\ VPR^44R7xK R#5i)r8r<c38"TFp\V4xK R#5ir()rrJs& r#rM*_load_catalog...Zs1U*Q+a..*rOr:r=)r8r<r:r=N)r7r;rr9r)rKvs& r#rM _load_catalog..Yst1#0Q&AgJ$quu[GYBZ,1E1U!G*1UEE1U!G*1U,U14QUU<5K1LNN#0sB Br[rXrYrZrrirjror!) rr_SCHEMA_VERSION ValueErrorr9_SCALAR_FIELDSitemsappendrWr)rrmr[kcoercedefaultscalarss& r# _load_catalogrQs 377#Q '(O;?3773C+D*GH..=->aAB BG ]]51#$J-1551#$J-11 0>/C/C/EG/E+q+6fW_QT!%%:KLL/E G|w%&~%6-(/0yCKquuX/8C155>7R!z!23     >Gs,1E? cV^8dQhRR/#)rr rr!)r"s"r#r$r$hs**3*r&c^RIHpV!R4PR4PRR7p\ \ P !V44#)rA)r:zhermes_cli.local_runtimez catalog.jsonz utf-8-sig)encoding)importlib.resourcesr:joinpath read_textrjsonloads)r:raws r#_packaged_catalogrhs=) * + 4 4^ D N NXc N dC C ))r&rrc V^8dQhRRRR/#)rforcer;r r!)r"s"r#r$r$rs4Dr&c\P!4p\;_uu_4V'g*\e"V\, \8d RRR4R#VsRRR4\ P P\RR/R7p\ P PV^ R7;_uu_4p\\P!V44pRRR4X\ 8wd \P#R\%T44TsR # +'giL;i +'giLQ;i \d"p\PRT4Rp?R#Rp?ii;i) zFetch the current catalog from the repo and swap it in memory. Best-effort: any failure (offline, GitHub down, unreadable schema) leaves the running catalog untouched and retries after the TTL. Returns True when a fetched document replaced the catalog.NFz User-Agentzhermes-local-runtime)headers)timeoutzcatalog refresh skipped: %sz'catalog refreshed from repo (%d models)T)time monotonic _refresh_lockr_REFRESH_TTL_SurllibrequestRequest _CATALOG_URLurlopenrrload Exceptionloggerdebugrinfolen)rnowreqrfetchedexcs& r#refresh_catalogr3rs .. C .:sEZ?Z]k?k !$ nn$$\LJ`;a$b ^^ # #C # 4 4#DIIaL1G5 ' =s7|LG   5 4  2C8sH(DD!AD-1 DD- D  D* %D-*D-- E8EEcV^8dQhRR/#)rr Noner!)r"s"r#r$r$sZZdZr&c\pVe(\P!4V, \8dR#\P !\ RRR7P4R#)uTTL-gated background refresh; returns immediately. The current request serves the catalog it already has — the refresh lands for the next one.NTzcatalog-refresh)targetdaemonr))rrr r" threadingThreadr3start)lasts r#refresh_catalog_soonr=sA !D DNN,t3nD OD?PQWWYr&cV^8dQhRR/#)rr zdict[str, CatalogEntry]r!)r"s"r#r$r$s22.2r&cL\Uu/uFqPVbK up#uupir()rrX)rs r# catalog_by_idr@s )0 1HHeO 11 1s!c V^8dQhRRRR/#)rrCrr z(tuple[CatalogEntry, QuantVariant] | Noner!)r"s"r#r$r$s3+Sr&cv\F.pVPFpVPV8XgKW3uu# K0 R#)z7Locate the entry + variant that owns a staged model id.N)rr[rC)rCrrs& r#find_entry_for_modelrCs5~~G8+~%& r&c V^8dQhRRRR/#)rrCrr zCatalogEntry | Noner!)r"s"r#r$r$s//c/&9/r&c6\V4pVe V^,#R#r()rC)rChits& r#entry_for_modelrGs x (C_3q6.$.r&)win32rrrz UD-Q4_K_Mr)rHrrr(i`Tr)F__conditional_annotations__r2 __future__rrloggingr9rurllib.requestr# dataclassesrrpathlibr'hermes_cli.local_runtime.context_policyrrrr r "hermes_cli.local_runtime.estimatorr r r rrhermes_cli.local_runtime.ggufrhermes_platform.host.productsr getLoggerr.r*rr7rWrrrrrrrrrrrr&rr"Lockr!rr3rrr;rqrrvrrrrr3r=r@rCrG)rIs@r#rUs#  (!KKHH<>   8 $ $;;;& $1116 $[-[-[-| $F4" $%).} : -+0 -AG -!Y_!!X>  '+|*M C;  -T{ d  %4sDk 3( )3(  D%=  $ 1BC8  Qx  $dBZ  2>Ry  Qx  +UCL  ;I3PR) $  132G JWY\^_X`b  .*%6$7 !70Z2/r&