jV) L%SrSSKrSSKrSSKJr SSKJrJr SSKrSSKJ r SSK J r J r SSK JrJrJrJr SS KJr SS KJr \(a SS KJr SS KJr \R4"\5r0r\\\\ \\\ \ RB444\"S '"SS5r#"SS5r$"SS\#5r%SSSSS\S\#S\\\ \ RB44 Sjr&SSSSS\S\#SS4 Sjr'S\%"50r(\\\#4\"S'S\\\)\\\4-4S\*\4S jr+S"SSS\\\)\\\4-4S-SS4S!jjr,g)#zrFusion registration helpers. See `docs/source/en/fusion_mapping.md` for the design overview and extension guide. N)Mapping) TYPE_CHECKINGAny)nn)!get_checkpoint_conversion_mapping®ister_checkpoint_conversion_mapping)Conv3dToLinearWeightConverterWeightRenamingWeightTransform)register_patch_mapping)logging)PretrainedConfig)PreTrainedModel_FUSION_DISCOVERY_CACHEc\rSrSr%SrSr\\S4\S'S\S\4Sjr S \ RS\ 4S jr S \\ RS\\ R4S jrS SS\\4SjrSrg)ModuleFusionSpec,zBase recipe for a fusion family. A fusion spec decides which modules are eligible for a fusion, how to build the runtime replacement class, and which weight transforms are needed to map checkpoints between the original and fused layouts. .target_modules_patterns model_namereturnc8S[U5RSU3$)zDReturn the log message emitted when no compatible modules are found.zNo compatible z classes found to fuse for )type__name__)selfrs کC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\transformers/fusion_mapping.py get_empty_logModuleFusionSpec.get_empty_log6s"T 3 344OPZ|\\modulec[e)z>Return whether `module` is compatible with this fusion family.NotImplementedError)rr"s r is_fusableModuleFusionSpec.is_fusable:!!r! original_clsc[e)zBBuild the runtime replacement class for a compatible module class.r$)rr)s rmake_fused_class!ModuleFusionSpec.make_fused_class>r(r!configrc[e)zMBuild the weight transforms needed to load and save the fused runtime layout.r$)rr-s rmake_transforms ModuleFusionSpec.make_transformsBr(r!N)r __module__ __qualname____firstlineno____doc__rtuplestr__annotations__rrModuleboolr&rr+listr r/__static_attributes__rr!rrr,s02U38_1]]]""t""T"))_"bii""&8"T/=R"r!rcb^\rSrSrU4SjrS\R S\R 4SjrSrU=r $)_FusedPatchEmbeddingMixinGc>[TU]"U0UD6 URR[R "URR 5-Ul[R"URURRURRSLURRRURRRS9UlU?g)N)biasdevicedtype)super__init__proj in_channelsmathprod kernel_size patch_volumerLinear out_channelsr@weightrArB linear_proj)rargskwargs __class__s rrD"_FusedPatchEmbeddingMixin.__init__Hs $)&) II11DIIdii>S>S4TT99    II " "t+99##**))""((   Ir! hidden_statesrcURRRnURSUR5nURUR US95nURSUR 5$)N)rB)rNrMrBviewrJto embed_dim)rrS target_dtypes rforward!_FusedPatchEmbeddingMixin.forwardWsf''..44 %**2t/@/@A (()9)9 )9)MN !!"dnn55r!)rNrJ) rr1r2r3rDtorchTensorrZr; __classcell__)rQs@rr=r=Gs( 6U\\6ell66r!r=c\rSrSrSrSrS\RS\4Sjr S\ \RS\ \R4Sjr S S S\ \ 4S jrS rg )PatchEmbeddingsFusionSpec^zJFuse compatible Conv3d patch embeddings into flattened Linear projections.)z(^|\.)patch_embed$r"rc[[USS5=n[R5(dgURUR :H=(a; UR S:H=(a% URS:H=(a URS:H$)NrEF)rrr)rrrr) isinstancegetattrrConv3dstriderIpaddingdilationgroups)rr"rEs rr&$PatchEmbeddingsFusionSpec.is_fusablecsr'&&$"??$KK KK4++ + ! ) ! * ! q  r!r)cn[SUR3[U405nSUR3UlU$)NFused)rrr=r2)rr) fused_clss rr+*PatchEmbeddingsFusionSpec.make_fused_classosB5!6!6 78;TVb:cegh #()B)B(C!D r!r-rc [USU5nURn[U[5(aX34nUR/[ U5Q7nUR n[SS[UUS9/S9[SSS9/$) N vision_configzpatch_embed\.proj\.weight$z!patch_embed\.linear_proj\.weight$)rFrI)source_patternstarget_patterns operationszpatch_embed\.proj\.bias$zpatch_embed\.linear_proj\.bias$)rqrr) rd patch_sizercinttemporal_patch_sizer5rFr r r )rr-rprtrIrFs rr/)PatchEmbeddingsFusionSpec.make_transformsts@ "-- j# & &$1J$88M5;LM #//   = D"$/$/   ; B   r!rN)rr1r2r3r4rrr8r9r&rr+r:r r/r;rr!rr`r`^s^T6    t  T"))_bii  &8 T/=R r!r`clsztype[PreTrainedModel]r-r fusion_namespecrch[RU05nX;aX@$[R"S5 U"U5nSSS5 [ 5n0nUR (a/[ R"SRUR 55OSnWR5Htup[U 5n X;aMUbURU 5cM.URU 5(dMFURU 5 URU 5X{R'Mv XtU'U$!,(df  N=f)aJDiscover compatible module classes for one fusion family on a meta-initialized model. This function: - instantiates `cls(config)` on the meta device - scans `named_modules()` for candidate modules - optionally pre-filters them with `target_modules_patterns` - uses `is_fusable(...)` as the final structural check - builds the class-level patch mapping used by monkey patching Results are cached per `(fusion_name, cls)` to avoid repeated meta-initialization. This matches the current class-level fusion behavior, where one compatible module class maps to one fused replacement class. metaN|)r setdefaultr\rAsetrrecompilejoin named_modulesrsearchr&addr+r) rxr-ryrzcachemodel seen_classes patch_mappingtarget_module_pattern module_namer" module_clss r_discover_fusable_modulesrs ( $ . .{B ?E |z f F  5LM>B>Z>Z 388D889:`d %224 &\  %  ,1F1M1Mk1Z1b v&& $-1-B-B:-N ))* 5#J +  s D## D1c [XX#S9nU(d/[RURUR55 g[ USS9 [ US5(a[ URS5(d[SURS35eURRnURU5n[U5nUbqUVs0sHn[UR5U_M n nUHAn [U R5n U RU 5n U cM.[S US US U S 35e Xv-n[XVSS9 gs snf) aqRegister one fusion family for `cls`. This function updates the two global registries used by fused loading: - the monkey-patching registry, so compatible module classes are replaced before initialization - the checkpoint conversion mapping, so fused runtime modules still load from the original checkpoint layout Notes: - conflicting checkpoint transforms fail fast )ryrzNT) overwrite config_class model_typezModel z" has no config class or model typezFusion z for model type zC conflicts with an existing conversion mapping for source patterns .)rloggerinforrrhasattrr ValueErrorrr/rr5rqgetr ) rxr-ryrzfusable_classesr convertersexisting_convertersexistingexisting_converter_sources converterrqexisting_converters r_register_module_fusionrsJ0`O  D&&s||45?d; 3 ' 'ws7G7G/V/V6#,,/QRSS!!,,J%%f-J;JG&at%t`sT\eH,D,D&Ex&O`s"%t#I#I$=$=>O!;!?!?!P !- k]*::,G++:*;1> $)5 *:TR&us Epatch_embeddings_FUSION_REGISTRY fusion_configc/nUR5H^up#U[;a[SU35eUSLaM$USLa$[U[5(d[SUS35eUR U5 M` U$)zQValidate `fusion_config` and return enabled fusion names in user-specified order.zUnknown fusion type: FTzInvalid fusion config for z4: expected `True`, `False`, or a mapping of options.)itemsrrrcrappend)renabled_fusionsryfusion_optionss r_iter_enabled_fusionsrsO'4':':'<# . .4[MBC C U "   %j.Q.Q,[M9mn  {+(= r!c`U(dg[U5Hn[XU[U5 M g)zRegister requested runtime fusions for `cls`. This function: - validates `fusion_config` against `_FUSION_REGISTRY` - resolves the enabled fusion families in user order - registers monkey patches and checkpoint transforms before model instantiation N)rrr)rxr-rrys rregister_fusion_patchesrs+ ,]; [:J;:WXrs  #% i``35/   H %MOc4d3RYY3G.H(H#IIJO""666.- 0- `- - --  -  #tBII  -`*S *S*<*SKN*SVf*S *SZ2DE^E`0a$s,,-adWS#X=N6N1N)OTXY\T]$jnY Y9@dWUXZ]U]M^F^A^9_bf9fY Yr!