,j"SrSSKrSSKJr SSKJrJrJrJrJ r SSK r SSK J r SSK r SSKJr SSKJr SSKJrJr SS KJr "S S \ R.5rg!\a Sr N&f=f) ztimm model adapter Wraps timm (https://github.com/rwightman/pytorch-image-models) models for use as a vision tower in CLIP model. N) OrderedDict)DictListOptionalTupleUnion)RotAttentionPool2d)AttentionPool2d)Mlp to_2tuple)freeze_batch_norm_2dc^\rSrSrSrSS\S\S\\\\\44S\S\S\ S \ S \ \ S \ \ S \ 4U4S jjjr S S\S\ 4Sjjr \RR S!S\ 4Sjj5rS"S\R$S\ \\\\4S\ S\ S\ S\S\ S\\\\R$\\R$444SjjrS\\\\\444SjrSrSrU=r$)# TimmModelztimm model adapter model_name embed_dim image_sizepoolproj proj_biasdrop drop_path patch_drop pretrainedc >[TU]5 [c [S5e[ U5Ul0n UbXS'U bXS'US;n U(aUS;deUS;n U (d4U (d-US:XaSOUn[R "U4UUU S .U D6UlUnO[R "U4S U 0U D6UlURRRS S5nU(dS OS nU (a#US :XdeURRSSS9 O.U(a [US9O0nURR"S0UD6 URRn[5nUS:Xa[UWUS9US'UnOUS:Xa[XS9US'UnUS:Xa2[ R""U5US'[ R$"XUS9US'OUS:Xa['US U-X'S4SU4S9US'[ R("U5Ulg)NzMPlease install the latest timm (`pip install timm`) to use timm based models.drop_path_ratepatch_drop_rate)abs_attnrot_attn)linearmlpnone)r!r"r#r) num_classes global_poolrr pool_sizer )r%r) feat_size out_featuresrr )r*r!r)biasrr"T)rr+)r)super__init__timm RuntimeErrorr r create_modeltrunk default_cfggetreset_classifierdict num_featuresrAbsAttentionPool2dr nnDropoutLinearr Sequentialhead)selfrrrrrrrrrr timm_kwargs custom_pool extra_projproj_dimprev_chsr) feature_ndim reset_kwargs head_layers __class__s ڢC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\open_clip/timm_model.pyr-TimmModel.__init__s   <no o#J/  ,5( )  !-7) *66 44 44.. +!FNq H**$ %   DJ!H**%DJ  ..22;EI$-11L#q((( ++A2+>:>t52  ++>>zz..H!m  : "4Xaj"kK  H Z "4X"VK  H 8 "$**T"2K "$))Hi"PK  U]!$Xq9}iUVi_cen^o!pK MM+. unlocked_groupsfreeze_bn_statscU(dFURR5H nSUlM U(a[UR5 ggSSKJnJn URR5nU"URU5n[UR55nX- n[US-5H0n Xyn U H#nSURRU5lM% M2 U(aTU"URUSS9n U R5V V s1sHupX::dM U iM n n n [URU 5 gg![a [S5ef=fs sn n f) z^lock modules Args: unlocked_groups (int): leave last n layer groups unlocked (default: 0) Fr)group_parameters group_modulesz^Please install latest timm `pip install git+https://github.com/rwightman/pytorch-image-models`r T)reverseN)r1 parameters requires_gradrtimm.models.helpersrMrN ImportErrorr/ group_matchermaxkeysrange get_parameteritems)r=rJrKparamrMrNmatchergparams max_layer_id group_idxgroupgmoduleskvs rGlockTimmModel.lockis4 ..0&+#1$TZZ0 vOjj..0G&tzz7;Gw||~.L'9L"OA*:P$TZZ: v"tvv vQsD? EE?EenablecURRU5 g![a n[R"S5 SnAgSnAff=f)NzQgrad checkpointing not supported for this timm image tower, continuing without...)r1set_grad_checkpointing Exceptionloggingwarning)r=rees rGrg TimmModel.set_grad_checkpointings< q JJ - -f 5 q OOo p p qs AAAxindices stop_earlynormalize_intermediatesintermediates_only output_fmtoutput_extra_tokensreturnc 0nU(aSUS'URR"U4UUUUUS.UD6n 0n U(aU OU Sn U(aKU (aD[U S[5(a,U V s/sHoSPM n n U V s/sHoSPM n n XS'XS'U(aU $URR U S5nUR U5nXS'U $s sn fs sn f) aForward features that returns intermediates. Args: x: Input image tensor indices: Take last n blocks if int, all if None, select matching indices if sequence stop_early: Stop iterating over blocks when last desired intermediate hit normalize_intermediates: Apply norm layer to all intermediates intermediates_only: Only return intermediate features output_fmt: Shape of intermediate feature outputs output_extra_tokens: Return both prefix and spatial intermediate tokens Returns: Treturn_prefix_tokens)rnrqnormrorrr rimage_intermediates_prefiximage_intermediatesimage_features)r1forward_intermediates isinstancetuple forward_headr<)r=rmrnrorprqrrrs extra_args trunk_output return_dict intermediatesxiintermediates_prefixrzs rGr{TimmModel.forward_intermediatess, 15J- .zz77#5,%%   (: Q =Z a@PRW5X5X4A#BMbqEM #B-:;]rU]M;8L4 5-:)*  00aA>2(6$%$C;s ,CCc[U5Ul[URS5(aURR U5 g[ R "SURRRS35 g)zSet the input image size for the model after initialization. This method attempts to call set_input_size on the underlying timm model if it supports dynamic input size adjustment. Args: image_size: New image size as int (square) or tuple (h, w) set_input_sizez timm model z/ does not have set_input_size method. Skipping.N) r rhasattrr1rriinforF__name__)r=rs rGrTimmModel.set_input_sizes]$J/ 4::/ 0 0 JJ % %j 1 LL;tzz';';'D'D&EEtu vrIcJURU5nURU5nU$)N)r1r<)r=rms rGforwardTimmModel.forwards! JJqM IIaLrI)r<rr1)avgr!FgNNF)rF)T)NFFFNCHWF)r __module__ __qualname____firstlineno____doc__strintrrboolfloatrr-rctorchjitignorergTensorrrr{rr__static_attributes__ __classcell__)rFs@rGrrs7: #)-*.$L/L/L/c5c?23 L/  L/  L/L/L/ L/!L/L/L/\;C;d;@ YYqTqq8<$,1',$(-1||1eCcN341 1 &* 1 !% 11"&1 c5tELL'99:: ;1fwsE#s(O/C)Dw"rIr)rri collectionsrtypingrrrrrrtorch.nnr8r. timm.layersr r r7r r rSutilsrModulerrIrGrs\#55 .A*(@ @  DsAA%$A%