oMjvSSKrSSKrSSKrSSKrSSKJr SSKJrJr SSKJ r J r SSK J r SSK Jr SSKrSSKrSSKJr SSKJr S S KJr S S KJrJrJrJrJrJrJrJrJ r J!r!J"r"J#r#J$r$J%r% S S K&J'r' \%RP"\)5r*S SSS.0r+\ "5(aSSK,J-r- SSK.J/r/J0r0J1r1J2r2 /S4S\RfRh4Sjjr5Sr6S\7S\8\7\9\7-\Rt-4S-4Sjr;S8S\7\Rx-S\8\7\4S-S\=S\7\Rt-4Sjjr>S9S\S\7\R~-S-S \7S-S!\S-S"\@S-S\8\7\9\7-\Rt-4S-S#\@\7S-S$\7\Rx-S-S%\8S-S&\8S-S'\7\Rx-S-S(\@\74S)jjrAS:S*jrBS;S+jrCS;S,jrDS-rESN)array) OrderedDict defaultdict)ThreadPoolExecutor as_completed)Path) is_zipfile) DDUFEntry)EntryNotFoundError)DiffusersQuantizer)#DEFAULT_HF_PARALLEL_LOADING_WORKERSGGUF_FILE_EXTENSIONSAFE_WEIGHTS_INDEX_NAMESAFETENSORS_FILE_EXTENSIONWEIGHTS_INDEX_NAME _add_variant_get_model_file deprecateis_accelerate_availableis_accelerate_versionis_gguf_availableis_torch_availableis_torch_versionlogging)is_torch_dist_rank_zeroTransformer2DModelDiTTransformer2DModelPixArtTransformer2DModel) ada_norm_zeroada_norm_single)infer_auto_device_map)get_balanced_memoryget_max_memoryoffload_weightset_module_tensor_to_devicemodelc ^[U[5(GaM0nUb URURX55 URUR 5V^Vs0sH3umn[ U4SjU55(dM"T[ R_M5 snn5 Un UbURU 5n URU5n SU 0n S[R"[5R;aXkS'O$[U5S:a[R!S5 US:wa[#U4UUS:HUS.U D6nO [%U5nUbUR'U5nX+S '[U4S U 0U D6nU$s snnf) Nc3,># UH oT;v M g7fN).0mnames ڲC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\diffusers/models/model_loading_utils.py (_determine_device_map..Os?*>QDy*>sno_split_module_classesspecial_dtypesrzThis model has some weights that should be kept in higher precision, you need to upgrade `accelerate` to properly deal with them (`pip install --upgrade accelerate`). sequentialbalanced_low_0)dtypelow_zero max_memoryr8r6) isinstancestrupdateget_special_dtypes_updatenamed_parametersanytorchfloat32adjust_target_dtype_get_no_split_modulesinspect signaturer" parameterslenloggerwarningr#r$adjust_max_memory) r' device_mapr8 torch_dtypekeep_in_fp32_modules hf_quantizerr3r._ target_dtypeno_split_modulesdevice_map_kwargss ` r/_determine_device_maprRDs*c""  #  ! !,"H"H"\ ] %557 7GD!?*>??$emm#7  #  #';;LIL 66zB68HI w001FGRR R2@. /  1 $ NN`   %,!$(88%  $ J( 3J  #%77 CJ*4,'*5Z ZHYZ O s !E' E' c ,URn[RU5RUSS5nU(aX[R"[R S5S5n[ XC5n[RSUSUSUS35 U$U$)N norm_type.rz Changing class object to be of `z ` type from `z` type.This is because `ze` is scheduled to be deprecated in a future version. Note that this DOESN'T affect the final results.) __name___CLASS_REMAPPING_DICTget importlib import_modulesplitgetattrrGinfo)config old_classprevious_class_nameremapped_class_namediffusers_libraryremapped_classs r/_fetch_remapped_cls_from_configrdvs#,,/334GHLLVT_M`bfg%33HNN34G4JK !2H ./B.C=QdPef 3451 1  param_namerJcUcgUn[U5S:a>X!;a9SRURS5SS5n[U5S:aX!;aM9US:XaSU;a[US35eX$)z4 Find the device of param_name from the device_map. NcpurrUz doesn't have any device set.)rFjoinr[ ValueError)rfrJ module_names r/_determine_param_devicerns +"{'D((;#4#4S#9#2#>?K+"{'D " :!5 |+HIJ J&&recheckpoint_file dduf_entries disable_mmap map_locationc V[U[5(aU$[RR U5R S5SnU[ :XaU(a;XR5n[RRU5sSSS5 $U(a7[RR[US5R55$[RRXS9$U[:Xa [U5$0n[!SS5(aSS 0O0n[U["5(a2US :wa,[!SS 5(a[%U5(a U(dS S 0n[R"U4S U0UDUD6$!,(df  N=f![&an[U5n U R5R)S5(a [+S5e[-SUS35Ue!,(df  SnAg=f![.[,4a [+SUSUS35ef=fSnAff=f)zM Reads a checkpoint file, returning properly formatted errors if they arise. rUriNrb)device>=z1.13 weights_onlyTmetaz2.1.0mmaprrversionzYou seem to have cloned a repository without having git-lfs installed. Please install git-lfs and run `git lfs install` followed by `git lfs pull` in the folder you cloned.zUnable to locate the file z_ which is necessary to load this pretrained model. Make sure you have saved the model properly.z1Unable to load weights from checkpoint file for 'z' at 'z'. )r9dictospathbasenamer[ras_mmap safetensorsr?loadopenread load_filerload_gguf_checkpointrr:r Exception startswithOSErrorrlUnicodeDecodeError) rorprqrrfile_extensionmm extra_argsweights_only_kwargefs r/load_state_dictrs /4((+))/:@@EbI 7 7!2::<&,,11"5=<"((--d?D.I.N.N.PQQ"((22?2XX 2 2'8 8J;KDRX;Y;Y.$!7_a ?C00 F*$T733//$$d^ ::omLmL^mblm m)=<*  o&!668&&y11!& %4_4EFNN'&&#J/ COCTTZ[jZkkno  snAF-F F=FF1FA:F F F H( G=(AG(( G: 2G=:G==#H  H##H( state_dictr6model_name_or_pathrMrLunexpected_keysoffload_folder offload_indexstate_dict_indexstate_dict_folderreturnc ^USLn UR5n UR5GHumnTU ;aM0nUb[R"U5(aUbM[ U4SjU55(a3UR [R 5n[R US'O8Ub UR[[SS5:XaOUR U5nX/S'[SS5(a SUS'S US 'UnTRS 5nUHn[UU5nM [U[RR[R45(dSnUbCUcUR UR5nUR5(aUR!5n[#TU5nU TR$UR$:waU (a?UR&(a.UR)XTUUS 9(aUR+TU TU5 O9UbUS 3OSn[-SUSTSU TR$SUR$S3 5eUS:Xa[/UTX5n GM9US:XaU b[/UTX5n GMRU (a-UR)XTUUS 9(aUR1XTUXUS9 GM[3UTU4SU0UD6 GM X4$)z This is somewhat similar to `_load_state_dict_into_model`, but deals with a model that has some or all of its params on a `meta` device. It replaces the model params with the data from the `state_dict` Nc3J># UHoTRS5;v M g7f)rUN)r[)r,module_to_keep_in_fp32rfs r/r0,load_model_dict_into_meta..s$8^rDZ**:*:3*??^rs #r6 float8_e4m3fn>z1.8.1T non_blockingF clear_cacherU) param_device rjz Cannot load z because z expected shape z , but got a. If you want to instead overwrite randomly initialized weights, please make sure to pass both `low_cpu_mem_usage=False` and `ignore_mismatched_sizes=True`. For more information, see also: https://github.com/huggingface/diffusers/issues/1619#issuecomment-1345604389 as an example.diskrh)r6value)ritemsr?is_floating_pointr>tor@r6r\rr[r9nn ParameterTensor is_contiguous contiguousrnshape pre_quantizedcheck_if_quantized_paramcheck_quantized_param_shaperlr%create_quantized_paramr&)r'rr6rrMrLrJrrrrr is_quantizedempty_state_dictparamset_module_kwargs old_paramsplitsr[rmodel_name_or_path_strrfs @r/load_model_dict_into_metars & t+L'')'--/ E - -   !8!8!?!?#/C8^r855/-2]]!'*)ekkWUO]a=b.b-2'* g . .04 n -/4 m ,  !!#&E 51I)ehh&8&8%,,%GHHI  }1&&((((*.z:F  J ' - - < .. 99*j|:88EUV`EachiEWEc,>+?q)Aik& "#9":)J0nX#S'U(a&[SS5(d[RS5 T XS//T4nUR"U6 URR 5HupVUcM T"XaU-S-U5 M g)Nrrvz2.1zYYou need to have torch>=2.1 in order to load the model with assign_to_params_buffers=TrueTrU)rrGr]_load_from_state_dict_modulesr) rrrlocal_metadataargsr.childrrrs r/r)_load_state_dict_into_model..loads5M12 #,>* % %%tu|t}}s#t  97DWgl mj)JD AJ@ =  !%R+:'@R"hj (--c2FKMk\*gY6 9NNF!$&!1  ",1!3'#1#%5%") +!-  "*- )xy@xAAw'x#=wH[kpq :'(89 "!  "s/1E$$E:9E:c[U[5(dU/n[U5S:XaUSnSnOUSS:wa [S5eUupUS;a[ US5nU$US;a[ US5nU$US;a[ US5nU$US;a3[S [U55R5R5nU$US ;a [X5nU$) Nrr zPReceived multiple types, therefore expected the first type to indicate an array.)rrr  ) ))B)r) r9listrFrlintfloatrrtobytesdecode_gguf_parse_value)_value data_typearray_data_types r/r-r-ls i & &K  9~aL  Q<1 op p%." ..VAY M g vay! M c fQi M c sDL)113::< M c "6; Mrec [5(a"[5(aSSKnSSKJn SSKJnJn O [RS5 [S5eU"U5n0nURHnURn URn XRRURR4;n U (aMX;aHSR!UV s/sHn [#U 5PM sn 5n [%U S [#U 5S U S 35e[&R("UR*R-55nU (aU"XS 9OUXy'M U$s sn f) a Load a GGUF file and return a dictionary of parsed parameters containing tensors, the parsed tokenizer and config attributes. Args: gguf_checkpoint_path (`str`): The path the to GGUF file to load return_tensors (`bool`, defaults to `True`): Whether to read the tensors from the file and return them. Not doing so is faster and only loads the metadata in memory. rN) GGUFReaderr )SUPPORTED_GGUF_QUANT_TYPES GGUFParameterzLoading a GGUF checkpoint in PyTorch, requires both PyTorch and GGUF>=0.10.0 to be installed. Please see https://pytorch.org/ and https://github.com/ggerganov/llama.cpp/tree/master/gguf-py for installation instructions.zKPlease install torch and gguf>=0.10.0 to load a GGUF checkpoint in PyTorch. z has a quantization type: zT which is unsupported. Currently the following quantization types are supported: zs To request support for this quantization type please open an issue here: https://github.com/huggingface/diffusers) quant_type)rrggufr2quantizers.gguf.utilsr3r4rGerror ImportErrortensorsr. tensor_typeGGMLQuantizationTypeF32F16rkr:rlr? from_numpydatar)gguf_checkpoint_pathreturn_tensorsr7r2r3r4readerparsed_parameterstensorr.r6 is_gguf_quantr_supported_quants_strweightss r/rrs@133#UU  A ghh , -F..{{'' #+D+D+H+H$JcJcJgJg*hh ZI$(IIE_.`E_Ts4yE_.`$a !f6s:6GHY,-LL ""6;;#3#3#56S`-"Ofm%!( /as E c/nU(dU$UHanUnXP;aM Xa;dMXRXR:wdM3URXPURXR45 X Mc U$r*rrs r/rrsO "%"  +   (Z-G-M-MQaQlQrQr-r  " "N!;!A!ACSC^CdCde *& rec 0nUR5HMup4URUVs0sH+oUU:Xd!URUS35(dUS:XdM)XT_M- sn5 MO U$s snf)zL Expand a device map to return the correspondence parameter name to device. rUrj)rr;r)rJ param_namesnew_device_maprrups r/_expand_device_maprOsrN$**, + i 1F{allfXUV<>X>X\bfh\hYQY i -  js (A& A& expanded_device_mapc~UcSOUR5nUR5VVs0sH-upV[U5S;dMU[R"U5_M/ nnnU(dg[ [ 5nUR5H1upURU 5n X==U R5- ss'M3 UR5H)upk[SX-5n [R"XUSS9n M+ gs snnf![a2 URU 5n N![a [SU S35ef=ff=f) ae This function warm-ups the caching allocator based on the size of the model tensors that will reside on each device. It allows to have one large call to Malloc, instead of recursively calling it later when loading the model, which is actually the loading speed bottleneck. Calling this function allows to cut the model loading time by a very large margin. Nr )rhrzParameter or buffer with name=z not found in modelrF)r6ru requires_grad) get_cuda_warm_up_factorrr:r?rurr) get_parameterAttributeError get_buffernumelmaxempty)r'rPr6rMfactorrruaccelerator_device_mapelements_per_devicerfrN elem_count warmup_elemsrNs r/_caching_allocator_warmupr_sF&QL,P,P,RF 16688ME v;o - $u||F##8 "%c*4::<  g##J/A #qwwy0#=27791j23 KK &PU V:+ g g$$Z0! g$'Ej\Qd%eff g gs)C:C: D D< DD88D<)NFrh) NNNNNNNNNN)rj)NNNNNNNNNNNFFF)Fr*)MrrYrCr|r collectionsrrconcurrent.futuresrrpathlibrzipfiler rr?huggingface_hubr huggingface_hub.utilsr quantizersr utilsrrrrrrrrrrrrrrutils.distributed_utilsr get_loggerrVrGrW accelerater"accelerate.utilsr#r$r%r&rrrRrdr:r{r)rurnPathLikerrr6r(rrrrrrrrr-rrOr_r+rer/rmsz" 0? %4+ >   H %050qq WYgk/ 88??/d(''c39u||C[>[9\_c9c'&15', 72;;&7sI~&-77 $ 7z'+%).2(,=A(,/3!%$(26`+`+  t #`+d `+ %t+ `+ + `+S#)ell223d:`+#Y%`+"++%,`+$;`+Tk`+R[[(4/`+ #Y`+F@ !#0Hn !#=H@.NS*FJ #YR15/sI~&-/@15?sI~&-?D00f$ #W $S%,,%6 7#W@E #W[mpt[t#W #Wre