ji"UdZddlmZddlmZddlmZddlZddlZddl m Z ddl m Z ddl mZd d lmZd d lmZmZmZmZmZmZmZd d lmZd ZdZddgZgZde d<da!de d<e"Z#de d<eGddZ$ddZ%ddZ&dd Z'dd#Z(dd%Z)dd'Z*dd)Z+dd-Z,dd/Z-dd1Z.ddd5Z/ddd6Z0ddd:Z1dd;Z2ddd=Z3dd>Z4dd?Z5ddAZ6ddBZ7ddDZ8ddFZ9ddHZ:ddIZ;ddJZddOZ?ddPZ@ddQZAddSZBddTZCddUd7dVddYZDddZdd[ZEddZdd]ZFdd^ZGd7d_ddaZHdbd7dd7ddcddfZId7dgddiZJdddjdkZKdlZLdddmZMddnZNddpZOddqZPddsZQddtZRdduZSddvZTd7dwddzZUdd|ZVdd}ZWddZXddZYddZZGddZ[dS)aTemporal upsampler plugin API. Temporal upsamplers are interchangeable handlers for frame interpolation. Handlers expose methods and supported multipliers through ``query_temporal_upsampler_def()`` and may expose config controls under ``wgp_config["temporal_upsamplers"][config_key]``. Definitions may also expose an optional ``description`` plus optional ``method_descriptions`` and ``method_parameters`` mappings for reusable discovery interfaces. Existing handlers without these fields remain valid. Discovery tests the existing optional ``enabled()`` method first. When it is absent, handlers may expose a ``status`` property containing ``"enabled"`` or ``"disabled"``. Discovery reports ``"unknown"`` only when neither contract provides a valid status. Disabled handlers may expose ``reason_disabled``. Handlers may implement ``method_available(method)`` and ``method_visible(method)``. Both default to True: hidden methods remain usable and are added to menus only when restoring their selection; unavailable methods are excluded even then. Plugin authors can register processors from ``plugin_info.json`` with: ```json { "temporal_upsampler_handlers": ["my_plugin.temporal.MyTemporalUpsampler"] } ``` ) annotations) dataclass)partialN)Any)attention_shared_state)offload_registry)memory)PROCESSOR_STATUS_DISABLEDPROCESSOR_STATUS_ENABLEDPROCESSOR_STATUS_UNKNOWNhandler_reason_disabledhandler_statushandler_method_availablehandler_method_in_choices)compatible_loaded_modeltemporal_upsamplers*zpostprocessing.dlss5.temporal_upsampler.DLSSGTemporalUpsampler list[Any]_temporal_upsampler_handlerszdict[str, Any] | None!_temporal_upsampler_server_configzset[str],_registered_temporal_upsampler_handler_pathsc.eZdZUded<ded<ded<dS)TemporalUpsamplerConfigBindingrhandlerstr config_keyzlist[tuple[str, Any]]controlsN)__name__ __module__ __qualname____annotations__JC:\Users\johnn\OneDrive\Documents\AI\postprocessing\temporal_upsamplers.pyrr7s0LLLOOO######r$rscalefloatreturnrct|}|rtt|n|dS)Ng)r' is_integerrintr&s r%format_multiplierr.>s8 %LLE#..00 B3s5zz???llBr$c&dt|S)Nx)r.r-s r%format_multiplier_labelr1Cs ) '' ) ))r$methodct|pdtt |SN)rstriplowerMULTIPLIER_SEPARATORr.)r2r&s r%format_multiplier_valuer9GsG&,B%%''--// a1E aGXY^G_G_ a aar$ default_scale float | Nonect|pd}t|pd}||sdS|t |d}|t r!|t t d}|sdSn t |vrdS t |p|S#t$rYdSwxYwr4)rr6r7 startswithlenr8r' ValueError)valuer2r:textsuffixs r%parse_multiplier_suffixrCKs  u{   ! ! # # ) ) + +D 2   $ $ & & , , . .F ??6 " "t #f++,, F -..011223 4   ' 'tV,}--- tts C11 C?>C?labelcnt|pdddt|S)Nr5z Upsampler )r removesuffixr1)rDr&s r%format_method_scale_labelrH]s:%+2++L99 \ \z#_method_choices..ls P P P vUFO P P Pr$methods)getrYs r%_method_choicesrdks$ P PB1O1O P P PPr$dict[str, str]c4dt|DS)Nci|]\}}|| Sr#r#r^s r% z"_method_labels..ps L L LmeVFE L L Lr$)rdrcs r%_method_labelsrios L L{/K/K L L LLr$ fallback_namect|ddpd}|r|St|}|r|ddS|S)Nrr5rr )rrbr6rdr7)rYrjrmethod_choicess r%_config_key_from_handler_defrmsss[__\266<"==CCEEJ$[11N$a ##     r$handler_moduleslist[str] | Nonedict[str, dict[str, Any]]cHi}|tn|D]}tt|pd}t |dsCt |}|sg|}||t||j <|S)Nr5default_config) temporal_upsampler_handlersrXrr6hasattrdictrrquery_temporal_upsampler_defrmr)rnsectionsrO handler_clsconfigrYs r%default_config_sectionsrz}sH/>/F++O[[+C OO,A,A,C,CDD {$455  k002233  !>>@@ TZ-k;;OPPQQ Or$c|a|tn|}|D]q}t|pd}|r |tvr1t t |||t|rdSr4)rrsrr6rrNrXadd) server_config files_locatorrnmodulesrOs r%register_temporal_upsamplersrs(5%-<-D))/G??4:2$$&& tKKK #$?$9$$?$? }$]$]^^^488>>>> ??r$F enabled_onlyboolc*fdtDS)Nc6g|]}rt||Sr#)handler_enabled)r_rrs r%r`z2registered_temporal_upsamplers..s- p p p| pWfgnWoWo pG p p pr$)rrs`r%registered_temporal_upsamplersrs p p p p#? p p ppr$cLt|d p|S)Nenabled)rtrrMs r%rrs$w ** * ?goo.?.??r$list[dict[str, Any]]c4dt|DS)Nc6g|]}|Sr#)rvr_rs r%r`z1query_temporal_upsampler_defs..s$ o o owG 0 0 2 2 o o or$)rrs r%query_temporal_upsampler_defsrs o oB`amBnBn o o oor$cz t|ddS#ttf$rYdSwxYw)Nposi)r'rb TypeErrorr?rcs r% _handler_posrsJ[__UD11222 z "tts "%::c|di}t|tr1||vr- t||S#tt f$rYnwxYwt |S)N method_pos)rb isinstancerur'rr?r)rYr2rs r% _method_posrs|r22J*d##*(<(< F+,, ,:&    D   $ $$sAAA Any | NonectpdsdStfdtDdS)Nr5c3FK|]}||VdSrK) is_upsampling)r_rtemporal_upsamplings r% z*find_temporal_upsampler..s7ssWH]H]^qHrHrsssssssr$)rr6nextrrs`r%find_temporal_upsamplerrsQ "(b ) ) / / 1 1t ssss(Dsssuy z zzr$ct|pd}|sdStD]3}|dt|Dvr|cS4dS)Nr5cg|]\}}|Sr#r#r__keys r%r`z5find_temporal_upsampler_by_method..s```fac```r$)rr6rrdrvr2rs r%!find_temporal_upsampler_by_methodrs} 2   $ $ & &F t/ ``8\8\8^8^(_(_``` ` `NNN a 4r$rcNt|}|td|d|S)Nz-No temporal upsampler registered for method '')r RuntimeErrorrs r%$require_temporal_upsampler_by_methodrs3/77GT6TTTUUU Nr$tuple[float, ...]ct|}|dSt|dit |dS)Nr# multipliers)rtuplervrbrrs r%method_multipliersrs^/77Gr 5577;;M2NNRRSVW]S^S^`bcc d ddr$list[tuple[str, float]]c4dt|DS)Nc0g|]}t||fSr#)r1)r_r&s r%r`z1multiplier_choices_for_method..s& \ \ \ $U + +U 3 \ \ \r$)r)r2s r%multiplier_choices_for_methodrs \ \ASTZA[A[ \ \ \\r$c@t|di|d}|sdS|dd}t|}|5||}||d|kr|d|vr|dS|dS)Nrr#default_temporal_upsamplingr5rr )rrbr split_value)rYr2r default_valuersplits r%_default_multiplier_from_defrs  r::>>vrJJKKK tOO$A2FFM%m44G##M22  qV!3!3aK8O8O8O q>r$ct|}|dSt|t|pdpdS)N@r5)rrrvrr6rs r%default_multiplier_for_methodrsW/77Gs '(L(L(N(NPSTZT`^`PaPaPgPgPiPi j j qnqqr$ct|}|sdS t|}n&#ttf$rt |}YnwxYw||vr|nt |S)Nr)rr'rr?r)r2r&rs r%normalize_multiplier_for_methodrs|$V,,K s6e  z "666-f556[((55.KF.S.SSs% AAtuple[str, float] | NonecRt|}|dn||SrK)rr)r@rs r%split_temporal_upsampling_valuers+%e,,G?44(;(;E(B(BBr$ str | NonecTt|}|dn|||SrK)r build_value)r2r&rs r%build_temporal_upsampling_valuers-/77G?44(;(;FE(J(JJr$ct|pd}|sdSt|}||St|d}|dn |j|}|p|S)Nr5r)rr6rrr)r@rArr normalizeds r%#normalize_temporal_upsampling_valuersw u{   ! ! # #D r +D 1 1E } /a99G .Ag.A5.IJ  r$cBt|pd}|sdSt|}||S||}||S|\}}t ||}|rt||n|Sr4)rr6rrrirvrbrH)r@rArrr2r&rDs r% format_temporal_upsampling_labelr s u{   ! ! # #D r%d++G    % %E } MFE 7??AA B B F Fv N NE6; E $UE 2 2 2Er$1tuple[list[tuple[str, float]], float | None, str]ct|pd}|sgddfSt|}t||}||t ||pdfSr4)rr6rrr)r2r&multiplier_choicess r%#normalize_temporal_upsampling_statersn 2   $ $ & &F 4|6v>> +FE : :E u&Efe&T&T&ZXZ ZZr$cTt|}t||dn|dS)Nrr )rr)r2 current_valuers r%.normalize_temporal_upsampling_value_for_methodr#s. +M : :E .vemssQVWXQY Z ZZr$r5selected_methodinclude_hiddenrrcg}t|D]7|fdtDz }8dt|DS)Ncg|]]\}}t|t|t|pdt|pd||f^S)rr5)rrrcasefold)r_rDr2rrYrrs r%r`z(query_method_choices..,sWWW{HzBHlEFMOUgvGUlVlVlVW[f55s5;B7G7G7P7P7R7RTWX^XdbdTeTeglntuWWWr$c"g|] \}}}}}||f Sr#r#)r_rrDr2s r%r`z(query_method_choices..-s' J J J 61aUFO J J Jr$)rrvrdsorted)rrrchoicesrrYs `` @@r%query_method_choicesr(sG1,??WW::<< WWWWWWWL[\gLhLhWWW W J J&// J J JJr$ field_helpc. t|dd}|g}i}|D]A\}}t|}|+||g||fB|D]\}}|} t | d|dd} t | ddpd d| g} r|  | dittrfd |D} | fd | Dz } |d | d |S) NTEMPORAL_UPSAMPLER_HELP_INTROzJTemporal upsamplers increase frame rate by generating intermediate frames.namer descriptionr5z### method_descriptionsc g|]K\}}t|t|dpdfLS)r5)rrbr6)r_rDr2rs r%r`z*temporal_help_markdown..AsUyyy`m`egmE C(;(?(?(K(K(Qr$R$R$X$X$Z$Z[yyyr$c6g|]\}}||k d|d|S)z- **z:** r#)r_rDdetailrs r%r`z*temporal_help_markdown..Bs@rrr]UFQWr\bfq\q\q0U0000\q\q\qr$z ) rSr setdefaultrLitemsrvrrbr6rrujoin)rlrintrorwhandler_choicesrDr2rrrYrlinesdetailsrrs @@r%temporal_help_markdownr0s J ?BN O OEwHO'LL v3F;;    & &w 3 3 : :E6? K K K+1133 , ,::<< ;??671:a=99::+//-<<BCCIIKK   & LL % % %)oo.CRHH )4 0 0 syyyyqxyyyG rrrrgrrr rE E**++++ ;;x  r$tuple[str, str]c(dt||fS)NzTemporal Upsamplerr)r)rlrs r%temporal_help_popuprGs !7S]!^!^!^ ^^r$cdd|D}dtj|dddS)N|c3:K|]\}}t|VdSrK)r)r__labelr2s r%rz#temporal_help_id..Ls,JJVJJJJJJr$temporal_upsampling_zutf-8 )rhashlibsha1encode hexdigest)rl signatures r%temporal_help_idrKs`JJ>JJJJJI \',y/?/?/H/H"I"I"S"S"U"UVYWYVY"Z \ \\r$late_postprocessingrct|pd\}}dgt| |z}|d|Dvrd}t||\}}}|||||dS)N)r5r)rIr5)rrch|]\}}|Sr#r#)r_rr@s r% z!dropdown_state..Ss;;;5e;;;r$r5)r2r&r@rlr)rrr)rrr2r&rlrr@s r%dropdown_staterPs34GHHUIMFE"^&:L_H_qw&x&x&xxN ;;N;;;;;'J6SX'Y'Y$uuuP^wI J JJr$T)visibler elem_classes update_formrrrc t|r|nd}5|d|d|dd|}|Ft|d|\} } ||t |d| | |d |d |o |ddkd d |} dddn #1swxYwY|dd|} fd} fd}|sK| | g}|jg| || g|g|d| jg||| g|d| || dS)Nr5rrlr2zTemporal Upsampling)rr@rr&rDrr)titlemarkdownrr&r Multiplierr@F)r@rrc t||\}}}t|}|d|d|d|dt|d|dfS) Nrrlr2)rr@rr&)rr@rr@)rrupdater)r2r@rstategrrs r%refresh_methodz5create_generation_temporal_ui..refresh_methodcsDVUSS 1eu:MNNNyy'7!8hyPPRTR[R[dij~dHMNUHV`dejkset`u`uR[SvSvx}~ExFF Fr$cxt||\}}}|t||fS)N)r@r)rr r)r2r&rr@rs r%refresh_multiplierz9create_generation_temporal_ui..refresh_multiplierhs9=feLL5%yyud6lly;;UBBr$hidden)triggersfninputsoutputs show_progress)r@r2 multiplier) rRowDropdownrbindrTextboxoninput)rrrrrrrr r2 help_title help_markdownrr@rrrs` ` r%create_generation_temporal_uir!Ysr 'A..rWj k k kE U+;%>@@ r%&9::GN8KNNNN##$788IFA #GV 4 4A@f@@@@w-..a**+>P_*```BQ Y > >WYYr$)main_offloadobjloaded_model_contextc t|}|;t|pdrtd|d|||fSd|d<|d#t t jt|d<| d}t|d r| nd } t|||} | Bt|d r2dd l m} ||d p| |t!5 ||jn|} | | | %t|dr|n | t|dr|j|fi||j||||fd| i|| | jn-| rt-j|gnt-j|gcdddS#| | jw| rt-j|gwt-j|gwxYw#1swxYwYdS)Nr5r%rrprofile init_pipe)r}rpersistent_modelsFdownload)process_files_def process_filesrrelease_private_runtimeload_upsamplerr))rrr6r?rbrprocessor_memoryr,rrvrtr-rshared.utils.downloadr/r.r offloadobj unload_allr1r2temporal_upsampler unload_vram release_all) rsampleprevious_last_framefpsr(r)kwargsrr persistentborrowed_contextr/core_offloadobjs r%r7r7s!%&9::G "(b ) ) / / 1 1 ^\FY\\\]] ]*C//F9 zz+&%&6&@Pqrrr{  / / 1 1& 9D07AT0U0U`**,,,[`J.w8KMabbGGZ$@$@;;;;;;O44I8I_rsss  ! !55 5AUAa2==gvO***,,,+AZ0[0[+//1111!)gg?O.P.P)&&':EEfEEE,7,-@&J]_bUUzJUNTUU+ +668888 5 ,dV4444 ,dV444!55555555 + +668888 5 ,dV4444 ,dV4444!5555555555s--I /A:G?)A I ?A I  I  IIc ht|}|t|dsdS|j|fd|i|S)Nr.Fr)rrtr.)rr0r=rs r%download_for_valuerBsJ%&9::Gggz::u 7 M ] ]?R ]V\ ] ]]r$cg}t|D]y}t|dr*||| 344  !>HHH Nr$cht|dr!t|niS)Nrr)rtrurrrMs r%_default_configrQs2-4W>N-O-O W4&&(( ) ) )UWWr$ryct|dr"t||nt|S)Nnormalize_config_section)rtrurS)rrys r%_normalize_config_sectionrTs==DWNh=i=i {40088 9 9 9ostzo{o{{r$c |ti}t|tr#|t |ini}it |t|tr|ni}t ||SrK)rbrMrrurKrQrT)r}rrNnestedvaluess r%read_config_sectionrXs =rBBGAKGUYAZAZ bW[[/88" = = =`bF Y(( Yz&$7O7O-WVVUW YF $Wf 5 55r$ct|it|t|pi}|t|t |<|SrK)rTrQrurOrK)r}rrys r%write_config_sectionrZsS &w0b?73K3K0btTZT`^`OaOa0b c cFFLOM""#9'#B#BC Mr$c t|td}tD]0}t |rt ||t ||1|t|tdkSrK)reprrbrMrrQrZrX)r}beforers r%!migrate_temporal_upsampler_configr^s -##$A4HH I IF/ff 7 # # f 9L]\c9d9d e e e T-++,I4PPQQ QQr$ lock_configr`$list[TemporalUpsamplerConfigBinding]c 8g}dtD}|s|S|5|D]}t||t||}||d5}||||}dddn #1swxYwYt||_|r>| t|t|t| dddn #1swxYwY|S)Nc2g|]}t|d|S)create_config_ui)rtrs r%r`z$create_config_ui..s(lllGwwXjGkGkllllr$rr_) rTabsrZrXTabrvrdrrrLrrKlist) rr}r`bindingshandlersrrytabrs r%rdrdsHll'ClllH  zz z zG)-BUVcelBmBmnnF<<>>vFGG Y3"33BK3XX Y Y Y Y Y Y Y Y Y Y Y Y Y Y Yx..CK z >wH^_fHgHgimnviwiw x xyyy  zzzzzzzzzzzzzzzz Os7AD=B" D"B& &D)B& *ADDDrhcd|DS)Nc,g|]}|jD]\}}|Sr#)r)r_bindingr components r%r`z%config_components..s, S S S''BR S S,!YI S S S Sr$r#)rhs r%config_componentsros S SX S S SSr$cft|pg}id}}|D]v}i}|jD]7\}}|t|krtd||||<|dz }8t |jit |j|||j<w|t|krtd|S)NrzDTemporal upsampler config UI values do not match registered controlsr )rgrr>r?rTrrQr)rhrWupdatesindexrmryfieldrs r%collect_config_updaterts &,B  FUGAA(  HE1F ## !ghhh"5MF5M QJEE&?QTcdkdsTtTtQx~Q'A'A"## F _``` Nr$rq list[str]c<g}|D]}|j|vrt|jdrv|j||j}t |t r|r||rt |tr|d|Dz }|S)Nvalidate_config_sectioncg|]}||Sr#r#)r_rAs r%r`z3validate_config_update_messages..s>>>d>T>>>r$)rrtrrwrrrLrg)rhrqmessagesrmmessages r%validate_config_update_messagesr{sH??   ( (WW_F_-`-` (o==ggFX>YZZG'3'' ?G ?((((GT** ?>>g>>>> Or$cd|D],}|j|vr!t||j||j-dSrK)rrZr)r}rhrqrms r%apply_config_updater}sJ^^   ( ( I[A\ ] ] ]^^r$ old_config new_configczt|}tj|tj|k}tD]y}t |dst ||}t ||}t |dr||||}n||k}|s|r|zdS)N release_vramconfig_requires_release)setr3 config_valuesrrtrXrr)r~r changed_keysmemory_changedr old_section new_sectionshould_releases r%*release_changed_config_temporal_upsamplersrs|$$L%3J??CSCablCmCmmN/ # #w//  )*g>> )*g>> 75 6 6 8$<<[+WcddNN(K7N  #^ #  " " " # #r$c,eZdZdZdZdZdZd dZdS) SimpleScaleSuffixMixinz[Value helpers writing '*' while accepting the legacy concatenated form.cXdt|DS)Ncg|]\}}|Sr#r#rs r%r`z7SimpleScaleSuffixMixin._method_keys..-sWWW3WWWr$)rdrv)selfs r% _method_keysz#SimpleScaleSuffixMixin._method_keys,s*WW/$2S2S2U2U"V"VWWWWr$c(t|pd}t|t dD]2}||rt||d}|dn||fcS3dS)Nr5T)rreverser)rr6r7rrr>r=rC)rr@rAr2r&s r%rz"SimpleScaleSuffixMixin.split_value/s5;B%%''--//T..00c4HHH B BFv&& B/fcBB$}tt65/AAA Btr$ct|pd}||vrdS|di|d}t |pd}||vr$t||pd}t||S)Nr5rr#r) rr6r7rrvrbr'rr9)rr2r&rs r%rz"SimpleScaleSuffixMixin.build_value7sV\r""((**0022 **,, , ,47799==mRPPTTU[]_`` ejq!!  # #01R1R1T1TV\]]babE&vu555r$r(rc0||duSrK)r)rr@s r%rz$SimpleScaleSuffixMixin.is_upsamplingAs&&d22r$Nr(r)rr r!__doc__rrrrr#r$r%rr)s^eeXXX666333333r$r)r&r'r(r)r2rr&r'r(r)r2rr:r'r(r;)rDrr&r'r(r)r(rI)rOr)rYrZr(r[)rYrZr(re)rYrZrjrr(rrK)rnror(rp)rnror(rI)F)rrr(rr)rrr(r)rYrZr(r')rYrZr2rr(r')r(r)r(r)r(r)r(r)rYrZr2rr(r;)r(r')r(r)r(r)r(r)r(r)rrrrrrr(r[)r(r)rrr(rZ)rrrrrrr(rZ)r#rr(r)T)r}rZr(rZ)r(rZ)ryrZr(rZ)r}rZryrZr(rZ)r}rZr(r)r}rZr`rr(ra)rhrar(r)rhrar(rp)rhrarqrpr(ru)r}rZrhrarqrpr(rI)r~rZrrZr(rI)\r __future__r dataclassesr functoolsrrrTtypingrshared.attentionr shared.utilsrr5r r3processor_statusr r r rrrr model_contextrrMr8rsrr"rrrrr.r1r9rCrHrNrXrdrirmrzrrrrrrrrrrrrrrrrrrrrrrrrrr!r'r7rBrDrKrOrQrTrXrZr^rdrortr{r}rrr#r$r%rs`4#"""""!!!!!!333333))))))((((((JJJJJJJJJJJJJJJJJJ222222!6CD+-,,,,;?!????9<,>>>> $$$$$$$ $ CCCC ****bbbb$]]]]5555 EEEE QQQQMMMM!!!!      ? ? ? ? ?qqqqq@@@@ppppp%%%%{{{{ eeee]]]]    rrrrTTTTCCCC KKKK     F F F F[[[[[[[[ KrjoKKKKKK:>!!!!!!.7;______]]]] HMJJJJJJOSpuEI_dquHHHHHH4RW Z Z Z Z Z Zae{55555D^^^     QQQQ XXXX||||6666 RRRRPU       TTTT        ^^^^ # # # # 3333333333r$