j5,dZddlZGddZdS)z The following code is copied from https://github.com/modelscope/DiffSynth-Studio/blob/main/diffsynth/schedulers/flow_match.py Nc<eZdZdZddZddZdd Zd Zd Zd Z d S)FlowMatchSchedulerFd@?Jh?c ||_||_||_||_||_||_||_||dSN)num_train_timestepsshift sigma_max sigma_mininverse_timestepsextra_one_stepreverse_sigmas set_timesteps) selfnum_inference_stepsr r rrrrrs DC:\Users\johnn\OneDrive\Documents\AI\shared\utils\basic_flowmatch.py__init__zFlowMatchScheduler.__init__ sR#6  ""!2,, ./////c|j|j|jz |zz}|jr,tj||j|dzdd|_n tj||j||_|jr!tj|jdg|_|j|jzd|jdz |jzzz |_|j rd|jz |_|j|j z|_ |rd|j }tj d||dz z |z dzz}|| z }|||z z}||_dSdS)Nr)dims)rrrtorchlinspacesigmasrflipr rr timestepsexpminsumlinear_timesteps_weights) rrdenoising_strengthtraining sigma_startxy y_shiftedbsmntw_weighings rrz FlowMatchScheduler.set_timestepssn ^dn ,0B BC   B.T^-@1-DFFFIrcKDKK .T^-@BBDK  ! <*T[s;;;DKj4;. $*q.DK/ /1   *dk/DKt'??  <A "%81%??l ^h & + + - -1666  K(00Q1==  G a3t~+>+>>CCEE G&F*.*=FQQDE F[q199"aAFFF|v~>> }rc|j|j|_|j|j|_t j|jd|dz d}|j|dddd}d|z |z||zz}| |S)a3 Diffusion forward corruption process. Input: - clean_latent: the clean latent with shape [B, C, H, W] - noise: the noise with shape [B, C, H, W] - timestep: the timestep with shape [B] Output: the corrupted latent with shape [B, C, H, W] rrr0r) r!r2r3r#rr4 unsqueezer5r6type_as)roriginal_samplesnoiser:r=r>r;s r add_noisezFlowMatchScheduler.add_noise>sknnU\22 **5<88l ^ % %a ( (8+=+=a+@+@ @ E E G GQPPP  K(00Q1==e)//%%-?~~e$$$rc||z }|Sr )rr;rFr:targets rtraining_targetz"FlowMatchScheduler.training_targetOs rctj|j||jjz }|j|}|Sr )rr4r#r2r3r5r')rr:r=weightss rtraining_weightz"FlowMatchScheduler.training_weightSsNl ^hkk$.*?@@ @ E E G GII / <rN)rrrrr FFF)rrF)F) __name__ __module__ __qualname__ is_statefulrrrArGrKrNrIrrrr sK0000<<<<2    %%%"rr)__doc__rrrIrrrTsV MMMMMMMMMMr