jw? ddlZddlmZddlZddlmZddlmZddl m Z dZ dZ d Z d Zd Zd Zd ZdZdZgdZgdZdddddZgdZddddddddddddddddgZd Zd!Zd"Zd#Zd$Zd%Zd&Zd'Z d(Z!d)Z"d*Z#d+Z$Gd,d-Z%dS).N) find_spec) files_locator) build_hf_url)!get_stable_audio3_prompt_enhancerzDeepBeepMeep/TTSstable_audio3_smallstable_audio3_mediumzt5gemma-b-b-ul2z t5gemma-b-b-ul2_bf16.safetensorszstable_audio3_small_config.jsonz stable_audio3_medium_config.jsonz%stable_audio3_same_s_bf16.safetensorsz%stable_audio3_same_l_bf16.safetensors)z config.jsonzspecial_tokens_map.jsonztokenizer.jsonztokenizer.modelztokenizer_config.json)AEAIACz Text to audiozAudio to audio editzInpaint source audiozContinue source audio))PingPongpingpong)Eulereuler)zDPM++dpmpp)RK4rk4inpaint_start_secondszInpaint Start Secondsfloatgg?)idlabelnametypedefaultminincinpaint_end_secondszInpaint End Secondsg$@c2tj|dp|S)NF) error_if_none)fl locate_file)filenames HC:\Users\johnn\OneDrive\Documents\AI\models\TTS\stable_audio3_handler.py_root_checkpoint_pathr%0s >(% 8 8 8 DHDctjtjtddt |S)N stable_audio3configs)ospathjoindirname__file__ _config_namebase_model_types r$ _config_pathr24s3 7<<11?I|\kOlOl m mmr&c4|tkrtntSN)STABLE_AUDIO3_MEDIUMSTABLE_AUDIO3_SAME_L_WEIGHTSSTABLE_AUDIO3_SAME_S_WEIGHTSr0s r$_asset_weightsr88s+:>R+R+R ' 'Xttr&c4|tkrtntSr4)r5STABLE_AUDIO3_MEDIUM_CONFIGSTABLE_AUDIO3_SMALL_CONFIGr0s r$r/r/<s*9=Q*Q*Q & &Wqqr&c |tkrdndS)Ni|x)r5r0s r$ _max_durationr>@s!%99933sBr&c.dddt|dddS)NzDuration (seconds)zTarget Durationr)rrrmax incrementr)r>r0s r$_duration_sliderrCDs6)3DQWdetWuWuEFSU V VVr&c*fdtDS)Nc fg|]-}t|tt.S))rA)dictrr>).0oner1s r$ z$_custom_settings..Is6 j j jSD% o > >?? @ @ @ j j jr&)STABLE_AUDIO3_CUSTOM_SETTINGSr0s`r$_custom_settingsrKHs j j j jLi j j jjr&c|t|pd}d|vrdSd|vrdSd|vrdSd|vrd SdS) Nr AtextEaudio_to_audioIinpaintCcontinue)strupper)audio_prompt_types r$_mode_from_audio_prompt_typerXLsl-344::<< ###v  y z 6r&ctddS ddl}n#t$rYdSwxYwtt |ddS)N flash_attnFrflash_attn_varlen_func)rrZ Exceptioncallablegetattr)rZs r$_flash_attention2_availabler_Ysf&u uu GJ(@$GG H HHs  &&cdS)NzStable Audio 3 Medium requires Flash Attention 2 for SAME-L sliding-window attention. Install flash-attn or use Stable Audio 3 Small Music/SFX.rar&r$_medium_flash_attention_errorrbcs ] ]r&cr|tkr)tsttdSdSr4)r5r_ RuntimeErrorrbr0s r$_require_medium_flash_attentionregs=...7R7T7T.8::;;;/...r&cl|tkrdnd}t|pidp|S)Nmedium small-musicstable_audio3_model_id)r5rUget)r1 model_defdefault_model_ids r$ _model_idrmls?#26J#J#JxxP]  R$$%=>>RBR S SSr&c,eZdZedZedZedZedZedZedZ eddZ e dd Z ed Z ed Z edZedZdS)family_handlercttgSr4)STABLE_AUDIO3_SMALLr5rar&r$query_supported_typesz$family_handler.query_supported_typesrs#%9::r&c iifSr4rarar&r$query_family_mapsz family_handler.query_family_mapsvs 2v r&cdS)Nttsrarar&r$query_model_familyz!family_handler.query_model_familyzsur&c dddS)N)iMusic)iTTS)musicrvrarar&r$query_family_infosz!family_handler.query_family_infos~s(???r&c4|tkrtStSr4)r5rqr0s r$ get_lora_dirzfamily_handler.get_lora_dirs 2 2 2' '""r&ct||}t|\}}}dddd|\}}d|dt|d}|tkr|dz }d |d |} id d d d|zdd| zdddddg|dkrdnd|dkrdndRDdd|dt|d|tkrdnd zd!d"|d#|d$d%d&d%d'd(d)d(d*d+d,d d-d%d.|gd/t t t tgd0t d1|||d2gd%td(d%d%d%d3d4ttd d5d6d7t|t|d(d8S)9N)z%instrumental music, loops and grooveszA relaxed 90 BPM instrumental with warm electric piano, rounded bass and brushed drums; a gentle introduction builds into a steady groove, then resolves softly.)z!sound effects, foley and ambiencezA heavy wooden door creaks open close to the listener, followed by footsteps across a stone floor and a short reverberant door slam.)z8longer music, evolving ambience and layered sound designzA slow cinematic instrumental with low strings and soft piano, gradually joined by distant thunder and wind, building to a restrained climax before fading.)rh small-sfxrgzStable Audio 3 is suited to z^. It produces stereo audio at 44.1 kHz. **Duration** sets the target output length, from 1 to au seconds; audible sound may finish earlier. ### Choose a Workflow - **Text to Audio:** describe a new sound or piece of music. - **Edit Audio:** supply source audio and describe the desired change. Audio strength 0 retains more source detail; 1 changes it more. - **Inpaint Audio:** supply source audio and select the start/end seconds of the interval to regenerate. - **Continue Audio:** supply source audio and choose a total duration longer than the source. The duration includes the original section. Inpainting and continuation may also change the sound slightly outside the regenerated region; preservation is not sample-exact. Start with 8 inference steps, guidance 1 and the PingPong solver. Prompt enhancement is optional. This model is not designed for speech or voice generation, or transcription. Inspect the result for silence and level before combining it with video.z Medium requires Flash Attention 2 for its audio codec. WanGP allows up to 380 seconds, but the upstream Medium checkpoint is documented for about 4.75 minutes; prefer that range.z.s.nnnfd^nnnr&z audio editingzaudio inpaintingzaudio continuationrh)z sound effectsrar)zmusic generation deepy_infoszStereo 44.1 kHz; u ; target 1–as. Modes audio_prompt_type: empty=text; AE=edit audio_guide (audio_scale 0..1, higher changes more); AI=inpaint audio_guide using custom_settings.inpaint_start_seconds/end_seconds; AC=continue audio_guide, duration_seconds is total length and must exceed the source. Codec reconstruction is not sample-exact. Start 8 steps, guidance 1, pingpong. Not designed for speech/voice generation or transcription; inspect silence/levels. zsMedium needs Flash Attention 2. WanGP allows 380s, but upstream documents Medium for about 285s; prefer that range.r deepy_prompt_infoszEnglish description of a: audible sources/instruments, rhythm, mood, texture, space and development. English-trained; other languages may underperform. Describe the target change when editing. Set timing with duration_seconds. Exact words, event timing and seamless loops are not guaranteed. Example: device_explicitT audio_only image_outputsFsliding_windowguidance_max_phasesrimage_prompt_types_allowedsupports_early_stop profiles_dirtext_encoder_URLstext_encoder_folder!text_prompt_enhancer_instructionsTz Source audiozEdit Noise Levelz Source AudioAEIC) selectionlabelsrrletters_filter)text_prompt_enhancer_max_tokensprompt_enhancer_button_labelprompt_enhancer_choices_allowedinference_stepssample_solvers temperatureany_audio_promptaudio_prompt_choicesenabled_audio_loraaudio_guide_labelaudio_scale_nameaudio_prompt_type_sourcesduration_slidercustom_settingscompile) rmrr>r5rSTABLE_AUDIO3_REPO_ID!STABLE_AUDIO3_TEXT_ENCODER_FOLDERSTABLE_AUDIO3_TEXT_ENCODER_BF16STABLE_AUDIO3_SAMPLE_SOLVERS STABLE_AUDIO3_AUDIO_MODE_CHOICESSTABLE_AUDIO3_AUDIO_MODE_LABELSrCrK) r1rkmodel_idprompt_enhancer_instructionsprompt_enhancer_max_tokensr specialityexample input_help prompt_helps r$query_model_defzfamily_handler.query_model_defsv_i88bCDLbMbM^$&@B^iGr     G d: d dERSbEcEc d d d  2 2 2 P PJ ": " "   " " ' W' ,z9'  7+E'  nnJ\^r9mMUYfMfMfwIwIln9mLTXcLcLcsHsHik9m9mnnn ' VzVV VeHfHfVVVS b f z S z S z ZO ZO @ B C ' !#gJ#g#g^e#g#g '  t'  $'  U'  e'  "1'  )"'  "4'  _-'  ,/DFgjI#J#J"K' "#D!' " 01M#' $0J,H03u#: $$("&!/ 2=9'"( ** 0@@/@@M' ' ' ' r&NcPtdtgt|gtgdS)Nr )repoIdsourceFolderListfileList)rrr8STABLE_AUDIO3_TOKENIZER_FILES) computeListr1rks r$query_model_filesz family_handler.query_model_filess3,!#%F G(99:torchbfloat16r conditioner conditioners main_model pretransformhasattrwgpr)model_filename model_typer1rkquantizeTransformertext_encoder_quantizationr VAE_dtypemixed_precision_transformersave_quantizedsubmodel_no_listtext_encoder_filenameprofilekwargsrtransformer_weights config_pathautoencoder_weights tokenizer_dirpipelineprompt_conditionerrrs r$ load_modelzfamily_handler.load_models" (888@@@@@@3=ntUZm3\3\pnQ//bp"?33 3N?4S4STT()JKK ''    !  ::&77)5>    S[^f^l^x_FSFSFX^7DXNNLP#.^0    )g6H'.R.R )#5#;D  }1 } 0 0 0 0 0 0 !4jBUW\Wn`e`np{ | | |$;;;;r&c^|dd|dddS)NrWr sample_solverr) setdefault)r1settings_versionrk ui_defaultss r$ fix_settingszfamily_handler.fix_settings s52B777 ;;;;;r&cH|ddddddddd d d d dS) Nr zeAn anthemic pop rock instrumental with bright guitars, punchy drums, and a nostalgic festival chorus.r@rrg?zpoor quality, distorted, noisyrg?FG) rWrduration_secondsrepeat_generation video_lengthnum_inference_stepsguidance_scalenegative_promptr audio_scalemulti_prompts_gen_type)update)r1rkrs r$update_default_settingsz&family_handler.update_default_settingssR%'B$&%& !'("%#C!+"*.       r&cr|2tt|dkrdSdS)Nrz/Prompt text cannot be empty for Stable Audio 3.)lenrUstrip)r1rkinputs one_prompts r$validate_generative_promptz)family_handler.validate_generative_prompt#s7  S__%:%:%<%Stable Audio 3 source-audio modes require a source audio file.rPrz1Stable Audio 3 Edit Noise Level must be a number.rrz8Stable Audio 3 Edit Noise Level must be between 0 and 1.r)rrzStable Audio 3 custom setting 'z' must be a number.) r5r_rbrjrXr TypeError ValueErrorrrF)r1rkrrWmoderkeyvalues r$validate_generative_settingsz+family_handler.validate_generative_settings)s 2 2 2;V;X;X 2022 2"JJ':B??E2+,=>> < < <MAZAZAbSS # # # =(A(A(M K(-f].C(D(D}%%z* K K KJJJ K}-22222222QQ **%6== ot , , VG V V'++C66=ERKKV+0<rCrKrXr_rbrermrorar&r$rsT $$$$$$ ,,,,,,((((((MMMMMM++-$5!"D>@FF!!!$:#9#9   ! ##     #-DNeovDGPS\_`` +@J_ip~BKNWZ[[! EEEnnnuuurrrCCCVVVkkk   III]]]<<< TTT QQQQQQQQQQr&