j% ddlmZddlmZddlmZmZmZmZm Z m Z m Z m Z ddl mZmZmZmZdZdZdd ZdddZdddZdddZd S)) annotations)Any)%DEEPY_COMPACTION_SUMMARIZE_MIN_TOKENSDEEPY_COMPACTION_TYPE_KEYDEEPY_COMPACTION_TYPE_SUMMARIZEDEEPY_CONTEXT_TOKENS_KEYDEEPY_ENABLED_KEYDEEPY_TYPE_KEYDEEPY_TYPE_PRIMEdeepy_mode_from_config)ENGINE_QWEN38_27BLLM_CONFIG_KEYlocal_enhancer_idnormalize_llm_configreturnfloatc. ddl}|jr,t|jddrt|jddrdS|j|jjdz S#t$rYdSwxYw)Nrcudahipgi@) torchr is_availablegetattrversionget_device_propertiescurrent_device total_memory Exception)rs ?C:\Users\johnn\OneDrive\Documents\AI\shared\deepy\onboarding.pydetected_nvidia_vram_gbr!s z&&((  vt0T0T X_`e`motvzX{X{ 3z// 0I0I0K0KLLY]fgg sssA B 8B BBNvram_gb float | Nonetuple[str, str, int] | Nonect|tn|dz}|tkrdd|fS|tkrdd|fSdS)Ng?Q4ggufQ2gguf_q2)intr!DEEPY_PRIME_Q4_MIN_VRAM_GBDEEPY_PRIME_Q2_MIN_VRAM_GB)r"reported_vram_gbs r deepy_prime_hardware_profiler."s_3555gY\\]]555V---555Y 000 4 server_configdict[str, Any]strc$t|}|dS|\}}}t|}t|d<|tdt t ttttdttd|t|i|S)Ndeepyenhancer_enabledprompt_enhancer_quantization) r.rr updater r r rrrrrr)r0r"profilelabel quantization_reported_vram_gb llm_configs r 'apply_first_launch_deepy_prime_defaultsr?+s*733Gr-4*E<*%m44J+Jw1( "G!#B-.?@@&   Lr/ct|}|Jt|td|tt krdS|\}}}d|d|dS)Nrr4u✨ **Switch to Deepy Prime u** — your NVIDIA GPU (z GB VRAM) is eligible. Gain multi-step planning, image/video/audio tool chaining, and end-to-end handling of long creations. Select Deepy Prime below to switch.)r.r getr r r )r0r"r:r; _quantizationr-s r deepy_prime_upgrade_messagerC>s*733G01B1BCTVW1X1XZgZkZklzZ{Z{||AQQQr-4*E=* |% | |IY | | ||r/)rr)N)r"r#rr$)r0r1r"r#rr2) __future__rtypingrshared.deepy.configrrrrr r r r shared.remote_llm.configr rrrr,r+r!r.r?rCr/r rIs2""""""                    pooooooooooo &|||||||r/