jesxSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKJrJ r SSK J r J r SSK JrJrJr SSKrSSKrSSKrSSKrSSKJrJr SSKJr SSKJr SSKr\R<"5S:waSSKr\"5(a,SS K J!r! SS K"J#r# SS K$J%r% SS K&J'r' SS K(J)r)J*r*J+r+J,r,J-r- SSK.J/r/ SSS.r0\1"\Rd\Rf-5r4\1"\Rd\Rj-\Rf-S-5r6SS0SS0SS0SS0SS0SS0SS0S.r7Sr8SSRs\7Ru55S3r;S \"S%S&5r?S'\?@[]^_`{|}~textz5There is a Llama in my lawn, how can I get rid of it?zyWrite a Python function that integrates any Python function f(x) numerically over an arbitrary interval [x_start, x_end].z4How many helicopters can a human eat in one sitting?z4Count to 10 but skip every number ending with an 'e'zWhy aren't birds real?z2Why is it important to eat socks after meditating?z$Which number is larger, 9.9 or 9.11?)llamacode helicopternumbersbirdssocksnumbers2a **TRANSFORMERS CHAT INTERFACE** Chat interface to try out a model. Besides chatting with the model, here are some basic commands: - **!help**: shows all available commands (set generation settings, save chat, etc.) - **!status**: shows the current status of the model and generation settings - **!clear**: clears the current conversation and starts a new one - **!exit**: closes the interface am **TRANSFORMERS CHAT INTERFACE HELP** Full command list: - **!help**: shows this help message - **!clear**: clears the current conversation and starts a new one - **!status**: shows the current status of the model and generation settings - **!example {NAME}**: loads example named `{NAME}` from the config and uses it as the user input. Available example names: ``, `a#` - **!set {ARG_1}={VALUE_1} {ARG_2}={VALUE_2}** ...: changes the system prompt or generation settings (multiple settings are separated by a space). Accepts the same flags and format as the `generate_flags` CLI argument. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-options - **!save {SAVE_NAME} (optional)**: saves the current chat and settings to file by default to `./chat_history/{MODEL_ID}/chat_{DATETIME}.yaml` or `{SAVE_NAME}` if provided - **!exit**: closes the interface base_urlreturnc[U5nURRS5RS5n[ UR UR USSS45$)zQReturn the service root of `base_url`, where the serve management endpoints live./z/v1)rpathrstrip removesuffixr schemenetloc)r%parsedr*s ڣC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\transformers/cli/chat.pyget_service_root_urlr1jsK h F ;;  c " / / 6D v}}fmmT2r2F GGc\rSrSrS\S\S\4SjrS\\\S\ \\\ -S-44S jr S\4S jr S r S \4S jrS \S\4SjrSS\S\S\4SjjrSS\4SjjrS\4SjrS\4SjrSrg) RichInterfaceqmodel_iduser_idr%cF[5UlXlX lX0lgN)r_consoler6r7r%)selfr6r7r%s r0__init__RichInterface.__init__rs     r2streamr&Nc l# URRSURS35 [URSS9nSnSn[R"5nSnUIShvN ShvN nUR SR Rn[UR SSU5n[USS5n U b [U S U5nU(dMl[R"S S U5nX8- n/n UR5HNn U RU 5 U RS 5(aU RS 5 M=U RS5 MP [SRU 5R!5SS9n UR#U SS9 GM&GN+GN% SSS5 O!,(df  O=f[R"5W- n U S:aKWS:aEXM- nURR5 URRSUSU SSUSS35 URR5 WW4$7f)Nz [bold blue]:)consolerefresh_per_secondr)r finish_reasonusagecompletion_tokensz <(/*)(\w*)>z\<\1\2\>z``` z z github-dark) code_themeT)refreshz[dim]z tokens in z.1fzs (z tok/s)[/dim])r:printr6rtimechoicesdeltacontentgetattrresub splitlinesappend startswithrjoinstripupdate)r;r>liverrE start_timerCtokenoutputsrDlineslinemarkdownelapsed tok_per_secs r0 stream_outputRichInterface.stream_outputxs l4==/<= $--A >$D ! J(,M%+||) 4e--*0088 ' a(8/= Y w5$(/7JL](^%&&gF OO-DLL&u-- T* V,.$BGGEN$8$8$:}U Hd 3S ,) 4| ? > >`))+ * Q;,q0+5K MM   ! MM  %(9':+gc]RUVabeUffs t u ]""sO>H4!F!F "F&F*F+F.DFFF H4 F*&BH4cURRSURS35nURR5 U$)z!Gets user input from the console. [bold red]: )r:inputr7rI)r;rds r0rdRichInterface.inputs8 ##k$,,t$DE  r2c8URR5 g)zClears the console.N)r:clear)r;s r0rgRichInterface.clears r2rcURRSURSU35 URR5 g)z%Prints a user message to the console.rcz>:[/ bold red] N)r:rIr7)r;rs r0print_user_message RichInterface.print_user_messages6 k$,,7GvNO r2colorczURRSUSU35 URR5 g)z,Prints text in a given color to the console.z[bold ]N)r:rI)r;rrls r0 print_colorRichInterface.print_colors1 fUG1TF34 r2messagedefaultcU(aSOSnURRSUSUS35nURR5 UR5R 5nU(dU$US;$)zFDisplays a yes/no prompt to the user, returning True for confirmation.zY/nzy/Nz [bold yellow]z (z): >yyes)r:rdrIrUlower)r;rqrr default_hintresponses r0confirmRichInterface.confirmsf 'uU ==&&wir,s'ST >>#))+N<''r2minimalcURR[U(a[O[55 URR5 g)z'Prints the help message to the console.N)r:rIrHELP_STRING_MINIMAL HELP_STRING)r;r{s r0 print_helpRichInterface.print_helps. HG%8UV r2modelc ,^^^[R"[[UR5S-S5ST0SS9nUR 5 "SS[ 5nSS S S S .mURR[T5S -S-:mUUU4Sjn[[S5[SS9U"5[5URS9nURU"S5SS9nSn[XPRSS9 UR!5GHnU(aUR#S5(dM#[$R&"USS5n U R)S5n U S:XaU R)SS5n OU S:Xa[+U R)SS55eU S :XdMU R)S!5n U R)S"5n U"U 5n U (a0U S#:XaS$OS%nUR-XmU S&U R)S'5US(9 MUR-XmS)SS*9 GM SSS5 U(a)URR/[1S+TS,355 O(URR/[1S+TS-355 URR/5 g!,(df  N=f).Nr( load_modelrT)jsonr>c\rSrSrSrSrg)3RichInterface.print_model_load..StatsColumncUR(d [S5$URRS5S:Xa[R "[ UR55n[R "[ UR55nUR(a-S[R "[ UR55S3OSnURb6S[ URS-5S[ URS-5S3nOSn[US UUU3S S 9$[[ UR5S [ UR535$) Nr)unitbytesz z/s<:02dr(zprogress.download)style) totalrfieldsgetrdecimalint completedspeedtime_remaining)r;taskdonetotretas r0render:RichInterface.print_model_load..StatsColumn.renderszz8O;;??6*g5#++C,?@D"**3tzz?;CJN**b!1!1#djj/!B C2FZ\E**6 "3t':':b'@#A"B!CH[H[^`H`DabeCfg 4&#ugcU ;CVWWs4>>231S_4EFGGr2N)__name__ __module__ __qualname____firstlineno__r__static_attributes__rr2r0 StatsColumnrs Hr2rzLoading processorzLoading configzDownloading fileszLoading into memory) processorconfigdownloadweightsFcF>TRX5nT(aTSU3$U$)Nu → )r) stage_key stage_textrshow_model_prefix stage_labelss r0_label.RichInterface.print_model_load.._labels-%)))?J  |44 r2z[bold]{task.description}() bar_width)rAr)rF)rA transientsdata: statusreadycachederrorrqz Unknown errorloadingstageprogressrritemscurrentr) descriptionrrrr)rrrz_*z was already loaded.*_z is warm.*_)requestspostrr1r%raise_for_statusrr:widthlenrrrradd_taskr iter_linesrSrloadsr RuntimeErrorrVrIr)r;rrxrrrtask_idrr\eventrrproglabelrrrs ` @@r0print_model_loadRichInterface.print_model_loadsU== (7#=| LT[]bSclp  !!# H. H&-&+,  !MM//3u:>B3FF   1 2  # M  MM  ##F;$7t#D (MMT B ++-4??9#=#= 48,8,W$"YYx7FW$&uyyO'LMMY&!IIg.E 99Z0D"5ME*/:*=w7 #$y/Y]YaYabiYjqu(!aW[\1.C6  MM  2eW4J)K L M MM  2eWK)@ A B ?C Bs2BJA7J JrcURRSURS35 URRSU35 URR5 g)zFPrints the status of the model and generation settings to the console.z[bold blue]Model: rFz [bold blue]N)r:rIr6)r;rs r0 print_statusRichInterface.print_status.sK 0rBC k&23 r2)r:r%r6r7)F)rrrrstrr<rrr tuplerr`rdrgrjroboolryrrr rrrr2r0r4r4qs!!s!c! ;# .H IJ;# sC#I$$ %;#zs s C (s (T (d ($ RcRh#3r2r4c,\rSrSrSrS\SS\S3SSSSSS4S \\\R"S S 94S \\S-\R"S S 94S\\ \S-\R"SS 94S\\S-\R"SS 94S\\S-\R"SS 94S\\\R"SS 94S\\S-\R"SS 94S\\S-\R"SS 94SS4Sjjr \ S5rS\S\S\\\\\44S \S!\ \S\\ \\44 S"jrS#rS$rg)%Chati5(Chat with a model from the command line.zhttp://rrrNz./chat_history/r6z9ID of the model to use (e.g. 'HuggingFaceTB/SmolLM3-3B').)helpr%z7Base url to connect to (e.g. http://localhost:8000/v1).generate_flagsaFlags to pass to `generate`, using a space as a separator between flags. Accepts booleans, numbers, and lists of integers, more advanced parameterization should be set through --generation-config. Example: `transformers chat max_new_tokens=100 do_sample=False eos_token_id=[1,2]`. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-optionsuserzKUsername to display in chat interface. Defaults to the current user's name. system_promptzSystem prompt. save_folderzFolder to save chat history. examples_pathz"Path to a yaml file with examples.generation_configzPath to a local generation config file or to a HuggingFace repo containing a `generation_config.json` file. Other generation settings passed as CLI arguments will be applied on top of this generation config.r&c X l[UR5n U R[S:Xa2U R[S:XaUR UR5 XlXPlX`l[U5n U RSSS9 U R"S 0[U5D6 Xl X!URR5S.UlUbUO [5UlU(a0[#U5n [$R&"U 5UlSSS5 O [*Ul[-5(d [/S5e[0R2"UR555 g!,(df  NM=f) rrrT) do_samplemax_new_tokens)r%r6rNzHYou need to install rich to use the chat interface. (`pip install rich`)r)r%rrDEFAULT_HTTP_ENDPOINTr check_healthr6rrload_generation_configrVparse_generate_flagsrto_dictsettings get_usernameropenyaml safe_loadexamplesDEFAULT_EXAMPLESr ImportErrorasynciorun _inner_run) r;r6r%rrrrrrr/rfs r0r< Chat.__init__:s&F! $--( ??3J? ?FKKShioSpDp   dmm , *&((9: S 9 =,^<= %-t{{ObObOde !,D,.  m$ $q 1 %$-DM!""hi i  DOO%&%$s ;E** E8c [[U5S-S5n[R"U5nURS:wa[ SUSURS35eg ![R a [ SUS35ef=f) Nr(healthzThe server running on z returned status code z on health check (/health).zNo server currently running on z. To run a local server, please run `transformers serve` in aseparate shell. Find more information here: https://huggingface.co/docs/transformers/servingT)rr1httpxr status_code ValueError ConnectError)url health_urloutputs r0rChat.check_healths1#6r extra_body assistantlengthz2Generation stopped after reaching the token limit.yellowzContinue generating?u'Please continue. Do not repeat text.”r)&r4r6rr%rgr rrrrr rjrdrSrr!r"r*rTrrJr#r$rrorUrVrrrRr%r&rto_json_stringchat_completionr`ryKeyboardInterrupt)r;rrrclientpending_user_inputrr(r r)r*r+r,r0r> model_outputrCs r0rChat._inner_runs!4==$))VZVcVcd  2 23 T*""4==1'??6-1 f)5%7 -1*!44Z@%.__%6 "W,#x//0B0BC!) #w.!,,. #..w77C @P@P@R.is_numberws, NN3 yyb!$,,..r2z, z: {}z"null"z"true"rGz"false"rHz"[[z]"rnzPFailed to convert `generate_flags` into a valid JSON object. `generate_flags` = z Converted JSON string = )rr< BadParameterrTr!rrvrrrOrrJSONDecodeErrorr) rr* invalid_flagsgenerate_flags_as_dictkvrQgenerate_flags_stringprocessed_generate_flagss r0rr^s^!4!9 &4Hnd4TnMH  6v{{=7Q6RS1 1  drrcq[_cDJJsA$6q$99C?CQRASTUAVVcqr KaJfJfJhJh$! %661779A=JhKaJfJfJhiJh$!a;A=Jhi/S/T/ RhQmQmQopQoa11QCq1DQop !II?U?[?[?]&^?]tq!Bqc{?]&^_ "77#=299(FK199(FK199)WM199$D199$D #'::.C#D  $#eIsjq '_     $$2#3()>(? A   s4 HH#9H12H9H6!H$8H* 6H00&Irc U(aSUS./$/$)z Returns a new chat conversation.systemrr)rs r0r r s=JX- 8 9RPRRr2r rrc [R"[RRU5SS9 [ US5n[ R "X!S.USS9 SSS5 [RRU5$!,(df  N-=f)z!Saves the chat history to a file.T)exist_okw)r chat_historyr@)indentN)r"makedirsr*rBrrdumpabspath)r rrrs r0r$r$s]KK)D9 h  x>!L  77??8 $$  s A?? B c[R"5S:Xa[R"5$[R "[R "55R$)z)Returns the username of the current user.r)platformr_r"getloginpwdgetpwuidgetuidpw_namerr2r0rrs8I%{{}||BIIK(000r2__main__z meta-llama/Llama-3.2-3b-Instruct)r6r9)Hrrr"rirOstringrJcollections.abcrrtypingrr urllib.parserrr rrr<rhuggingface_hubr r transformersr transformers.utilsr readlinerr_rkrichr rich.consoler rich.liver rich.markdownr rich.progressrrrrr rich.textrrset ascii_letters whitespaceALLOWED_KEY_CHARSdigitsALLOWED_VALUE_CHARSrr}rTr&r~rr1r4rrr%r@rr r$rrrr2r0rs4  4!66  L)0   ?? !$&``%0$?,,v/@/@@A 6==(6+<+<?@A &H3H3HAAHZZz CcDj C=M C7$cT)97$d7$tSC$JS$t*S %%4:%%#%1c1 z45Q  sF//F98F9