j~ rSSKrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J r SSK J r J r Jr SSKrSSKJr \"5(aSSKrSSKJr SS KJr "S S \5r\R0"5R2r\ "\5R8S rS \S3R=5rSSSSS.r S9S\ \!S-\RD"SS944Sjjr#"SS5r$S\!\RJ-S\!S\!4Sjr&S\ S\$S\!S \!S!\'\(\!\)44 S"jr*S#\!S$\'\!4S%jr+S\ S&\!S\!S \!4S'jr,S&\!S\!S!\'\(\!\)44S(jr-S)\!S*\.4S+jr/S)\ S\$S,\!S*\(\!\!\'44S-jr0S\ S\$S\!S!\'\(\!\)4S*\!4 S.jr1S\ S\$S!\'\(\!\)44S/jr2S\ S\$S\!S \!S!\'\(\!\)44 S0jr3S:S1\!S2\!S-S3\S-S4\!S-S*\ 4 S5jjr4S6\!S*\)4S7jr5S8r6g);N)Callable)date)Path) AnnotatedAnycast)is_libcst_available) CSTVisitor)matchersc\rSrSrSrSrS\RSS4SjrS\R4Sjr S\R4S jr S r g) ClassFinder$z3 A visitor to find all classes in a python module. c./Ul/UlSUlgNF)classespublic_classes is_in_class)selfs ڱC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\transformers/cli/add_new_model_like.py__init__ClassFinder.__init__)s!#DL(*D $D nodereturnNcpURRURR5 SUlg)zwRecord class names. We assume classes always only appear at top-level (i.e. no class definition in function or similar)TN)rappendnamevaluerrrs rvisit_ClassDefClassFinder.visit_ClassDef.s$ LL    0#D rcSUlgr)rr s rleave_ClassDefClassFinder.leave_ClassDef3s $D rc[R"[R"[R"[R"5S9/S9/S9nUR (d[R "X5(a[[RURS5n[[RURSR5RnUS:Xas[[RUR5RnUVs/sH1n[[RUR5RPM3 snUlggggs snf)z:Record all public classes inside the `__all__` assignment.)target)targets)bodyr__all__N)mSimpleStatementLineAssign AssignTargetNamermatchesrcstr)r(r'rTupleelements SimpleStringr)rr!simple_top_level_assign_structurestmtassigned_variabler3elements rvisit_SimpleStatementLine%ClassFinder.visit_SimpleStatementLine6s010E0Ehhaffh(G'HIJ1 -## $(Z(ZCJJ ! 5$(4<<?3I3I$J$P$P!$ 1#CIItzz:CCHfn*ofn[b40@0@'--+P+V+Vfn*oD'2)[# +ps8E)rrr) __name__ __module__ __qualname____firstlineno____doc__rr1ClassDefr!r$r,r9__static_attributes__rrrr$sG  %  $s|| $ $  %s|| % p#2I2I prrz # coding=utf-8 # Copyright aN the HuggingFace Team. All rights reserved. # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. IMAGE_PROCESSOR_MAPPING_NAMESVIDEO_PROCESSOR_MAPPING_NAMESPROCESSOR_MAPPING_NAMESFEATURE_EXTRACTOR_MAPPING_NAMES)zimage_processing_auto.pyzvideo_processing_auto.pyzprocessing_auto.pyzfeature_extraction_auto.py repo_pathzFWhen not using an editable install, the path to the Transformers repo.)helpc`[5unnnn[Ub [U5O[UUUUS9 g)z; Add a new model to the library, based on an existing one. NrHold_model_infosnew_lowercase_namenew_model_paper_namefilenames_to_add)get_user_input_add_new_model_like_internalr REPO_PATHrKs radd_new_model_likerSbs?  !%.%:$y/ '-1) rc&\rSrSrSrS\4SjrSrg) ModelInfos}zA Retrieve the basic information about an existing model classes. lowercase_namectSSKJn SSKJn SSKJn SSKJn SSKJ n SSK J n UR5RSS 5RS S 5UlURU;aURRS S 5 URU;a[US 35eX RUlUR RS S 5UlURU;a>SUlX`RUlUR&S:XaSO UR&UlOSuUlUlUR)URS5UlUR)URS5UlUR)URS5UlUR)URS5Ulg)Nr CONFIG_MAPPING_NAMES)rG)rD)rF)TOKENIZER_MAPPING_NAMES)rE _-z is not a valid model nameConfigPreTrainedTokenizerFast)NN)models.auto.configuration_autorZ#models.auto.feature_extraction_autorG!models.auto.image_processing_autorDmodels.auto.processing_autorFmodels.auto.tokenization_autor[!models.auto.video_processing_autorElowerreplacerW ValueError config_classcamelcase_nametokenizer_classfast_tokenizer_classgetimage_processor_classesvideo_processor_classfeature_extractor_classprocessor_class)rrWrZrGrDrFr[rEs rrModelInfos.__init__sIYUIKU-224<r?strrrArBrrrUrU}sVsVrrU file_name new_content add_afterc[USSS9nUR5nSSS5 WRUS5upVXR-U-U-n[USSS9nURU5 SSS5 g!,(df  NR=f!,(df  g=f)a? A utility to add some content inside a given file. Args: file_name (`str` or `os.PathLike`): The name of the file in which we want to insert some content. new_content (`str`): The content to add. add_after (`str`): The new content is added just after the first instance matching it. rutf-8encodingNw)openreadsplitwrite)rvrwrxf old_contentbeforeafters radd_content_to_filers~ iw /1ffh  0 %%i3MF${2U:K iw /1   0 / 0 / 0 /sA)A:) A7: BrLrMrNrOc XSRSURSS5RS555nURnURnUSSVV s/sHupURUS5U 4PM nnn /n UH5upSU ;aU S upX=(d U 4U S 'M#U R X45 M7 [ US - S - S - S- S - SUSUS3SS9 US - S - S - S- S - R5nU GH&upU (dMU[;aq[UnS n[R"SUS3U[R5nURS5n[R"SUS3U[R5nO[URSS5nUS - S - S - S- U- R5n [R"SUS3U [R5nUH;n[ US - S - S - S- U- URXb5RXu5US9 M= GM) gs sn nf)a Add a model to all the relevant mappings in the auto module. Args: old_model_infos (`ModelInfos`): The structure containing the class information of the old model. new_lowercase_name (`str`): The new lowercase model name. new_model_paper_name (`str`): The fully cased name (as in the official paper name) of the new model. filenames_to_add (`list[tuple[str, bool]]`): A list of tuples of all potential filenames to add for a new model, along a boolean flag describing if we should add this file or not. For example, [(`modeling_xxx.px`, True), (`configuration_xxx.py`, True), (`tokenization_xxx.py`, False),...] r`c3@# UHoR5v M g7fNtitle.0xs r -add_model_to_auto_mappings..`0_1WWYY0_r^r]r~Nautoztokenization_auto_fast.pysrc transformersmodelszauto_mappings.pyz("z", "zConfig"), z2CONFIG_MAPPING_NAMES = OrderedDict( [ rwrxz[^\w_]z%\s*=\s*OrderedDict\(\s*\[(.*?)\]\s*\)z( {8,12}\(\s*"z",.*?\),\n)(?: {4,12}\(|\])_fast.py.py)joinrirrWrlrr read_text_AUTO_MAPPING_NAMESresearchDOTALLgroupfindall)rHrLrMrNrOnew_cased_nameold_lowercase_nameold_cased_namefilenameto_addcorrected_filenames_to_addfile previous_fileprevious_to_addautofile mapping_name block_matchblockmatching_linesmatchs radd_model_to_auto_mappingsrs*WW`0B0J0J3PS0T0Z0Z[^0_``N(77$33NWghihjWkWkCS8  ,f 5v>Wk"$(  &$ .-G-K *M.;=VPV-W &r * & - -tn = )EN*X5>ASS+,D0@@STH E!N2X=FI[[ffhH6 6..28< - iil^+PQS[]_]f]f $))!,!#'(:';;XY[`bdbkbk" $++J>!E)N:XENQYYddf!#'(:';;XY[_acajaj"(#%6AFJXU % .@ U ] ]&!$ (-7)s H&new_paper_namerc,Sn[R"SS[5RSS5U-n[R "SUSUS35n/nUH'nS US U3nS U;aUS - nUR U5 M) S RU5nX4-U-$)a Create a new doc file to fill for the new model. Args: new_paper_name (`str`): The fully cased name (as in the official paper name) of the new model. public_classes (`list[str]`): A list of all the public classes that the model will have in the library. u ⚠️ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be rendered properly in your Markdown viewer. --> z# ?r`z coding=utf-8 z