jc%SSKrSSKJrJrJr SSKJrJr \R"\ 5r "SS\SS9r \"S S \55r S /rg) N)MultiModalDataProcessingKwargsProcessorMixin)auto_docstringloggingc*\rSrSrSSSS.SS0S.rSrg) Glm46VProcessorKwargsFT)paddingreturn_token_type_idsreturn_mm_token_type_idsreturn_metadata) text_kwargs videos_kwargsN)__name__ __module__ __qualname____firstlineno__ _defaults__static_attributes__rںC:\Users\johnn\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.13_qbz5n2kfra8p0\LocalCache\local-packages\Python313\site-packages\transformers/models/glm46v/processing_glm46v.pyr r s#%*(, ,T2 Irr F)totalc^\rSrSr\rSU4SjjrS\S\S\ 4Sjr S\S\S\ 4S jr SS jr SS jr \U4S j5rS \S\\\4SjrSS\4SjjrSrU=r$)Glm46VProcessor)c >[US5(dSO URUl[US5(dSO URUl[USS5(a UROUR UR5Ul[USS5(a UR OUR UR5Ul[TU]!XX4S9 UR S5Ul UR S 5Ul g) N image_tokenz <|image|> video_tokenz <|video|>image_token_idvideo_token_id) chat_templatez<|begin_of_video|>z<|end_of_video|>) hasattrr r!getattrr"convert_tokens_to_idsr#super__init__video_start_id video_end_id)selfimage_processor tokenizervideo_processorr$kwargs __class__s rr)Glm46VProcessor.__init__-s.5i.O.O;U^UjUj.5i.O.O;U^UjUjy"2D99  $ $001A1AB y"2D99  $ $001A1AB  _b'==>RS%;;sI++669 '(89)DIIK|["222r video_inputs video_idxc zURRS-nUSUSnUSUR5U-U-nUSUnSnURc[R S5 URcSO URUlUR SSS2n /n [S[U 55Hn U RX5 M U SUn [U 5U:a.U RU (aU SOS5 [U 5U:aM.[U5Hn XnURXS 9nX- nM U$) Nr7video_grid_thwrvideo_metadataaGLM46V requires frame timestamps to construct prompts, but the `fps` of the input video could not be inferred. Probably `video_metadata` was missing from inputs and you passed pre-sampled frames. Defaulting to `fps=24`. Please provide `video_metadata` for more accurate results.)r<) r/r9r:fpslogger warning_once timestampsrangelenappendreplace_frame_token_id)r,r?r@r0r; num_framesr<metadatavideo_structurerJunique_timestampsidxselected_timestamps frame_idx timestamp_secframe_structures rreplace_video_token#Glm46VProcessor.replace_video_tokenCs_++669 !"23I>qA '(89)DIIK|[_ii 01)< <<    e  &\\1rx|| ((1- C O,C  $ $Z_ 5-0 <%&3  & &BU':2'>[\ ]%&3z*I/:M"99-9kO  .O+ rc 0nUb[RRS05nURU5 URSS5=(d URR nUVs/sH!nURR "/UQUP76PM# nnUV s/sH oUS--PM n n URXS.5 Ubz[RRS05n U RU5 UV s/sH!n URR"/U QU P76PM# n n U V s/sH oWS--PM nn XS'[S0UD6$s snfs sn fs sn fs sn f) a Computes the number of placeholder tokens needed for multimodal inputs with the given sizes. Args: image_sizes (`list[list[int]]`, *optional*): The input sizes formatted as (height, width) per each image. video_sizes (`list[list[int]]`, *optional*): The input sizes formatted as (num_frames, height, width) per each video. Returns: `MultiModalData`: A `MultiModalData` object holding number of tokens per each of the provided input modalities, along with other useful data. N images_kwargsr9r7)r<num_image_patchesrnum_video_tokensr) r rgetupdater-r9get_number_of_image_patchesr/get_number_of_video_patchesr)r, image_sizes video_sizesr0 vision_datar[r9 image_sizer\ num_patchesr<r video_sizenum_video_patchesr]s r_get_num_multimodal_tokens*Glm46VProcessor._get_num_multimodal_tokensbs  "1;;??QSTM   (&**<>a$BVBVBaBaJ#.!"-J$$@@\*\m\"- !SddRc; A !=Rc d   4Dm n  "1;;??QSTM   (#.!"-J$$@@\*\m\"- !SddRc; A !=Rc d.>* +, ,,#! e ! es*(EE 6(E$Ec BURR"U4UUS.UD6$)a* Post-process the output of the model to decode the text. Args: generated_outputs (`torch.Tensor` or `np.ndarray`): The output of the model `generate` function. The output is expected to be a tensor of shape `(batch_size, sequence_length)` or `(sequence_length,)`. skip_special_tokens (`bool`, *optional*, defaults to `True`): Whether or not to remove special tokens in the output. Argument passed to the tokenizer's `batch_decode` method. clean_up_tokenization_spaces (`bool`, *optional*, defaults to `False`): Whether or not to clean up the tokenization spaces. Argument passed to the tokenizer's `batch_decode` method. **kwargs: Additional arguments to be passed to the tokenizer's `batch_decode method`. Returns: `list[str]`: The decoded text. )skip_special_tokensclean_up_tokenization_spaces)r. batch_decode)r,generated_outputsrlrmr0s rpost_process_image_text_to_text/Glm46VProcessor.post_process_image_text_to_texts3(~~**  3)E    rc >[TU]S/-$)Nmm_token_type_ids)r(model_input_names)r,r1s rrt!Glm46VProcessor.model_input_namessw(,?+@@@r input_idsc/nUHn[R"U5n[R"U5n[R"X@R:HSS9n[R"X@R :HSS9nXg:nSXTUR :HU-'SXTUR :HU)-'URUR55 M U$)Nr)axisr7) nparray zeros_likecumsumr*r+r"rMtolist) r,rvrsinput array_idsmm_token_typesstartsendsis_video_modalitys rcreate_mm_token_type_ids(Glm46VProcessor.create_mm_token_type_idssEI]]51N YYy,?,??aHF99Y*;*;;!DD & UVN)<)<<@QQ RXYN)<)<z<|end_of_image|>z.1fz seconds)r )r,rVr<s rrN&Glm46VProcessor.replace_frame_token_ids+#D$4$47G$G#HHXYfgjXkksttr)r r"r+r*r!r#)NNNN)NN)TF)ry)rrrrr valid_processor_kwargsr)dictintstrr=rXrirppropertyrtlistrrNr __classcell__)r1s@rrr)s2P"333SV3 SV>$-NY^ 6AA!$!4S ?!*ucuurr)numpyrzprocessing_utilsrrrutilsrr get_loggerrrHr r__all__rrrrs`*PP,   H %,ESunSuSul  r