trinity.common.patch.glm4v module

trinity.common.patch.glm4v module#

Monkey patching for ‘glm4v’ models.

trinity.common.patch.glm4v.glm4v_text_forward(self: Glm4vTextModel, input_ids: LongTensor | None = None, attention_mask: Tensor | None = None, position_ids: LongTensor | None = None, past_key_values: Cache | None = None, inputs_embeds: FloatTensor | None = None, use_cache: bool | None = None, cache_position: LongTensor | None = None, **kwargs: Unpack[FlashAttentionKwargs]) tuple | BaseModelOutputWithPast[source]#