trinity.common.models package

Subpackages

• trinity.common.models.sglang_patch package
  • Submodules
    • trinity.common.models.sglang_patch.openai_api_patch module
    • trinity.common.models.sglang_patch.server_patch module
  • Module contents
• trinity.common.models.vllm_patch package
  • Submodules
    • trinity.common.models.vllm_patch.api_patch module
    • trinity.common.models.vllm_patch.api_patch_v12 module
    • trinity.common.models.vllm_patch.api_patch_v13 module
    • trinity.common.models.vllm_patch.api_patch_v17 module
    • trinity.common.models.vllm_patch.worker_patch module
  • Module contents

Submodules

• trinity.common.models.allocator module
• trinity.common.models.experience_extraction module
• trinity.common.models.mm_utils module
• trinity.common.models.model module
• trinity.common.models.sglang_model module
• trinity.common.models.tinker_model module
• trinity.common.models.utils module
  • tokenize_and_mask_messages_hf()
  • tokenize_and_mask_messages_default()
  • get_action_mask_method()
  • get_checkpoint_dir_with_step_num()
  • get_latest_state_dict()
  • has_huggingface_model_weights()
  • load_state_dict_iterator()
  • load_state_dict()
  • get_verl_checkpoint_info()
  • load_fsdp_state_dict_from_verl_checkpoint()
  • load_huggingface_state_dict()
  • get_megatron_converter()
• trinity.common.models.vllm_extension module
• trinity.common.models.vllm_model module
• trinity.common.models.vllm_worker module

Module contents

Inference model classes and utilities.