trinity.trainer.verl_legacy package#
Submodules#
- trinity.trainer.verl_legacy.dp_actor module
- trinity.trainer.verl_legacy.fsdp_checkpoint_manager module
- trinity.trainer.verl_legacy.fsdp_workers module
- trinity.trainer.verl_legacy.megatron_actor module
- trinity.trainer.verl_legacy.megatron_checkpoint_manager module
- trinity.trainer.verl_legacy.megatron_workers module
- trinity.trainer.verl_legacy.monkey_patch module
- trinity.trainer.verl_legacy.utils module
- trinity.trainer.verl_legacy.verl_config module
DataFusedKernelOptionsActorModelActorModel.pathActorModel.external_libActorModel.override_configActorModel.enable_gradient_checkpointingActorModel.use_remove_paddingActorModel.use_fused_kernelsActorModel.fused_kernel_optionsActorModel.custom_chat_templateActorModel.enable_activation_offloadActorModel.use_shmActorModel.trust_remote_codeActorModel.lora_rankActorModel.lora_alphaActorModel.target_modulesActorModel.exclude_modulesActorModel.lora_adapter_pathActorModel.mtpActorModel.rope_scalingActorModel.rope_thetaActorModel.__init__()
OptimOptim.optimizerOptim.optimizer_implOptim.lrOptim.lr_warmup_stepsOptim.lr_warmup_steps_ratioOptim.min_lr_ratioOptim.warmup_styleOptim.lr_scheduler_typeOptim.total_training_stepsOptim.betasOptim.clip_gradOptim.lr_warmup_initOptim.lr_decay_stepsOptim.lr_decay_styleOptim.min_lrOptim.weight_decayOptim.weight_decay_incr_styleOptim.lr_wsd_decay_styleOptim.lr_wsd_decay_stepsOptim.use_checkpoint_opt_param_schedulerOptim.override_optimizer_configOptim.__init__()
WrapPolicyFSDPConfigOverrideTransformerConfigProfileConfigActorActor.strategyActor.ppo_mini_batch_sizeActor.ppo_micro_batch_sizeActor.ppo_micro_batch_size_per_gpuActor.use_dynamic_bszActor.use_prefix_grouperActor.calculate_sum_pi_squaredActor.sum_pi_squared_checkpointingActor.ppo_max_token_len_per_gpuActor.fix_actor_microbatch_loss_scaleActor.grad_clipActor.ppo_epochsActor.shuffleActor.ulysses_sequence_parallel_sizeActor.entropy_from_logits_with_chunkingActor.entropy_checkpointingActor.checkpointActor.optimActor.fsdp_configActor.megatronActor.profileActor.data_loader_seedActor.load_weightActor.policy_lossActor.profilerActor.router_replayActor.freeze_vision_towerActor.loss_agg_modeActor.loss_scale_factorActor.clip_ratioActor.clip_ratio_lowActor.clip_ratio_highActor.entropy_coeffActor.use_kl_lossActor.__init__()
RefRef.strategyRef.fsdp_configRef.log_prob_micro_batch_sizeRef.log_prob_micro_batch_size_per_gpuRef.log_prob_use_dynamic_bszRef.use_prefix_grouperRef.log_prob_max_token_len_per_gpuRef.ulysses_sequence_parallel_sizeRef.entropy_from_logits_with_chunkingRef.entropy_checkpointingRef.checkpointRef.megatronRef.profileRef.load_weightRef.profilerRef.router_replayRef.__init__()
RolloutActorRolloutRefCriticModelCriticModel.pathCriticModel.tokenizer_pathCriticModel.override_configCriticModel.external_libCriticModel.trust_remote_codeCriticModel.enable_gradient_checkpointingCriticModel.use_remove_paddingCriticModel.fsdp_configCriticModel.freeze_vision_towerCriticModel.rope_scalingCriticModel.rope_thetaCriticModel.__init__()
CriticCritic.enableCritic.strategyCritic.optimCritic.modelCritic.ppo_mini_batch_sizeCritic.ppo_micro_batch_sizeCritic.ppo_micro_batch_size_per_gpuCritic.forward_micro_batch_sizeCritic.forward_micro_batch_size_per_gpuCritic.use_dynamic_bszCritic.ppo_max_token_len_per_gpuCritic.forward_max_token_len_per_gpuCritic.ulysses_sequence_parallel_sizeCritic.ppo_epochsCritic.shuffleCritic.grad_clipCritic.cliprange_valueCritic.checkpointCritic.rollout_nCritic.loss_agg_modeCritic.megatronCritic.profileCritic.data_loader_seedCritic.load_weightCritic.nccl_timeoutCritic.ray_namespaceCritic.profilerCritic.__init__()
RewardModelRewardModel.enableRewardModel.strategyRewardModel.modelRewardModel.micro_batch_size_per_gpuRewardModel.max_lengthRewardModel.ulysses_sequence_parallel_sizeRewardModel.use_dynamic_bszRewardModel.forward_max_token_len_per_gpuRewardModel.reward_managerRewardModel.use_reward_loopRewardModel.__init__()
RewardCustomRewardFunctionKL_CtrlAlgorithmTrainerTrainer.balance_batchTrainer.total_epochsTrainer.total_training_stepsTrainer.project_nameTrainer.group_nameTrainer.experiment_nameTrainer.loggerTrainer.val_generations_to_log_to_wandbTrainer.nnodesTrainer.n_gpus_per_nodeTrainer.save_freqTrainer.resume_modeTrainer.resume_from_pathTrainer.test_freqTrainer.critic_warmupTrainer.default_hdfs_dirTrainer.remove_previous_ckpt_in_saveTrainer.del_local_ckpt_after_loadTrainer.default_local_dirTrainer.val_before_trainTrainer.training_rollout_modeTrainer.enable_exp_bufferTrainer.sync_freqTrainer.max_actor_ckpt_to_keepTrainer.max_critic_ckpt_to_keepTrainer.deviceTrainer.__init__()
veRLConfigveRLConfig.dataveRLConfig.actor_rollout_refveRLConfig.criticveRLConfig.reward_modelveRLConfig.rewardveRLConfig.custom_reward_functionveRLConfig.algorithmveRLConfig.trainerveRLConfig.global_profilerveRLConfig.synchronizerveRLConfig.enable_previewveRLConfig.synchronize_config()veRLConfig.__init__()
load_config()
- trinity.trainer.verl_legacy.verl_trainer module
Module contents#
Legacy trainer based on verl 0.7.1. This trainer is deprecated and should not be used for new development. This module may be removed in a future release. It is retained for backward compatibility with existing codebases that rely on the old veRL API.