trinity.explorer.workflow_runner module

The Workflow Runner Module.

class trinity.explorer.workflow_runner.Status(completed_runs: int, total_runs: int, metrics: List[Dict[str, float]], message: str | None = None)

基类：object

Status of the task running result.

completed_runs: int

total_runs: int

metrics: List[Dict[str, float]]

message: str | None = None

property ok: bool

__init__(completed_runs: int, total_runs: int, metrics: List[Dict[str, float]], message: str | None = None) → None

class trinity.explorer.workflow_runner.RunnerExecutionResult(status: Status, experiences: List[Experience])

基类：object

Execution result for one runner task.

status: Status

experiences: List[Experience]

__init__(status: Status, experiences: List[Experience]) → None

trinity.explorer.workflow_runner.calculate_run_level_metrics(experiences: List[Experience]) → Dict[str, float]

Calculate metrics from experiences.

For non-repeatable workflows, this function will average the metrics from experiences generated by each run, which is equivalent to calculating run level metrics.

For repeatable workflows, please do not use this function.

class trinity.explorer.workflow_runner.WorkflowRunner(config: Config, model: InferenceModel, auxiliary_models: List[InferenceModel] | None = None, runner_id: int | None = None)

基类：object

A Ray remote actor to run the workflow and generate experiences.

__init__(config: Config, model: InferenceModel, auxiliary_models: List[InferenceModel] | None = None, runner_id: int | None = None) → None

async prepare() → None

Prepare the runner.

is_alive()

async get_runner_state() → Dict

Get the runner state.

async run_task(task: Task, batch_id: str, repeat_times: int = 1, run_id_base: int = 0, collect_partial_runs: bool = True) → Tuple[Status, bytes]

Run the task and return the states.

class trinity.explorer.workflow_runner.DebugWorkflowRunner(config: Config, output_dir: str = 'debug_output', enable_profiling: bool = False, disable_overwrite: bool = False)

基类：WorkflowRunner

A WorkflowRunner for debugging.

__init__(config: Config, output_dir: str = 'debug_output', enable_profiling: bool = False, disable_overwrite: bool = False) → None

async prepare() → None

Prepare the runner.

async debug() → None

Run the debug workflow.