flip.nvflare.executors.evaluator

Classes

MetricsValidator

RUN_EVALUATOR

Executes the uploaded evaluator and handles any errors.

Module Contents

class flip.nvflare.executors.evaluator.MetricsValidator(input_evaluation: Dict, input_models: List)[source]
input_evaluation[source]
input_models[source]
validate(input_evaluation) → Tuple[bool, str][source]
validate_element(element, original_element) → Tuple[bool, str][source]
class flip.nvflare.executors.evaluator.RUN_EVALUATOR(evaluate_task_name=PTConstants.EvalTaskName, project_id='', query='')[source]

Bases: nvflare.apis.executor.Executor

Executes the uploaded evaluator and handles any errors.

execute(task_name: str, shareable: nvflare.apis.shareable.Shareable, fl_ctx: nvflare.apis.fl_context.FLContext, abort_signal: nvflare.apis.signal.Signal) → nvflare.apis.shareable.Shareable[source]