flip.nvflare.executors.evaluator
================================

.. py:module:: flip.nvflare.executors.evaluator


Classes
-------

.. autoapisummary::

   flip.nvflare.executors.evaluator.MetricsValidator
   flip.nvflare.executors.evaluator.RUN_EVALUATOR


Module Contents
---------------

.. py:class:: MetricsValidator(input_evaluation: Dict, input_models: List)

   .. py:attribute:: input_evaluation


   .. py:attribute:: input_models


   .. py:method:: validate(input_evaluation) -> Tuple[bool, str]


   .. py:method:: validate_element(element, original_element) -> Tuple[bool, str]


.. py:class:: RUN_EVALUATOR(evaluate_task_name=PTConstants.EvalTaskName, project_id='', query='')

   Bases: :py:obj:`nvflare.apis.executor.Executor`


   Executes the uploaded evaluator and handles any errors.


   .. py:method:: execute(task_name: str, shareable: nvflare.apis.shareable.Shareable, fl_ctx: nvflare.apis.fl_context.FLContext, abort_signal: nvflare.apis.signal.Signal) -> nvflare.apis.shareable.Shareable