Files
NexQuant/rdagent/core/evaluation.py
T
Xu Yang 6b626eb56d New Framework for idea proposal and implementation on RD-Agent (#34)
* Commit init framework

* Co-authored-by: Yuante Li (FESCO Adecco Human Resources) <v-yuanteli@microsoft.com>
Co-authored-by: XianBW <XianBW@users.noreply.github.com>

* add an import

* refine the whole framework

* benchmark related framework

* fix black and isort errors

* move requirements to folder

* fix black again

---------

Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-28 11:45:23 +08:00

16 lines
353 B
Python

from abc import ABC, abstractmethod
from rdagent.core.task import BaseTask, TaskImplementation
class Evaluator(ABC):
@abstractmethod
def evaluate(
self,
target_task: BaseTask,
implementation: TaskImplementation,
gt_implementation: TaskImplementation,
**kwargs,
):
raise NotImplementedError