Files
NexQuant/rdagent/core/evaluation.py
T
USTCKevinF ebb659a018 reporeformat V2 (#23)
* reformat factor implement process

* move some code to more reasonable place

* fix the bug

* add test function in factor_extract_and_implement.py

* change select factor number to ratio , add some factor implement setting and fix some bug while using knowledgebase

* change evoagent

* add abstract class EvoAgent

* add benchmark workflow

* fix some bug in llm_utils

* run wenjun's code

* fix the knowledgebase instance check

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-14 12:59:44 +08:00

17 lines
364 B
Python

from abc import ABC, abstractmethod
from rdagent.core.task import (
TaskImplementation,
BaseTask,
)
class Evaluator(ABC):
@abstractmethod
def evaluate(
self,
target_task: BaseTask,
implementation: TaskImplementation,
gt_implementation: TaskImplementation,
**kwargs,
):
raise NotImplementedError