gavindiaz/NexQuant
1
0
Fork 0
mirror of https://github.com/NicolasBohn/NexQuant.git synced 2026-08-08 20:47:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat: add extra_eval config and import_class for custom evaluators (#1097)

Browse Source 
* feat: add extra_eval config and import_class for custom evaluators

* lint

* build: update litellm requirement to >=1.73 for get_valid_models

* refactor: remove *args/**kwargs from _create_embedding_inner_function signature
This commit is contained in:
you-n-g
2025-07-20 16:31:43 +08:00
committed by GitHub
parent 16b552a6e0
commit f603f2b20f
6 changed files with 21 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
rdagent/components/coder/data_science/conf.py
+12
View File
@@ -23,6 +23,18 @@ class DSCoderCoSTEERSettings(CoSTEERSettings):
env_type: str = "docker"
# TODO: extract a function for env and conf.
extra_eval: list[str] = []
"""
Extra evaluators
The evaluator follows the following assumptions:
- It runs after previous evaluator (So the running results are alreadly there)
It is not a complete feature due to it is only implemented in DS Pipeline & Coder.
TODO: The complete version should be implemented in the CoSTEERSettings.
"""
def get_ds_env(
conf_type: Literal["kaggle", "mlebench"] = "kaggle",