gavindiaz/NexQuant
1
0
Fork 0
mirror of https://github.com/NicolasBohn/NexQuant.git synced 2026-08-05 03:07:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: move mlebench check into runner (#556)

Browse Source 
* abandon mlebench check in workflow

* move mlebench check to runner and put it into the exp
This commit is contained in:
Xu Yang
2025-02-06 15:37:41 +08:00
committed by GitHub
parent 0e447a3a19
commit b2d56e39e5
6 changed files with 41 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files
rdagent/components/coder/data_science/workflow/eval_tests/mle_submission_check.txt
-12
View File
@@ -1,12 +0,0 @@
from pathlib import Path
from mlebench.grade import validate_submission
from mlebench.registry import registry
COMPETITION_ID = "<competition_id>"
new_registry = registry.set_data_dir(Path("/mle/data"))
competition = new_registry.get_competition(COMPETITION_ID)
is_valid, message = validate_submission(Path("submission.csv"), competition)
print(message)