gavindiaz/NexQuant
1
0
Fork 0
mirror of https://github.com/NicolasBohn/NexQuant.git synced 2026-08-05 11:07:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat: add mlebench submission validitor (#545)

Browse Source 
* add mlebench submission check

* fix CI

* fix bug
This commit is contained in:
XianBW
2025-01-27 00:41:35 +08:00
committed by GitHub
parent 6e96cff435
commit 10abb20117
3 changed files with 38 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
rdagent/components/coder/data_science/workflow/eval_tests/mle_submission_check.txt
+12
View File
@@ -0,0 +1,12 @@
from pathlib import Path
from mlebench.grade import validate_submission
from mlebench.registry import registry
COMPETITION_ID = "<competition_id>"
new_registry = registry.set_data_dir(Path("/mle/data"))
competition = new_registry.get_competition(COMPETITION_ID)
is_valid, message = validate_submission(Path("submission.csv"), competition)
print(message)