8 Commits

Author	SHA1	Message	Date
you-n-g	8974704567	fix: refine prompt, equal lightgbm, discourage over hypertuning (#1072) ... * feat: add mount_path parameter to run command * feat: add runtime environment info and dynamic timeouts to DS runners	2025-07-15 21:58:19 +08:00
Xu Yang	da67df19a4	feat: add sample submission file check (#1053) ... * check sample submission & add package constraint * add trace.log into clear * change default * simplify * clear CI workspace before running * move to CI * use sudo to clean workspace * move prepare out of global var --------- Co-authored-by: Xu Yang <xuyang1@microsoft.com>	2025-07-10 18:10:32 +08:00
Yuante Li	fb8f2b561e	fix: fix a minor bug in DS eval (#1012)	2025-07-02 23:31:29 +08:00
Yuante Li	667af3e1ea	feat: added running time statistics for the DS scenario experiment (#1007) ... * added running time statistics for the DS scenario experiment * update execute_ret_code to return running_time * fix * fix * update describe * add EnvResult * update corresponding calls * add RunningInfo class * fix * fix * fix * fix ci * rename function name * fix ci * fix * refine running_time logic * fix ci	2025-07-02 15:11:18 +08:00
you-n-g	e1d08cfe73	fix: adjust ds_trace lookup and add stderr redirect to mlebench command (#853) ... * fix: adjust ds_trace lookup and add stderr redirect to mlebench command * style: reformat SOTA experiment lookup in ds_trace.py * feat: add DS_RD_SETTING pipeline to MergeExpGen success message	2025-05-08 02:40:49 +08:00
you-n-g	cda656b4ca	fix: non-exist variable test_eval.py (#847)	2025-05-07 04:36:00 +08:00
you-n-g	62e5953a6a	fix: wrong variable test_eval.py (#846)	2025-05-07 04:17:57 +08:00
Tim	46dec7b624	feat: custom data (#810) ... * custom data * fix: simplify competition check and log local description file * no sample data * feat: add test evaluation module with error handling support * fix: update eval path to use eval_sub_dir and add valid_check TODO * refactor: add MLETestEval check to conditionally run grading steps * avoid blank stdout * valid in testeval * rename test.csv to avoid conflict * Support Disabling sample submission * refactoring * fix: remove DS_KAGGLE_DATA and update prompt instructions * add try for grade * ignore submission * fix: remove tee from eval command and warn about pipeline exit code detection * optional to use raw description * support old data * add execution result to stdout * add metric to raw description * custom data explain * add debug_path * rst update --------- Co-authored-by: Young <afe.young@gmail.com>	2025-05-06 16:00:13 +08:00