Commit Graph

933 Commits

Author SHA1 Message Date
XianBW 3df94e920c chore: refine get_summary_df and sota exp stat in log utils (#1201)
* add best valid selector to get sota exp stat

* remove unused in summary & refine get_summary_df

* fix hypothesis table bug in trace
2025-08-26 18:31:21 +08:00
Linlang a829b2aaea style: convert CLI flags from snake_case to kebab-case (#1198)
Co-authored-by: Young <afe.young@gmail.com>
2025-08-25 20:07:01 +08:00
Xu Yang e4bd647d1b fix: increase time default not controlled by LLM (#1196)
* fix: add longer timeout configuration for data science scenarios

* fix CI
2025-08-21 11:27:17 +08:00
XianBW 04878f9e70 fix: kaggle competition metric direction (#1195)
* fix leaderboard and competition direction

* ui fix
2025-08-20 16:40:53 +08:00
amstrongzyf c150d33603 fix bug for embedding caused by PR 1188 (#1194) 2025-08-18 20:15:18 +08:00
Tim 3260c0c3ff chore: refine env command (#1193) 2025-08-18 18:16:16 +08:00
XianBW 2f8261f82b fix: ui bug (#1192)
* small bug

* fix ci
2025-08-18 17:48:49 +08:00
amstrongzyf 880a6c70c4 fix: enable embedding truncation (#1188)
* fix: enable embedding auto truncation

* move embedding_utils to utils.embedding

* fix bug

* fix(embedding): improve text truncation with retry strategies and binary search optimization

* new way for embedding truncate

* fix ci errors
2025-08-18 17:20:41 +08:00
xuangu-fang b05a530126 feat: enable to inject diversity cross async multi-trace (#1173)
* init multi_trace_async_ diversity inject

* lint

* add task in context for diversity injection, add abstract class for diversity injection

* lint

* feat: update diversity injection strategy and enhance sibling context handling in experiment generation

* add always inject

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-18 12:43:21 +08:00
you-n-g d493d33603 change the trace number from 3 to 1 (simpler default value) (#1191) 2025-08-18 12:13:23 +08:00
XianBW 2c0702a4ac fix ui bugs (#1190) 2025-08-18 10:56:51 +08:00
you-n-g dbe214282e fix: skip res_ratio check if timer or res_time is None (#1189) 2025-08-17 16:08:55 +08:00
Tim 4a516949b4 chore: add inference mode for model dump (#1182)
* chore: add inference mode for model dump
* check runtime environment
* update opened_trace_lines
---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-15 15:34:49 +08:00
you-n-g e0453e0058 fix: insert await asyncio.sleep(0) to yield control in loop (#1186) 2025-08-15 13:27:29 +08:00
you-n-g 481e226844 refactor: use UI_SETTING.amlt_path for combined log folder path (#1184) 2025-08-14 21:51:05 +08:00
Tim 85ebc4889d chore: catch log_workflow error (#1183) 2025-08-14 16:12:37 +08:00
amstrongzyf 5353bd31f2 fix: refine prompts and add additional package info (#1179)
* refine prompts and add additional package info

* refine prompts to be specific for GBDT models

* minor refine prompts

* use include to replace duplicate info

* refine prompts

* refactor: import DSTrace from base and remove exp_gen __init__

* lint

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-08-13 23:00:23 +08:00
Tim e0f713c7d3 chore: add merge statistics (#1176)
* chore: add stat for merge
* use best selector
* use trace.hist
2025-08-13 22:59:34 +08:00
Chaos Yu b6fae75cde fix(graph): using assignment expression to avoid repeated function call (#1174)
* using assignment expression to avoid repeated function call

* format
2025-08-13 17:16:58 +08:00
Roland Minrui e77572fb53 feat: refine the logic of enabling hyperparameter tuning and add criteira (#1175)
* add 4 tuning criteria

* fix equation direction

* fix ci

* add comment

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-12 21:12:54 +08:00
you-n-g 0e3f4cf08f fix: cancel tasks on resume and kill subprocesses on termination (#1166)
* fix: cancel tasks on resume and kill subprocesses on termination

* lint

* lint
2025-08-09 19:39:13 +08:00
XianBW 02069767e1 fix exec_time in summary because of parallel (#1171) 2025-08-08 17:14:02 +08:00
XianBW 6f1a8c63e0 add auto sota selector llm log in trace (#1169) 2025-08-08 16:26:48 +08:00
Xu Yang 586623084f feat: streamline hyperparameter tuning checks and update evaluation g… (#1167)
* feat: streamline hyperparameter tuning checks and update evaluation guidelines

* fix task_gen json check
2025-08-08 13:49:01 +08:00
Xu Yang 9c190e3268 feat: improve fallback handling in CoSTEER and add GPU usage guidelin… (#1165)
* feat: improve fallback handling in CoSTEER and add GPU usage guideline in share.yaml

* update prompt

* update
2025-08-07 15:52:55 +08:00
XianBW 7f90253c4c add parent & root node in trace page (#1164) 2025-08-07 15:02:46 +08:00
Xu Yang bfa452541c feat: add reasoning attribute to DSRunnerFeedback for enhanced evaluation context (#1162) 2025-08-07 00:50:08 +08:00
Roland Minrui 5594ab418b fix: refine DSCoSTEER_eval prompts (#1157)
* change DSCoSTEER_eval prompts

* fallback to better exp only

* fix fallback

* fix and reformat

* fix bug when base_fb is None

* add reasoning to hyperparameter evaluation

* feat: add acceptable assessment in exp_feedback (#1159)

* add time

* refine eval prompt and make the logic of tuning check more clear

* some refinement

* fix CI

* fix a small bug, only consider score in runner

* refine comment

* simplify compare function

---------

Co-authored-by: jingyuanlm <842442862@qq.com>
Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: Jensen Lee <91518020+Jensen246@users.noreply.github.com>
Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-06 22:55:25 +08:00
Jensen Lee 1b84f7b754 fix: ignore case when checking metric name (#1160)
* fix: ignore case when checking metric name

* add case-sensitive to prompts

---------

Co-authored-by: amstrongzyf <amstrongzyf@126.com>
2025-08-06 20:54:08 +08:00
XianBW d771b26a26 chore: show timeline and change load_times (#1161)
* show timeline, deperacate old load_times

* fix bug
2025-08-06 18:42:17 +08:00
xuangu-fang 7e15b5e200 feat: prob-based trace scheduler (#1131)
* draft prob-based trace scheduler

* refactor ProbabilisticScheduler

* auto lint

* keep random, Sota-based, length-based trace schedluer

* lint

* example

* example

* refactor

* add inverse option for sota Scheduler

* add trace_Scheduler in conf

* lint

* add scheduler_temperature

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-08-06 16:42:51 +08:00
XianBW 6b50670f2e fix loop step time log problem (#1158) 2025-08-06 15:43:28 +08:00
Tim 35c209b092 feat: enable finetune llm (#1055)
* feat: start with previous workspace

* feat: finetune llm

* add PrevModelLoadEvaluator

---------

Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: v-jianwan <v-jianwan@microsoft.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-06 12:24:44 +08:00
Xu Yang c111966d19 feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling (#1156)
* feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling

* remove useless line

* enable time_ratio_limit_to_enable_hyperparameter_tuning
2025-08-05 18:16:10 +08:00
Paul f03b1b918d feat: create Jupyter notebook pipeline file based on main.py file (#1134)
* First commit

* isort

* black

* tweak prompt

* fix for argparse

* fix typo

* add e2e

* Add test files, clean

* fix black settings

* revert

* fix trailing

* remove extra

* comment

* small fix, updated prompt

* Fix argparse

* small improvements

* fix for merge

* fix for merge
2025-08-05 18:06:57 +08:00
Linlang 56ed919b2e docs: update configuration docs (#1155)
* update configuration docs

* update configuration docs

* update configuration docs
2025-08-05 15:48:28 +08:00
Jensen Lee b4117cf58a feat: add mask inference in debug mode (#1154) 2025-08-05 14:09:12 +08:00
amstrongzyf 80c953d405 fix: add metric in scores.csv and avoid reading sample_submission.csv (#1152)
* add scores.csv metric name in both task_gen and coder

* a little fix to column names

* small fix

* avoid sample submission read in task_gen

* avoid sample_submission reading in coding

* code change summary bug fix

* little update

* little refinement to eval

* refine coder and runner eval prompts

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-04 19:53:08 +08:00
Xu Yang 811d4e7631 feat: enhance timeout handling in CoSTEER and DataScience scenarios (#1150)
* add prev loops to runner history

* fix evolving history

* fix bug on initializing feedback without final decision

* reformat

* refine

* add comments

* feat: enhance timeout handling in CoSTEER and DataScience scenarios

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
2025-08-04 17:44:51 +08:00
Roland Minrui 2426a1dc67 feat: add previous runner loops to runner history (#1142)
* add prev loops to runner history

* fix evolving history

* fix bug on initializing feedback without final decision

* reformat

* refine

* add comments

* fix ci

* a little refinement

* fix CI

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-04 17:38:27 +08:00
XianBW c2bde6dcc3 save more time info (#1151) 2025-08-04 17:28:25 +08:00
XianBW c985e34531 change something for ui compatiblity (#1149) 2025-08-04 12:40:35 +08:00
Roland Minrui 5565fbe8a4 fix (#1148)
Co-authored-by: Xu <v-xuminrui@microsoft.com>
2025-08-02 18:36:31 +08:00
XianBW 52bf46318f chore: overwrite sota exp stat in summary page (#1146)
* overwrite sota exp stat in summary page

* remove unused import
2025-08-01 18:55:26 +08:00
Xu Yang 8a3e42d7fe feat: add show_hard_limit option and update time limit handling in DataScience settings (#1144) 2025-08-01 18:32:15 +08:00
XianBW d0832eb5ff bug fix (#1145) 2025-08-01 18:07:19 +08:00
Yuante Li 7134a51afa fix: fix some bugs in RD-Agent(Q) (#1143)
* fix some bugs in RD-Agent(Q)

* fix factor from report

* fix ci
2025-08-01 13:20:09 +08:00
you-n-g bd8a16d92f fix: ignore RuntimeError for shared workspace double recovery (#1140)
* fix: ignore RuntimeError for shared workspace double recovery

* add print
2025-07-31 21:02:37 +08:00
XianBW 38aa6eb046 use popover instead of expander (#1138) 2025-07-31 18:14:38 +08:00
you-n-g 28ceb41e1c fix: clear ws_ckp after extraction to reduce workspace object size (#1137) 2025-07-31 18:10:32 +08:00