0284b73596
feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling ( #1156 )
...
* feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling
* remove useless line
* enable time_ratio_limit_to_enable_hyperparameter_tuning
2025-08-05 18:16:10 +08:00
50916fa6c9
feat: create Jupyter notebook pipeline file based on main.py file ( #1134 )
...
* First commit
* isort
* black
* tweak prompt
* fix for argparse
* fix typo
* add e2e
* Add test files, clean
* fix black settings
* revert
* fix trailing
* remove extra
* comment
* small fix, updated prompt
* Fix argparse
* small improvements
* fix for merge
* fix for merge
2025-08-05 18:06:57 +08:00
067b5908f4
docs: update configuration docs ( #1155 )
...
* update configuration docs
* update configuration docs
* update configuration docs
2025-08-05 15:48:28 +08:00
fcfea1943c
feat: add mask inference in debug mode ( #1154 )
2025-08-05 14:09:12 +08:00
84b7c30a90
fix: add metric in scores.csv and avoid reading sample_submission.csv ( #1152 )
...
* add scores.csv metric name in both task_gen and coder
* a little fix to column names
* small fix
* avoid sample submission read in task_gen
* avoid sample_submission reading in coding
* code change summary bug fix
* little update
* little refinement to eval
* refine coder and runner eval prompts
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-08-04 19:53:08 +08:00
5b541841cf
feat: enhance timeout handling in CoSTEER and DataScience scenarios ( #1150 )
...
* add prev loops to runner history
* fix evolving history
* fix bug on initializing feedback without final decision
* reformat
* refine
* add comments
* feat: enhance timeout handling in CoSTEER and DataScience scenarios
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-08-04 17:44:51 +08:00
f3cb3f8870
feat: add previous runner loops to runner history ( #1142 )
...
* add prev loops to runner history
* fix evolving history
* fix bug on initializing feedback without final decision
* reformat
* refine
* add comments
* fix ci
* a little refinement
* fix CI
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-08-04 17:38:27 +08:00
cf070a004e
save more time info ( #1151 )
2025-08-04 17:28:25 +08:00
88e346b6b5
change something for ui compatiblity ( #1149 )
2025-08-04 12:40:35 +08:00
4b444097b2
fix ( #1148 )
...
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-08-02 18:36:31 +08:00
a99b9aad39
chore: overwrite sota exp stat in summary page ( #1146 )
...
* overwrite sota exp stat in summary page
* remove unused import
2025-08-01 18:55:26 +08:00
ea7483f5a7
feat: add show_hard_limit option and update time limit handling in DataScience settings ( #1144 )
2025-08-01 18:32:15 +08:00
d08ce38fb8
bug fix ( #1145 )
2025-08-01 18:07:19 +08:00
8c454afd17
fix: fix some bugs in RD-Agent(Q) ( #1143 )
...
* fix some bugs in RD-Agent(Q)
* fix factor from report
* fix ci
2025-08-01 13:20:09 +08:00
fe9b625091
fix: ignore RuntimeError for shared workspace double recovery ( #1140 )
...
* fix: ignore RuntimeError for shared workspace double recovery
* add print
2025-07-31 21:02:37 +08:00
692f3006ce
use popover instead of expander ( #1138 )
2025-07-31 18:14:38 +08:00
6b0fae5000
fix: clear ws_ckp after extraction to reduce workspace object size ( #1137 )
2025-07-31 18:10:32 +08:00
684e41f43a
feat: fallback to acceptable results ( #1129 )
...
* refactor: add is_acceptable, fallback logic and generify evolving agent
* refine lint
* small
* lint
* lint
* lint
* feat: add is_acceptable to CoSTEERMultiFeedback
* feat: add in-memory workspace checkpoint and recovery
* feat: preserve symbolic links in workspace checkpoints and recovery
* lint
* lint
* feat: limit workspace checkpoint to files under 100KB
* feat: add workspace checkpoint size limit setting
* prompt
* lint
2025-07-31 17:53:18 +08:00
66659e9de2
fix: remove unused imports in data science scenario module ( #1136 )
2025-07-31 17:05:14 +08:00
e554b3a680
feat: add time ratio limit for hyperparameter tuning in Kaggle settin… ( #1135 )
...
* feat: add time ratio limit for hyperparameter tuning in Kaggle settings and update evaluator logic
* add recommend time limit
* remove 25% hard line
* small fix
2025-07-31 16:47:19 +08:00
1aa5cc2535
feat: enhance timeout management and knowledge base handling in CoSTEER components ( #1130 )
...
* feat: enhance timeout management and knowledge base handling in CoSTEER components
* fix a little bug
* fix small bug
* fix a small bug
* Update rdagent/scenarios/data_science/loop.py
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com >
* add scale check
* fix a small bug
* fix CI
* use dynamic chat_token_limit & remove repeated lines
* fix CI
* remove useless comment
* fix small bug
* update draft appendix
* fix prompt
* add code correctness as top priority
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com >
2025-07-31 13:06:28 +08:00
ce25bafbf7
fix: update requirements.txt's streamlit ( #1133 )
2025-07-30 21:30:53 +08:00
af7b1f6c4b
log time duration when call LLM and show timeout ratio of coding & running in trace UI ( #1128 )
2025-07-29 17:54:29 +08:00
dd2e06ade6
feat: add coder check and give more time ( #1127 )
...
* feat: introduce max_seconds_multiplier for timeout management across components
* avoid using assert in test
* hot fix a very small bug
* runner multiply twice
* revert feedback change
* add a switch to longer timeout
2025-07-29 14:59:38 +08:00
53dd98abf4
feat: add hypo_critic and hypo_rewrite in proposal ( #1106 )
...
add hypo_critique and hypo_rewrite in proposal.py, controlled by `DS_RD_SETTING.enable_hypo_critique_rewrite` (default True)
2025-07-29 14:20:09 +08:00
82011ea444
small fix to runner eval order to prevent both final decision and hyperparameter decision to be true
...
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-07-29 13:31:35 +08:00
8790503e8d
fix current_selection maybe empty ( #1125 )
2025-07-29 11:56:59 +08:00
60cae0f588
fix find last SOTA diff ( #1124 )
2025-07-29 10:56:41 +08:00
99a3cad9c9
chore: implement runtime_env func ( #1104 )
...
* implement runtime_env func for quant
* add runtime_info code
* add runtime env information to the prompt
* format with black
* optimize get_runtime_env code
* delete unnecessary files
* some refinement
* fix fin_quant bugs
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-07-28 14:19:41 +08:00
b03b070138
fix: fix code diff bug ( #1115 )
...
* fix code diff bug
* fix minor bug
* reformat
* fix minor bug
* fix
* fix
* fix the prefix type
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-07-26 22:51:59 +08:00
3149557351
fix sota_exp is None ( #1121 )
2025-07-25 11:53:26 +08:00
b08cb3b7c8
fix a small bug in feedback ( #1120 )
2025-07-24 22:33:08 +08:00
d531faab38
add lite curves figure ( #1119 )
2025-07-24 20:11:09 +08:00
e63961f00e
fix curve ( #1118 )
2025-07-24 19:15:01 +08:00
7a8b11e7b6
chore: some ui features change ( #1117 )
...
* add some todos
* fix bug
* fix leaderboard download function
* summary stat fix
* show medal
* show SOTA Loop
* fix CI
2025-07-24 18:50:29 +08:00
1eb60d9cb7
chore: avoid more traces during merge ( #1108 )
...
* avoid more traces during merge
* restore change
* remove duplicate experiments
* add dropped pool
* use scenario
* remove drop_pool
* use max_sota_retrieved_num
2025-07-24 18:27:23 +08:00
061870a71e
feat: analyze feedback based on sota numbers ( #1116 )
...
* give sota numbers to feedback
* refine prompt
2025-07-24 14:17:52 +08:00
4fc5eb2285
fix cli command type checker ( #1114 )
2025-07-23 19:43:25 +08:00
9e0612ec67
fix: prompt yaml ( #1112 )
...
* small fix to prompt yaml
* shrink the content
* remove parallel.py
2025-07-23 15:03:59 +08:00
a7b5141501
fix health check bug ( #1111 )
2025-07-23 12:29:09 +08:00
66d07c73f6
feat: enable meta planner ( #1103 )
...
* enable meta planner
* fix a small bug
* ADD PLAN TO GEN
* remove ensemble in planner
* fix CI
* fix CI
* fix planner threshold
2025-07-23 12:20:06 +08:00
47458d612c
feat: new prompt for auto-sota-selector ( #1109 )
...
* fix mismmatch typo
* new sota_select_submit prompt
* update
* polish prompt
2025-07-22 21:51:31 +08:00
7ed3cd1240
chore: show merge loop in figure ( #1105 )
2025-07-22 17:02:56 +08:00
2f87089f21
chore: update figure ( #1102 )
...
* chore: update figure
* add record id
2025-07-21 18:53:07 +08:00
bbd08460c7
chore: merge enable parallel ( #1093 )
...
* chore: merge enable parallel
2025-07-21 14:28:36 +08:00
2f48a95d43
chore: add response format in chatbot ( #1099 )
...
* add response format in chatbot
* fix CI
2025-07-21 12:19:05 +08:00
8bab00d558
feat: add loop ID mapping to trace nodes and update UI labels ( #1098 )
...
* Add loop index
* feat: add loop ID mapping to trace nodes and update UI labels
* lint
* doc lint
2025-07-21 11:02:37 +08:00
f603f2b20f
feat: add extra_eval config and import_class for custom evaluators ( #1097 )
...
* feat: add extra_eval config and import_class for custom evaluators
* lint
* build: update litellm requirement to >=1.73 for get_valid_models
* refactor: remove *args/**kwargs from _create_embedding_inner_function signature
2025-07-20 16:31:43 +08:00
16b552a6e0
fix: use CoSTEERSettings for DSRunnerCoSTEERSettings ( #1096 )
...
* refactor: use CoSTEERSettings for DSRunnerCoSTEERSettings
* lint
2025-07-20 10:53:09 +08:00
cb3064e57d
docs: update data science docs ( #1015 )
...
* update data science docs part1
* update data science docs part2
* update data science docs part3
* update data science docs part4
* update data science docs part5
* format with isort
* update data science docs part6
* add check environment scripts
* format with isort
* format with isort
* merge env_check to health_check
* format with isort
* format with black
* optimize code
* use boolean cli options
* replace fire with typer
* replace fire with typer
* optimizing parameter and variable naming
2025-07-19 18:35:24 +08:00
Xu Yang