32ecf92afc
fix: handle mixed str and dict types in code_list ( #1279 )
...
* fix: handle mixed str and dict types in code_list
* fix: handle missing token_costs entry for loop 0 in summarize_win
2025-11-03 21:52:41 +08:00
35a7ae5e1f
feat: show the summarized final difference between the final workspace and the base workspace ( #1281 )
2025-11-03 17:59:46 +08:00
4f64f20df6
fix litellm log content ( #1278 )
2025-10-24 12:30:30 +08:00
27d38af7bd
fix: refine task scheduling logic in MultiProcessEvolvingStrategy for… ( #1275 )
...
* fix: refine task scheduling logic in MultiProcessEvolvingStrategy for improved handling of feedback in improve mode
* fix: add empty implementation for skipped tasks in MultiProcessEvolvingStrategy
2025-10-23 17:09:18 +08:00
afb575cc91
fix: enhance feedback handling in MultiProcessEvolvingStrategy for improved task evolution ( #1274 )
2025-10-23 16:00:23 +08:00
03f22dc7c7
feat: add improve_mode to MultiProcessEvolvingStrategy for selective task implementation ( #1273 )
2025-10-22 17:35:18 +08:00
e3d24437cf
fix: replace hardcoded ChromeDriver path with webdriver-manager ( #1271 )
2025-10-20 22:15:44 +08:00
dc7b732b2c
feat: add a rag mcp in proposal ( #1267 )
...
* add simple rag mcp
* add rag_agent in expGen v2
* add conf config for research rag
* fix CI
* refactor: move context7 and rag config files to new conf modules
* make rag agent general
* fix CI
---------
Co-authored-by: Young <afe.young@gmail.com >
2025-10-20 16:46:25 +08:00
5003affb17
fix: fix mcts ( #1270 )
...
* init mcts class
* full ver of MCTS
* auto-lint
* make MCTS feedback in exp-gen()
* refactor: move reset logic from Trace to ExpGen and update usage accordingly
* fix: reinitialize trace on consecutive errors in DataScienceRDLoop
* feat: add reset method to BaseScheduler and call in MCTSScheduler reset
* style: reorder imports for consistency and PEP8 compliance
* lint
* fix observe_feedback
* fix bug
* remove uncommited_rec_status
* more simple
* refactor: move commit observation logic to process_uncommitted_nodes method
* docs: add TODO comment about rule-based virtual root node expansion
* add score reward
* fix bug
* fix small bug
* lint
* change reward
* small small change
* autolint
---------
Co-authored-by: xuangu-fang <xuangufang@gmail.com >
Co-authored-by: Young <afe.young@gmail.com >
2025-10-17 16:57:28 +08:00
4f493c8d63
feat(mcp): cache with one-click toggle ( #1269 )
...
* feat: enable cache in mcp
* refactor: remove redundant setting
* fix: conflicts during installation
---------
Co-authored-by: Linlang <Lv.Linlang@hotmail.com >
2025-10-17 16:30:59 +08:00
ac6d8edad4
feat: mcts policy based on trace scheduler ( #1203 )
...
* init mcts class
* full ver of MCTS
* auto-lint
* make MCTS feedback in exp-gen()
* refactor: move reset logic from Trace to ExpGen and update usage accordingly
* fix: reinitialize trace on consecutive errors in DataScienceRDLoop
* feat: add reset method to BaseScheduler and call in MCTSScheduler reset
* style: reorder imports for consistency and PEP8 compliance
* lint
* fix observe_feedback
* fix bug
* remove uncommited_rec_status
* more simple
* refactor: move commit observation logic to process_uncommitted_nodes method
* docs: add TODO comment about rule-based virtual root node expansion
* add score reward
* fix bug
* fix small bug
* lint
* change reward
* lint
---------
Co-authored-by: Young <afe.young@gmail.com >
Co-authored-by: jingyuanlm <842442862@qq.com >
Co-authored-by: amstrongzyf <amstrongzyf@126.com >
2025-10-17 16:21:39 +08:00
9e34b4e855
fix: model/factor experiment filtering in Qlib proposals ( #1257 )
...
* Fix model/factor experiment filtering in Qlib proposals
* fix(dockerfile): install coreutils to resolve timeout command error (#1260 )
* chore: remove unused experiment_list and target_list from Qlib proposals
* fix CI
* fix target list
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-10-10 22:49:46 +08:00
35580cbdf8
fix(dockerfile): install coreutils to resolve timeout command error ( #1260 )
2025-10-10 10:44:22 +08:00
31b19dee80
fix: prevent JSON content from being added multiple times during retries ( #1255 )
2025-10-02 09:45:58 +08:00
3b9ad11457
fix(docs): update rdagent ui with correct params ( #1249 )
2025-09-23 16:20:00 +08:00
46aad789ef
fix: merge candidates ( #1254 )
...
* fix: add hypotheses_candidates
2025-09-22 21:04:07 +08:00
12969b491e
feat: update README with latest paper acceptance to NeurIPS 2025 ( #1252 )
...
* feat: update README with latest news and announcements
* update readme
2025-09-19 10:58:07 +08:00
6e09dc6d69
feat: add user interaction in data science scenario ( #1251 )
...
* feat: add interactor classes and user interaction handling for experiments
* update code
* use fragment retry mechanism instead of rerun()
* fix a bug
* integrate user instructions into proposal and coder
* fix CI
* fix CI
* feat: add approval option for user instructions submission
* feat: enhance user instructions handling in Task and DSExperiment classes
* fix CI
* add user instructions into hypothesis rewrite
* add interface to command line
---------
Co-authored-by: Bowen Xian <xianbowen@outlook.com >
2025-09-18 11:10:12 +08:00
f1bacabe0a
chore: valid selector update ( #1248 )
...
* chore: add medal info
* return sota_exp_stat
* update hit check
* update experiment
* udpate experiment
* extract log
* remove old log folder
* update candidates
* keep highest score
* early stop if no medal candidate
2025-09-17 15:48:16 +08:00
694afd8133
fix: add json format response fallback to prompt templates ( #1246 )
...
* fix: add json format response fallback to prompt templates
* more json prompt
2025-09-15 23:27:24 +08:00
ee8c119f31
fix: set requires_documentation_search to None to disable feature in eval ( #1245 )
2025-09-15 07:45:08 +08:00
5ba5e8356c
feat: init pydantic ai agent & context 7 mcp ( #1240 )
...
* feat: init pydantic ai agent & context 7 mcp
* feat: integrate MCP documentation search into data science pipeline evaluation
* fix: disable MCP documentation search and update related docstrings and defaults
* lint
* fix: correct prompt formatting and conditional blocks in pipeline_eval section
* lint
* feat: add query method to PAIAgent for synchronous agent execution
* fix: apply nest_asyncio for agent and update context7 query method
* lint
* lint
* lint
* lint
* docs: update MCP folder docstring and rename test class in test_pydantic.py
* refactor: centralize completion kwargs logic and update pydantic_ai integration
* fixbug
* typo
* fix: bug triggered by padantic-ai version backtracking.
---------
Co-authored-by: Linlang <Lv.Linlang@hotmail.com >
2025-09-13 10:25:02 +08:00
7e996055f2
fix: fix chat_max_tokens calculation method to show true input_max_tokens ( #1241 )
...
* fix: use real max_input_length
* lint
* Update rdagent/oai/backend/litellm.py
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com >
* fix lint
* lint
* lint
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com >
2025-09-12 15:09:20 +08:00
2201a47623
fix: revert 2 commits ( #1239 )
...
* revert commit:c51a3008f897416a7416f92d1286cbbf6a2291ae. PR 1179
* Revert "fix: change runner prompts (#1223 )"
This reverts commit db2ebc27d70663d6aa85e0b05d9b81f5f6443c17.
* fix ruff check error
* fix: change switch place for fix_seed_and_data_split
2025-09-11 16:14:48 +08:00
a984f69f68
fix: move task cancellation to finally block and fix subprocess kill typo ( #1234 )
2025-09-10 10:05:08 +08:00
0daeb82d63
feat: add stdout into workspace for easier debugging ( #1236 )
...
* refactor: use get_truncated_stdout for consistent stdout handling across modules
* lint
* feat: add dump_stdout_type to DSRunnerCoSTEERSettings and use in eval
* fix: avoid circular import by moving DSRunnerEvaluator import inside method
2025-09-10 10:02:49 +08:00
d4c539912a
feat: offline selector ( #1231 )
...
* offline selector test
* fix score with tensor
* sort sota list
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-09-09 11:56:42 +08:00
fc18942339
fix: add a switch for ensemble_time_upper_bound and fix some bug in main ( #1226 )
...
* change runner prompts
* v1
* ensemble_time_upper_bound
* lint
* fix inf bug in function prob_dis_torch() and ensemble prompts
* lint
* lint
---------
Co-authored-by: amstrongzyf <amstrongzyf@126.com >
2025-09-08 16:35:42 +08:00
86ce4f135d
fix: increase retry count in hypothesis_gen decorator to 10 ( #1230 )
2025-09-08 12:23:58 +08:00
6fc3877a39
fix: handle ValueError in stdout shrinking and refactor shrink logic ( #1228 )
2025-09-07 23:24:45 +08:00
d68b0f4223
chore: make sure token size below limit ( #1225 )
...
* chore: make sure token size below limit
* refactor: refactor and add import
---------
Co-authored-by: amstrongzyf <amstrongzyf@126.com >
2025-09-04 15:07:42 +08:00
be3433f26b
fix: change runner prompts ( #1223 )
...
* change runner prompts
* v1
2025-09-04 11:31:42 +08:00
51f5bc9e11
fix: revert to v10 setting ( #1220 )
...
* feat: add runner_patience
* task gen prompts and torch version
* fix ensemble time bug
* small bug
* lint
* add torch
* fiix: remove useless code and change formula
* fix: rename parameter
---------
Co-authored-by: jingyuanlm <842442862@qq.com >
2025-09-03 16:37:33 +08:00
beab473b40
fix: summary page bug ( #1219 )
...
* fix summary bug
* fix CI
2025-09-02 17:06:54 +08:00
70fd91cd05
feat: ui, support disable cache ( #1217 )
...
* fix: (drop) add cache_enable for functions in ui.utils
* fix: (drop) handle no logging, rename sota_exp to last_sota_exp for clarity in running_win
2025-09-01 15:58:05 +08:00
6725f15f30
fix: jinja problem of enumerate ( #1216 )
2025-09-01 14:50:26 +08:00
5bad04b439
for ui, a simple fix ( #1215 )
2025-09-01 14:46:51 +08:00
f02dc5f47d
fix: allow prev_out keys to be None in workspace cleanup assertion ( #1214 )
...
* fix: allow prev_out keys to be None in workspace cleanup assertion
* fix: clean workspace only for non-None DSExperiment instances
2025-08-30 07:27:12 +08:00
c8bf617aca
fix: add missing self parameter to instance methods in DSProposalV2ExpGen ( #1213 )
2025-08-30 00:45:55 +08:00
9de8d60669
fix: handle None output and conditional step dump in LoopBase execution ( #1212 )
2025-08-29 20:19:09 +08:00
dbbe374ac8
fix: update fallback criterion ( #1210 )
...
* fix: update fallback criterion
* fix: ensure evo_fb is initialized and used correctly in fallback logic
* refactor: rename use_new_evo to should_use_new_evo for clarity
2025-08-29 17:07:41 +08:00
f82de4a380
feat: add option to enable hyperparameter tuning only in first eval loop ( #1211 )
...
* feat: add option to enable hyperparameter tuning only in first eval loop
* fix: use total_seconds() for accurate time calculations in evolution and tracking
2025-08-29 16:59:22 +08:00
215db05656
chore: ui updates ( #1209 )
...
* show a workspace path string for easier copy, only percent existing columns when percent summary dataframe
* catch summary exception
* fix a bug
* fix ci
2025-08-29 15:05:15 +08:00
d759ca95e7
fix: fix bug for hypo_select_with_llm when not support response_schema ( #1208 )
2025-08-28 14:36:23 +08:00
70fdfc89b0
fix ui bug ( #1207 )
2025-08-28 14:18:58 +08:00
774346d92e
fix: move snapshot saving after step index update in loop execution ( #1206 )
2025-08-28 10:58:57 +08:00
90dd2f7b9b
feat: enable LLM‑based hypothesis selection with time‑aware prompt & colored logging ( #1122 )
...
* add hypo select by llm (without time)
* add time_info and log color
* select no smooth
* 2 hypo
* change select
* small change
* fix bug
* fix bug and add hypothesis router and begin flag
* fix bug v1
* fix bug v2
* fix feedback
* add new model
* add filter
* fix bug v3
* fix bug v4
* change prompts v2
* fix bug v5
* fix bug v6
* fix hypo
* fix some bug(sota socre, prompts, ensemble prompts ) and add path legth.
* fix bug v7
* fix bug v8
* fix bug v9
* fix bug v10
* reset to v10 and refine
* fix: translate to english
* fix bug
* fix: use differnet increase_stage for coder & runner
* fix: use different timeout_increase_stage for coder and runner.
* fix: revert logger
* fix: remove duplicate content
* feat: implement LLM-driven extra hypothesis selection and adjust logic
* refactor: relocate Hypothesis models below TraceChallenges
* remove torch fix bug
* fix small bug
* refactor: prefix internal methods with underscore for llm-based hypothesis selection
* add fix_seed_and_data_split and enable_simple_hypothesis
* lint
* refine proposal config order
* code review; comments
* lint
* merge int to float
---------
Co-authored-by: jingyuanlm <842442862@qq.com >
Co-authored-by: Young <afe.young@gmail.com >
2025-08-27 18:36:51 +08:00
3df94e920c
chore: refine get_summary_df and sota exp stat in log utils ( #1201 )
...
* add best valid selector to get sota exp stat
* remove unused in summary & refine get_summary_df
* fix hypothesis table bug in trace
2025-08-26 18:31:21 +08:00
a829b2aaea
style: convert CLI flags from snake_case to kebab-case ( #1198 )
...
Co-authored-by: Young <afe.young@gmail.com >
2025-08-25 20:07:01 +08:00
e4bd647d1b
fix: increase time default not controlled by LLM ( #1196 )
...
* fix: add longer timeout configuration for data science scenarios
* fix CI
2025-08-21 11:27:17 +08:00
Linlang