Commit Graph

872 Commits

Author SHA1 Message Date
Linlang bbcee389b4 chore: implement runtime_env func (#1104)
* implement runtime_env func for quant

* add runtime_info code

* add runtime env information to the prompt

* format with black

* optimize get_runtime_env code

* delete unnecessary files

* some refinement

* fix fin_quant bugs

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-07-28 14:19:41 +08:00
Roland Minrui 514c191b75 fix: fix code diff bug (#1115)
* fix code diff bug

* fix minor bug

* reformat

* fix minor bug

* fix

* fix

* fix the prefix type

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
2025-07-26 22:51:59 +08:00
XianBW 15fa03d415 fix sota_exp is None (#1121) 2025-07-25 11:53:26 +08:00
amstrongzyf 13f49062a4 fix a small bug in feedback (#1120) 2025-07-24 22:33:08 +08:00
XianBW 5025448e84 add lite curves figure (#1119) 2025-07-24 20:11:09 +08:00
XianBW 59a2d7f91d fix curve (#1118) 2025-07-24 19:15:01 +08:00
XianBW e92cd99450 chore: some ui features change (#1117)
* add some todos

* fix bug

* fix leaderboard download function

* summary stat fix

* show medal

* show SOTA Loop

* fix CI
2025-07-24 18:50:29 +08:00
Tim 7a5dd566f5 chore: avoid more traces during merge (#1108)
* avoid more traces during merge

* restore change

* remove duplicate experiments

* add dropped pool

* use scenario

* remove drop_pool

* use max_sota_retrieved_num
2025-07-24 18:27:23 +08:00
Xu Yang 5e959a5f59 feat: analyze feedback based on sota numbers (#1116)
* give sota numbers to feedback

* refine prompt
2025-07-24 14:17:52 +08:00
XianBW bbb008c95e fix cli command type checker (#1114) 2025-07-23 19:43:25 +08:00
Xu Yang 0c3d0cd327 fix: prompt yaml (#1112)
* small fix to prompt yaml

* shrink the content

* remove parallel.py
2025-07-23 15:03:59 +08:00
Linlang 067c5a3334 fix health check bug (#1111) 2025-07-23 12:29:09 +08:00
Xu Yang a3c0f29451 feat: enable meta planner (#1103)
* enable meta planner

* fix a small bug

* ADD PLAN TO GEN

* remove ensemble in planner

* fix CI

* fix CI

* fix planner threshold
2025-07-23 12:20:06 +08:00
xuangu-fang 733a17dd84 feat: new prompt for auto-sota-selector (#1109)
* fix mismmatch typo

* new sota_select_submit prompt

* update

* polish prompt
2025-07-22 21:51:31 +08:00
Tim 9f7a4280dc chore: show merge loop in figure (#1105) 2025-07-22 17:02:56 +08:00
Tim 1f142cc5d8 chore: update figure (#1102)
* chore: update figure

* add record id
2025-07-21 18:53:07 +08:00
Tim 68f961407e chore: merge enable parallel (#1093)
* chore: merge enable parallel
2025-07-21 14:28:36 +08:00
XianBW c326aa52b9 chore: add response format in chatbot (#1099)
* add response format in chatbot

* fix CI
2025-07-21 12:19:05 +08:00
you-n-g 810af369e0 feat: add loop ID mapping to trace nodes and update UI labels (#1098)
* Add loop index

* feat: add loop ID mapping to trace nodes and update UI labels

* lint

* doc lint
2025-07-21 11:02:37 +08:00
you-n-g ab97dd8b77 feat: add extra_eval config and import_class for custom evaluators (#1097)
* feat: add extra_eval config and import_class for custom evaluators

* lint

* build: update litellm requirement to >=1.73 for get_valid_models

* refactor: remove *args/**kwargs from _create_embedding_inner_function signature
2025-07-20 16:31:43 +08:00
you-n-g 54d72e1dca fix: use CoSTEERSettings for DSRunnerCoSTEERSettings (#1096)
* refactor: use CoSTEERSettings for DSRunnerCoSTEERSettings

* lint
2025-07-20 10:53:09 +08:00
Linlang 81d0ac7185 docs: update data science docs (#1015)
* update data science docs part1

* update data science docs part2

* update data science docs part3

* update data science docs part4

* update data science docs part5

* format with isort

* update data science docs part6

* add check environment scripts

* format with isort

* format with isort

* merge env_check to health_check

* format with isort

* format with black

* optimize code

* use boolean cli options

* replace fire with typer

* replace fire with typer

* optimizing parameter and variable naming
2025-07-19 18:35:24 +08:00
Tim 705eb07e81 chore: extend eda output (#1086) 2025-07-18 21:07:43 +08:00
amstrongzyf b1b77bd98b fix: add gpu_info in research phase (#1094) 2025-07-18 21:00:06 +08:00
Xu Yang 9b82bc10ad fix: package and timer bug (#1092)
* fix package bug & timer bug

* fix typo
2025-07-18 16:22:57 +08:00
XianBW 0e5a9894c5 use enum value when generate hypothesis (#1091) 2025-07-18 16:22:34 +08:00
XianBW 3b57264d2c fix ui bugs (#1090) 2025-07-18 16:01:39 +08:00
Xu Yang 51921c2344 fix: minor fix to runtime_environment (#1089)
* minor fix to funtime_environment

* add python runtime info header
2025-07-17 19:58:06 +08:00
XianBW 221fea1e15 chore: add a simple chatbot in LLM_LOG window in DataScience UI (#1088)
* refine time show

* updates

* add chatbot in llm_log_win

* use newest litellm
2025-07-17 19:29:25 +08:00
Xu Yang 77725913fa feat: query & cache package_info (#1083)
* feat: add package query in draft.py (not yet enabled)

* feat: integrate package query into task_gen and cache runtime environment

- Remove pkg_query modifications from draft components
- Add package declaration requirement in task_gen prompts
- Add optional packages field to CodingSketch model
- Cache runtime_environment in scenario object for loop-wide reuse
- Parse packages from LLM response and generate runtime environment dynamically

* some refinement

* feat: merge default packages with CLI args in package_info.py

* fix: code style

---------

Co-authored-by: Qizheng Li <jenssenlee@163.com>
2025-07-17 18:35:36 +08:00
Tim e389b4a396 chore: change default setting (#1087)
live_output = True
2025-07-17 17:19:10 +08:00
you-n-g 79d21589c1 fix: ignore class types when filtering workflow steps (#1085)
* fix: ignore class types when filtering workflow steps

* chore: add TODO for record method in RDLoop

* lint
2025-07-17 15:50:41 +08:00
amstrongzyf e3679d6c0d fix: refine the prompt to force complete code & refine the logic of running (#1069)
* change refine prompt for full code

* fix: fix the logic of running

* refine prompt

* fix some bugs

* fix

* add two guidelines

* refactor the code

* make costeer evaluator more logical

* refine eval prompt

* make costeer eval prompt markdown

* update code diff prompt

* correct pipeline

* feat: add apply_patch utility and update ret.py with patch functionality (#1071)

* restore to the right version

* fix the docstring

* fix extract_output fcn

* add inplace parameter to apply patch

* remove enable_runner_iteration and make the eval prompt same as main

* refine runner eval prompt based on main

* Update rdagent/scenarios/data_science/dev/runner/prompts.yaml

* add wait_retry

* refactor: move enable_runner_code_diff to DSRunnerCoSTEERSettings as diff_mode

* reformat and remove enable_runner_code_diff

---------

Co-authored-by: yuanteli <1957922024@qq.com>
Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: Jensen Lee <91518020+Jensen246@users.noreply.github.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: Qizheng Li <jenssenlee@163.com>
2025-07-17 11:59:27 +08:00
Shuo Yin 6469a0679a docs: update docs/installation_and_configuration.rst for Configuration (#1061)
* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update installation_and_configuration.rst

* Update installation_and_configuration.rst

* Update installation_and_configuration.rst

* Update docs/installation_and_configuration.rst

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>

* Update installation_and_configuration.rst

* Update installation_and_configuration.rst

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-07-16 22:20:49 +08:00
Xu Yang 427f5d270e fix: minor conflict in prompts (#1081) 2025-07-16 16:10:56 +08:00
Xu Yang daea490941 fix: align scenario descriptions and include debug timeout (#1079)
* Align scenario descriptions and include debug timeout

- Updated config.py to support debug timeout configuration
- Synchronized prompts in exp_gen and scen modules
- Refactored proposal.py for consistency with new scenario descriptions
- Improved __init__.py for better scenario management

* remove running time in stdout

---------

Co-authored-by: Xu Yang <xuyang1@microsoft.com>
2025-07-16 14:30:17 +08:00
you-n-g de34c99931 fix: refine prompt; runner focus on low hanging fruit (#1076)
* fix: refine prompts formatting and logic across data science scenarios

* Make runner evaluator more detailed

* feat: switch to system_debugger prompt and print early stopping stats
2025-07-16 12:29:57 +08:00
you-n-g 5496168d07 feat: add enable_cache toggle for UI data caching (#1075) 2025-07-15 22:26:06 +08:00
you-n-g 8974704567 fix: refine prompt, equal lightgbm, discourage over hypertuning (#1072)
* feat: add mount_path parameter to run command

* feat: add runtime environment info and dynamic timeouts to DS runners
2025-07-15 21:58:19 +08:00
XianBW 277d12e5bb chore: log LITELLM_SETTINGS when first use (#1074)
* log LITELLM_SETTINGS when first use

* fix ci
2025-07-15 18:41:18 +08:00
XianBW 38aff84ed2 fix: filter log folders bug in ui (#1073)
* fix bug

* fix ci
2025-07-15 18:11:48 +08:00
you-n-g 51d458a7d7 feat: add ws CLI and support optional timeout/cache (#1066)
* feat: add ws CLI and support optional timeout/cache

* lint

* fix bugs

* convert extra_volumes to dict for multiprocess

* lint
2025-07-12 18:26:45 +08:00
Tim e610fcaa57 fix: error in prompt template (#1065)
* fix prompt error

* fix prompt error
2025-07-12 09:32:46 +08:00
Yuante Li 76fcbbf64f refactor: try to convert the DS coder prompt into automaton logic (#1052)
* try to convert the DS coder prompt into automaton logic

* refine

* refine coder

* refine eval

* polish eval

* changes to pipeline_coder_system

* refine eval.py

* merge eval guidelines and steps

* fix a small bug

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: amstrongzyf <amstrongzyf@126.com>
2025-07-11 21:42:52 +08:00
XianBW f5615ec383 refactor: move selector codes to an independent folder (#1059)
* refactor: move exp_gen selection files into select directory

* fix selector value in data_science conf

* fix selector template name

* fix CI

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-07-11 17:42:40 +08:00
Jensen Lee d8790a0e7a fix: correct DS_LOCAL_DATA_PATH error in devcontainer (#1063) 2025-07-11 17:29:21 +08:00
xuangu-fang 0c6e6a4c31 fix: handle the no-update case of root node in uncommited_rec_status (#1062)
* fix: improve scheduler API (suggest_sel) and add timer.remain_time()

* chore: exclude .venv from auto-black and auto-isort tasks

* refactor: wrap RoundRobinScheduler commit and selection in retry loop

* set search_type="ancestors" for experiment_and_feedback_list_after_init

* fix bug:  no update of uncommited_rec_status with root node

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-07-11 17:13:00 +08:00
you-n-g c27f3b4aa8 docs: add Properties code-block for BACKEND setting in docs (#1060) 2025-07-11 16:57:08 +08:00
amstrongzyf dfd73cb619 docs: update installation methods in readme (#1058) 2025-07-11 16:26:16 +08:00
amstrongzyf e4d4ceafa2 fix: improve the logic of json_schema and refine the reasoning extraction logic for reasoning model (#1044)
* fix: fix a small bug in response_schema

* feat: support response_format parameter in chat completion

* fix: fix between json_mode and response_format

* Update base.py

* Update deprec.py

* add unittest and refine logic

* fix the reasoning extraction logic and refine prompt for deepseek adaptation

* refactor: introduce workflow_check and streamline task parsing

* refine prompt

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-07-11 15:36:03 +08:00