Commit Graph

1460 Commits

Author SHA1 Message Date
Xu Yang 2b821884e7 If not use the session stored timer, need to replace it with the default timer (#825) 2025-04-25 00:39:31 +08:00
Yuante Li 7f90e44798 fix: fix a bug in docker result extraction (#824)
* fix a bug in docker result extraction
2025-04-24 19:02:38 +08:00
XianBW f8af5c0682 can set reasoning_effor=None in chat_model_map (#823) 2025-04-24 18:47:24 +08:00
XianBW f909b1b6bc feat: using different chat model in different part (#822)
* using model in the chat_model_map in one tag

* add replace timer to DS loop

* fix CI

* fix CI

* add more custom config in chat_model_map

* fix CI

* fix CI

* fix CI

---------

Co-authored-by: Xu Yang <xuyang1@microsoft.com>
2025-04-24 18:22:51 +08:00
Yuante Li 44ccee864d fix: fix model input shape bug and costeer_model bug (#821)
* fix model input shape bug and costeer_model bug

* fix a bug
2025-04-24 12:48:25 +08:00
Xu Yang 0ce1ca74a0 fix: update runner max loop to 1 in DS scenario (#820) 2025-04-23 19:15:29 +08:00
Yuante Li 18a115b4e0 fix: fix some minor bugs in qlib scenario (#817)
* fix some bugs

* fix a bug

* fix a bug in qlib frontend

* fix ci

* fic ci

* fix qlib Dockerfile
2025-04-23 18:48:02 +08:00
Haoran Pan 364e3c9f61 update qrcode (#818) 2025-04-23 16:12:48 +08:00
Yuante Li 39e25d28a1 fix: improve eval alignment check (e.g. small-scale finetuning) (#802)
* fix

* fix
2025-04-22 18:47:24 +08:00
Xu Yang 0f2399667b feat: add mlflow logger in RD loop to log (#815)
* add mlflow logger in DS loop

* fix CI

* fix CI

---------

Co-authored-by: Xu Yang <xuyang1@microsoft.com>
2025-04-22 01:23:40 +08:00
Xu Yang 29b1cbc316 feat: archive python and csv files in workspace to maintain results (#814)
* archive workspace also

* remove non python csv and md files in workspace to avoid big workspace dump

* FIX ci
2025-04-21 16:34:29 +08:00
XianBW 1c9b00474b fix: align competion_full_desc and scenario_all_desc, remove redundant info in problems proposal (#808)
* align competition desc & scenario desc string

* remove competition_desc when having used scenario_desc in problem gen

* fix bug

* remove redundant competition desc in naive expgen

* improve proposal prompt

* modify phrase

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-04-18 16:48:26 +08:00
XianBW 6f3e1a5b8a add select lite and select best button (#809) 2025-04-18 16:28:31 +08:00
Xu Yang 2b7122f41f fix: bug fix in timer start (#807) 2025-04-18 16:16:28 +08:00
Xu Yang 6646613359 fix: bug in problem identification (#806) 2025-04-18 15:46:11 +08:00
Roland Minrui 6fe9be19cd feat: idea pool integrated to exp_gen & add timer to RD-Agent & pause-resume to RD-loops (#795)
* update all code

* update all code

* dump knowledge base

* rename the tag

* add timer to RD-Agent

* fix CI

* fix CI

* use batch embedding

* fix a small bug

* fix prompt bug

* feat: add pause resume to handle K8S cluster pause (#804)

* add resume to cluster running

* fix non-pickle problem

* fix a small bug

* fix a small bug

* avoid shutil move error

* refine the logic

* move knowledge base out of session

* avoid mistake information to pipeline coding

* avoid load and dump in steps

* archive the right folder

* small improvement

* avoid restart when timer is already started

* fix CI

---------

Co-authored-by: Xu Yang <xuyang1@microsoft.com>

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
Co-authored-by: Xu Yang <xuyang1@microsoft.com>
Co-authored-by: Xu <v-xuminrui@microsoft.com>
2025-04-18 14:01:03 +08:00
Linlang 6d56061341 chore: modify kaggle docs & Adding ds_loop at program entry (#786)
* modify kaggle docs

* optimise code based on comments

* Update docs/scens/kaggle_agent.rst

* fix docs build error

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-04-17 22:02:49 +08:00
you-n-g d46d27375d refactor: use remove_eda_part for EDA cleanup, fix diff eval (#800) 2025-04-17 16:19:26 +08:00
Linlang 353d8f05ef update wechat qrcode (#798) 2025-04-16 21:39:56 +08:00
XianBW 8bd48c3dde fix retry when hypothesis gen (#796) 2025-04-16 19:01:46 +08:00
you-n-g a974dd9ba3 refactor: use dynamic input path and update template loader (#792)
* refactor: use dynamic input path and update template loader

* fix: update include syntax for data source in prompts.yaml

* add customization path

* docs: update prompts for ensemble scoring and metric direction

* chore: remove obsolete data_science/share.yaml file
2025-04-16 18:11:46 +08:00
Xu Yang 829f5534ca feat: raise error when timeout in api call (#793)
* small change to try catch in backend

* fix CI

* add timeout tolerance to 3
2025-04-16 13:50:20 +08:00
you-n-g e05a645ad4 feat: refine prompt (#760)
* style: Simplify language and improve clarity in prompts and share.yaml

* style: Update prompt wording for clarity in raw_data_loader

* style: Simplify conditional logic in task_gen system prompt

* refactor: Update prompts and proposal for component output format handling

* fix: Correct grammar and add clarification in prompts.yaml

* feat: Include coding guidelines in data science component prompts

* lint
2025-04-16 09:35:30 +08:00
you-n-g b18ed7ce27 fix: update metric direction to return bool (#791) 2025-04-15 17:10:31 +08:00
Roland Minrui ea5fef308a fix: add wait_retry to exp_gen v2 (#783)
* add wait retry to v2

* format

* fix a bug

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: yuanteli <1957922024@qq.com>
2025-04-14 11:02:45 +08:00
you-n-g f0d9919d93 fix: import path of T (#787)
* feat: add DocDev for auto-generating workspace documentation

* fix: update markdown instructions in tpl.yaml

* feat: add enable_doc_dev flag and conditionally call DocDev

* refactor: update T import and prompt keys for DocDev

* fix: update include path for MarkdownOut template

* fix: update file search, README injection, and brief prompt text

* docs: update prompt to only introduce models

* lint
2025-04-13 10:21:24 +08:00
Yuante Li 209e2ec329 fix: fix competition metric direction (#784) 2025-04-11 16:25:30 +08:00
Yuante Li 90b6f81e62 refactor: refactor feedback logic and fix bug in task_gen (#782)
* task gen refine & feedback refine

* fix

* refine feedback logic

* fix a bug

* fix

* fix

* fix ci
2025-04-11 15:52:52 +08:00
you-n-g 453265705e feat: add DocDev for auto-generating workspace documentation (#781)
* feat: add DocDev for auto-generating workspace documentation

* fix: update markdown instructions in tpl.yaml

* feat: add enable_doc_dev flag and conditionally call DocDev
2025-04-10 20:12:21 +08:00
Xu Yang 117428829a still assign five component to pipeline (#780) 2025-04-10 18:30:32 +08:00
Tim a6ae88fb42 chore: fit more competition (#723)
1. Remove potential <code> tags from the generated code.
2. Use return codes in data_loader, feature, and model.
3. Configure the debug timeout.
2025-04-10 17:56:57 +08:00
Tim 612621f393 feat: pull image with progress (#777)
pull image with progress
2025-04-10 12:00:27 +08:00
you-n-g bbc591b401 feat: dump model (#776)
* feat: add model dump flag and multi-evaluator support

* tmp code

* refactor: update evaluator feedback and FBWorkspace types

* feat: add get_clear_ws_cmd and CPU count in Docker environment

* feat: Add model dump check level and enhance evaluator functionality

fix data type bug

* fix: Ensure required files exist before model dump evaluation

* refactor: streamline prompt and file checks in model dump evaluation

* fix: add assertions and reorder file reads in model dump evaluator

* feat: remove EDA part from evaluation output

* docs: update dump_model guidelines and eval prompt to include template

* style: reformat multiline dicts and lists in conf and eval files

* fix: add DOTALL flag to EDA removal regex
2025-04-09 23:24:12 +08:00
XianBW 835da5b918 ui updates (#778) 2025-04-09 20:11:00 +08:00
you-n-g 8a11bfbf53 refactor: update MLEBench submission validation logic in runner and eval (#769)
* refactor: Update MLEBench submission validation logic in runner and eval

* lint

* Delete docs/scens/data_science.rst

* fix: update variable name in feedback prompt

* define a variable: submission_check_out

* fix: update submission check handling for MLE data

* refactor: reformat if condition for clarity

---------

Co-authored-by: Linlang <Lv.Linlang@hotmail.com>
2025-04-09 13:34:48 +08:00
Linlang 8d5fb2eebf update wechat qrcode (#775) 2025-04-09 12:23:38 +08:00
XianBW b95154c99d catch llm_data pkl read exception (#774) 2025-04-09 12:21:54 +08:00
xuangu-fang fd155d1fa8 feat: checkpoint selection (#744)
* rebase selection code

* bug-free run: checkpoint selection and dynamic EDA loading

* add prototypes of various selectors, to imp. and test later

* fix EDA write bug

* move selector to from proposal.py tp seletc.py

* auto lint

* fix line-too-long typos

* aligh the design of "selection", rm extra instance check

* make auto-lint

* add non-trival selector: SOTAjump
2025-04-09 09:42:30 +08:00
Xu Yang c3cc763430 fix: update feedback.py (#772) 2025-04-08 23:35:11 +08:00
Xu Yang a50b2bba43 small bug fix in feedback (#771) 2025-04-08 22:17:47 +08:00
XianBW 6c8fdeaa41 chore: data science scenario UI updates (#770)
* fix some pandas warning

* fix load time logic

* optimize load_time logic

* fix CI

* fix bug
2025-04-08 19:33:20 +08:00
Xu Yang f092739ab5 add rule-based eval to speed up the whole process (#768) 2025-04-08 17:27:21 +08:00
Yuante Li cd4d07c323 feat: merge failed and successful traces together (#766)
* merge failed and successful traces together

* delete the task description from the trace display

* prune unnecessary info for the proposal stage
2025-04-08 17:04:55 +08:00
Yuante Li 3741611ebe feat: add reviewer in feedback (#765) 2025-04-08 16:20:13 +08:00
XianBW ceffbb165a add hypothesis table (#764) 2025-04-07 20:16:37 +08:00
XianBW e7f3cf97ec fix: duplicate model names test in pipeline coder & runner (#763)
* add model name duplicate test in pipeline costeer

* fix ci
2025-04-07 19:06:42 +08:00
you-n-g 4c5020f67e fix: Set PYTHONPATH in env.run_ret_code call in FBWorkspace class (#755) 2025-04-07 18:15:33 +08:00
XianBW f0d919f04c chore: data science scenario UI updates (#757)
* ui changes

* add ours vs medal threshold

* add success loop statistic of components

* show times info

* UI updates

* summary selected

* change colors

* fix CI

* add stat hours param for `mle_summary.py --summary` command

* add 24h summary button

* fix CI

* add logger info for dockerEnv/condaEnv running time
2025-04-07 16:24:27 +08:00
Roland Minrui 743f070d48 remove buggy info in hypothesis rank (#762)
Co-authored-by: Xu <v-xuminrui@microsoft.com>
2025-04-07 14:09:36 +08:00
Xu Yang 8dd0b74da5 pretrained & validation alignment (#761) 2025-04-07 13:29:41 +08:00