42d15623ca
fix: move next_component_required logic to DSTrace class and accurate implement ( #612 )
...
* refactor: Move next_component_required logic to DSTrace class
* lint
2025-02-18 21:56:32 +08:00
6c20263e2e
fix: sota comparison logic ( #608 )
...
* concat sota and current result
* fix the bug in current_exp's score vs sota's score
* fix ci
---------
Co-authored-by: yuanteli <1957922024@qq.com >
2025-02-18 20:43:28 +08:00
50e637f9cd
add PYTHONUNBUFFERED=1 for docker env ( #613 )
2025-02-18 20:07:49 +08:00
1605cddb40
feat: add loop_n parameter to the main loop ( #611 )
...
* add loop_n parameter to main loop
* complete the loop_n
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-02-18 19:22:52 +08:00
75e496d461
fix restart bug ( #609 )
2025-02-18 15:39:34 +08:00
9fcd5d473e
refactor: replace Evaluator with CoSTEEREvaluator in eva_utils.py ( #607 )
...
* refactor: Replace Evaluator with CoSTEEREvaluator in eva_utils.py
* fix bug
---------
Co-authored-by: Linlang <Lv.Linlang@hotmail.com >
2025-02-18 13:38:13 +08:00
5f1c814355
fix: a small bug in exp_gen ( #606 )
2025-02-17 22:40:05 +08:00
21d88f38d0
fix: fix some minor bugs and add AutoML & cross-validation ( #604 )
...
* fix some complex sentences
* add AutoML in model and cross-validation in workflow
2025-02-17 19:14:50 +08:00
fd27842a98
print head for txt files and shuffle when sample ( #603 )
2025-02-17 18:44:26 +08:00
bddb5eb935
fix: docker error will trigger retry and data science runner loop set to 3 ( #602 )
...
* docker error will trigger retry
data science runner loop set to 3
* fix CI
2025-02-17 17:36:05 +08:00
ffc85936f1
refactor: refactor core framework to better propogate feedbacks ( #599 )
...
* refactor: Update type annotations and remove unused class in evolving modules
* refactor: Simplify evolving agent and feedback handling in CoSTEER module
* lint & CI
* mypy
* ruff for core
* mypy
* refactor: remove unnecessary comments and update feedback handling logic
* refactor: Add prev_task_feedback parameter to evolving strategies
* feat: Clear folder before extracting zip file in DockerEnv
* fix: Correct retrieval of last experiment from history
2025-02-16 01:40:44 +08:00
241c05ccac
chore: print txt info ( #600 )
...
* print head for txt files
* update sample
2025-02-14 19:16:28 +08:00
50e020b75d
fix: auto continue small bug ( #598 )
2025-02-14 17:03:57 +08:00
d1c005ff6d
fix: fix a bug in proposal (add last loop's exception to last task desc) ( #596 )
...
* fix a bug in proposal (add last loop's exception to last task desc)
* fix
2025-02-14 16:36:49 +08:00
96ee62c7a2
small bugs in cache rerun ( #597 )
2025-02-14 16:24:26 +08:00
c321ebfbcb
fix: fix some bugs in the ensemble component ( #595 )
...
* allow the LLM in the ensemble to focus on the significance of metrics
* fix a bug in feedback
* prun spec
* fix a bug in ensemble
* delete unnecessary prompts
* fix the logic in spec
* generalize dataset split
2025-02-14 15:32:40 +08:00
1a44a954df
feat: integrate azure deepseek r1 ( #591 )
...
* fix several task & integrate deepseek R1
* fix CI
---------
Co-authored-by: Xu Yang <xuyang1@microsoft.com >
2025-02-13 22:20:17 +08:00
4d8e334ef8
fix error ( #594 )
2025-02-13 19:34:49 +08:00
b7be0f35f8
fix: ensure expected type ( #593 )
...
* ensure expected type
* reformat
2025-02-13 19:04:26 +08:00
97c1f7a021
feat(backend): integrate LiteLLM API Backend ( #564 )
...
* File structure for supporting litellm
* more litellm support
* feat: Add CachedAPIBackend class and dynamic API backend retrieval function
* fix: update benchmark folder path and add default values for architecture and hyperparameters
* feat: add LiteLLMAPIBackend and DeprecBackend ; changed structure of the project ; with bus
* fix : deprec_backend
* feat: Add LiteLLMAPIBackend class and related features; update configuration and test cases.
* feat: Enhance LiteLLMAPIBackend with encoder support and dynamic argument handling;Enhance log Colors
* lint
* fix lint...
* fix: Lint
* fix:make auto-lint
* fix:test oai
* fix:redundant _abckend.py
* fix: Optimize LiteLLMAPIBackend on token counting functiona, and clean up unused code;add test on this function
* feat: Add LiteLLMSettings class and update model settings usage
* fix: Update LiteLLMSettings environment variable prefix and model configurations
* fix : gitignore
* test: Consolidate and relocate test files for litellm backend and oai
* fix : lint
* fix: lint
* auto lint
* lint
* LINT
* lint
* chore: remove deprecated backend configuration comments
* refactor: Remove unused functions and imports from deprec.py and llm_utils.py
* refactor: Move md5_hash function from deprec.py to llm_utils.py
* chore: Remove extra newline and add missing import in deprec.py
* lint
* refactor: Move md5_hash function to utils module
* lint
* lint
* lint
---------
Co-authored-by: Young <afe.young@gmail.com >
Co-authored-by: Yihua Chen <v-yihuachen@microsoft.com >
2025-02-13 15:16:18 +08:00
f362a1618d
fix: fix a bug in threshold score display ( #592 )
...
* fix a bug in threshold score display
* fix
2025-02-13 14:50:56 +08:00
43703d45d2
feat: add baseline score stat ( #590 )
...
* add baseline score stat
* fix ci
* fix
* fix
2025-02-12 18:57:08 +08:00
f06412e628
sample group files by basename ( #589 )
2025-02-12 16:36:46 +08:00
dc2bf4b442
fix: sort file name for cache reproduction ( #588 )
2025-02-12 15:29:57 +08:00
8f1f19d4b9
fix: Handle ValueError when resolving relative path for uri ( #585 )
2025-02-12 13:23:08 +08:00
064733d82b
fix runner as costeer when using static task ( #587 )
2025-02-12 12:35:17 +08:00
da7169675c
ignore score value ( #586 )
2025-02-12 11:39:49 +08:00
6de33fa13b
fix: coder prompt & model test text ( #583 )
...
* test text fix
* Require LLM to use print() instead of logging
2025-02-11 21:12:25 +08:00
c1085921b5
add feedback to workspace and ds runner base on costeer
2025-02-11 20:50:19 +08:00
18de5eea43
feat: summary and UI update ( #581 )
...
* summary and UI update
* fix CI
* fix
* fix CI
2025-02-11 20:48:30 +08:00
13214ba5d0
avoid length exception ( #580 )
2025-02-11 18:12:45 +08:00
56f3a668f2
fix: handle invalid regex patterns in filter_progress_bar function ( #579 )
...
* fix: handle invalid regex patterns in filter_progress_bar function
* Update rdagent/utils/__init__.py
2025-02-11 18:07:16 +08:00
75f29f0dd9
refine the code in hypo&task generating ( #578 )
2025-02-10 22:09:42 +08:00
345a702501
fix: fix the errors in the coder and evaluator of the five components ( #576 )
...
* refine the prompt in feat coder
* refine data loader prompt in coder & eval
* fix
* fix
* refine model prompt in coder & eval
* refine ensemble prompt in coder & eval
* refine workflow prompt in coder & eval
* fix
2025-02-10 20:20:30 +08:00
d2baa40fb1
add the none check for data loader & feature output ( #577 )
2025-02-10 20:18:01 +08:00
216361c640
score chart error catch ( #575 )
2025-02-10 12:19:29 +08:00
904f4b8523
refactor: Use file dictionaries for diff generation in feedback module ( #574 )
2025-02-10 09:03:13 +08:00
59337a9050
fix: add retry mechanism for GPU device check in DockerEnv ( #573 )
...
* fix: add retry mechanism for GPU device check in DockerEnv
* lint
* my py linting
* refactor: Improve type annotations and retry logic in workflow utils
* fix syntax
2025-02-10 08:59:46 +08:00
0db49991cb
feat: add retry mechanism with wait_retry decorator and refactor diff generation ( #572 )
2025-02-10 01:35:54 +08:00
34bf87c410
refine the logic in feedback ( #571 )
2025-02-08 21:14:30 +08:00
f37ec32981
text change ( #568 )
2025-02-08 21:14:13 +08:00
cefef61d0e
feat: diff mode fix ( #569 )
...
* feat: Add last runnable experiment feedback retrieval and improve diff generation
* lint
2025-02-08 20:13:38 +08:00
3090718ca3
fix: include data information in cache key generation ( #566 )
2025-02-08 20:05:57 +08:00
7eb7f49f52
fix: add scores.csv checking in ensemble_test ( #567 )
...
* add scores.csv checking in ensemble_test
* text modify
2025-02-08 19:03:29 +08:00
c255b79da4
chore: format check result ( #565 )
...
* format check result placed next to the metric result
* reformat
2025-02-08 18:53:16 +08:00
94d0eca0ca
support multiple types in feature engineering ( #562 )
2025-02-08 15:21:11 +08:00
bfdee6b692
add time info and stdout window ( #563 )
2025-02-07 22:00:45 +08:00
732839e4bd
feat: add the shape of the CSV to the dataset description ( #561 )
...
* add csv's shape info to data description
* fix CI
2025-02-07 18:12:18 +08:00
98a0801a32
fix bugs ( #560 )
2025-02-07 11:00:18 +08:00
e1f86d7ca0
fix: add stdout context length setting and improve text shrinking logic ( #559 )
...
* feat: Add stdout context length setting and improve text shrinking logic
* lint
2025-02-06 23:00:15 +08:00
you-n-g