0e302204e8
several bug fix ( #621 )
2025-02-19 22:03:39 +08:00
77ddee64ce
fix: change ensemble test ( #622 )
...
* change ensemble test
* remove redundant info
* fix bug
* add model name duplication check in ensemble test
* change text
2025-02-19 21:26:09 +08:00
faf15b74d0
fix: move docker timeout message to __run() ( #620 )
...
* move docker timeout msg to __run()
* fix CI
2025-02-19 19:09:52 +08:00
b6928f6ced
update qrcode ( #616 )
2025-02-19 13:44:40 +08:00
4cc951ea38
fix: Runnable on first complete & Rename method to next_incomplete_component for clarity ( #615 )
2025-02-19 01:00:25 +08:00
f200320b3f
add a check for the name of ensemble's score in scores.csv ( #614 )
2025-02-18 22:24:11 +08:00
8bdccb59d7
fix: move next_component_required logic to DSTrace class and accurate implement ( #612 )
...
* refactor: Move next_component_required logic to DSTrace class
* lint
2025-02-18 21:56:32 +08:00
45f022cd32
fix: sota comparison logic ( #608 )
...
* concat sota and current result
* fix the bug in current_exp's score vs sota's score
* fix ci
---------
Co-authored-by: yuanteli <1957922024@qq.com >
2025-02-18 20:43:28 +08:00
bf6eb6f15d
add PYTHONUNBUFFERED=1 for docker env ( #613 )
2025-02-18 20:07:49 +08:00
2b89fafa56
feat: add loop_n parameter to the main loop ( #611 )
...
* add loop_n parameter to main loop
* complete the loop_n
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-02-18 19:22:52 +08:00
15584bad43
fix restart bug ( #609 )
2025-02-18 15:39:34 +08:00
4b949b3c29
refactor: replace Evaluator with CoSTEEREvaluator in eva_utils.py ( #607 )
...
* refactor: Replace Evaluator with CoSTEEREvaluator in eva_utils.py
* fix bug
---------
Co-authored-by: Linlang <Lv.Linlang@hotmail.com >
2025-02-18 13:38:13 +08:00
2a9ae28a6a
fix: a small bug in exp_gen ( #606 )
2025-02-17 22:40:05 +08:00
f322766a00
fix: fix some minor bugs and add AutoML & cross-validation ( #604 )
...
* fix some complex sentences
* add AutoML in model and cross-validation in workflow
2025-02-17 19:14:50 +08:00
73cfa26d33
print head for txt files and shuffle when sample ( #603 )
2025-02-17 18:44:26 +08:00
d9576706cd
fix: docker error will trigger retry and data science runner loop set to 3 ( #602 )
...
* docker error will trigger retry
data science runner loop set to 3
* fix CI
2025-02-17 17:36:05 +08:00
5baed909e7
refactor: refactor core framework to better propogate feedbacks ( #599 )
...
* refactor: Update type annotations and remove unused class in evolving modules
* refactor: Simplify evolving agent and feedback handling in CoSTEER module
* lint & CI
* mypy
* ruff for core
* mypy
* refactor: remove unnecessary comments and update feedback handling logic
* refactor: Add prev_task_feedback parameter to evolving strategies
* feat: Clear folder before extracting zip file in DockerEnv
* fix: Correct retrieval of last experiment from history
2025-02-16 01:40:44 +08:00
86962574bb
chore: print txt info ( #600 )
...
* print head for txt files
* update sample
2025-02-14 19:16:28 +08:00
0a09fd02d3
fix: auto continue small bug ( #598 )
2025-02-14 17:03:57 +08:00
6367bf1833
fix: fix a bug in proposal (add last loop's exception to last task desc) ( #596 )
...
* fix a bug in proposal (add last loop's exception to last task desc)
* fix
2025-02-14 16:36:49 +08:00
79a004bc23
small bugs in cache rerun ( #597 )
2025-02-14 16:24:26 +08:00
3c2f799618
fix: fix some bugs in the ensemble component ( #595 )
...
* allow the LLM in the ensemble to focus on the significance of metrics
* fix a bug in feedback
* prun spec
* fix a bug in ensemble
* delete unnecessary prompts
* fix the logic in spec
* generalize dataset split
2025-02-14 15:32:40 +08:00
ed53af4c65
feat: integrate azure deepseek r1 ( #591 )
...
* fix several task & integrate deepseek R1
* fix CI
---------
Co-authored-by: Xu Yang <xuyang1@microsoft.com >
2025-02-13 22:20:17 +08:00
c76afb21b5
fix error ( #594 )
2025-02-13 19:34:49 +08:00
2e3fe1ac71
fix: ensure expected type ( #593 )
...
* ensure expected type
* reformat
2025-02-13 19:04:26 +08:00
5090c6153f
feat(backend): integrate LiteLLM API Backend ( #564 )
...
* File structure for supporting litellm
* more litellm support
* feat: Add CachedAPIBackend class and dynamic API backend retrieval function
* fix: update benchmark folder path and add default values for architecture and hyperparameters
* feat: add LiteLLMAPIBackend and DeprecBackend ; changed structure of the project ; with bus
* fix : deprec_backend
* feat: Add LiteLLMAPIBackend class and related features; update configuration and test cases.
* feat: Enhance LiteLLMAPIBackend with encoder support and dynamic argument handling;Enhance log Colors
* lint
* fix lint...
* fix: Lint
* fix:make auto-lint
* fix:test oai
* fix:redundant _abckend.py
* fix: Optimize LiteLLMAPIBackend on token counting functiona, and clean up unused code;add test on this function
* feat: Add LiteLLMSettings class and update model settings usage
* fix: Update LiteLLMSettings environment variable prefix and model configurations
* fix : gitignore
* test: Consolidate and relocate test files for litellm backend and oai
* fix : lint
* fix: lint
* auto lint
* lint
* LINT
* lint
* chore: remove deprecated backend configuration comments
* refactor: Remove unused functions and imports from deprec.py and llm_utils.py
* refactor: Move md5_hash function from deprec.py to llm_utils.py
* chore: Remove extra newline and add missing import in deprec.py
* lint
* refactor: Move md5_hash function to utils module
* lint
* lint
* lint
---------
Co-authored-by: Young <afe.young@gmail.com >
Co-authored-by: Yihua Chen <v-yihuachen@microsoft.com >
2025-02-13 15:16:18 +08:00
dd4152caf9
fix: fix a bug in threshold score display ( #592 )
...
* fix a bug in threshold score display
* fix
2025-02-13 14:50:56 +08:00
863e42f8a1
feat: add baseline score stat ( #590 )
...
* add baseline score stat
* fix ci
* fix
* fix
2025-02-12 18:57:08 +08:00
e8075cbb4a
sample group files by basename ( #589 )
2025-02-12 16:36:46 +08:00
3b9b646ed2
fix: sort file name for cache reproduction ( #588 )
2025-02-12 15:29:57 +08:00
99141a7b19
fix: Handle ValueError when resolving relative path for uri ( #585 )
2025-02-12 13:23:08 +08:00
57c35cb2b9
fix runner as costeer when using static task ( #587 )
2025-02-12 12:35:17 +08:00
940a58e142
ignore score value ( #586 )
2025-02-12 11:39:49 +08:00
3d8ec4e272
fix: coder prompt & model test text ( #583 )
...
* test text fix
* Require LLM to use print() instead of logging
2025-02-11 21:12:25 +08:00
203967ae9a
add feedback to workspace and ds runner base on costeer
2025-02-11 20:50:19 +08:00
f96c710c23
feat: summary and UI update ( #581 )
...
* summary and UI update
* fix CI
* fix
* fix CI
2025-02-11 20:48:30 +08:00
2bb176427a
avoid length exception ( #580 )
2025-02-11 18:12:45 +08:00
089042f06b
fix: handle invalid regex patterns in filter_progress_bar function ( #579 )
...
* fix: handle invalid regex patterns in filter_progress_bar function
* Update rdagent/utils/__init__.py
2025-02-11 18:07:16 +08:00
dbcd380968
refine the code in hypo&task generating ( #578 )
2025-02-10 22:09:42 +08:00
e2b7c9dc78
fix: fix the errors in the coder and evaluator of the five components ( #576 )
...
* refine the prompt in feat coder
* refine data loader prompt in coder & eval
* fix
* fix
* refine model prompt in coder & eval
* refine ensemble prompt in coder & eval
* refine workflow prompt in coder & eval
* fix
2025-02-10 20:20:30 +08:00
63d7388612
add the none check for data loader & feature output ( #577 )
2025-02-10 20:18:01 +08:00
70abdd1949
score chart error catch ( #575 )
2025-02-10 12:19:29 +08:00
e2803e096b
refactor: Use file dictionaries for diff generation in feedback module ( #574 )
2025-02-10 09:03:13 +08:00
61e9089519
fix: add retry mechanism for GPU device check in DockerEnv ( #573 )
...
* fix: add retry mechanism for GPU device check in DockerEnv
* lint
* my py linting
* refactor: Improve type annotations and retry logic in workflow utils
* fix syntax
2025-02-10 08:59:46 +08:00
b92bc1ad29
feat: add retry mechanism with wait_retry decorator and refactor diff generation ( #572 )
2025-02-10 01:35:54 +08:00
6e334c154c
refine the logic in feedback ( #571 )
2025-02-08 21:14:30 +08:00
b452626cfb
text change ( #568 )
2025-02-08 21:14:13 +08:00
12cbd21dbe
update qrcode ( #570 )
2025-02-08 20:48:19 +08:00
fc33bb607e
feat: diff mode fix ( #569 )
...
* feat: Add last runnable experiment feedback retrieval and improve diff generation
* lint
2025-02-08 20:13:38 +08:00
dc4d492470
fix: include data information in cache key generation ( #566 )
2025-02-08 20:05:57 +08:00
Xu Yang