6cc1e5da3c
feat: add pipeline coder ( #742 )
...
* init commit
* limit problem numbers
* ensemble lower case
* add runtime and spec to coder
* submission check notice
* sub EDA in sample execution
* avoid lightgbm
* add time limit to scenario
* rephrase the submission check
* give positive feedback when facing warning in check
* ENABLE FEEDBACK
* fix feedback bug
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2025-04-03 13:00:11 +08:00
6b09ade605
fix: fix KeyError direct_exp_gen ( #735 )
...
* fix KeyError direct_exp_gen
* fix KeyError direct_exp_gen
* fix fin_factor fetch data error
2025-04-03 12:01:10 +08:00
f752cf5a48
fix: replace func "len()" in ensemble test code to support various data type ( #739 )
...
* replace len with def get_length
* update get_length implementation
2025-04-02 19:52:54 +08:00
66e484101b
feat: add describe_data_folder_v2 ( #738 )
...
* add describe_data_folder_v2
* fix ci
* fix
* add packages
2025-04-02 19:38:43 +08:00
f18c1828c8
costeer max loop as hyperp & skip workflow in eval ( #737 )
2025-04-02 14:18:42 +08:00
1db6063345
feat: new exp gen v2 implementation ( #725 )
...
* first framework commit
* idea proposal v2
Co-authored-by: Roland Minrui <RolandMinrui@users.noreply.github.com >
* fix a small bug in v1
* fix a small bug
* add problem to DShypothesis
* use exp gen as unified interface
* merge yuante's code into pr
* fix a small bug in draft
* update all minrui's code
* small update
* fix small bug & remove useless code
* fix return type
* fix CI
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
Co-authored-by: Roland Minrui <RolandMinrui@users.noreply.github.com >
Co-authored-by: Xu <v-xuminrui@microsoft.com >
Co-authored-by: Xu Yang <xuyang1@microsoft.com >
2025-04-02 13:37:47 +08:00
3d6ae62ad5
feat: loader prompt & simplify YAML loading and update data loader specifications ( #736 )
...
* refactor: Simplify YAML loading and update data loader specifications
* docs: Add comment explaining FunctionLoader usage in tpl.py
* lint
* lint
2025-04-01 22:36:25 +08:00
67ee1a90bd
chore: split dsapp to pages & add llm_logs showing ( #733 )
...
* split dsapp to pages & add llm_logs showing
* some changes
* small bug
* add time info
* do not test UI in test_import
* cache stdout
2025-04-01 20:55:10 +08:00
cc063dd646
feat: update prompts and descriptions for data science components ( #731 )
...
* docs: Update prompts and descriptions for data science components
* chore: Remove outdated comments from conf.py
* feat: Add metric_name attribute to DataScienceScen class
* style: Update description in prompts.yaml and reorder metric_name init
* docs: Update prompts.yaml with feature engineering guidelines
2025-04-01 20:54:42 +08:00
c5dcd3b704
fix: fix a bug in regular expression exception processing ( #734 )
...
* fix a bug in regular expression exception precessing
* fix ci
* fix
2025-04-01 16:54:05 +08:00
7ee5bc2e19
feat: add a tool to enable saving workspace files into a specific folder ( #728 )
...
* add a tool to enable saving workspace files into a specific folder
* fix
* fix
2025-03-28 16:22:27 +08:00
aa8ceed2fa
feat: track and log accumulated completion cost in LiteLLMAPIBackend ( #727 )
...
* feat: Track and log accumulated completion cost in LiteLLMAPIBackend
* refactor: Use variable for retry count and update import formatting
* lint
* fix: Allow chat_max_tokens to be None in LLMSettings
* feat: Add logging for LiteLLM settings and finish reason in cost calculation
2025-03-28 12:24:19 +08:00
b13575dc69
fix: add metric name check for valid scores ( #724 )
...
* update metric_name
* fix some bugs
* add an evaluation in workflow
* add an evalution in runner
* fix ci
* test change
* fix CI
---------
Co-authored-by: TPLin22 <tplin2@163.com >
Co-authored-by: yuanteli <1957922024@qq.com >
2025-03-27 19:36:57 +08:00
7733841f1c
feat: make spec optional ( #719 )
...
* feat: Add spec_enabled configuration for data science settings
* make spec alternative
* change spec logic in exp_gen
* remove some general texts
* align
---------
Co-authored-by: Young <afe.young@gmail.com >
Co-authored-by: yuanteli <1957922024@qq.com >
2025-03-27 17:17:41 +08:00
78757aeed7
refactor: remove unused code and update documentation in CoSTEER module ( #720 )
...
* refactor: Remove unused code and update documentation in CoSTEER module
* fix mypy error
* fix black error
---------
Co-authored-by: Young <afe.young@gmail.com >
2025-03-26 22:48:01 +08:00
9bc4d8d1d6
chore: update data science scenario UI ( #717 )
...
* UI changes
* remove hardcode
* fix CI
2025-03-21 18:11:06 +08:00
2574b0114f
feat: Add line length limit to shrink_text function and settings ( #715 )
2025-03-21 00:41:52 +08:00
c47de22c3d
add task type logger tag in coding ( #714 )
2025-03-20 19:15:37 +08:00
0624ed180f
fix: fix a bug in ensemble test script ( #713 )
...
* fix a bug in ensemble test script
* fix
* add a comment
2025-03-20 17:35:39 +08:00
613121ca45
fix: fix a bug in progress_bar filter ( #712 )
...
* fix a bug in progress_bar filter
* fix
2025-03-20 16:02:09 +08:00
7185613671
fix docs build error ( #709 )
2025-03-20 11:39:19 +08:00
8c4d6b9686
change only model codes in model coder ( #707 )
2025-03-19 19:37:26 +08:00
dfce823102
fix coverage using method ( #706 )
2025-03-19 19:00:53 +08:00
5a73901d2d
fix: clarify an ambiguous explanation ( #705 )
2025-03-19 17:57:04 +08:00
8133e4dcde
feat: add cross validation to workflow ( #700 )
2025-03-19 17:56:42 +08:00
466a851362
fix: default emb model ( #702 )
...
* fix: Remove incorrect prefix from default embedding model name
* refactor: Consolidate model settings in LLMSettings class
2025-03-19 12:27:45 +08:00
33e295107c
fix: align components' name ( #701 )
2025-03-19 11:27:43 +08:00
c263ece07c
fix: fix combined_factors_df.pkl not loading in docker ( #697 )
...
* Fix combined_factors_df.pkl not loading in docker
* change combined factors file type
* change qlib commit id
2025-03-18 18:36:21 +08:00
e21b334741
feat: out spec change for o1-preview ( #666 )
...
* add not_json batcheditout
* ensemble out_spec change
* feature out_spec change
* model out_spec change
* workflow out_spec change
* runner debugger out_spec change
* filter_progress_bar return format fix
* data_loader and spec out_spec change
* show finish_reason in llm log
* json_mode fix
* remove hardcode
* fix CI
* fix grammer
* complete PythonBatchEditOut logic
---------
Co-authored-by: yuanteli <1957922024@qq.com >
2025-03-18 17:43:44 +08:00
d32d8754d9
fix: fix some description errors in direct_exp_gen ( #698 )
...
* fix some description errors in direct_exp_gen
* delete an unused module
2025-03-18 16:21:59 +08:00
32dda6ea63
refactor: update evolving_strategy.py ( #686 )
...
implmentation -> implementation
2025-03-18 16:15:08 +08:00
0fe901d8cd
fix: add check when retrying gen model codes ( #699 )
...
* add check when retrying gen model codes
* fix CI
2025-03-18 15:59:34 +08:00
3e9ba73c2f
feat: add model removal and adjust some framework logic ( #681 )
...
* prune model task
* add component_description
* add model removal logic to component, hypo, and task gen
* fix ci
* adjust coder to meet the requirement of model removal
* fix and refine the logic of model removal
* add model removal logic in model_eval
* fix ci
* fix ci
* prune some unnecessary codes
2025-03-18 14:42:53 +08:00
229866123b
fix preds_dict's keys ( #695 )
2025-03-17 23:33:17 +08:00
4c9c29d244
fix: runner COSTEER evaluator ( #693 )
...
* fix scores.csv and submission.csv check in runner eval
* add coverage check info in running COSTEER feedback
* feedback value fix
2025-03-17 23:12:59 +08:00
6a6c9832f4
fix: fix a minor bug ( #694 )
2025-03-17 21:43:26 +08:00
119d69185a
fix: fix a bug related to model_name in ensemble ( #692 )
...
* fix a bug related to model_name in ensemble
* refine
2025-03-17 21:23:57 +08:00
699984fe1e
validate and update 'final_decision' before init CosTeerFeedback ( #691 )
2025-03-17 19:53:09 +08:00
1184be76bc
fix: fix an error in model_coder prompt ( #690 )
2025-03-17 15:38:39 +08:00
626ed4f069
fix: add force parameter for cache_with_pickle & using cache when get kaggle leaderboard ( #687 )
...
* use kaggleApi latest edition
* add 'force' for cache_with_pickle, use cache when getting kaggle leaderboard
2025-03-16 00:50:17 +08:00
08bda3bf8c
fix PythonAgentOut extract ( #685 )
2025-03-14 21:12:10 +08:00
bf9b383277
fix: rich.print error when some control char in output ( #684 )
...
* fix rich.print error when some control char in output
* change conda env info printing
* fix import
2025-03-14 21:03:46 +08:00
7809979e1f
fix running part timeout ( #683 )
2025-03-14 17:56:41 +08:00
641beb2203
check 'ensemble' in scores.csv in workflow eval ( #682 )
2025-03-14 17:40:06 +08:00
44d38a5909
feat: add constraint labels for semantic search ( #680 )
...
* add constraint labels for semantic search
* reformat
* reformat
* reformat
---------
Co-authored-by: Xu <v-xuminrui@microsoft.com >
2025-03-14 16:08:29 +08:00
13cfd1b3a8
timeout message adjustment for Run Env ( #677 )
2025-03-13 16:57:10 +08:00
edf1bdc997
feat: display LLM prompt ( #676 )
...
* log llm prompt
* fix
* fix log llm messages problem
---------
Co-authored-by: Bowen Xian <xianbowen@outlook.com >
2025-03-13 15:57:17 +08:00
890661735d
fix: save only one mle_score pkl for a running exp ( #675 )
...
* save only one mle_score pkl for a running exp
* fix_CI
2025-03-13 14:55:13 +08:00
6f06d5ab2c
fix: mle_score save problem ( #674 )
...
* fix mle_score save problem
* fix CI
2025-03-12 20:54:05 +08:00
866700415a
change default to False of 'do_truncate' ( #673 )
2025-03-12 20:21:34 +08:00
Roland Minrui