Commit Graph

320 Commits

Author SHA1 Message Date
Xu Yang f7c1c4fd74 feat: implement isolated model feature selection loop (#370)
* rename meta_tpl

* use a isolated coder to deal with model feature selection and refine the structure

* fix CI

* fix: fix some errors in scenario.py, proposal.py and runner.py and several complex competition scenarios(#365)

* fix several bugs in proposal and runner

* fix a bug in feedback-prize-english-language-learning

* fix some bugs and templates

* fix the bug in optiver and nlp problem

* delete unnecessary codes

* remove unnecessary codes

* complete forest and s4e8

* push

* feedback & s4e8 &  forest

* optiver finished

* s3e11 & s3e26

* s4e9 finished

* sf-crime finished

* the last one finished

---------

Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
Co-authored-by: WinstonLiyte <1957922024@qq.com>
2024-09-28 00:40:25 +08:00
WinstonLiyt 437e8d2996 fix: fix some errors in scenario.py, proposal.py and runner.py and several complex competition scenarios(#365)
* fix several bugs in proposal and runner

* fix a bug in feedback-prize-english-language-learning

* fix some bugs and templates

* fix the bug in optiver and nlp problem
2024-09-27 20:26:51 +08:00
Xu Yang 2d5fad409d feat: announce Discord and WeChat (#367)
* upload gitter and wechat links

* update badge

* update gitter to discord
2024-09-27 15:58:24 +08:00
Tim 0705e52d7d fix undefined error (#363) 2024-09-27 10:42:12 +08:00
Tim b93f034b19 feat: Modify FactorRowCountEvaluator and FactorIndexEvaluator to return the ratio (#328)
* remove AttributeError caused by select_threshold

* develop with ground truth

* raise exception for eval_case

* Revert "develop with ground truth"

This reverts commit e68c136588685476f32a3c3696a6a33deb47acc5.

* Modify FactorRowCountEvaluator and FactorIndexEvaluator to return the ratio

* reformatted by black

* Set the threshold for FactorIndexEvaluator to 0.99

* Apply suggestions from code review

* Update rdagent/components/coder/factor_coder/CoSTEER/evaluators.py

* geometric mean for format_succ_rate

* no need to check when similarity is high enough

* black reformat

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2024-09-27 09:34:55 +08:00
WinstonLiyt 0e94e74d20 fix: fix a typo (#362) 2024-09-27 02:15:28 +08:00
WinstonLiyt 9c8fed3010 feat: add normal rag into framework (#360)
* add normal rag into framework

* fix a typo

* fix a bug
2024-09-27 01:36:12 +08:00
Haoran Pan f5a2ea3aa1 feat: xgboost gpu accelerate (#359)
* gpu accelerate

* delete nn of sf-crime
2024-09-27 00:40:53 +08:00
WinstonLiyt ddc625f443 fix: refine some codes (#353)
* refine some codes

* fix ci errors

* update

* update advanced rag
2024-09-27 00:17:28 +08:00
Haoran Pan 7cfd5be6ff fix: preprocess output format & some mistake in spelling (#358)
* spaceship: format type of y = pd.series; fix a wrong spelling in xgb

* s3e11: format of y -- pd.series

* spaceship: format of y & fit nn

* spaceship: wrong spelling in xgb

* ci issue
2024-09-26 23:17:27 +08:00
Way2Learn 4beb704b2b fix: Optiver fixes (#357)
* Adding the competition: Optiver Volatility Prediction

* Fixing for CI

* Updating a new competition @ Optiver

* re-writing the optiver competition

* Revise for better commit

* Further fixes

* Further fixes

* Fixes

* Further Fixing Optiver Template

* Fix further to pass the test

* Fixing for CI

* Fixing for CI
2024-09-26 23:11:05 +08:00
Way2Learn 19ec34e613 feat: New competition - Optiver (#356)
* Adding the competition: Optiver Volatility Prediction

* Fixing for CI

* Updating a new competition @ Optiver

* re-writing the optiver competition

* Revise for better commit

* Further fixes

* Further fixes

* Fixes
2024-09-26 22:06:42 +08:00
Xu Yang e046ce9e0e remove temp debug prompt (#352) 2024-09-26 18:00:56 +08:00
Xu Yang 28dd0a0471 fix: revert model and make SOTA model available to COSTEER (#351)
* revert model and make SOTA model available to COSTEER

* fix CI

* fix CI

* fix CI
2024-09-26 17:54:45 +08:00
Way2Learn a468234da1 feat: better feedback & evaluation (#346)
* Updated new keys for evaluation

* fix the bug in feedback

---------

Co-authored-by: WinstonLiye <1957922024@qq.com>
2024-09-26 16:15:47 +08:00
XianBW 725a788c34 fix submission exception (#349) 2024-09-26 15:17:16 +08:00
XianBW bbe06b9e50 feat: show workspace in demo (#348)
* change id name in s4e8 tpl

* add workspace in demo

* add workspace in demo

* fix CI

* change workspace path color
2024-09-26 14:35:22 +08:00
Haoran Pan 9e14cefe65 feat: random forest for s3e11 (#347) 2024-09-26 13:43:50 +08:00
XianBW 43e24cc996 feat: auto submit result after one kaggle RDLoop (#345)
* auto submit when a loop end

* fix CI
2024-09-26 09:41:14 +08:00
XianBW 4b639452af feat: add kaggle tpl: feedback-prize (#331)
* change feedback tpl

* feedback tpl changes

* fix feedback tpl

* fix train.py of feedback tpl

* add rf model for feedback tpl

* fix CI
2024-09-26 09:08:25 +08:00
WinstonLiyt 7707f60bc9 feat: refine the template in several Kaggle competitions (#343)
* add an error catching in model runner

* check forest & s3e11 & s4e8 & spaceship, change params of forest & s3e26 & spaceship

* fix ci errors

---------

Co-authored-by: TPLin22 <tplin2@163.com>
2024-09-26 02:12:07 +08:00
WinstonLiyt db2f5f7646 add a button to control feature selection (#342) 2024-09-26 01:11:42 +08:00
Way2Learn e4c2b2537f fix: Update prompts.yaml to constrain only one model type (#341)
* Update prompts.yaml

* Update prompts.yaml

* fix a bug

---------

Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
Co-authored-by: WinstonLiye <1957922024@qq.com>
2024-09-25 23:25:14 +08:00
Haoran Pan 2f1b393b3e fix: a bug of developer& edit s4e8 template (#338)
* s4e8 preprocess remove onehot & fix a bug

* Update runner.py

* Update fea_share_preprocess.py

* Update runner.py

---------

Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
2024-09-25 20:09:52 +08:00
WinstonLiyt ddb2360cd8 fix a bug in model tuning feedback (#339) 2024-09-25 19:42:37 +08:00
Xu Yang 0b6687dc3e multi channel support in kaggle scenario (#337) 2024-09-25 19:15:31 +08:00
WinstonLiyt 34ef0c3a78 fix a bug in the definition of source data shape (#335) 2024-09-25 18:14:59 +08:00
Xu Yang 5ebeb20dc1 fix: stop using markup in docker env print (#336)
* stop using markup in docker env print

* fix CI
2024-09-25 18:12:11 +08:00
Haoran Pan b61d8847e1 fix: template for kaggle foreset & s4e9 (#334)
* s4e9: remove onehot, reshape output

* forest-cover-type-prediction: cross validation
2024-09-25 17:52:11 +08:00
WinstonLiyt f9f46fce1b fix a bug in feature selection prompt (#333) 2024-09-25 17:14:58 +08:00
Way2Learn d5f2c6a4d0 feat: support Multi output (#330)
* Key changes

* Revised to support submission specifications

* Revised to support submission specifications

* revise CI

* CI-Fix

* fixing-CI

* Support COSTEER Multi-Dimension for output & bug-fix

* Revised to support submission specifications

* revise CI

* CI-Fix

* fixing-CI

* Support COSTEER Multi-Dimension for output & bug-fix

* Linting
2024-09-25 16:45:08 +08:00
Xu Yang e343a29c75 avoid_generating_more_column_than_data (#332) 2024-09-25 16:41:08 +08:00
XianBW 287e7e7e90 only use kaggle setting in kaggle scenario now (#329) 2024-09-25 16:19:23 +08:00
WinstonLiyt 9ce243551b fix: fix a bug in the format of the model input (#327)
* fix a bug

* fix a bug

* fix a ci bug
2024-09-25 15:56:01 +08:00
Way2Learn cd59b55247 feat: Supporting Model Specifications (#319)
* Key changes

* Revised to support submission specifications

* Revised to support submission specifications

* revise CI

* CI-Fix

* fixing-CI
2024-09-25 07:42:28 +01:00
XianBW aefba2046a change docker logs print (#326) 2024-09-25 14:25:25 +08:00
XianBW 3bf99ca0ee feat: add s3e11 kaggle template (#324)
* s3e11 tpl v1

* some changes

* fix some bugs in s3e11 tpl, change docker logs color

* fix CI
2024-09-25 12:06:27 +08:00
you-n-g b441fb8059 docs: Update README.md (#323) 2024-09-25 08:54:04 +08:00
you-n-g d7c0785610 Docs: Update README.md (#321) 2024-09-24 23:31:09 +08:00
WinstonLiyt 51b6038c2e change the mechanism of traceback and action choosing (#320) 2024-09-24 18:42:14 +08:00
Haoran Pan 1ee2f5d764 fix sf-crime nn model (#318) 2024-09-24 18:03:13 +08:00
XianBW 660371d686 feat: add download submission.csv button for kaggle scenario (#317)
* add download submission.csv button for kaggle scenario

* fix CI
2024-09-24 17:58:22 +08:00
WinstonLiyt b0672baa9d fix: fix a bug in model tuning feedback (#316)
* fix a bug

* fix two bugs
2024-09-24 17:23:18 +08:00
Xu Yang 67167041e7 align local data folder and kaggle data folder to store mid result (#314) 2024-09-24 17:01:33 +08:00
XianBW f732c39265 fix: raise error in demo when no Metric in a Loop (#313)
* fix webpage when Metric is None

* fix CI
2024-09-24 16:14:01 +08:00
WinstonLiyt d94ba1ace2 feat: add qlib_factor_strategy (#307)
* add qlib_factor_strategy

* refine the code of action choosing

* fix a bug

* feat: template for kaggle (#308)

* init for s3e26

* ci issue

* fix a small bug in model runner which might cause error when model is the first try (#309)

* update

---------

Co-authored-by: Haoran Pan <167847254+TPLin22@users.noreply.github.com>
Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2024-09-24 15:03:18 +08:00
Way2Learn 8dc837b731 fix: Use fixed file name in model costeer & fixing cache (#311)
* use fixed name in model costeer to enable cache

* fix ci
2024-09-24 07:50:01 +01:00
XianBW 05e9522f18 fix: bug of saving preprocess cache files (#310)
* save independent returns of preprocess_script() to 'others.pkl'

* fix CI
2024-09-24 14:46:12 +08:00
Xu Yang 7e6e2b9c3a fix a small bug in model runner which might cause error when model is the first try (#309) 2024-09-24 14:39:21 +08:00
Haoran Pan 89c73fa19c feat: template for kaggle (#308)
* init for s3e26

* ci issue
2024-09-24 14:00:41 +08:00