* rename meta_tpl
* use a isolated coder to deal with model feature selection and refine the structure
* fix CI
* fix: fix some errors in scenario.py, proposal.py and runner.py and several complex competition scenarios(#365)
* fix several bugs in proposal and runner
* fix a bug in feedback-prize-english-language-learning
* fix some bugs and templates
* fix the bug in optiver and nlp problem
* delete unnecessary codes
* remove unnecessary codes
* complete forest and s4e8
* push
* feedback & s4e8 & forest
* optiver finished
* s3e11 & s3e26
* s4e9 finished
* sf-crime finished
* the last one finished
---------
Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
Co-authored-by: WinstonLiyte <1957922024@qq.com>
* remove AttributeError caused by select_threshold
* develop with ground truth
* raise exception for eval_case
* Revert "develop with ground truth"
This reverts commit e68c136588685476f32a3c3696a6a33deb47acc5.
* Modify FactorRowCountEvaluator and FactorIndexEvaluator to return the ratio
* reformatted by black
* Set the threshold for FactorIndexEvaluator to 0.99
* Apply suggestions from code review
* Update rdagent/components/coder/factor_coder/CoSTEER/evaluators.py
* geometric mean for format_succ_rate
* no need to check when similarity is high enough
* black reformat
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
* Search enhancement
* refactor: reorganize imports for consistency with isort
* reformatterd by black
---------
Co-authored-by: Tim <illking@foxmail.com>
* init a scenario for kaggle feature engineering
* fix some bugs and add original features' description
* refine the process of data downloading
* fix a error
* revert the code
* fix a bug in feedback
* fix a ci bug
* fix a ci bug
* Init todo
* Evaluation & dataset
* Generate new data
* dataset generation
* add the result
* Analysis
* Factor update
* Updates
* Reformat analysis.py
* CI fix
* Revised Preprocessing & Supported Random Forest
* Revised to support three models with feature
* Further revised prompts
* Slight Revision
* docs: update contributors (#230)
* Revised to support three models with feature
* Further revised prompts
* Slight Revision
* feat: kaggle model and feature (#238)
* update first version code
* make hypothesis_gen and experiment_builder fit for both feature and model
* feat: continue kaggle feature and model coder (#239)
* use qlib docker to run qlib models
* feature coder ready
* model coder ready
* fix CI
* finish the first round of runner (#240)
* Optimized the factor scenario and added the front-end.
* fix a small bug
* fix a typo
* update the kaggle scenario
* delete model_template folder
* use experiment to run data preprocess script
* add source data to scenarios
* minor fix
* minor bug fix
* train.py debug
* fixed a bug in train.py and added some TODOs
* For Debugging
* fix two small bugs in based_exp
* fix some bugs
* update preprocess
* fix a bug in preprocess
* fix a bug in train.py
* reformat
* Follow-up
* fix a bug in train.py
* fix a bug in workspace
* fix a bug in feature duplication
* fix a bug in feedback
* fix a bug in preprocessed data
* fix a bug om feature engineering
* fix a ci error
* Debugged & Connected
* Fixed error on feedback & added other fixes
* fix CI errors
* fix a CI bug
* fix: fix_dotenv_error (#257)
* fix_dotenv_error
* format with isort
* Update rdagent/app/cli.py
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
* chore(main): release 0.2.1 (#249)
Release-As: 0.2.1
* init a scenario for kaggle feature engineering
* delete error codes
* Delete rdagent/app/kaggle_feature/conf.py
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: cyncyw <47289405+taozhiwang@users.noreply.github.com>
Co-authored-by: Xisen-Wang <xisen_application@163.com>
Co-authored-by: Haotian Chen <113661982+Hytn@users.noreply.github.com>
Co-authored-by: WinstonLiye <1957922024@qq.com>
Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
Co-authored-by: Linlang <30293408+SunsetWolf@users.noreply.github.com>
* init commit for XGBoost
* fix some bugs
* CI issues
* CI issues
* CI issue
* edit prompts for kaggle scenario & fix some bugs
* Revised Prompts To Improve Performance on Model Type & Support of Random Forest
* edit prompts & modify evaluator.py to adapt to Kaggle scenario
* edit prompts
* fix some bugs
* CI issues
---------
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: Xisen-Wang <xisen_application@163.com>
* Init todo
* update all code
* update
* Extract factors from financial reports loop finished
* Fix two small bugs.
* Delete rdagent/app/qlib_rd_loop/run_script.sh
* Minor mod
* Delete rdagent/app/qlib_rd_loop/nohup.out
* Fix a small bug in file reading.
* some updates
* Update the detailed process and prompt of factor loop.
* Evaluation & dataset
* Optimize the prompt for generating hypotheses and feedback in the factor loop.
* Generate new data
* dataset generation
* Performed further optimizations on the factor loop and report extraction loop, added log handling for both processes, and implemented a screenshot feature for report extraction.
* Update rdagent/components/coder/factor_coder/CoSTEER/evaluators.py
* Update package.txt for fitz.
* add the result
* Performed further optimizations on the factor loop and report extraction loop, added log handling for both processes, and implemented a screenshot feature for report extraction. (#100) (#102)
- Performed further optimizations on the factor loop and report extraction loop.
- Added log handling for both processes.
- Implemented a screenshot feature for report extraction.
* Analysis
* Optimized log output.
* Factor update
* A draft of the "Quick Start" section for README
* Add scenario descriptions.
* Updates
* Adjust content
* Enable logging of backtesting in Qlib and store rich-text descriptions in Trace. Support one-step debugging for factor extraction.
* Reformat analysis.py
* CI fix
* Refactor
* remove useless code
* fix bugs (#111)
* Fix two small bugs.
* Fix a merge bug.
* Fix two small bugs.
* fix some bugs.
* Fix some format bugs.
* Restore a file.
* Fix a format bug.
* draft renew of evaluators
* fix a small bug.
* fix a small bug
* Support Factor Report Loop
* Update framework for extracting factors from research reports.
* Refactor report-based factor extraction and fix minor bugs.
* fix a small bug of log.
* change some prompts
* improve factor_runner
* fix a small bug
* change some prompts
* cancel some comments
* cancel some comments and fix some bugs
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: Suhan Cui <51844791+SH-Src@users.noreply.github.com>
* Init todo
* Evaluation & dataset
* Generate new data
* dataset generation
* add the result
* Analysis
* Factor update
* Updates
* Reformat analysis.py
* CI fix
* Further Optimised Model Workflow by Incorporating Feedbacks on Exp Task Card
* Rebasing To build the extraction & implementation demo
* Revised for clean code
* Revised further to show "Knowledge"
* Revised to make model_research_copilot better
* Further Optimised Model Workflow by Incorporating Feedbacks on Exp Task Card
* Rebasing To build the extraction & implementation demo
* Revised for clean code
* Revised further to show "Knowledge"
* Revised to make model_research_copilot better
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: cyncyw <47289405+taozhiwang@users.noreply.github.com>
* fix mypy error
* fix mypy error
* fix ruff error
* change command
* delete python 3.8&3.9 from CI
* change command
* Some modifications according to the comments
* Add literal type
* Update .github/workflows/ci.yml
* Some modifications according to the comments
* fix ruff error
* fix meta dict
* Fix type
* Some modifications according to the comments
* merge latest code
* Some modifications according to the comments
* Some modifications according to the comments
* fix ci error
* fix ruff error
* Update Makefile
* Update Makefile
---------
Co-authored-by: Ubuntu <debug@debug.qjtqi00gqezu1eqs55bqdrf51f.px.internal.cloudapp.net>
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
- Performed further optimizations on the factor loop and report extraction loop.
- Added log handling for both processes.
- Implemented a screenshot feature for report extraction.
you-n-g