* remove AttributeError caused by select_threshold
* develop with ground truth
* raise exception for eval_case
* Revert "develop with ground truth"
This reverts commit e68c136588685476f32a3c3696a6a33deb47acc5.
* Modify FactorRowCountEvaluator and FactorIndexEvaluator to return the ratio
* reformatted by black
* Set the threshold for FactorIndexEvaluator to 0.99
* Apply suggestions from code review
* Update rdagent/components/coder/factor_coder/CoSTEER/evaluators.py
* geometric mean for format_succ_rate
* no need to check when similarity is high enough
* black reformat
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
* Search enhancement
* refactor: reorganize imports for consistency with isort
* reformatterd by black
---------
Co-authored-by: Tim <illking@foxmail.com>
* init a scenario for kaggle feature engineering
* fix some bugs and add original features' description
* refine the process of data downloading
* fix a error
* revert the code
* fix a bug in feedback
* fix a ci bug
* fix a ci bug
* Init todo
* Evaluation & dataset
* Generate new data
* dataset generation
* add the result
* Analysis
* Factor update
* Updates
* Reformat analysis.py
* CI fix
* Revised Preprocessing & Supported Random Forest
* Revised to support three models with feature
* Further revised prompts
* Slight Revision
* docs: update contributors (#230)
* Revised to support three models with feature
* Further revised prompts
* Slight Revision
* feat: kaggle model and feature (#238)
* update first version code
* make hypothesis_gen and experiment_builder fit for both feature and model
* feat: continue kaggle feature and model coder (#239)
* use qlib docker to run qlib models
* feature coder ready
* model coder ready
* fix CI
* finish the first round of runner (#240)
* Optimized the factor scenario and added the front-end.
* fix a small bug
* fix a typo
* update the kaggle scenario
* delete model_template folder
* use experiment to run data preprocess script
* add source data to scenarios
* minor fix
* minor bug fix
* train.py debug
* fixed a bug in train.py and added some TODOs
* For Debugging
* fix two small bugs in based_exp
* fix some bugs
* update preprocess
* fix a bug in preprocess
* fix a bug in train.py
* reformat
* Follow-up
* fix a bug in train.py
* fix a bug in workspace
* fix a bug in feature duplication
* fix a bug in feedback
* fix a bug in preprocessed data
* fix a bug om feature engineering
* fix a ci error
* Debugged & Connected
* Fixed error on feedback & added other fixes
* fix CI errors
* fix a CI bug
* fix: fix_dotenv_error (#257)
* fix_dotenv_error
* format with isort
* Update rdagent/app/cli.py
---------
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
* chore(main): release 0.2.1 (#249)
Release-As: 0.2.1
* init a scenario for kaggle feature engineering
* delete error codes
* Delete rdagent/app/kaggle_feature/conf.py
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: cyncyw <47289405+taozhiwang@users.noreply.github.com>
Co-authored-by: Xisen-Wang <xisen_application@163.com>
Co-authored-by: Haotian Chen <113661982+Hytn@users.noreply.github.com>
Co-authored-by: WinstonLiye <1957922024@qq.com>
Co-authored-by: WinstonLiyt <104308117+WinstonLiyt@users.noreply.github.com>
Co-authored-by: Linlang <30293408+SunsetWolf@users.noreply.github.com>
* Init todo
* update all code
* update
* Extract factors from financial reports loop finished
* Fix two small bugs.
* Delete rdagent/app/qlib_rd_loop/run_script.sh
* Minor mod
* Delete rdagent/app/qlib_rd_loop/nohup.out
* Fix a small bug in file reading.
* some updates
* Update the detailed process and prompt of factor loop.
* Evaluation & dataset
* Optimize the prompt for generating hypotheses and feedback in the factor loop.
* Generate new data
* dataset generation
* Performed further optimizations on the factor loop and report extraction loop, added log handling for both processes, and implemented a screenshot feature for report extraction.
* Update rdagent/components/coder/factor_coder/CoSTEER/evaluators.py
* Update package.txt for fitz.
* add the result
* Performed further optimizations on the factor loop and report extraction loop, added log handling for both processes, and implemented a screenshot feature for report extraction. (#100) (#102)
- Performed further optimizations on the factor loop and report extraction loop.
- Added log handling for both processes.
- Implemented a screenshot feature for report extraction.
* Analysis
* Optimized log output.
* Factor update
* A draft of the "Quick Start" section for README
* Add scenario descriptions.
* Updates
* Adjust content
* Enable logging of backtesting in Qlib and store rich-text descriptions in Trace. Support one-step debugging for factor extraction.
* Reformat analysis.py
* CI fix
* Refactor
* remove useless code
* fix bugs (#111)
* Fix two small bugs.
* Fix a merge bug.
* Fix two small bugs.
* fix some bugs.
* Fix some format bugs.
* Restore a file.
* Fix a format bug.
* draft renew of evaluators
* fix a small bug.
* fix a small bug
* Support Factor Report Loop
* Update framework for extracting factors from research reports.
* Refactor report-based factor extraction and fix minor bugs.
* fix a small bug of log.
* change some prompts
* improve factor_runner
* fix a small bug
* change some prompts
* cancel some comments
* cancel some comments and fix some bugs
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
Co-authored-by: Taozhi Wang <taozhi.mark.wang@gmail.com>
Co-authored-by: Suhan Cui <51844791+SH-Src@users.noreply.github.com>
* fix mypy error
* fix mypy error
* fix ruff error
* change command
* delete python 3.8&3.9 from CI
* change command
* Some modifications according to the comments
* Add literal type
* Update .github/workflows/ci.yml
* Some modifications according to the comments
* fix ruff error
* fix meta dict
* Fix type
* Some modifications according to the comments
* merge latest code
* Some modifications according to the comments
* Some modifications according to the comments
* fix ci error
* fix ruff error
* Update Makefile
* Update Makefile
---------
Co-authored-by: Ubuntu <debug@debug.qjtqi00gqezu1eqs55bqdrf51f.px.internal.cloudapp.net>
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
- Performed further optimizations on the factor loop and report extraction loop.
- Added log handling for both processes.
- Implemented a screenshot feature for report extraction.
* ignore result csv file
* fix app scripts
* rename taskgenerator to developer and generate to develop
* fix a config bug in coder
* fix a small bug in factor coder evaluators
* remove a single logger in factor coder evaluators
* fix a small bug in model coder main.py
* rename Implementation to Workspace
* move the prepare the inject_code into FBWorkspace to align all the behavior
* fix a small bug in model feedback
* remove debug lines for multi processing and simplify evaluators multi proc
* add a copy function to workspace to freeze the workspace && add config prefix to speed up debugging
* make hypothesisgen a abc class
* use Qlib***Experiment
* fix a small bug
* rename Imp to Ws
* rename sub_implementations to sub_workspace_list
* fix a bug in feedback not presented as content in prompts
* move proposal pys to proposal folder
* reformat the folder
* align factor and model qlib workspace and use template to handle the workspace
* add a filter to evoagent to filter out false evo
* align multi_proc_n into RDAGENT seeting
* handle when runner gets empty experiment
* fix logger merge remaining problems
* fix black and isort automatically
* remove ruff comment in log.py
* change log framework and fix llm_utils.py's logs
* Some thoughts for logging
* fix SingletonMeta's definition, maintain an instance dict for each class that inherits it
* adjust log codes directory, add some tag for factor implementation logging
* Update rdagent/core/conf.py
* fix factor task app & log
* fix log import
* Streamlet framework
* fix log tag to path logic
* Add todos
* Add example in docstring
* add log tag for llm_utils.py
* Capture lost content
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
* store code into FBImplementation
* fix path related bugs
* fix a bug
* fix factor related small bugs
* re-submit all model related code
* new code to model coder
* finish the model evolving code
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
you-n-g