Commit Graph

113 Commits

Author SHA1 Message Date
you-n-g 5fca696be8 Agent Infra (#107)
* Agent Infra

* Update test/utils/test_agent_infra.py
2024-07-25 11:15:22 +08:00
Xisen Wang fd2efcd47f Merge pull request #106 from microsoft/Continous-Update-Branch
Further Optimised Workflow, Enabled Graph Input, Stored rich-text-description, Logged Back-Testing, Enabled Concise_Hypothesis
2024-07-25 11:01:04 +08:00
Xisen Wang 26565d6dab Merge branch 'main' into Continous-Update-Branch 2024-07-25 11:00:55 +08:00
Xisen Wang a2734fd34a Update model_extraction_and_implementation.py 2024-07-24 19:36:37 +08:00
Xisen Wang 0af2ca8211 Update model_extraction_and_implementation.py 2024-07-24 19:36:15 +08:00
Xisen-Wang 25b5160185 Unified ModelTask structure 2024-07-24 11:33:04 +00:00
Xisen-Wang 0821fd4b8d Revised to enable logging of backtesting in Qlib & storing of rich-text-description in Trace 2024-07-24 10:26:06 +00:00
WinstonLiyt e11e175309 Remove an absolute path.
Remove an absolute path.
2024-07-24 18:20:15 +08:00
Xisen-Wang b6c958b16c Revised relevant code to enable graph input 2024-07-24 09:14:20 +00:00
WinstonLiyt 2b7837b774 Optimized log output. (#104)
Optimized log output.
2024-07-24 17:06:52 +08:00
you-n-g 2d4e9c41fc Data mining (#103)
* scen

* scen2

* app

* fix

* Simplify workflow

* We can share more code in new scenarios

* rename model to rd loop

* Optimize data path

* Update rdagent/app/data_mining/model.py

* Add TODO

* Support GPU

* gpu

---------

Co-authored-by: SH-Src <suhan.c@outlook.com>
2024-07-24 16:56:27 +08:00
WinstonLiyt 8500eba02a Performed further optimizations on the factor loop and report extraction loop, added log handling for both processes, and implemented a screenshot feature for report extraction. (#100)
- Performed further optimizations on the factor loop and report extraction loop.
- Added log handling for both processes.
- Implemented a screenshot feature for report extraction.
2024-07-24 12:15:56 +08:00
Xisen-Wang b4b53ee6f7 Further Revision on Prompts 2024-07-23 12:01:52 +00:00
you-n-g 2192ec1b1f Support run one step for debugging (#99) 2024-07-23 19:00:59 +08:00
Xisen Wang a11e2eb497 Merge pull request #97 from microsoft/recover-branch-xisen-3
Further Optimisation For Model
2024-07-23 17:19:17 +08:00
you-n-g f75b5d3ef5 Workflow Support Loading and saving sessions (#98)
* Successfully logging the trace

* Start debugging & Add policy file

* Support loading sessions

* Add docs

* Add tqdm
2024-07-23 16:37:41 +08:00
bowen xian b219909135 process None in list when demo 2024-07-23 07:57:46 +00:00
XianBW a485715156 Demo adjustment (#95)
add model trace and trace obj demo
2024-07-23 14:48:14 +08:00
Xisen-Wang 4596388814 Further Optimised Kwargs & Confs 2024-07-23 06:32:26 +00:00
WinstonLiyt a7e433cc21 Update the detailed process and prompt of factor loop. (#96)
Update the detailed process and prompt of factor loop.
2024-07-22 18:18:08 +08:00
WinstonLiyt 0daa7e064b Fix a small bug in file reading. 2024-07-22 14:40:14 +08:00
XianBW a27b44fbbc Demo with some base windows (#88)
* add TabsWindow, LLMWindow

* add TraceWindow logics

* fix annotation for TabsWindow __init__

* add factor tasks table

* finish base qlib factor tasks trace

* add readme for webview ui
2024-07-22 12:58:09 +08:00
you-n-g 15dbdb68d5 Document in High-level (#93)
* Add init information

* Adjust order and move content

* GPU support

* edit docs

* README structure

* Update Dockerfile

* Update rdagent/utils/env.py

* Update read the docs

* Update framework
2024-07-22 12:49:03 +08:00
WinstonLiyt 444a773259 Extract factors from financial reports loop finished. (#90)
- Extract factors from financial reports loop finished.

- Fix some small bugs.
2024-07-20 12:31:40 +08:00
Young b3c57d9881 Fix import bug 2024-07-19 09:20:27 +00:00
Xisen-Wang 294579b941 Revised Prompts Again For Feedback 2024-07-19 09:09:17 +00:00
you-n-g 8e737befc2 Docker gpu fix (#89)
* GPU support

* check gpu

* get gpu kwargs based on its availability
2024-07-19 16:20:07 +08:00
you-n-g 5b20c146bd Update Dockerfile (#87) 2024-07-19 15:25:30 +08:00
Xisen Wang 26db33c75f Merge pull request #86 from microsoft/recover-branch-xisen-3
Model Optimisation Update 

After optimization, the rd agent loop for model in the qlib scenario should now work.
2024-07-19 15:05:24 +08:00
Xisen Wang 73adf51fef Update prompts.yaml
- Fixed a typo
2024-07-19 15:03:59 +08:00
Xisen Wang 6adb9faff9 Update Dockerfile 2024-07-19 14:59:45 +08:00
XianBW 670f8ffebd demo (#80)
save logs and load it.

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-07-19 14:16:54 +08:00
Linlang ae2aa6e9b4 Fix ruff error1 (#81)
* fix_ruff_error1

* fix_ruff_error

* fix ruff error

* fix ruff error

* pass model.py

* rename exception class

* rename exception class

* rename func name generate_feedback

* remove prepare args

* optimize code

* optimize code

* fix code error
2024-07-18 22:36:04 +08:00
you-n-g 4b0ea172d2 Update rdagent/app/qlib_rd_loop/RDAgent.py 2024-07-18 18:33:31 +08:00
Xisen-Wang c75300e7cb Revised all prompts 2024-07-18 09:42:55 +00:00
Xisen-Wang 35bb3b7e4d Trying 2024-07-18 09:42:55 +00:00
Xu Yang 74bc047615 reject any implementation failed in one column and format check 2024-07-18 17:39:11 +08:00
Xu Yang 08eb29ca3b add_logger_to_factor_and_fix_a_small_bug_in_factor_runner (#85) 2024-07-18 17:00:41 +08:00
WinstonLiyt 9029c4c801 fix_some_errors_when_debug_factor (#84)
* update all code

* update
2024-07-18 15:01:07 +08:00
you-n-g 032cf32ce6 Fix Logger context bug. (#83) 2024-07-17 18:07:30 +08:00
Xu Yang 9e2d6f3fdb use json mode to extract factors since gpt-4o has no json bug (#82) 2024-07-17 17:51:31 +08:00
you-n-g 1dbeebe6c4 Model run with logger (#79) 2024-07-17 17:29:39 +08:00
WinstonLiyt 79476a992e Fix two minor bugs related to factor extraction. 2024-07-17 07:45:51 +00:00
Xu Yang d5a6a08210 Several update on the repo (see desc) (#76)
* ignore result csv file

* fix app scripts

* rename taskgenerator to developer and generate to develop

* fix a config bug in coder

* fix a small bug in factor coder evaluators

* remove a single logger in factor coder evaluators

* fix a small bug in model coder main.py

* rename Implementation to Workspace

* move the prepare the inject_code into FBWorkspace to align all the behavior

* fix a small bug in model feedback

* remove debug lines for multi processing and simplify evaluators multi proc

* add a copy function to workspace to freeze the workspace && add config prefix to speed up debugging

* make hypothesisgen a abc class

* use Qlib***Experiment

* fix a small bug

* rename Imp to Ws

* rename sub_implementations to sub_workspace_list

* fix a bug in feedback not presented as content in prompts

* move proposal pys to proposal folder

* reformat the folder

* align factor and model qlib workspace and use template to handle the workspace

* add a filter to evoagent to filter out false evo

* align multi_proc_n into RDAGENT seeting

* handle when runner gets empty experiment

* fix logger merge remaining problems

* fix black and isort automatically
2024-07-17 15:00:13 +08:00
XianBW 9d7aa09f54 adjust logging system (#51)
* remove ruff comment in log.py

* change log framework and fix llm_utils.py's logs

* Some thoughts for logging

* fix SingletonMeta's definition, maintain an instance dict for each class that inherits it

* adjust log codes directory, add some tag for factor implementation logging

* Update rdagent/core/conf.py

* fix factor task app & log

* fix log import

* Streamlet framework

* fix log tag to path logic

* Add todos

* Add example in docstring

* add log tag for llm_utils.py

* Capture lost content

---------

Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2024-07-16 20:35:42 +08:00
WinstonLiyt 9b7d035b3f fix a small bug in evaluators.py 2024-07-16 15:47:04 +08:00
Xu Yang d36a316509 Reject the factor code if factor is not daily in COSTEER coder (#73)
* when not build from docker file we allow user not provide the dockerfile path

* Reject the factor code if factor is not daily in COSTEER coder
2024-07-16 11:37:38 +08:00
Xu Yang d70292959e when not build from docker file we allow user not provide the dockerfile path (#72) 2024-07-16 11:21:34 +08:00
Xu Yang c9346a9377 first version of model runner and model feedback (#70)
* Implemented model.py

- Need to run within the RDAgent folder (relevant path)
- Each time copy a template & insert code & run qlib & store result back to experiment

* Create model.py

* Create conf.yaml

This is the sample conf.yaml to be copied each time.

This has gone several times of iteration and is now working for both tabular and Time-Series data.

* Create read_exp.py

This is to read the results within Qlib

* Create ReadMe.md

* Update model.py

* Create test_model.py

A testing file that separates model code generation and running&feedback section.

* move the template folder

* help xisen finish the model runner

* help xisen fix improve model feedback generation

* delete debug file

* rename readme.md

---------

Co-authored-by: Xisen Wang <118058822+Xisen-Wang@users.noreply.github.com>
2024-07-16 10:33:53 +08:00
Linlang 87212b0310 create_docs_framework (#66)
* Init from quick start

* optimize docs config

* add image

* optimize docs config

* complement file

* drop comments

* add ci

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-07-15 20:17:12 +08:00