Commit Graph

65 Commits

Author SHA1 Message Date
Xu Yang be2c19307e first version of model runner and model feedback (#70)
* Implemented model.py

- Need to run within the RDAgent folder (relevant path)
- Each time copy a template & insert code & run qlib & store result back to experiment

* Create model.py

* Create conf.yaml

This is the sample conf.yaml to be copied each time.

This has gone several times of iteration and is now working for both tabular and Time-Series data.

* Create read_exp.py

This is to read the results within Qlib

* Create ReadMe.md

* Update model.py

* Create test_model.py

A testing file that separates model code generation and running&feedback section.

* move the template folder

* help xisen finish the model runner

* help xisen fix improve model feedback generation

* delete debug file

* rename readme.md

---------

Co-authored-by: Xisen Wang <118058822+Xisen-Wang@users.noreply.github.com>
2024-07-16 10:33:53 +08:00
Linlang 947e52bacd create_docs_framework (#66)
* Init from quick start

* optimize docs config

* add image

* optimize docs config

* complement file

* drop comments

* add ci

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-07-15 20:17:12 +08:00
WinstonLiyt 6c5549715c Merge pull request #65 from microsoft/ytli_update
Completed and integrated the entire factor process
2024-07-15 18:58:30 +08:00
WinstonLiyt 77560b4a91 Fix a bug. 2024-07-15 10:31:57 +00:00
Xu Yang 93362ba747 enable debug data and all data in config 2024-07-15 10:23:32 +00:00
Xu Yang ef0dc083a8 Merge branch 'main' into ytli_update 2024-07-15 10:12:32 +00:00
Xu Yang b63c7804ef add a comment for GPU support 2024-07-15 10:08:20 +00:00
Xu Yang bc758a67df fix a small bug 2024-07-15 09:40:40 +00:00
Xisen Wang 8b286a760e Merge pull request #68 from microsoft/update-feedback
Model Feedback Implementation Done | Future Todo: Redesign Prompts & Reformat, Rethink get_last_experiment_info, Raise Errors
2024-07-15 17:20:59 +08:00
Xisen Wang 0e3448119a Update feedback.py
- Deleted one printing
2024-07-15 17:20:04 +08:00
Xu Yang 1854c25fb4 remove useless print command 2024-07-15 08:31:27 +00:00
Xu Yang 09825315d1 remove the new test file 2024-07-15 08:30:21 +00:00
Xu Yang 1ed2f655b9 help yuante on the final version of data code 2024-07-15 08:28:34 +00:00
you-n-g cd49661708 Update rdagent/core/proposal.py 2024-07-15 11:58:41 +08:00
you-n-g 02a4696a80 Update rdagent/scenarios/qlib/task_generator/feedback.py 2024-07-15 11:58:36 +08:00
Xisen Wang 0b6172dd43 Updated Trace class
- Updated get_last_experiment_info(), a very useful function that returns the information of last experiment (to be used in feedback generation).
2024-07-15 11:41:22 +08:00
Xisen Wang 32ab23e58a Update QlibModelHypothesisExperiment2Feedback Class
- Implemented generateFeedback()
- Tested to be working
- Added conditional prompts to deal with "1st generation"
- Requires Trace class to have get_last_experiment_info
- Future Todo: Revise Prompts & Turn into YAML
2024-07-15 11:40:09 +08:00
WinstonLiyt 57ae5c93ea Upload the configuration file for running Docker. 2024-07-12 05:32:00 +00:00
WinstonLiyt 1c9256f434 Switch from local_env to Docker for running Qlib 2024-07-12 03:30:25 +00:00
WinstonLiyt 2bd2ad3896 String together the entire factor process 2024-07-11 11:24:41 +00:00
Xu Yang d29a57692b Fix a bug when proposing model ideas using factor as key words (#63) 2024-07-11 18:02:51 +08:00
WinstonLiyt 4e0fae2f04 fix based_experiments bug 2024-07-11 09:06:52 +00:00
WinstonLiyt bf1b140f68 re-commit 2024-07-11 08:49:37 +00:00
Linlang 29184aff9b fix pytest localenv error (#62) 2024-07-11 12:13:42 +08:00
Xu Yang b1ddba388a model proposal first version (#61)
* init code

* first version of model proposal
2024-07-11 10:50:34 +08:00
Xu Yang 720994c8e0 Implement model (and some factor) coder with evolving (#52)
* store code into FBImplementation

* fix path related bugs

* fix a bug

* fix factor related small bugs

* re-submit all model related code

* new code to model coder

* finish the model evolving code

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-10 15:45:43 +08:00
Linlang 828a624238 Add template for reading experiment (#48)
* Add template for reading experiment

* add code

* read latest exp

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-07-09 20:49:51 +08:00
Xisen Wang 7350d9aa1f refine core to store experiment results and hypothesis feedback (#55)
* Update proposal.py

Completed The HypothesisFeedback Class.

* refine the core code

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-09 17:31:35 +08:00
Linlang 541c1ff990 Support LocalEnv (#53)
* Support LocalEnv

* resolve issues

* resolve issues

* resolve issues

* resolve issues

* resolve issues

* resolve issues
2024-07-09 12:45:32 +08:00
Xisen Wang d9926a6f72 Merge pull request #49 from microsoft/update
Update Experiment2Feedback interface
2024-07-08 11:01:56 +08:00
Xisen Wang 91663e268d Update proposal.py
Updated class name & description.
2024-07-05 21:06:36 +08:00
Xisen Wang 86a60b641e Update proposal.py
Updated the summarize function to include more inputs
2024-07-05 18:14:48 +08:00
Xu Yang 1d9b4cd2ec Align factor coder into new framework (#47)
* use CoSTEER as component name

* rename factorimplementation to avoid confusion

* rename modelimplementation

* align benchmark and evolving evaluators

* add scenario to evaluator init function

* rename all factorimplementationknowledge in CoSTEER

* remove all scenario related information in component

* remove useless code

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-05 17:42:00 +08:00
Xu Yang f61453fbb1 First version of factor idea proposal (#46)
* update all code

* save code

* update first version of factor proposal

* change a comment

* remove a useless comment

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-04 15:56:14 +08:00
Xu Yang d88ddc0c1c Build model class inheritance (#44)
* update all code

* fix a typo

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-03 17:42:07 +08:00
XianBW ab2f61fe9d adjust new core classes for CI (#43)
* add README for CI tool
* adjust new core classes for CI
2024-07-03 16:34:47 +08:00
Linlang 833e7ce1b9 Initial framework for docker env (#40)
* Initial framework for docker env

* Update test name

* add features

* Download Qlib data with extra_volume

* fix pytest error

* Fix the parameters

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-07-03 04:54:24 +08:00
Xu Yang 1b31bcd2c2 refine class design and inheritance first version code (#41)
* refine class design and inheritance first version code

* fix all typos

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-07-02 17:58:37 +08:00
Xinjie Shen 0faf232b81 Fix missing image path in Readme (#37) 2024-07-02 09:27:43 +08:00
you-n-g a6f03d18b1 Support managed_identity_client_id for DefaultAzureCredential (#39) 2024-07-01 14:24:47 +08:00
Xinjie Shen b2fb104108 Pdf2 model task (#33)
* add needed dependency

* add extract_model_and_implement pipeline

* add merge_file_to_model_dict_to_model_dict

* implement `rdagent\app\model_implementation\eval.py`

* Running benchmark

* refine import

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-06-30 23:31:00 +08:00
Xu Yang 6b626eb56d New Framework for idea proposal and implementation on RD-Agent (#34)
* Commit init framework

* Co-authored-by: Yuante Li (FESCO Adecco Human Resources) <v-yuanteli@microsoft.com>
Co-authored-by: XianBW <XianBW@users.noreply.github.com>

* add an import

* refine the whole framework

* benchmark related framework

* fix black and isort errors

* move requirements to folder

* fix black again

---------

Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-28 11:45:23 +08:00
you-n-g bc8d96e96c Fix model bug and push (#35) 2024-06-27 18:15:31 +08:00
Young f25ef70c98 Update README 2024-06-27 10:13:22 +00:00
Haoxue 07a77dd802 Eval process (#31)
* test data load process and fix bug

* fix bug when evaluating

* refine json content

---------

Co-authored-by: USTCKevinF <fengwenjun@mail.ustc.edu.cn>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-27 16:39:17 +08:00
Xinjie Shen f20dc4482b example workflow code for model implementation (#17)
* upload example code for model implementation

* Refactor Model Implement

* add export

---------

Co-authored-by: Young <afe.young@gmail.com>
2024-06-21 16:41:34 +08:00
Xu Yang a126c84c92 Refine all the implementation code to higher quality for release (#29)
* refine CI script

* refine all the code to higher quality

* refine the script to factor extraction and implementation

* add task loader interface

* add a task loader interface && move pdf analysis to pdf task loader

* change the name to global variables

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-18 11:50:03 +08:00
USTCKevinF ebb659a018 reporeformat V2 (#23)
* reformat factor implement process

* move some code to more reasonable place

* fix the bug

* add test function in factor_extract_and_implement.py

* change select factor number to ratio , add some factor implement setting and fix some bug while using knowledgebase

* change evoagent

* add abstract class EvoAgent

* add benchmark workflow

* fix some bug in llm_utils

* run wenjun's code

* fix the knowledgebase instance check

---------

Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-14 12:59:44 +08:00
Xu Yang 9e82da243b use token limit to shrink report content (#24)
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
2024-06-13 16:20:54 +08:00
XianBW 55959c93ff Ci fix (#22)
* fix replace function of CI tool

* fix ruff errors (ignore some parts)

* add ruff rule ignore comment
2024-06-12 15:12:11 +08:00