* Commit init framework
* Co-authored-by: Yuante Li (FESCO Adecco Human Resources) <v-yuanteli@microsoft.com>
Co-authored-by: XianBW <XianBW@users.noreply.github.com>
* add an import
* refine the whole framework
* benchmark related framework
* fix black and isort errors
* move requirements to folder
* fix black again
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* test data load process and fix bug
* fix bug when evaluating
* refine json content
---------
Co-authored-by: USTCKevinF <fengwenjun@mail.ustc.edu.cn>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* refine CI script
* refine all the code to higher quality
* refine the script to factor extraction and implementation
* add task loader interface
* add a task loader interface && move pdf analysis to pdf task loader
* change the name to global variables
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* reformat factor implement process
* move some code to more reasonable place
* fix the bug
* add test function in factor_extract_and_implement.py
* change select factor number to ratio , add some factor implement setting and fix some bug while using knowledgebase
* change evoagent
* add abstract class EvoAgent
* add benchmark workflow
* fix some bug in llm_utils
* run wenjun's code
* fix the knowledgebase instance check
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* adjust interact and log for CI fix tool
* change method to split large code files
* refine statistics table after fixing one file
* process default --fix option when ruff check
* remove hardcode path
* add tree-sitter requirements
* replace <| |> to < > in comments, for GPT
* update mypy version
* Add Mypy Evaluator
Xu Yang