* use CoSTEER as component name
* rename factorimplementation to avoid confusion
* rename modelimplementation
* align benchmark and evolving evaluators
* add scenario to evaluator init function
* rename all factorimplementationknowledge in CoSTEER
* remove all scenario related information in component
* remove useless code
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* Commit init framework
* Co-authored-by: Yuante Li (FESCO Adecco Human Resources) <v-yuanteli@microsoft.com>
Co-authored-by: XianBW <XianBW@users.noreply.github.com>
* add an import
* refine the whole framework
* benchmark related framework
* fix black and isort errors
* move requirements to folder
* fix black again
---------
Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* refine CI script
* refine all the code to higher quality
* refine the script to factor extraction and implementation
* add task loader interface
* add a task loader interface && move pdf analysis to pdf task loader
* change the name to global variables
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
* reformat factor implement process
* move some code to more reasonable place
* fix the bug
* add test function in factor_extract_and_implement.py
* change select factor number to ratio , add some factor implement setting and fix some bug while using knowledgebase
* change evoagent
* add abstract class EvoAgent
* add benchmark workflow
* fix some bug in llm_utils
* run wenjun's code
* fix the knowledgebase instance check
---------
Co-authored-by: xuyang1 <xuyang1@microsoft.com>
Xu Yang