cbbbb4e9a5
fix: unzip kaggle data ( #464 )
...
* unzip kaggle data
* read local_data_path from .env file
* fix build docs error
* recover azure-identity packages
* optimize code logic
* add error when downloading data from kaggle
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2024-11-04 14:57:10 +08:00
450317d8fe
fix a bug in kaggle runner cache and kaggle costeer execute template ( #467 )
2024-11-04 11:16:16 +08:00
09325aed89
feat: refine logic for qlib_factor_from_report ( #463 )
...
* fix a bug in kaggle conf
* fix a ci error
* refine logic for qlib_factor_from_report
2024-10-31 16:04:32 +08:00
2c206e9ce5
docs: some changes in kaggle doc ( #461 )
...
* add kaggle scenario description for webapp
* catch download button error
* change kaggle auto_submit to False default
* Added guidance for custom templates in kaggle doc
* CI
* CI
* add kaggle data set instruction(NOTE)
* delete repeated description for kaggle scenario
---------
Co-authored-by: TPLin22 <tplin2@163.com >
2024-10-30 17:00:56 +08:00
80e4a2aa79
fix: fix a bug in kaggle conf ( #459 )
...
* fix a bug in kaggle conf
* fix a ci error
2024-10-29 15:13:18 +08:00
62beb3a7ae
fix: templates bug ( #456 )
...
* Update model_nn.py
* ci issue
2024-10-28 14:22:04 +08:00
6fe0d75b38
chore: remove package ( #449 )
...
* remove package
* reformat with black
* fix pytest error
* fix pytest error
* fix pytest error
* add packages
* change code
2024-10-24 20:38:13 +08:00
c379b9221a
feat: independent use_azure_token_provider on chat and embedding ( #452 )
...
* independent use_azure_token_provider
* fix CI
* fix doc format
2024-10-23 18:22:58 +08:00
effce1df15
always return str ( #453 )
2024-10-23 16:47:36 +08:00
d57477aefa
fix KGFactorRunner cache system bug ( #451 )
2024-10-23 15:17:38 +08:00
972d8602c2
docs: add documentation for kaggle scen ( #448 )
...
* init for bg & quickstart for kaggle docs
* Add documentation for the environment configuration in the Kaggle scenario.
* add some descriptions in documents
* remove useless docs
* ci issue
---------
Co-authored-by: TPLin22 <tplin2@163.com >
2024-10-23 13:26:57 +08:00
d3c59b2f33
chore: remove torch in main code ( #439 )
...
* use np.ndarray in costeer model evaluators
* remove package
* fix test error
---------
Co-authored-by: Xu Yang <peteryang@vip.qq.com >
2024-10-21 15:56:04 +08:00
2161956315
chore: move use_auto_chat_cache_seed_gen and init_chat_cache_seed to LLMSett… ( #444 )
...
* move use_auto_chat_cache_seed_gen and init_chat_cache_seed to LLMSettings
* remove RD_AGENT_SETTINGS in llm_utils.py
2024-10-21 12:03:59 +08:00
46d8247697
feat: use auto gen seed when using LLM cache ( #441 )
...
* initial version
* test requirements
* fix bugs
* fix bugs
* add annotation
* fix ruff error
* fix CI
* fix CI
* fix CI
* fix CI
* change random usage
* move cache_seed_gen to core/utils.py
* fix CI
* change cache_seed_gen name
---------
Co-authored-by: Young <afe.young@gmail.com >
2024-10-21 11:32:20 +08:00
8d88dbec33
fix display bug in webapp ( #440 )
2024-10-18 17:07:25 +08:00
254c8f9a49
fix problem of reading log file tags on Windows ( #437 )
...
Co-authored-by: Bowen Xian (Shanghai Wicresoft Co Ltd) <v-bxian@microsoft.com >
2024-10-17 20:22:39 +08:00
b2de6f3190
add inf evaluator to factor costeer and some minor improvement ( #435 )
2024-10-16 16:00:55 +08:00
61189fbe73
number of subprocesses <= number of tasks ( #434 )
2024-10-16 14:13:20 +08:00
4fff3370bd
feat: supporting various Kaggle competitions & scenarios for RD-Agent ( #409 )
...
* Fixes on kaggle output
* feat: add kaggle s3e14 template (#394 )
* add s3e14 template
* fix CI
* Initialisation of a template of competition
* add kaggle s3e16 template (#396 )
* get kaggle competition scores (#397 )
* Adding a new competition s4e6
* feat: s4e5 (#400 )
* init for s4e5
* edit s4e5
* ci issue
* feat: S4e3 (#402 )
* Initialisation of a template of competition
* Adding a new competition s4e6
* Competition Initialised
* Fixed to make sure that now it runs
* Fixing for CI
* correct evaluation (#403 )
* find rank in leaderboard (#405 )
* fix: model templates for KG scenario (#408 )
* fix feature selection for some models
* feat select template
* Updating the prompts for a more powerful model tuning
* refine the prompt
* fix: template error in s4e6
* feat: show simple execution time in demo (#410 )
* show time in kaggle demo
* change color
* fix a small bug
* edit loop.py and proposal
* delete useless files
* CI issues
* ci issue
---------
Co-authored-by: XianBW <36835909+XianBW@users.noreply.github.com >
Co-authored-by: Haoran Pan <167847254+TPLin22@users.noreply.github.com >
Co-authored-by: Way2Learn <118058822+Xisen-Wang@users.noreply.github.com >
Co-authored-by: WinstonLiyt <1957922024@qq.com >
Co-authored-by: TPLin22 <tplin2@163.com >
2024-10-15 13:06:36 +08:00
022a558dd1
chore: more optional parameters for running benchmark analysis ( #431 )
...
* set title and round
* decision from multiple types
* check if decision is true
* reformat
* remove unused file
2024-10-15 12:41:32 +08:00
5988683cd9
force use_chat_cache False when facing error in evaluators ( #432 )
2024-10-15 12:21:33 +08:00
ef373e1632
fix: fix cache result logic ( #430 )
...
* make cache logic more tidy
* update WeChat QR code
2024-10-14 19:35:21 +08:00
a8e4e6b4ae
fix: fix a small bug in cache using module name and function name as unique folder name ( #429 )
2024-10-14 17:53:04 +08:00
216719670d
convert str to bool ( #428 )
2024-10-14 17:44:33 +08:00
25472fc1e3
feat: use unified pickle cacher & move llm config into a isolated config ( #424 )
...
* simplify RDAgent conf
* add unified cacher(untested)
* fix small bugs
* fix a bug
* fix a small bug in runner
* use hash_key = None to skip cache
* fix CI
* in factor execution, ignore cache when raise exception
* add file locker to avoid mp calling
* fix CI
* use function __module__ name as folder in cache
2024-10-14 17:34:09 +08:00
f808c35c34
auto select content element in kaggle crawler now ( #423 )
2024-10-11 22:34:12 +08:00
f1a841ba14
perf: some small upgrade to factor costeer to improve the performance ( #420 )
...
* 1. use dataframe.info instead of head
2. in former trace query, add the latest attempt to the last success execution
* fix CI
2024-10-10 20:29:17 +08:00
a1507aa7ab
fix: fix json load error ( #386 )
...
* fix json load error
* fix os.symlink error
* reformat with black
* fix os.symlink error
* reformat with isort
2024-10-10 11:58:15 +08:00
f2a5967c12
improve factor costeer: ( #417 )
...
1. when facing odd v2_query_component_limit, make from gt bigger than without gt
2. do code evaluator even value does not pass
3. provide the value header to value failed evaluators
2024-10-09 18:56:37 +08:00
b3f1a10000
use main thread to get embedding to speed up cache ( #415 )
2024-10-08 19:34:19 +08:00
a211facf79
refactor: refine util ( #413 )
...
* refine util
* lint
2024-10-08 02:07:20 +08:00
b8a931d0f5
fix: fix a bug in competition metric evaluation ( #407 )
...
* fix a bug in competition metric evaluation
* fix a bug
* fix a bug in rag loading
2024-09-30 14:54:56 +08:00
858857a921
fix: refine the ucb algorithm ( #406 )
...
* refine the ucb algorithm
* fix a ci error
2024-09-30 12:30:42 +08:00
8ec00a5120
feat: Add ranking in kaggle scenario ( #401 )
...
* fix some bugs in rag
* add ranking in kaggle scenario
* fix two mistouches
* fix two bugs
* fix a bug
2024-09-30 04:15:07 +08:00
59cdf946a7
fix: fix some bugs in rag ( #399 )
...
* fix some bugs in rag
* fix a bug in costeer
2024-09-30 02:38:33 +08:00
48c5dbfd4d
chore: update web.py ( #395 )
...
seperate -> separate
2024-09-30 01:36:26 +08:00
455e73858e
fix bug in feature selection ( #398 )
2024-09-30 01:21:45 +08:00
7fc53940fd
feat: Dynamic scenario based on task ( #392 )
...
* OAI api
* more comments
* llm utils
* RD-Framework for dynamic scen
* remove useless code
* auto lint
* fix dynamic scennario
* Add parameter
* auto lint
* remove abstractmethod
* fix lint
2024-09-29 18:43:17 +08:00
1f9ae1af2e
feat: Revise to support better hypothesis proposal ( #390 )
...
* Revising for feedback
* Revised for better hypothesis proposal
* revise for CI
* typo-fix
2024-09-29 16:18:18 +08:00
a32cfcc116
fix: fix a bug in mini case ( #389 )
...
* fix: fix a bug in mini case
* fix a bug
2024-09-29 15:51:51 +08:00
3c80325aad
fix: fix a bug in scenario.py ( #388 )
...
* fix: fix a bug in scenario.py
* Update scenario.py
2024-09-29 14:46:00 +08:00
5cdffe3510
fix: debug dsagent ( #387 )
...
* basic dsagent & debug
debug dsagent
change dsagent conf
* Refine changes
* Update vector_base.py
2024-09-29 01:15:33 -04:00
7b865c3337
fix: cache ( #383 )
...
* fix: cache
* update cache
* fix
* Fix lint
2024-09-29 12:07:36 +08:00
5a2744069c
fix: rag save file ( #385 )
...
* debug vector base
2024-09-28 23:43:11 -04:00
4f8a9aca40
convert covid workspace to merged.py for submission ( #384 )
2024-09-29 11:29:40 +08:00
346261c1ac
fix: partial bug in bench ( #368 )
...
* Add more log
* Fix eval
* update
* keep ratio <= 1
* feat: cache exception (#369 )
* 0 instead of NaN
* remove unused evaluators
* save gen_factor_l_all_rounds
* black reformat
* cache exception
---------
Co-authored-by: Tim <illking@foxmail.com >
2024-09-29 09:59:54 +08:00
3ea9d6744e
debug vector base ( #380 )
2024-09-28 17:58:51 -04:00
1e710ebeb6
Quick fixes for logging ( #379 )
2024-09-29 01:36:57 +08:00
f4c09c29a1
fix: fix some bugs in knowledge base ( #378 )
...
* fix a bug in dig_recognizer
* fix some bug in rag
* fix a ci error
2024-09-29 00:23:38 +08:00
7642adc703
fix two template ( #376 )
2024-09-28 06:12:06 +08:00
Linlang