Commit Graph

945 Commits

Author SHA1 Message Date
amstrongzyf c8830f3f3d fix: jinja problem of enumerate (#1216) 2025-09-01 14:50:26 +08:00
XianBW 88a1b08b8c for ui, a simple fix (#1215) 2025-09-01 14:46:51 +08:00
you-n-g f0b7fa2466 fix: allow prev_out keys to be None in workspace cleanup assertion (#1214)
* fix: allow prev_out keys to be None in workspace cleanup assertion

* fix: clean workspace only for non-None DSExperiment instances
2025-08-30 07:27:12 +08:00
amstrongzyf 19eb7ae138 fix: add missing self parameter to instance methods in DSProposalV2ExpGen (#1213) 2025-08-30 00:45:55 +08:00
you-n-g ac31473bfc fix: handle None output and conditional step dump in LoopBase execution (#1212) 2025-08-29 20:19:09 +08:00
you-n-g fbc1beb927 fix: update fallback criterion (#1210)
* fix: update fallback criterion

* fix: ensure evo_fb is initialized and used correctly in fallback logic

* refactor: rename use_new_evo to should_use_new_evo for clarity
2025-08-29 17:07:41 +08:00
you-n-g 1b15b53c1a feat: add option to enable hyperparameter tuning only in first eval loop (#1211)
* feat: add option to enable hyperparameter tuning only in first eval loop

* fix: use total_seconds() for accurate time calculations in evolution and tracking
2025-08-29 16:59:22 +08:00
XianBW 7735e121b4 chore: ui updates (#1209)
* show a workspace path string for easier copy, only percent existing columns when percent summary dataframe

* catch summary exception

* fix a bug

* fix ci
2025-08-29 15:05:15 +08:00
amstrongzyf da8f61f874 fix: fix bug for hypo_select_with_llm when not support response_schema (#1208) 2025-08-28 14:36:23 +08:00
XianBW 11b0f1b9ee fix ui bug (#1207) 2025-08-28 14:18:58 +08:00
you-n-g 64734fba4c fix: move snapshot saving after step index update in loop execution (#1206) 2025-08-28 10:58:57 +08:00
amstrongzyf 40f26ac54d feat: enable LLM‑based hypothesis selection with time‑aware prompt & colored logging (#1122)
* add hypo select by llm (without time)

* add time_info and log color

* select no smooth

* 2 hypo

* change select

* small change

* fix bug

* fix bug and add hypothesis router and begin flag

* fix bug v1

* fix bug v2

* fix feedback

* add new model

* add filter

* fix bug v3

* fix bug v4

* change prompts v2

* fix bug v5

* fix bug v6

* fix hypo

* fix some bug(sota socre, prompts, ensemble prompts  ) and add path legth.

* fix bug v7

* fix bug v8

* fix bug v9

* fix bug v10

* reset to v10 and refine

* fix: translate to english

* fix bug

* fix: use differnet increase_stage for coder & runner

* fix: use different timeout_increase_stage for coder and runner.

* fix: revert logger

* fix: remove duplicate content

* feat: implement LLM-driven extra hypothesis selection and adjust logic

* refactor: relocate Hypothesis models below TraceChallenges

* remove torch fix bug

* fix small bug

* refactor: prefix internal methods with underscore for llm-based hypothesis selection

* add fix_seed_and_data_split and enable_simple_hypothesis

* lint

* refine proposal config order

* code review; comments

* lint

* merge int to float

---------

Co-authored-by: jingyuanlm <842442862@qq.com>
Co-authored-by: Young <afe.young@gmail.com>
2025-08-27 18:36:51 +08:00
XianBW 0018429dc4 chore: refine get_summary_df and sota exp stat in log utils (#1201)
* add best valid selector to get sota exp stat

* remove unused in summary & refine get_summary_df

* fix hypothesis table bug in trace
2025-08-26 18:31:21 +08:00
Linlang b4e11f1895 style: convert CLI flags from snake_case to kebab-case (#1198)
Co-authored-by: Young <afe.young@gmail.com>
2025-08-25 20:07:01 +08:00
Xu Yang 3b57ea2666 fix: increase time default not controlled by LLM (#1196)
* fix: add longer timeout configuration for data science scenarios

* fix CI
2025-08-21 11:27:17 +08:00
XianBW 2f54199b44 fix: kaggle competition metric direction (#1195)
* fix leaderboard and competition direction

* ui fix
2025-08-20 16:40:53 +08:00
amstrongzyf 2173fc8c25 fix bug for embedding caused by PR 1188 (#1194) 2025-08-18 20:15:18 +08:00
Tim 08db63e0fe chore: refine env command (#1193) 2025-08-18 18:16:16 +08:00
XianBW 4728df7f38 fix: ui bug (#1192)
* small bug

* fix ci
2025-08-18 17:48:49 +08:00
amstrongzyf 5785bcf2ba fix: enable embedding truncation (#1188)
* fix: enable embedding auto truncation

* move embedding_utils to utils.embedding

* fix bug

* fix(embedding): improve text truncation with retry strategies and binary search optimization

* new way for embedding truncate

* fix ci errors
2025-08-18 17:20:41 +08:00
xuangu-fang ceabfe9686 feat: enable to inject diversity cross async multi-trace (#1173)
* init multi_trace_async_ diversity inject

* lint

* add task in context for diversity injection, add abstract class for diversity injection

* lint

* feat: update diversity injection strategy and enhance sibling context handling in experiment generation

* add always inject

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-18 12:43:21 +08:00
you-n-g 0885d4d218 change the trace number from 3 to 1 (simpler default value) (#1191) 2025-08-18 12:13:23 +08:00
XianBW c3ef9e2d48 fix ui bugs (#1190) 2025-08-18 10:56:51 +08:00
you-n-g 00b588ffd4 fix: skip res_ratio check if timer or res_time is None (#1189) 2025-08-17 16:08:55 +08:00
Tim 0dae88e2cd chore: add inference mode for model dump (#1182)
* chore: add inference mode for model dump
* check runtime environment
* update opened_trace_lines
---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-15 15:34:49 +08:00
you-n-g bfbdbcfbbd fix: insert await asyncio.sleep(0) to yield control in loop (#1186) 2025-08-15 13:27:29 +08:00
you-n-g 254eb56da3 refactor: use UI_SETTING.amlt_path for combined log folder path (#1184) 2025-08-14 21:51:05 +08:00
Tim f87dc2a5b8 chore: catch log_workflow error (#1183) 2025-08-14 16:12:37 +08:00
amstrongzyf 5b785346f7 fix: refine prompts and add additional package info (#1179)
* refine prompts and add additional package info

* refine prompts to be specific for GBDT models

* minor refine prompts

* use include to replace duplicate info

* refine prompts

* refactor: import DSTrace from base and remove exp_gen __init__

* lint

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-08-13 23:00:23 +08:00
Tim aa2a5bae15 chore: add merge statistics (#1176)
* chore: add stat for merge
* use best selector
* use trace.hist
2025-08-13 22:59:34 +08:00
Chaos Yu 30d6afbb45 fix(graph): using assignment expression to avoid repeated function call (#1174)
* using assignment expression to avoid repeated function call

* format
2025-08-13 17:16:58 +08:00
Roland Minrui b94414a8ed feat: refine the logic of enabling hyperparameter tuning and add criteira (#1175)
* add 4 tuning criteria

* fix equation direction

* fix ci

* add comment

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>

---------

Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-12 21:12:54 +08:00
you-n-g 137bdc15c5 fix: cancel tasks on resume and kill subprocesses on termination (#1166)
* fix: cancel tasks on resume and kill subprocesses on termination

* lint

* lint
2025-08-09 19:39:13 +08:00
XianBW 5b6a7d1d9b fix exec_time in summary because of parallel (#1171) 2025-08-08 17:14:02 +08:00
XianBW dbbf43558d add auto sota selector llm log in trace (#1169) 2025-08-08 16:26:48 +08:00
Xu Yang 3fe2ba44df feat: streamline hyperparameter tuning checks and update evaluation g… (#1167)
* feat: streamline hyperparameter tuning checks and update evaluation guidelines

* fix task_gen json check
2025-08-08 13:49:01 +08:00
Xu Yang 2764da68a3 feat: improve fallback handling in CoSTEER and add GPU usage guidelin… (#1165)
* feat: improve fallback handling in CoSTEER and add GPU usage guideline in share.yaml

* update prompt

* update
2025-08-07 15:52:55 +08:00
XianBW bad433ac47 add parent & root node in trace page (#1164) 2025-08-07 15:02:46 +08:00
Xu Yang 6dab8fd7dd feat: add reasoning attribute to DSRunnerFeedback for enhanced evaluation context (#1162) 2025-08-07 00:50:08 +08:00
Roland Minrui 16aadb7a0d fix: refine DSCoSTEER_eval prompts (#1157)
* change DSCoSTEER_eval prompts

* fallback to better exp only

* fix fallback

* fix and reformat

* fix bug when base_fb is None

* add reasoning to hyperparameter evaluation

* feat: add acceptable assessment in exp_feedback (#1159)

* add time

* refine eval prompt and make the logic of tuning check more clear

* some refinement

* fix CI

* fix a small bug, only consider score in runner

* refine comment

* simplify compare function

---------

Co-authored-by: jingyuanlm <842442862@qq.com>
Co-authored-by: Xu <v-xuminrui@microsoft.com>
Co-authored-by: Jensen Lee <91518020+Jensen246@users.noreply.github.com>
Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-06 22:55:25 +08:00
Jensen Lee acfbd1b097 fix: ignore case when checking metric name (#1160)
* fix: ignore case when checking metric name

* add case-sensitive to prompts

---------

Co-authored-by: amstrongzyf <amstrongzyf@126.com>
2025-08-06 20:54:08 +08:00
XianBW 0334805744 chore: show timeline and change load_times (#1161)
* show timeline, deperacate old load_times

* fix bug
2025-08-06 18:42:17 +08:00
xuangu-fang 3244ba6833 feat: prob-based trace scheduler (#1131)
* draft prob-based trace scheduler

* refactor ProbabilisticScheduler

* auto lint

* keep random, Sota-based, length-based trace schedluer

* lint

* example

* example

* refactor

* add inverse option for sota Scheduler

* add trace_Scheduler in conf

* lint

* add scheduler_temperature

---------

Co-authored-by: Young <afe.young@gmail.com>
2025-08-06 16:42:51 +08:00
XianBW 912163d753 fix loop step time log problem (#1158) 2025-08-06 15:43:28 +08:00
Tim f5d17a1508 feat: enable finetune llm (#1055)
* feat: start with previous workspace

* feat: finetune llm

* add PrevModelLoadEvaluator

---------

Co-authored-by: Young <afe.young@gmail.com>
Co-authored-by: v-jianwan <v-jianwan@microsoft.com>
Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-08-06 12:24:44 +08:00
Xu Yang 0284b73596 feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling (#1156)
* feat: refactor CoSTEER classes to use DSCoSTEER and update max seconds handling

* remove useless line

* enable time_ratio_limit_to_enable_hyperparameter_tuning
2025-08-05 18:16:10 +08:00
Paul 50916fa6c9 feat: create Jupyter notebook pipeline file based on main.py file (#1134)
* First commit

* isort

* black

* tweak prompt

* fix for argparse

* fix typo

* add e2e

* Add test files, clean

* fix black settings

* revert

* fix trailing

* remove extra

* comment

* small fix, updated prompt

* Fix argparse

* small improvements

* fix for merge

* fix for merge
2025-08-05 18:06:57 +08:00
Linlang 067b5908f4 docs: update configuration docs (#1155)
* update configuration docs

* update configuration docs

* update configuration docs
2025-08-05 15:48:28 +08:00
Jensen Lee fcfea1943c feat: add mask inference in debug mode (#1154) 2025-08-05 14:09:12 +08:00
amstrongzyf 84b7c30a90 fix: add metric in scores.csv and avoid reading sample_submission.csv (#1152)
* add scores.csv metric name in both task_gen and coder

* a little fix to column names

* small fix

* avoid sample submission read in task_gen

* avoid sample_submission reading in coding

* code change summary bug fix

* little update

* little refinement to eval

* refine coder and runner eval prompts

---------

Co-authored-by: Xu Yang <peteryang@vip.qq.com>
2025-08-04 19:53:08 +08:00