feat: add coder check and give more time (#1127)

* feat: introduce max_seconds_multiplier for timeout management across components

* avoid using assert in test

* hot fix a very small bug

* runner multiply twice

* revert feedback change

* add a switch to longer timeout
This commit is contained in:
Xu Yang
2025-07-29 14:59:38 +08:00
committed by GitHub
parent 53dd98abf4
commit dd2e06ade6
29 changed files with 102 additions and 83 deletions
@@ -19,7 +19,7 @@ class DSCoderCoSTEERSettings(CoSTEERSettings):
class Config:
env_prefix = "DS_Coder_CoSTEER_"
max_seconds: int = DS_RD_SETTING.debug_timeout * 4
max_seconds_multiplier: int = 4
env_type: str = "docker"
# TODO: extract a function for env and conf.
@@ -28,7 +28,7 @@ class DSCoderCoSTEERSettings(CoSTEERSettings):
Extra evaluators
The evaluator follows the following assumptions:
- It runs after previous evaluator (So the running results are alreadly there)
- It runs after previous evaluator (So the running results are already there)
It is not a complete feature due to it is only implemented in DS Pipeline & Coder.