mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-07-27 23:47:46 +00:00
chore: format check result (#565)
* format check result placed next to the metric result * reformat
This commit is contained in:
@@ -65,7 +65,6 @@ class DSExperiment2Feedback(Experiment2Feedback):
|
||||
sota_desc=sota_desc,
|
||||
cur_exp=exp,
|
||||
diff_edition=diff_edition,
|
||||
format_check=exp.format_check_result,
|
||||
feedback_desc=feedback_desc,
|
||||
)
|
||||
|
||||
|
||||
@@ -8,7 +8,7 @@ exp_feedback:
|
||||
Your feedback should:
|
||||
1. Confirm if the current result supports or refutes the hypothesis.
|
||||
2. Compare with previous best results.
|
||||
3. Suggest improvements or new directions. Stay innovative and adapative.
|
||||
3. Suggest improvements or new directions. Stay innovative and adaptive.
|
||||
4. SOTA results are the best outcomes we have achieved in this scenario. If we do not have complete experiment available (i.e., results that are runnable and can generate evaluation outcomes), **please replace it as the best result/SOTA**.
|
||||
|
||||
Please provide detailed and constructive feedback.
|
||||
@@ -45,14 +45,15 @@ exp_feedback:
|
||||
|
||||
Final results of the current solution:
|
||||
{{ cur_exp.result }}
|
||||
|
||||
{% if cur_exp.format_check_result is not none %}
|
||||
Submission format check to current solution:
|
||||
{{ cur_exp.format_check_result }}
|
||||
{% endif %}
|
||||
|
||||
### Complete Code of current solution
|
||||
{{cur_exp.experiment_workspace.all_codes}}
|
||||
|
||||
{% if format_check is not none %}
|
||||
Submission format check to current solution:
|
||||
{{ format_check }}
|
||||
{% endif %}
|
||||
|
||||
{{feedback_desc}}
|
||||
|
||||
Please refer to these hypotheses and feedback to help you recommend new experiment and hypothesis
|
||||
|
||||
@@ -16,8 +16,12 @@ describe: # some template to describe some object
|
||||
{% if exp.result is none %}
|
||||
There are no according evaluation results
|
||||
{% else %}
|
||||
Evaluated results on validation is:
|
||||
Evaluated results on validation are:
|
||||
{{ exp.result }}
|
||||
{% if exp.format_check_result is not none %}
|
||||
Submission format check result is:
|
||||
{{ exp.format_check_result }}
|
||||
{% endif %}
|
||||
{% endif %}
|
||||
|
||||
{% else %}
|
||||
|
||||
Reference in New Issue
Block a user