mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-07-29 08:27:43 +00:00
fix: fix a bug in model tuning feedback (#316)
* fix a bug * fix two bugs
This commit is contained in:
@@ -114,7 +114,7 @@ class KGHypothesisExperiment2Feedback(HypothesisExperiment2Feedback):
|
||||
# Prepare render dictionary
|
||||
render_dict = {
|
||||
"context": self.scen.get_scenario_all_desc(),
|
||||
"last_hypothesis": trace.hist[-1][0].hypothesis if trace.hist else None,
|
||||
"last_hypothesis": trace.hist[-1][0] if trace.hist else None,
|
||||
"last_task_and_code": last_task_and_code,
|
||||
"last_result": trace.hist[-1][1].result if trace.hist else None,
|
||||
"hypothesis": hypothesis,
|
||||
|
||||
@@ -110,7 +110,7 @@ model_experiment_output_format: |-
|
||||
}
|
||||
Usually, a larger model works better than a smaller one. Hence, the parameters should be larger.
|
||||
|
||||
model_feedback_generation:
|
||||
model_tuning_feedback_generation:
|
||||
system: |-
|
||||
You are a professional result analysis assistant. You will receive a result and a hypothesis.
|
||||
Your task is to provide feedback on how well the result supports or refutes the hypothesis by judging from the observation of performance increase or decrease.
|
||||
@@ -149,8 +149,7 @@ model_feedback_generation:
|
||||
{% if last_hypothesis %}
|
||||
Last Round Information:
|
||||
Hypothesis: {{last_hypothesis.hypothesis}}
|
||||
Task: {{last_task}}
|
||||
Code Implemented: {{last_code}}
|
||||
Last Task and Code: {{last_task_and_code}}
|
||||
Result: {{last_result}}
|
||||
{% else %}
|
||||
This is the first round. No previous information available. As long as the performance is not too negative (eg.ICIR is greater than 0), treat it as successful. Do not set the threshold too high.
|
||||
|
||||
Reference in New Issue
Block a user