mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-07-28 16:07:46 +00:00
Linlang
a8f1fc939c
* add test import * format with isort * format with black * merge main * fix pytest error * fix pytest error * fix pytest error * fix pytest error * format with black * fix pytest error * fix pytest error * fix pytest error * fix pytest error * fix pytest error * format with isort * Exclude entrance * Add offline test * auto-lint * update coverage rate --------- Co-authored-by: Young <afe.young@gmail.com>
Tasks
Task Extraction
From paper to task.
# python rdagent/app/model_implementation/task_extraction.py
# It may based on rdagent/document_reader/document_reader.py
python rdagent/components/task_implementation/model_implementation/task_extraction.py ./PaperImpBench/raw_paper/
Complete workflow
From paper to implementation
# Similar to
# rdagent/app/factor_extraction_and_implementation/factor_extract_and_implement.py
Paper benchmark
# TODO: it does not work well now.
python rdagent/app/model_implementation/eval.py
TODO:
- Create reasonable benchmark
- with uniform input
- manually create task
- Create reasonable evaluation metrics