mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-07-27 23:47:46 +00:00
999bbac08d
Replace sequential predict() calls with predict_batch() in both build_kronos_factor and evaluate_kronos_model. Up to batch_size windows processed simultaneously on GPU, reducing per-window time from ~10s to ~0.13s (10 windows in 1.3s on RTX 5060 Ti, 75x speedup). Adds --batch-size / -b option (default 32) to both kronos-factor and kronos-eval CLI commands. Falls back to single inference per window if a batch fails. Refactors timestamp prep into _build_window_inputs helper. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>