mirror of
https://github.com/manifoldbt/manifoldbt.git
synced 2026-08-24 22:48:05 +00:00
A speed claim a reader cannot reproduce is a screenshot. This harness installs manifoldbt from PyPI like any user would, generates its own data, and gates every timing behind a parity check: a workload where the two engines disagree publishes nothing and fails the run. It lives here rather than in the engine repository because it benchmarks the published wheel, not the source. Anyone can fork this repository and press "Run workflow" to get the same table on their own runner. The workflow runs on demand, weekly, and on every published release, so a version that gets slower says so in public.
13 lines
503 B
Plaintext
13 lines
503 B
Plaintext
# Pinned on purpose: a benchmark whose dependency set moves under it is not a
|
|
# benchmark. These are the exact versions the harness was validated against, and
|
|
# they are recorded again inside every results JSON so a reader can tell whether
|
|
# two runs are comparable.
|
|
#
|
|
# manifoldbt itself is NOT pinned here: the workflow installs the version under
|
|
# test (`pip install manifoldbt==X`), so the same lock file serves every release.
|
|
vectorbt==0.28.4
|
|
numpy==2.4.3
|
|
numba==0.64.0
|
|
pandas==2.3.3
|
|
psutil==7.2.2
|