Files
kingchenc 4f708d410d test: golden-pin the four de-duplicated indicators across all bindings (#305)
* test: golden-pin the four de-duplicated indicators across all C-ABI bindings

Extend gen_golden to emit reference fixtures for AdOscillator (ADOSC),
IntradayIntensity, AwesomeOscillatorHistogram and AverageDrawdown, and replay
them through the Go / C# / Java / R golden harnesses so their corrected
definitions stay bit-identical to the Rust core in every binding. Go suite
verified locally (gcc 13 + cgo): all 9 golden tests pass; C#/Java/R use the
same fixtures and harness pattern (CI-verified). First step of extending the
golden coverage beyond the seven archetype representatives.

* test: golden-pin the scalar-output tranche (308 indicators) against Rust

Extend gen_golden with a generated emit_scalar that writes reference fixtures
for every single-f64-output indicator (scalar / candle / pairwise input) using
valid constructor params, and add a manifest-driven generic Python golden
replay that reconstructs each by its native name and checks it bit-for-bit
against the Rust output. 308 indicators now value-tied to the Rust core in
Python (pytest: 308/308). Takes golden coverage from the 7 archetype
representatives to 308+ of the catalogue.

22 scalar indicators with non-default constructor constraints are skipped by
gen_golden for now (logged), as are non-f64-output ones; multi-output, exotic
inputs and the per-indicator arg arities of the C-ABI/Node replays follow.
Generated + verified locally with the full toolchain.

* test: golden-pin the multi-output tranche (70 indicators) in Python

Add a generated emit_multi to gen_golden (per-indicator Output-field access,
one CSV column per field) and a manifest-driven generic Python replay that
checks every field of each multi-output indicator against the Rust reference.
70 multi-output indicators now value-tied to Rust in Python; combined with the
scalar tranche, 378 indicators are golden-pinned. 8 multi with non-default
param constraints and 5 with non-f64 Output fields (Option/Vec/i64) are
deferred. pytest green.

* test(golden): add 30 constraint-tuned indicators to scalar/multi golden suite

Emit golden fixtures for 22 scalar-output and 8 multi-output indicators
whose constructors need non-default parameters (Alma, Jma, Psar, T3, Mama,
DoubleBollinger, ZigZag, ...). All 408 fixtures replay bit-for-bit through
the Python binding.

* test(golden): cover 36 missed scalar/multi indicators

Add 26 single-output (LinearRegression family, HT cycle, Candle
volatility estimators, DrawdownDuration) and 10 multi-output
(BollingerBands, MACD/MACDEXT/MACDFIX, Camarilla, VWAP bands, ...)
indicators to the golden suite. 444 fixtures replay bit-for-bit
through the Python binding.

* test(golden): cover 50 exotic-input indicators

Add deterministic synthetic feeders for the DerivativesTick (17),
CrossSection (15), Trade (8), TradeQuote (3) and OrderBook (7)
families, derived from the shared OHLCV input series in both
gen_golden and a new Python replay harness (test_golden_exotic).
All 494 fixtures replay bit-for-bit through the Python binding.

* test(golden): complete 514-indicator golden coverage

Add the final tranches: 3 mixed multi-output indicators (Ichimoku,
WilliamsFractals, LeadLagCrossCorrelation), 6 histogram profiles
(time/volume seasonality + TPO/volume price profiles), 10 alt-chart
bar builders and the footprint. Every one of the 514 distinct
indicators now has a Rust-generated g_<Canonical>.csv fixture and a
generic Python replay (scalar/multi/exotic/profile/bars), all passing
bit-for-bit.

* test(golden): add generic Node replay for all 514 indicators

A manifest-driven node:test harness reconstructs every indicator by its
native class, feeds the same synthetic stream derived from the shared
golden input, and checks output bit-for-bit against the Rust reference
fixtures (scalar/multi/exotic/profile/bars). node_manifest.json is
generated from index.d.ts plus the Python-side manifests. 514/514 pass.

* test(golden): add generated Go replay for all 514 indicators

golden_all_test.go (generated by gen_golden_test.py) reconstructs every
Go indicator, feeds the shared synthetic stream and checks output
bit-for-bit against the Rust reference fixtures. A reflection-based
comparator flattens multi-output structs, profiles and bar slices so one
path covers all archetypes. This is the first C-ABI binding verified
across the full catalogue. 514/514 pass.

* test(golden): add generated C# replay for all 514 indicators

GoldenAllTests.g.cs (generated by gen_golden_test.py) reconstructs every
C# indicator, feeds the shared synthetic stream and checks output
bit-for-bit against the Rust reference fixtures via a reflection-based
flatten covering scalar/multi/profile/bar archetypes. 514/514 pass.

Also add the '#nullable enable' directive the compiler requires to the
generated Indicators.g.cs, clearing the four CS8669 warnings on the
nullable double[] profile return types.

* fix(java): marshal C ABI bool params correctly; add 514 golden replay

The Java FFM binding marshalled the cross-section state flags (newHigh,
newLow, aboveMa, onBuySignal) as JAVA_DOUBLE arrays, but the C ABI takes
them as const bool* (one byte each), so the native side read the low byte
of each 8-byte double and saw every flag as false. Add WickraNative.
boolSegment and use it across the 15 cross-section indicators. Also pass
the MacdExt MaType arguments as byte to match the uint8_t downcall
descriptor (was int, throwing WrongMethodTypeException).

Add GoldenAllTest.java (generated by gen_golden_test.py): a reflection
runner replaying all 514 indicators against the Rust reference fixtures.
The bugs above were found by this test; 514/514 now pass.

* fix(r): marshal C ABI bool flags correctly; add 514 golden replay

The R wrapper passed the cross-section state flags as (bool *)REAL(x),
reinterpreting the 8-byte doubles as 1-byte bools so the native side read
every flag as false. Add wk_bool_vec to convert each flag vector into a
real C bool buffer and use it for all 15 cross-section update wrappers.

Add test-golden-all.R + generated golden_specs.R: a reflective runner
replaying all 514 indicators against the Rust reference fixtures. The bug
above was found by this test; verified 514/514 pass locally.

* test(golden): add WASM replay for all 514 indicators

A manifest-driven node:test harness loads the nodejs-target wasm-pack
build, reconstructs every indicator by its JS class, feeds the shared
synthetic stream and checks output bit-for-bit against the Rust
reference fixtures. wasm_manifest.json is generated from the wasm .d.ts
plus the shared manifests; a recursive flattener covers scalar, multi
(Reflect objects), profile and bar shapes. 514/514 pass locally
(wasm-pack build --target nodejs, then node --test).

* test(golden): add C and C++ replay for all 514 indicators

golden_test.c (generated by gen_golden_test.py) drives every indicator
through the C ABI (wickra.h) and checks output bit-for-bit against the
Rust reference fixtures. golden_test.cpp #includes the same source so the
identical runner is compiled and run under both gcc (C) and g++ (C++) via
the CMake targets golden_test / golden_test_cpp — proving the extern "C"
header is consumable from each language. Both 514/514 (verified via ctest).

* test(golden): gofmt the generated Go golden replay

* test(golden): make the Node fixture reader CRLF-safe and pin fixtures to LF
2026-06-15 04:48:51 +02:00

129 lines
4.7 KiB
Python

"""Generic golden replay for the exotic-input families: DerivativesTick,
CrossSection, Trade, TradeQuote and OrderBook indicators.
Each family feeds a synthetic stream deterministically derived from the shared
`testdata/golden/input.csv` OHLCV rows — the exact same construction the Rust
`gen_golden` binary uses — and every value is checked bit-for-bit against the
Rust-generated `g_<Canonical>.csv`. This pins the Python FFI for indicators
whose inputs cannot be expressed as a plain close/candle/pair stream.
"""
import json
import math
import os
import pytest
import wickra as ta
HERE = os.path.dirname(__file__)
GOLDEN = os.path.normpath(os.path.join(HERE, "..", "..", "..", "testdata", "golden"))
def _cell(s):
return math.nan if s == "nan" else float(s)
def _rows(name):
with open(os.path.join(GOLDEN, name + ".csv")) as f:
return [[_cell(x) for x in line.split(",")] for line in f.read().splitlines()[1:] if line.strip()]
def _input():
with open(os.path.join(GOLDEN, "input.csv")) as f:
return [[float(x) for x in line.split(",")] for line in f.read().splitlines()[1:] if line.strip()]
with open(os.path.join(GOLDEN, "exotic_manifest.json")) as _mf:
MANIFEST = json.load(_mf)
ROWS = _input()
def _deriv_fields(o, h, l, c, v):
return {
"funding_rate": (c - o) / c * 0.01,
"mark_price": c,
"index_price": c - 0.5,
"futures_price": c + 1.0,
"open_interest": v * 10.0,
"long_size": v * 0.6,
"short_size": v * 0.4,
"taker_buy_volume": v * 0.55,
"taker_sell_volume": v * 0.45,
"long_liquidation": h - c,
"short_liquidation": c - l,
}
def _cross_lists(o, h, l, c, v):
change = [(c - o) + j for j in range(5)]
volume = [v + j * 10.0 for j in range(5)]
new_high = [j % 2 == 0 for j in range(5)]
new_low = [j % 3 == 0 for j in range(5)]
above_ma = [j % 2 == 0 for j in range(5)]
on_buy_signal = [j % 3 == 0 for j in range(5)]
return change, volume, new_high, new_low, above_ma, on_buy_signal
def _ob_lists(o, h, l, c, v):
bid_px = [c - 0.1 * (k + 1) for k in range(5)]
bid_sz = [v / (k + 1) for k in range(5)]
ask_px = [c + 0.1 * (k + 1) for k in range(5)]
ask_sz = [v * 0.9 / (k + 1) for k in range(5)]
return bid_px, bid_sz, ask_px, ask_sz
def _assert_scalar(got, want, canonical, i):
got = math.nan if got is None else got
if math.isnan(want):
assert math.isnan(got), f"{canonical} row {i}: want NaN got {got}"
elif math.isinf(want):
assert math.isinf(got) and (got > 0) == (want > 0), f"{canonical} row {i}: got {got} want {want}"
else:
assert abs(got - want) <= 1e-6 * max(1.0, abs(want)), f"{canonical} row {i}: got {got} want {want}"
def _specs(family):
return [(family, s) for s in MANIFEST[family]]
@pytest.mark.parametrize(
"family,spec",
_specs("deriv") + _specs("cross") + _specs("trade") + _specs("trademid") + _specs("ob"),
ids=[s["canonical"] for fam in ("deriv", "cross", "trade", "trademid", "ob") for s in MANIFEST[fam]],
)
def test_exotic_matches_golden(family, spec):
ind = getattr(ta, spec["native"])(*spec["params"])
expected = _rows("g_" + spec["canonical"])
n = spec.get("n")
for i, (o, h, l, c, v) in enumerate(ROWS):
if family == "deriv":
f = _deriv_fields(o, h, l, c, v)
got = ind.update(*[f[a] for a in spec["args"]])
elif family == "cross":
change, volume, nh, nl, above_ma, on_buy = _cross_lists(o, h, l, c, v)
extra = spec.get("extra")
if extra == "above_ma":
got = ind.update(change, volume, nh, nl, above_ma)
elif extra == "on_buy_signal":
got = ind.update(change, volume, nh, nl, on_buy)
else:
got = ind.update(change, volume, nh, nl)
elif family == "trade":
got = ind.update(c, v, c >= o)
elif family == "trademid":
got = ind.update(c, v, c >= o, (h + l) / 2.0)
else: # ob
bid_px, bid_sz, ask_px, ask_sz = _ob_lists(o, h, l, c, v)
got = ind.update(bid_px, bid_sz, ask_px, ask_sz)
want = expected[i]
if n: # multi-output (LiquidationFeatures)
if got is None:
assert all(math.isnan(w) for w in want), f"{spec['canonical']} row {i}: want {want} got None"
continue
vals = list(got)
assert len(vals) == len(want), f"{spec['canonical']} row {i}: arity {len(vals)} vs {len(want)}"
for gv, w in zip(vals, want):
_assert_scalar(gv, w, spec["canonical"], i)
else:
_assert_scalar(got, want[0], spec["canonical"], i)