e8eb0a7dbd
copybot: live paper feed [skip ci]
2026-07-21 19:08:11 +00:00
c0caff58f0
copybot: live paper feed [skip ci]
2026-07-21 19:08:08 +00:00
e5e212a0bb
copybot: live paper feed [skip ci]
2026-07-21 19:05:57 +00:00
8cf5c65594
copybot: live paper feed [skip ci]
2026-07-21 18:55:02 +00:00
1877478be7
copybot: live paper feed [skip ci]
2026-07-21 18:33:35 +00:00
ff3062ca92
copybot: live paper feed [skip ci]
2026-07-21 18:33:07 +00:00
d0e4fc4c0b
copybot: live paper feed [skip ci]
2026-07-21 18:22:02 +00:00
df364a1ed9
copybot: live paper feed [skip ci]
2026-07-21 18:20:17 +00:00
b3bbb05ca9
copybot: live paper feed [skip ci]
2026-07-21 18:19:50 +00:00
8add61be3b
copybot: live paper feed [skip ci]
2026-07-21 17:36:27 +00:00
935db9a906
copybot: live paper feed [skip ci]
2026-07-21 17:35:45 +00:00
8edccda58a
docs: stage-0 coherence pass across README/HANDOFF/recorder/research
...
- README: recorder row + architecture diagram reflect fold->parquet->
15-min mirror (and research/ joins the diagram); cheat-sheet gains a
'sync the tape now' row
- HANDOFF: snapshot dated 2026-07-21, launchd roster (tape-sync +
research-nightly wait behavior), #15 back in the open queue, tape ops
line in quick-reference
- recorder/README: ops block (sync_tape + fold health, deploy gap note),
storage economics (/mo, mirror as Stage-1 feedstock)
- research/README: nightly.sh wait-for-fresh-tape semantics
- live/tape_sharps.json: refreshed 4-day chain-validated screen (the
smoke run had briefly left a chain-less version)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-21 13:07:31 -04:00
b5166630fd
copybot: live paper feed [skip ci]
2026-07-21 17:06:05 +00:00
9b17928b27
copybot: live paper feed [skip ci]
2026-07-21 17:04:37 +00:00
56cefc80f0
copybot: live paper feed [skip ci]
2026-07-21 17:04:37 +00:00
5c8ee5961b
stage-0 warehouse: recorder folds its own tape to parquet; Mac mirrors every 15 min
...
The nightly Mac-coupled bulk ingest was the fragile link (today: Mac slept
through 08:00, the pipeline started 09:31, and the sftp bulk pull wedged in
timeout cascades holding the db lock — digest blocked behind it). Stage 0
moves the fold onto the box and reduces the Mac to an incremental mirror:
- recorder/fold.py (sidecar, capture stays PID 1): closed gz segments ->
zstd parquet /data/parquet/<fam>/date=*/segment.parquet, row-parity
verified, manifest-logged, THEN gz deleted. Deletion invariant STRONGER:
raw needs a verified parquet; parquet needs a Mac ACK before the disk
guard may prune it. duckdb capped 384MB; VM 256MB -> 1GB.
- recorder/sync_tape.py (com.jaxperro.tape-sync every 15 min + daily.sh):
manifest-driven incremental sftp pull, per-file row verify, append into
rtds.duckdb NATIVE tables (views-over-parquet rejected: sim's per-asset
point queries would crawl), segment-keyed idempotence shared with the
legacy ingest.py (kept as fallback), ack back to the box.
- recorder/bootstrap_parquet.py: pre-fold history exported to the mirror,
parity OK (13.84M trades + 3.07M aux). live/parquet/ is now the complete
durable layer Stage 1 (MotherDuck/ClickHouse) would consume.
- research/tape.py connect(): brief retry — the 15-min sync holds the
write lock for seconds.
First run: backlog folded in <60s on the box, 36/36 files mirrored+
verified, rtds.duckdb 13.8M -> 18.2M trades, tape age 24h+ -> ~15-45 min.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
2026-07-21 12:46:54 -04:00
803df06944
copybot: live paper feed [skip ci]
2026-07-21 16:22:46 +00:00
6892aa5b1e
live: daily refresh — skilled + sharp wallets [skip ci]
2026-07-21 12:19:03 -04:00
6c43d4410e
copybot: live paper feed [skip ci]
2026-07-21 15:52:46 +00:00
76c7ec96ae
copybot: live paper feed [skip ci]
2026-07-21 15:52:22 +00:00
cf78e95db7
copybot: live paper feed [skip ci]
2026-07-21 15:50:37 +00:00
81f46edeae
copybot: live paper feed [skip ci]
2026-07-21 15:50:10 +00:00
935200c901
copybot: live paper feed [skip ci]
2026-07-21 15:47:57 +00:00
dba34bf026
copybot: live paper feed [skip ci]
2026-07-21 15:34:47 +00:00
7497f5e867
copybot: live paper feed [skip ci]
2026-07-21 15:34:20 +00:00
85cc84de0d
copybot: live paper feed [skip ci]
2026-07-21 15:32:10 +00:00
05b17c52ad
copybot: live paper feed [skip ci]
2026-07-21 14:31:00 +00:00
26e2d59b8e
copybot: live paper feed [skip ci]
2026-07-21 14:20:32 +00:00
0b15441ea0
copybot: live paper feed [skip ci]
2026-07-21 14:18:21 +00:00
f98861b5cd
copybot: live paper feed [skip ci]
2026-07-21 14:17:54 +00:00
81abef5636
copybot: live paper feed [skip ci]
2026-07-21 10:40:28 +00:00
23e00ec485
copybot: live paper feed [skip ci]
2026-07-21 10:38:58 +00:00
6539719c41
copybot: live paper feed [skip ci]
2026-07-21 10:14:19 +00:00
5b463aba43
copybot: live paper feed [skip ci]
2026-07-21 10:13:18 +00:00
fe5638c096
copybot: live paper feed [skip ci]
2026-07-21 09:36:52 +00:00
7f5289527a
copybot: live paper feed [skip ci]
2026-07-21 09:36:33 +00:00
02e7456ada
copybot: live paper feed [skip ci]
2026-07-21 09:36:33 +00:00
40481e62d9
copybot: live paper feed [skip ci]
2026-07-21 09:12:51 +00:00
33fdd558a6
copybot: live paper feed [skip ci]
2026-07-21 05:14:05 +00:00
e83739b01c
copybot: live paper feed [skip ci]
2026-07-21 05:01:12 +00:00
c22f37cd4b
copybot: live paper feed [skip ci]
2026-07-21 05:00:46 +00:00
a33e2fe1b3
copybot: live paper feed [skip ci]
2026-07-21 02:12:52 +00:00
c5527ec93a
copybot: live paper feed [skip ci]
2026-07-21 01:33:42 +00:00
519720fb9d
copybot: live paper feed [skip ci]
2026-07-21 01:32:12 +00:00
1a34c510b1
copybot: live paper feed [skip ci]
2026-07-21 01:06:49 +00:00
14fd64279a
copybot: live paper feed [skip ci]
2026-07-21 01:05:48 +00:00
aebcfa2d24
copybot: live paper feed [skip ci]
2026-07-20 23:33:52 +00:00
b9faf6c3f8
copybot: live paper feed [skip ci]
2026-07-20 23:20:55 +00:00
f86adc4029
copybot: live paper feed [skip ci]
2026-07-20 23:02:01 +00:00
0f2368f049
copybot: live paper feed [skip ci]
2026-07-20 22:24:39 +00:00
copybot[bot]