Commit Graph
8 Commits
Author SHA1 Message Date
Marc Shade 306173c0ec feat: add cross-domain analytics — correlation, domain summary, trend detection (109 tools)
- intel_cross_correlate: finds related signals across all domains for a topic,
  groups by category, shows how events ripple across intelligence streams
- intel_domain_summary: per-category aggregate of stored intelligence with
  data point counts, unique sources, latest/earliest timestamps
- intel_trend_detection: compares recent vs baseline activity rates per
  category, identifies SURGE/ELEVATED/DECLINING/DROP patterns for early warning
- All three leverage accumulated Qdrant vector store data
- 109 tools total across 30+ domains
2026-03-08 10:15:53 -04:00
Marc Shade 094f37d443 feat: add collector daemon and 5 vector search tools (106 total)
- collector.py: standalone daemon for 24/7 vector store population
  - 43 sources organized by domain with parallel fetching
  - --daemon, --interval, --sources CLI args
  - Dynamic import via _import_fetch_fn()
  - Entry point: intel-collector
- server.py: 5 new MCP tools (intel_semantic_search, intel_similar_events,
  intel_timeline, intel_vector_stats, intel_collect)
- pyproject.toml: vector optional dependency (qdrant-client + fastembed)
- README.md: updated architecture, vector store section, tool reference
- CLAUDE.md: updated tool count and architecture docs
2026-03-08 10:05:06 -04:00
Marc Shade b01a77721b docs(world-intel): update README and CLAUDE.md for 101 tools 2026-03-08 08:24:45 -04:00
Marc ShadeandClaude Opus 4.6 d075bbaf1a feat: phase 16 — country dossier, 89 tools, 119 RSS feeds, 53 tests
- Add intel_country_dossier: comprehensive 6-source country analysis
  (economy, markets, elections, sanctions, news, security) in parallel
- Expose 4 hidden sources as MCP tools: intel_traffic_flow,
  intel_traffic_incidents, intel_aviation_domestic, intel_webcams
- RSS feeds expanded from 100 to 119 across 24 categories (+6 new:
  central_asia, arctic, maritime, space, nuclear, climate)
- CLI expanded from 44 to 49 commands (dossier, traffic, incidents,
  air-traffic, webcams)
- Tests expanded from 45 to 53 covering all new Phase 16 tools

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-26 17:55:47 -05:00
Marc ShadeandClaude Opus 4.6 4dda867968 feat: phase 14 — BTC technicals, central bank rates, 3 datasets, dashboard UX (+5 = 84 tools)
New tools:
- intel_btc_technicals: SMA-50/200, Mayer Multiple, golden/death cross, ATH distance
- intel_central_bank_rates: 15 banks (Fed/ECB/BoE via FRED, 12 curated fallback)
- intel_trade_routes: 19 maritime chokepoints with oil flow and vessel transit data
- intel_cloud_regions: 28 AWS/Azure/GCP regions with coordinates
- intel_financial_centers: GFCI top 20 with rankings and specializations

Dashboard additions:
- BTC Technicals drawer section (price, SMA, Mayer, cross signal)
- Central Bank Rates drawer section (15 banks, sorted by rate)
- Trade route markers on infrastructure map layer (chokepoint/canal/route icons)
- Regional presets (Globe/Americas/Europe/MENA/Asia-Pac/Africa) with localStorage persistence
- Time window filter (1h/6h/24h/7d/All) filtering earthquakes and news by timestamp
- Static datasets served via /api/static for instant boot

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-26 17:04:17 -05:00
Marc ShadeandClaude Opus 4.6 39e687b054 feat: phase 13 — USNI fleet tracker, RSS expansion, remove static reports
- Add intel_usni_fleet tool: parses USNI News Fleet Tracker RSS for
  Navy fleet disposition (ships, hull numbers, strike groups, regions)
- Expand RSS to 90+ feeds across 16 categories: +3 Latin America
  (InSight Crime, Brazil Reports, Mexico News Daily), +7 multilingual
  (BBC Mundo, DW ES/DE, France24 FR, RFI, UN News ES/FR)
- Add data freshness monitoring: per-source staleness in dashboard
  drawer via cache.freshness() and SSE stream
- Add USNI Fleet Tracker drawer section to dashboard
- Remove static HTML report system (reports/ dir, 3 MCP tools,
  4 CLI commands, PDF endpoint) — live dashboard replaces all
- Update ROADMAP.md: phases 1-11 complete, 80 tools, 15 datasets

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-26 16:41:38 -05:00
Marc ShadeandClaude Opus 4.6 6075910505 feat: phase 12 — 68→81 tools, 5 geospatial datasets, 5 new sources, news ticker fix
New static datasets (config/):
- cables.py: 34 undersea fiber-optic cables with landing points, capacity, owners
- datacenters.py: 48 AI datacenter clusters with power capacity (MW)
- spaceports.py: 27 launch facilities worldwide
- minerals.py: 27 critical mineral deposits (lithium, cobalt, rare earths, etc.)
- exchanges.py: 82 stock exchanges across 4 tiers with country→ticker mapping

New source modules (sources/):
- hacker_news.py: HN Firebase API top stories
- github_trending.py: GitHub search API trending repos
- arxiv_papers.py: arXiv Atom API with regex XML parsing
- usa_spending.py: USAspending.gov federal agency budgets
- environmental.py: NASA EONET natural events + GDACS disaster alerts

Extended existing modules:
- markets.py: fetch_country_stocks() — any country by ISO-3 code
- military.py: fetch_aircraft_details_batch() — parallel batch lookup (max 20)
- geospatial.py: 5 new fetch functions for cables, datacenters, spaceports, minerals, exchanges
- circuit_breaker.py: per-source configurable thresholds
- cache.py: freshness() method for per-source staleness tracking

Fixed news ticker (News 0 → News 17+):
- Root cause: RSS feeds fetched sequentially by category (14 categories × slow feeds = timeout)
- Fix: single asyncio.gather() for all 80+ feeds with 12s per-feed hard timeout
- Reduced per-request HTTP timeout from 15s to 8s for RSS feeds

13 new tools wired in server.py, 14 new tests (76 total, all passing).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-24 20:05:44 -05:00
Marc ShadeandClaude Opus 4.6 a72fdc50f7 fix: dashboard instant boot, pipeline map layer, theater data bugs
- Add /api/static endpoint for instant geospatial data on boot (158 items)
- Add per-coroutine 45s timeout to prevent SSE first-frame blocking
- Dismiss loading overlay after static fetch instead of waiting for SSE
- Render 24 oil/gas/hydrogen pipelines as colored polylines on map
- Fix theaters dict-vs-list bug in posture.py and fleet.py
- Add exposure detail modal and color/label entries

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-24 10:09:14 -05:00