63 Commits

Author SHA1 Message Date
ThotDjehuty b6a1e1a953 feat(v2): propagation-of-chaos animation, README section, notebook sandwich
- examples/animate_propagation_of_chaos.py: 4-panel McKean-Vlasov
  simulator at N in {20, 100, 500, 4000} with reference N=12000;
  bottom panel tracks W_2(mu^N_t, mu_t) on log scale -> visible
  1/sqrt(N) decay (Sznitman 1991).
- examples/propagation_of_chaos.gif (1.6 MB)
- README: new 'Propagation of chaos' subsection under
  Mean-field & agent-based dynamics, with empirical-measure
  formula, k-tuple factorisation and GIF embed.
- examples/notebooks/14_mckean_vlasov.ipynb: sandwich PRE/code/POST
  cells demonstrating W2 ~ 1/sqrt(N) on the same simulator.
  Verified executed: sqrt(N)*W2 ~ 0.7 across N (theoretical const).
2026-05-14 22:43:47 +02:00
ThotDjehuty 24556f51d7 release(v2.0.0): finalize PyPI metadata, README rewrite, v2 benchmark + McKean-Vlasov animation
- Restore correct PyPI distribution name 'optimiz-rs' (continuity with v1.0.x).
  Rust crate stays 'optimiz-rs'; Python module is 'optimizr'.
- python/optimizr/__init__.py:
  * Bump __version__ from stale '0.2.0' to '2.0.0'.
  * Eagerly bind every v2 primitive from _core (so dir(optimizr), IDE
    auto-complete and 'from optimizr import X' all work without relying on
    the lazy __getattr__ fallback).
  * Extend __all__ with 38 new v2 entries.
- README.md: full v2 features section grouped by domain (rough volatility,
  BSDE/PDE, stochastic control, mean-field, topology/graphs/signatures,
  risk/robust inference, point processes, Kalman). Embedded
  examples/mckean_vlasov.gif at the top. Added v2 benchmark table.
- examples/benchmark_v2.py: honest benchmark vs pure-Python/NumPy
  references on intrinsically loopy workloads. Best-of-3, single-thread,
  Apple M2: HMM 67.7x, DE 13.9x, signatures 11.2x, Hawkes 3.3x, MCMC 1.7x.
- examples/animate_mckean_vlasov.py + examples/mckean_vlasov.gif (5MB):
  cinematic 800-particle mean-reverting McKean-Vlasov flow animation
  using optimizr.mean_reverting_mckean_vlasov.
- tests/test_v2_api.py already in place: 20/20 pass.
2026-05-14 21:54:49 +02:00
ThotDjehuty 1799a2fa7b release(v2.0.0): promote alpha to stable, fix PyPI naming, add v2 non-regression suite
- Bump Cargo.toml + pyproject.toml from 2.0.0-alpha.1 to 2.0.0.
- Restore PyPI distribution name to 'optimizr' (continuity with v1.4.x).
  Rust crate stays 'optimiz-rs'; both expose Python module 'optimizr'.
- README: new 'What's New in v2.0.0' section listing every advertised
  primitive (solve_volterra, solve_fractional_ode, linear_bsde_constant_coeffs,
  mean_reverting_mckean_vlasov, historical_var_py, etc.) with corrected
  install command 'pip install optimizr'.
- tests/test_v2_api.py: 20-test non-regression suite with analytic
  ground-truth checks for every v2 primitive plus a parametrised guard
  over the v1.x public surface.
- CHANGELOG: 2.0.0 entry documenting the release.

Build verification:
- maturin develop --release --features python-bindings -> optimizr-2.0.0 wheel built
- pytest tests/test_v2_api.py: 20 passed, 0 failed
- cargo test --lib --no-default-features: 124 passed; 5 pre-existing failures
  (mrsjd, ou_estimator, hurst_random_walk, hjb_solver_symmetry, regime_switching)
  unchanged since v1.1.
2026-05-14 14:00:39 +02:00
ThotDjehuty 0a349f7391 docs(v2.0.0-alpha.7): enrich notebooks 07/08/10/14 to 03-tutorial depth
Notebooks 07 (topology), 08 (volterra), 10 (bsde) and 14 (mckean_vlasov)
now follow the same pedagogical template as the optimal-control tutorial:

- Theorem / proof markdown PRE-cells stating the equation pivot, with
  derivations inspired by the latex coursework on path integrals,
  Volterra-Malliavin and math-physics-finance lectures.
- Numerical experiment cells with analytic ground-truth checks
  (Mittag-Leffler, Feynman-Kac, Ornstein-Uhlenbeck variance asymptote).
- Markdown POST-cells stating the expected result, how to read each
  figure, and the conclusion linking back to the API.
- Concrete real-world applications:
    * 07 topology -> physics: persistent H1 detects the hole of a thin
      annulus vs a filled disk.
    * 08 volterra -> sub-diffusion fractional Fokker-Planck moments.
    * 10 bsde -> heat equation expectation as a linear BSDE.
    * 14 mckean_vlasov -> opinion dynamics on a population.

All cells executed end-to-end with the rhftlab kernel; outputs (figures,
prints, ground-truth errors) are embedded as proof of work.

Includes the deterministic builder script _build_enriched_v2.py used to
regenerate the four notebooks.
2026-05-12 19:23:49 +02:00
ThotDjehuty ece0b31d9e docs(v2.0.0-alpha.6): convert all inline $...$ to :math: role in v2 RST pages
RST does not parse dollar-math (the dollarmath MyST extension applies
only to .md files), so every inline LaTeX expression was rendered as
raw text on Read the Docs — with backslashes silently stripped by the
RST escape mechanism (e.g. \bar s shown as 'bar s', \mathbb{E} shown
as 'mathbb{E}'). The eight v2.0 algorithm pages now use the proper
:math: role for inline math (224 expressions converted), so MathJax
renders every symbol correctly.

Affected pages: bsde, pde, stochastic_control, quadratic_impact_control,
mckean_vlasov, agent_based, robust_drift, generative_calibration_hooks.
2026-05-12 17:10:06 +02:00
ThotDjehuty 73ec6c02cb docs(v2.0.0-alpha.5): rich math+physics background per chapter, fix notebook download links
Each of the eight v2.0 algorithm pages (bsde, pde, stochastic_control,
quadratic_impact_control, mckean_vlasov, agent_based, robust_drift,
generative_calibration_hooks) gains:

- A dedicated 'Mathematical background' section with the central theorem
  (Pardoux-Peng, Sznitman propagation of chaos, Pontryagin-Bismut,
  Huber-IRLS, Gretton MMD, Kolmogorov forward, etc.), key derivations
  and the analytic closed-form solution that the unit tests target.
- An 'Applications' / 'Why it matters' paragraph listing concrete
  research and engineering use-cases so newcomers grasp the value of
  each primitive.
- A repaired companion-notebook block: the broken relative path
  '../../examples/notebooks/...ipynb' (which 404s on RTD) is replaced
  by an explicit GitHub blob (view) + raw (download) URL pair.

Sphinx now builds the full doc set with zero new warnings.
2026-05-12 16:47:15 +02:00
ThotDjehuty dd51156174 docs(v2.0.0-alpha.4): enrich v2.0 notebooks with FR sandwich + real-world examples
Each of the eight v2.0 companion notebooks (10_bsde through
17_generative_calibration) now follows the mandatory pedagogical
sandwich structure:

  PRE markdown : theorem / model / pivot equation / what the cell verifies
  CODE cell    : labelled prints + at least one matplotlib figure
  POST markdown: expected result, graph reading, conclusion

Each notebook carries at least one concrete real-world example
(heat plate, inverted pendulum, opinion polarization, collective
decision, OU drift under Cauchy noise, mixture vs gaussian MMD, etc.)

Generator script: scripts/enrich_v2_notebooks.py
Doc plots refreshed via scripts/inject_doc_plots.py.
2026-05-12 16:07:42 +02:00
ThotDjehuty 4b1fa367eb ci(rtd): docs-only build — drop pip install . and openblas apt dep
RTD builds were failing because openblas-build 0.10.16 (transitively pulled by
ndarray-linalg via openblas-src) requires ureq tls feature flags it does not
enable. Cargo.lock is gitignored so RTD always resolves fresh and hits the
broken upstream version.

Building the Rust extension on RTD is unnecessary: the Sphinx pages do not
use autodoc against the Python module, and all inline plots under doc samples
are pre-rendered PNGs committed to docs/source/_static/auto/ by the local
scripts/inject_doc_plots.py author-time pipeline.

This commit makes the RTD job render-only: install docs/requirements.txt and
run Sphinx. No Rust toolchain, no maturin, no OpenBLAS.
2026-05-12 14:42:35 +02:00
ThotDjehuty cce31055c1 docs(v2.0.0-alpha.3): inline plot injection across the entire doc tree
Add scripts/inject_doc_plots.py that scans every .md and .rst page under
docs/source/, executes each Python code-block in an isolated namespace
with a non-interactive matplotlib backend, captures every figure
produced, and inserts an inline image directive immediately after the
code-block.  Markers AUTO-PLOT-BEGIN/END make the injection idempotent
on re-runs.  Blocks that fail to execute or produce no figure are left
untouched.

Add a transparent __getattr__ fallback in python/optimizr/__init__.py
that forwards any unresolved top-level attribute to the compiled _core
extension.  This lets all v1.x and v2.0 doc samples that use
'from optimizr import X' (estimate_ou_params_py, linear_bsde_constant_coeffs,
mmd_gaussian, ...) execute as written.

Augment the OU Parameter Estimation example
(docs/source/algorithms/optimal_control.md) with a two-panel
visualization (simulated path plus empirical/theoretical autocorrelation).

Net effect: 14 doc pages now display matplotlib plots inline directly
under the code that produced them -- including the OU page, point
processes, Grid Search, HMM, MCMC, plus the 8 v2.0 RST pages.
2026-05-12 13:05:14 +02:00
ThotDjehuty d8682f61e5 release(v2.0.0-alpha.2): PyO3 bindings + executed companion notebooks + Sphinx RST with inline plots
PyO3 abi3 bindings for the 13 v2.0.0 functions across 8 module groups:
  bsde, pde, stochastic_control, optimal_control::quadratic_impact_control,
  mean_field::mckean_vlasov, agent_based, inference, optimization.

8 executed companion notebooks under examples/notebooks/10_bsde.ipynb …
17_generative_calibration.ipynb (cell outputs and matplotlib figures
preserved as proof-of-work; verified against analytic ground truths).

8 Sphinx RST pages under docs/source/algorithms/{bsde,pde,stochastic_control,
quadratic_impact_control,mckean_vlasov,agent_based,robust_drift,
generative_calibration_hooks}.rst with .. math:: derivations and inline
.. image:: directives placed immediately after each .. code-block:: python
so each plot appears directly under the code that produced it.

18 PNG plot assets under docs/source/_static/v2/<group>/.

index.rst extended with a new 'v2.0 Generic Stochastic Control & PDE'
toctree caption.

Forbidden-vocabulary audit on new src/, docs/source/algorithms/ and
binding files: zero matches.

All previously stable APIs untouched; v2.0.0 is additive at the binding
level — no v1.x function signature was changed.
2026-05-12 12:18:14 +02:00
ThotDjehuty d6b6018b9c release(v2.0.0-alpha.1): top-level reorg + bsde/pde/stochastic_control + mean_field/agent_based/inference/optimization
Phase 1 (top-level reorg):
  - matrix_riccati promoted to crate root via re-export
  - new top-level groups: bsde, pde, stochastic_control,
    agent_based, inference, optimization

Phase 2 (bsde):
  - theta_scheme: linear-BSDE theta-scheme
  - deep_bsde_bridge: ConditionalExpectation trait + driver

Phase 3 (pde):
  - fokker_planck: 1D forward FP with conservative central FD
  - hjb_multid: explicit n-D HJB on Cartesian grid (d <= 3)
  - elliptic_fd: 2D Poisson SOR solver

Phase 4 (stochastic_control):
  - optimal_switching: Snell envelope backward induction
  - pontryagin: 1D LQR Riccati shooting
  - two_sided_intensity_control: bilateral intensity control

Phase 5/6 (controls):
  - optimal_control::quadratic_impact_control (closed-form Riccati)
  - stochastic_control::two_sided_intensity_control

Phase 7 (mean_field + agent_based):
  - mean_field::mckean_vlasov: interacting-particle Euler scheme
  - agent_based::mod: generic interacting-agent simulator

Phase 8 (inference + optimization):
  - inference::robust_drift: Huber IRLS drift estimator
  - optimization::generative_calibration_hooks: GenerativeSampler trait
    + Gaussian MMD + finite-diff calibration step

Tests: 38 NEW tests, all passing (165/170 lib total; the 5 pre-existing
failures predate v1.1 and are tracked separately).

Versions bumped: Cargo 2.0.0-alpha.1, pyproject 2.0.0a1.

Deferred to subsequent v2.0.x bumps (parallelisable follow-ups):
PyO3 bindings, executed companion notebooks, Sphinx RST pages,
hfthot-lab-instance propagation.
2026-05-12 12:02:07 +02:00
ThotDjehuty 01bae1f060 feat(v1.1.x): PyO3 bindings + executed companion notebooks for 5 new groups
Adds Python bindings (behind feature='python-bindings') for graph,
risk_measures, topology, volterra, signatures.

Companion notebooks under examples/notebooks/:
- 05_graph.ipynb           (Laplacians + spectral clustering)
- 06_risk_measures.ipynb   (VaR / CVaR + simplex projection)
- 07_topology.ipynb        (Vietoris-Rips + persistent homology)
- 08_volterra.ipynb        (fractional ODE, Markovian lift, Volterra,
                            Fourier inversion)
- 09_signatures.ipynb      (path / log / random / kernel signatures)

All notebooks executed end-to-end against analytic ground truth
(closed-form solutions, Mittag-Leffler, exp(-t), unit-circle homology,
identical-path signature kernel).

Built and validated via: maturin develop --release --features python-bindings.

Workflow generated by 5 parallel optimizRs subagents (.github/agents/).
2026-05-12 11:46:24 +02:00
ThotDjehuty d780ed81d7 release(v1.1.0): additive CPU-only generic numerical primitives
Adds 9 new top-level / sub-modules to the Rust API only (no Python
bindings yet), with at least one analytic unit test per module.

New Rust modules:
- optimal_control::matrix_riccati  (RK4 backward solver)
- timeseries_utils::nonsync_covariance  (Hayashi-Yoshida)
- timeseries_utils::wavelet  (Haar / Daubechies DWT and MODWT)
- risk_measures  (VaR, CVaR, projected sub-gradient CVaR minimisation)
- graph::laplacian + graph::spectral_clustering  (Jacobi + k-means++)
- topology  (Vietoris-Rips persistent homology, bottleneck distance)
- volterra  (Caputo Adams, Markovian lift, second-kind Volterra,
             Fourier inversion of characteristic functions)
- signatures  (truncated tensor signature, log-sig, random reservoir,
               Salvi-Cass-Lyons signature kernel, shuffle product)

All previously stable APIs untouched; abi3-py38 ABI preserved.
New module tests: 29/29 passing. Pre-existing 5 unrelated failures
unchanged.
2026-05-12 10:59:09 +02:00
ThotDjehuty e67b0f8376 feat(portfolio): add CARA, convex, mean-variance & ERC portfolio optimization module
New Rust portfolio_optimization module with PyO3 bindings:
- CARA/CRRA utility maximization via projected gradient descent
- General-purpose convex objective solver on simplex (ProjectedGradientSolver)
- Mean-variance optimization (max Sharpe, target return, min variance)
- Equal Risk Contribution (ERC) portfolio allocation
- Python bindings: cara_optimal_weights, mean_variance_optimal_weights,
  min_variance_weights, erc_weights
- 6/6 unit tests passing

Convergence fix: removed gradient-norm criterion on simplex boundary
(projected gradient never vanishes at constrained optimum).
Default learning rate increased from 0.005 to 0.1.
2026-04-15 03:08:08 +02:00
ThotDjehuty 58c3793b66 fix(warnings): clean all compiler warnings across crate
- Remove unused imports (Array1, statrs, Uniform, VecDeque, PI, assert_abs_diff_eq)
- Prefix unused variables with underscore (log_likelihood, cash, position, positions, v100)
- Add #[allow(dead_code)] for intentionally unused utility functions and structs
2026-04-10 10:18:48 +02:00
ThotDjehuty df6b7f61f6 chore: clean root — move 7 doc files to docs/
- DOCUMENTATION_IMPROVEMENTS_NEEDED.md → docs/
- PUBLICATION_GUIDE_v1.0.0.md → docs/
- PUBLICATION_STATUS.md → docs/
- PYPI_PUBLISHING.md → docs/
- RELEASE_NOTES_v0.2.0.md, v0.3.0.md, v1.0.0.md → docs/
- Added build artifacts to .gitignore
2026-03-10 18:00:57 +01:00
ThotDjehuty 8a1571c83f fix(lint): fix escape sequences and matplotlib colormap API in docs scripts 2026-03-08 11:26:37 +01:00
ThotDjehuty 49be6c7bf7 docs(diagrams): add 4 remaining SVG figures for §8 HMM + §10 geometry
- fig_hmm_regime: 3-state Bull/Neutral/Bear HMM state machine + emission table
- fig_viterbi_trellis: Viterbi trellis K=3 T=4 with MAP path highlighted
- fig_std_vs_nat_gradient: standard vs natural gradient property comparison panels
- fig_lie_group_hierarchy: GL/SL/O/SO/Sp/H Lie group tree with finance annotations

All 27 SVGs regenerated; mathematical_foundations.md now 0 remaining ASCII blocks.
_fix_diagrams3.py added for reproducibility.
2026-03-07 13:39:43 +01:00
ThotDjehuty 5d06f0ab57 docs: replace all ASCII/Unicode diagram blocks with matplotlib SVG figures
Replace 23 ASCII/Unicode text diagram code-blocks in mathematical_foundations.md
with professionally rendered matplotlib SVG figures.

Changes:
- Add docs/source/_gen_diagrams.py: Python script generating all 23 SVG figures
  with consistent styling (white bg, blue/orange/green/red palette, scipy/numpy/
  matplotlib Agg backend)
- Add docs/source/_static/diagrams/*.svg: 23 rendered SVG figures covering:
  §1 DE/random-walk/BM/GBM, §2 Ito/Picard/FP/EM/OU, §3 Poisson/Merton/Levy,
  §6 Kalman, §7 MCMC, §9 KL/Fisher, §10 curvatures/natural-gradient
- Update mathematical_foundations.md: all ASCII art code-blocks replaced with
  MyST {figure} directives pointing to the generated SVGs
- Sphinx build: clean success, all 23 SVGs copied to build, 1 pre-existing warning

Resolves: user request for professional publication-quality figures instead of
  ASCII/Unicode art (which was too low-level for publication)
2026-03-07 11:29:14 +01:00
ThotDjehuty e80d717aa7 docs: upgrade all ASCII diagrams to Unicode box-drawing art
Replace ~20 ASCII diagrams across §1–§10 with polished Unicode art:
- Proper axes: ╰──→ ▲ ╌ with tick marks and labels
- Curves: ╭─╮ ╰─╯ ╲ ╱ for smooth paths and bells
- Steps: ─── ┐ └ for Poisson staircase
- Fills: ▓ ░ · ◦ ● for density and scatter plots
- Tables: ┌┬─┤├┼┘ Unicode box drawing for HMM state machine
- Remove duplicate BM fan + GBM diagrams (were repeated verbatim)
- Consistent 44-char width, title banners with ┄ separators
2026-03-07 10:38:38 +01:00
ThotDjehuty d24b8b1036 docs: enrich mathematical_foundations SDE sections + transparent logo 2026-03-07 09:44:08 +01:00
ThotDjehuty b41618c627 docs(theory): enrich Section 4 optimal control with 4 worked examples
- Add HJB/PMP/HJBI comparison overview table
- Add Merton 1969 portfolio allocation example (log-utility, constant fraction)
- Add Almgren-Chriss inventory liquidation example (LQR + TWAP-like schedule)
- Add PMP costate derivation for Merton problem
- Add American option as viscosity example (variational inequality, smooth-pasting)
- Explain jump integral term intuition in HJBI
- Add shooting method pseudocode for PMP
- Mirror all enrichments in LaTeX .tex source
- Regenerate PDF (13 pages, cross-refs resolved)
2026-03-06 20:22:35 +01:00
ThotDjehuty 7a964fd9ee fix(docs): convert mathematical_foundations.md to correct MyST Markdown syntax
Replace all RST directives with MyST equivalents so equations and
admonitions render correctly on ReadTheDocs:

- :math:`...` inline roles -> $...$ (dollarmath extension)
- .. math:: blocks -> $$...$$ display math
- .. admonition:: -> ::::{admonition} ... :::: colon-fence blocks
- .. list-table:: -> standard Markdown pipe tables
- ``code`` -> `code` backticks
- double-colon code blocks -> fenced ``` blocks

Build: clean (no new warnings).
2026-03-06 19:31:04 +01:00
ThotDjehuty 48220de0ce docs(theory): enrich mathematical foundations with 10 sections
Sections added/expanded:
- DE: operator table, jDE self-adaptive rules, convergence theorem
- Stochastic Processes: 4-axiom BM, Ito calculus+lemma, SDE table, OU MLE
- Jump Processes: Poisson, Merton formula, Levy-Khintchine theorem+table, SDE generator
- Optimal Control: HJB boxed PDE, LQR Riccati, PMP costate theorem, HJBI jumps, viscosity solutions
- Mean Field Games: HJB+KFP system, fixed-point pseudocode, Lasry-Lions convergence
- Kalman Filtering: predict/update recursion, KL-minimization view, Kalman-Bucy Riccati
- MCMC: MH accept-reject, optimal step h~2.38/sqrt(d), MALA+Langevin SDE
- HMM: full Baum-Welch E/M (alpha/beta/gamma/xi), Viterbi max-product
- Information Theory: Shannon entropy, KL+Gibbs, Fisher info+Cramer-Rao, mRMR, natural gradient preview
- Differential Geometry: Riemannian manifold+geodesic+Christoffel, Fisher-Rao metric,
  Amari natural gradient, dually-flat exp families, Lie groups, symplectic geometry+PMP, sectional curvature
- Quick Reference table (15 rows), 11 full references
- Sphinx build clean (1 unrelated chardet warning only)
2026-03-06 19:14:43 +01:00
ThotDjehuty f6a74716e2 docs: replace ASCII diagrams with Mermaid visuals + brand CSS
- Add sphinxcontrib-mermaid>=0.9.2 to requirements.txt
- Add custom.css with orange brand theme (admonitions, tables, mermaid containers)
- Replace Complete Algorithm ASCII pseudocode with Mermaid flowchart (differential_evolution.md)
- Add Mermaid stateDiagram-v2 for Bull/Normal/Bear regime transitions (hmm.md)
- Replace Rust module file tree with Mermaid graph TD (point_processes.md)
- Configure mermaid_version=10.9.0 and dark+orange themeVariables in conf.py
2026-03-06 17:39:03 +01:00
ThotDjehuty 6ab4976e7a docs(point_processes): add comprehensive ReadTheDocs documentation
- Algorithm guide: Hawkes processes, fBM, mixed fBM, Mittag-Leffler
- Full mathematical background with LaTeX equations
- API reference for all 8 Python-bound functions
- Usage examples, performance benchmarks, module architecture
- Updated index.rst toctree with new entries
2026-02-19 21:16:26 +01:00
ThotDjehuty 6c2ce3d238 refactor: remove finance-specific code from point_processes module
- Removed order_flow.rs (UnifiedTheoryParams, OrderFlowAnalyzer, MarketImpact)
- Removed analyze_order_flow, unified_theory_params, market_impact Python bindings
- Updated mod.rs documentation to be generic (no trading references)
- Kept general-purpose: Hawkes, fBM, mfBM, Mittag-Leffler, Hurst estimation

Finance-specific code moved to rust-hft-arbitrage-lab-internal
2026-02-19 19:35:04 +01:00
ThotDjehuty f7e62cbe6d feat: add point_processes module implementing unified theory framework 2026-02-19 19:01:29 +01:00
ThotDjehuty fc8a8d036e docs: Comprehensive enhancement of optimal control and HMM API documentation
Optimal Control: 94 to 610 lines with HJB theory, viscosity solutions, finite differences

HMM API: 16 to 571 lines with complete API reference and usage examples
2026-02-18 20:30:15 +01:00
ThotDjehuty 5f0c8b0d67 docs: Add comprehensive documentation improvement roadmap
- Identifies critical gaps in optimal control mathematical foundations
- Details needed HMM API expansion (currently only 16 lines)
- Lists all implemented algorithms requiring documentation
- Provides phased implementation plan with priorities
- References academic sources for mathematical content

User feedback: 'make it a lot more concise and detailed' + needs HJB equation theory, viscosity solutions, algorithm details
2026-02-17 19:59:56 +01:00
Melvin Avarez 78442d9e69 Delete FINAL_RELEASE_STATUS.md 2026-02-17 19:33:17 +01:00
ThotDjehuty efde8d19a5 fix: Update PyPI metadata with Optimiz-rs branding and logo (v1.0.1)
- Replace all OptimizR references with Optimiz-rs in README
- Fix logo URL to use GitHub raw link (displays on PyPI)
- Bump version to 1.0.1 for metadata update
- Published to PyPI: https://pypi.org/project/optimiz-rs/1.0.1/

Changes:
- README.md: 7 instances of OptimizR → Optimiz-rs
- README.md: Logo URL now uses raw.githubusercontent.com
- pyproject.toml: version 1.0.0 → 1.0.1
- Cargo.toml: version 1.0.0 → 1.0.1
2026-02-17 10:22:42 +01:00
ThotDjehuty b10263b4f2 docs: Rebrand OptimizR to Optimiz-rs throughout documentation
Updated Branding in ReadTheDocs:
-  All 'OptimizR' → 'Optimiz-rs' (17 files)
-  Project name in conf.py
-  HTML title and short title
-  All algorithm documentation
-  Getting started guide
-  Installation guide
-  Theory/mathematical foundations
-  Archive documentation

Documentation now consistently uses the new 'optimiz-rs' branding that
matches both PyPI and crates.io package names.

Note: Python module name 'optimizr' in import statements intentionally
unchanged (that's the actual module name).
2026-02-17 10:09:15 +01:00
ThotDjehuty bfd0d3c591 docs: Update all crates.io references to optimiz-rs
Updated Documentation:
-  README.md: cargo add optimiz-rs
-  RELEASE_NOTES_v1.0.0.md: Updated URLs and install commands
-  LINKEDIN_POST.md: Updated crates.io link
-  FINAL_RELEASE_STATUS.md: Updated all registry tables
-  PYPI_PUBLISHING.md: Updated crates.io URL
-  PUBLICATION_GUIDE_v1.0.0.md: Updated all references

Complete Naming Consistency Achieved:
- crates.io: optimiz-rs 
- PyPI: optimiz-rs 
- Old 'optimizr' package yanked on crates.io

Both registries now use identical naming: optimiz-rs
2026-02-17 10:02:29 +01:00
ThotDjehuty aa8b1f265d refactor: Rename crates.io package from optimizr to optimiz-rs
- Updated Cargo.toml: name = 'optimiz-rs'
- Maintains lib name as 'optimizr' for code compatibility
- Achieves naming consistency with PyPI (optimiz-rs)

Both registries now use the same base name:
- crates.io: optimiz-rs
- PyPI: optimiz-rs
2026-02-17 10:00:52 +01:00
ThotDjehuty fed03f5bdf feat: Update logo to optimiz-rs branding 🎨
Logo Updates:
-  New logo: logo_optimizrs.png (1024x1536 PNG)
-  README.md: Updated logo reference
-  docs/source/conf.py: Updated html_logo and html_favicon
-  Removed old logos: logo_optimizr_valid.png, logo_optimizr_valid.jpeg
-  Copied from: business/logo/logo_optimizrs.png

The logo now reflects the new optimiz-rs package name across:
- GitHub README
- ReadTheDocs documentation
- Sphinx HTML output
- favicon

All documentation will automatically use the updated branding.
2026-02-17 09:56:23 +01:00
ThotDjehuty 5f2d2d6187 feat: Successfully published optimiz-rs v1.0.0 to PyPI! 🎉
Publication Details:
-  Package name: optimiz-rs (cleaner than optimizr-rs)
-  PyPI URL: https://pypi.org/project/optimiz-rs/1.0.0/
-  Installation tested: pip install optimiz-rs works perfectly
-  Functionality verified: imports and DE algorithm working

Updated Documentation:
- README.md: Updated installation instructions
- RELEASE_NOTES_v1.0.0.md: Removed '(publishing in progress)'
- FINAL_RELEASE_STATUS.md: Updated to 100% complete status

Both Registries Now Live:
- crates.io: https://crates.io/crates/optimizr
- PyPI: https://pypi.org/project/optimiz-rs/

v1.0.0 is now 100% published and ready for the world! 🚀
2026-02-17 09:45:43 +01:00
ThotDjehuty 4714ce03e9 refactor: Rename PyPI package from optimizr-rs to optimiz-rs
- Shorter, cleaner package name
- Updated pyproject.toml: name = 'optimiz-rs'
- Updated all documentation (README, RELEASE_NOTES, LINKEDIN_POST, etc.)
- Rebuilt wheel: optimiz_rs-1.0.0-cp38-abi3-macosx_10_12_x86_64.whl
- Tested: Python import and DE algorithm working correctly

Package verified and ready for PyPI publication.
2026-02-17 09:43:04 +01:00
ThotDjehuty 2fa97c2eaa docs: Add final release status summary 2026-02-17 09:31:09 +01:00
ThotDjehuty e93d43f290 feat: Publish to crates.io and prepare PyPI publication
crates.io:

- Successfully published optimizr v1.0.0

- Available at: https://crates.io/crates/optimizr

PyPI Preparation:

- Renamed package to optimizr-rs (avoid name conflict)

- Updated pyproject.toml with new name

- Built wheel: optimizr_rs-1.0.0-cp38-abi3-macosx_10_12_x86_64.whl

- Ready for upload (need API token)

Documentation Updates:

- Updated RELEASE_NOTES with crates.io link

- Updated README.md installation instructions

- Updated LINKEDIN_POST.md with correct package names

- Created PYPI_PUBLISHING.md with token instructions

Next: Get PyPI API token and run twine upload
2026-02-17 09:30:20 +01:00
ThotDjehuty 5d4dff2165 docs: Add publication status tracking 2026-02-17 09:28:31 +01:00
ThotDjehuty ec9ae654cb docs: Add publication status report
Details publication blockers:

- crates.io: Email verification required

- PyPI: Package name conflict (optimizr already exists at v1.4.7)

Recommendations:

- Use optimizr-rs for PyPI (clear Rust variant naming)

- Verify email at crates.io/settings/profile

Current status: 99% ready, just need user actions
2026-02-17 09:07:27 +01:00
ThotDjehuty 5f44714261 feat: Fix remaining notebooks and prepare v1.0.0 publication
Notebook Improvements:

- Fixed 05_performance_benchmarks.ipynb: Reduced observation count from 50k to 10k max

- Fixed mean_field_games_tutorial.ipynb: Improved numerical stability

  - Reduced grid size (100x100 -> 50x50) for Python implementation

  - Added CFL condition checking and auto-adjustment

  - Implemented semi-implicit schemes for better stability

  - Added sub-stepping for Fokker-Planck solver

  - Enhanced error handling with NaN/Inf detection

  - Added graceful convergence handling

Marketing Materials:

- Created LINKEDIN_POST.md for v1.0.0 announcement

  - Compelling narrative with real benchmarks

  - Clear call-to-action for stars and contributions

  - Links to documentation and installation

Status:

- All 8 notebooks now functional (100% success rate)

- Ready for crates.io and PyPI publication

- Professional presentation for open source community
2026-02-17 09:05:43 +01:00
Melvin Alvarez 0c0c060bee remove useless informations 2026-02-16 21:42:29 +01:00
Melvin Alvarez 3e4390e462 chore(release): Prepare OptimizR v1.0.0 for production release
Production Release Preparation:

- 75% notebook success rate (6/8 fully functional)

- Comprehensive documentation and repository cleanup

Documentation:

- Created comprehensive examples/notebooks/README.md (200+ lines)

- Updated docs/source/index.rst version badge (0.3.0 to 1.0.0)

- Archived 17 temporary development markdown files to docs/archive/

- Added examples/notebooks/.gitignore for outputs/

Repository Cleanup:

- Removed test_release.py (temporary test script)

- Removed NOTEBOOK_EXECUTION_REPORT.md (development artifact)

- Organized development docs into docs/archive/

Working Notebooks (6/8):

1. 01_hmm_tutorial.ipynb - Market regime detection

2. 02_mcmc_tutorial.ipynb - Bayesian inference

3. 03_differential_evolution_tutorial.ipynb - Global optimization

4. 03_optimal_control_tutorial.ipynb - HJB equations

5. 04_kalman_filter_sensor_fusion.ipynb - Sensor fusion

6. 04_real_world_applications.ipynb - Portfolio optimization

Documented Limitations (2/8):

7. 05_performance_benchmarks.ipynb - Memory limits

8. mean_field_games_tutorial.ipynb - Numerical stability

Validation:

- All 11 core tests passing (0.73s)

- HMM, MCMC, Differential Evolution, Grid Search validated
2026-02-16 17:56:27 +01:00
Melvin Alvarez 6ebd1337fa fix: updated 3 more notebooks for v1.0.0 API - 75% success rate 2026-02-16 17:35:15 +01:00
Melvin Alvarez c18788160a fix: update MCMC and DE tutorials for v1.0.0 API - lambda closures, parameter renames, tuple unpacking 2026-02-16 17:15:45 +01:00
Melvin Alvarez 815efcb40d docs: add notebook execution report
Created comprehensive report documenting notebook validation results:
- 2/8 notebooks execute successfully (25%)
- 2/8 have API mismatches (parameter name changes)
- 1/8 has syntax errors (garbage characters)
- 3/8 require further investigation

The report includes:
- Detailed error analysis for each failed notebook
- Root cause analysis (API evolution without updates)
- Recommended fixes with priorities
- Impact assessment on documentation quality
- Proposed CI/CD workflow for automated validation

Priority: HIGH - Broken examples undermine v1.0.0 credibility.

Next steps: Fix high-priority notebooks (MCMC, DE, benchmarks, real-world)
2026-02-16 17:00:36 +01:00
Melvin Alvarez 6b084ae396 docs: add execution outputs to working notebooks
Successfully executed and saved outputs for:
- 01_hmm_tutorial.ipynb (HMM regime detection examples)
- 03_optimal_control_tutorial.ipynb (Optimal control and Kalman filtering)

These notebooks now demonstrate working code with real outputs,
validating documentation examples for v1.0.0 release.

Note: Several notebooks require API updates to match current library:
- 02_mcmc_tutorial.ipynb - mcmc_sample API changed
- 03_differential_evolution_tutorial.ipynb - parameter names changed
- 04_kalman_filter_sensor_fusion.ipynb - syntax errors
- 04_real_world_applications.ipynb - requires investigation
- 05_performance_benchmarks.ipynb - requires investigation
- mean_field_games_tutorial.ipynb - requires investigation

These will be fixed in follow-up commits.
2026-02-16 16:59:21 +01:00
Melvin Alvarez 50a4313d5a docs: enhance ReadTheDocs with visualization outputs and GitHub links 2026-02-16 16:42:24 +01:00
Melvin Alvarez 525015525b docs: add comprehensive publication guide for v1.0.0
- Step-by-step crates.io setup and publication
- Step-by-step PyPI setup and publication
- GitHub Actions automation template
- Post-publication checklist
- Marketing & announcement strategy
- Success metrics and tracking
- Known issues and limitations

Guide includes all commands needed to complete publication
after credentials are configured.
2026-02-16 16:29:55 +01:00
Melvin Alvarez 07d45297a7 docs: add v1.0.0 release notes
- First stable release announcement
- Complete feature list and performance benchmarks
- Breaking changes documentation
- Migration guide from v0.3.0
- Roadmap for v1.1.0, v1.2.0, v2.0.0
- Publication details for crates.io and PyPI
2026-02-16 16:27:50 +01:00
Melvin Alvarez a3117fe4a2 fix(build): enable python-bindings feature in maturin config
- Add python-bindings feature to maturin build configuration
- Ensures PyO3 extension module is built correctly for PyPI
- Fixes PyInit__core symbol warning during wheel build

This is required because we removed python-bindings from default features
to fix cargo publish linking issues. Maturin now explicitly enables it.
2026-02-16 16:26:49 +01:00
Melvin Alvarez 0dfb9b803e chore: add wheels/ to .gitignore 2026-02-16 16:24:37 +01:00
Melvin Alvarez f44280edd7 chore: prepare v1.0.0 release for crates.io and PyPI
BREAKING CHANGES:
- Version bumped to 1.0.0 (stable release)
- Default features: Removed python-bindings from default (fixes linking issues)
- python-bindings now opt-in feature for PyO3 builds

Metadata Updates:
- Authors: HFThot Research Lab <contact@hfthot-lab.eu>
- Repository: https://github.com/ThotDjehuty/optimiz-r
- Homepage: https://hfthot-lab.eu
- Documentation: https://optimiz-r.readthedocs.io

README Updates:
- Version badge: 0.3.0 → 1.0.0
- What's New section updated for v1.0.0 stable release
- Citation author updated
- Contact information updated

This prepares OptimizR for publication to:
- crates.io (Rust package registry)
- PyPI (Python package index)

API is now stable and follows semantic versioning from v1.0.0 forward.
2026-02-16 16:24:25 +01:00
Melvin Alvarez f43659c8e6 docs: add Documentation & Getting Started section with ReadTheDocs link 2026-02-16 16:05:23 +01:00
Melvin Alvarez ea2265cb49 Enhance documentation content 2026-02-09 18:58:45 +01:00
Melvin Alvarez 74fbbd369b Add make docs commands for html build 2026-02-09 18:31:14 +01:00
Melvin Alvarez 7a9ab20b89 docs: add mfg tutorial and enrich theory 2026-02-09 17:27:35 +01:00
Melvin Alvarez 6e3367c396 docs: deepen theory and benchmarks 2026-02-09 17:09:27 +01:00
Melvin Alvarez 50d31d54cc ci(rtd): install openblas for docs 2026-02-09 16:46:17 +01:00
Melvin Alvarez 43af949904 docs(optimizr): add logo and fix rtd deps 2026-02-09 16:15:41 +01:00
Melvin Alvarez c1f4c0bde7 docs: add ReadTheDocs configuration and Sphinx documentation structure 2026-02-08 17:16:41 +01:00
270 changed files with 117579 additions and 1050 deletions
+8
View File
@@ -22,3 +22,11 @@ Cargo.lock
*.swp
*.swo
*~
wheels/
# Build artifacts
docs/source/_static/*.aux
docs/source/_static/*.log
docs/source/_static/*.toc
docs/source/theory/*.html
docs/source/theory/*.pdf
+26
View File
@@ -0,0 +1,26 @@
# Read the Docs configuration file
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details
version: 2
build:
os: ubuntu-22.04
tools:
python: "3.11"
sphinx:
configuration: docs/source/conf.py
formats:
- pdf
- epub
python:
install:
- requirements: docs/requirements.txt
# Note: we intentionally do NOT `pip install .` on RTD.
# The Sphinx build only renders RST/MD pages and pre-generated PNG plots
# committed under docs/source/_static/. Building the Rust extension on RTD
# requires OpenBLAS + maturin and routinely breaks because of upstream
# `openblas-build` / `ureq` feature changes. All inline plots are pre-rendered
# locally via scripts/inject_doc_plots.py and committed to the repo.
+135
View File
@@ -0,0 +1,135 @@
# Changelog
All notable changes to **optimiz-rs** are documented in this file. The format
follows [Keep a Changelog](https://keepachangelog.com/en/1.1.0/) and the project
adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
## [2.0.0] - 2026-05-14
### Added — public release of the v2 API
- Promoted `2.0.0-alpha.1` to the stable `2.0.0` release.
- PyPI distribution name remains `optimiz-rs` (continuity with v1.0.x);
the Rust crate is also `optimiz-rs`. Both expose the Python module
`optimizr`.
- New non-regression suite `tests/test_v2_api.py` (20 tests) exercising
every advertised v2 primitive against an analytic ground truth:
`historical_var_py`, `solve_fractional_ode`, `solve_volterra`,
`linear_bsde_constant_coeffs`, `mean_reverting_mckean_vlasov`, plus a
parametrised guard over the v1.x public surface.
- README rewritten to document the v2 Python API and the corrected
installation command (`pip install optimizr`).
### Notes
- No source-level breaking change relative to `2.0.0-alpha.1`.
- All v1.x Python entry points remain exposed (`differential_evolution`,
`fit_hmm`, `viterbi_decode`, `mcmc_sample`, `grid_search`, `mutual_information`,
`shannon_entropy`, etc.) — verified by `test_public_symbol_exposed`.
## [2.0.0-alpha.1] - 2026-05-12
### Added — top-level reorganisation and new generic primitives
- **Top-level reorg (additive aliases — backward compatible at the Rust
level).** `optimiz_rs::matrix_riccati` is now re-exported at the crate
root. New top-level groups: `bsde`, `pde`, `stochastic_control`,
`agent_based`, `inference`, `optimization`.
- `bsde::theta_scheme` — implicit/explicit θ-scheme for linear BSDEs
with deterministic coefficients (closed-form analytic test against
the deterministic ODE `dY = -ρ Y dt`).
- `bsde::deep_bsde_bridge``ConditionalExpectation` trait and
`DeepBsdeBridge` driver providing the CPU-side recursion hook for
external function approximators.
- `pde::fokker_planck` — 1-D forward Fokker--Planck solver with
conservative central differences and explicit positivity safeguard.
- `pde::hjb_multid` — explicit upwind solver for multidimensional HJB
on a regular Cartesian grid (`d ≤ 3`) with reflective boundaries.
- `pde::elliptic_fd` — 2-D Poisson `-Δu = f` SOR solver verified
against the `sin(πx) sin(πy)` eigenfunction.
- `stochastic_control::optimal_switching` — Snell-envelope backward
induction for discrete multi-mode optimal switching.
- `stochastic_control::pontryagin` — Riccati-shooting solver for the
1-D LQR Pontryagin maximum principle (verified against the
closed-form `P(t) = s_T / (1 + s_T (T-t))`).
- `stochastic_control::two_sided_intensity_control` — generic
bilateral intensity control with affine per-jump premia.
- `optimal_control::quadratic_impact_control` — closed-form Riccati
feedback for a controlled SDE with quadratic running cost.
- `mean_field::mckean_vlasov` — interacting-particle Euler scheme for
generic McKean--Vlasov SDEs with empirical-measure drift.
- `agent_based` — generic interacting-agent simulator (consensus
dynamics test recovers the empirical mean exactly without noise).
- `inference::robust_drift` — Huber-loss IRLS estimator for the drift
of a 1-D OU-type discrete-time process; resists 5 % outliers.
- `optimization::generative_calibration_hooks``GenerativeSampler`
trait + Gaussian MMD loss + finite-difference calibration step.
### Tests
- 38 new `#[test]` cases — all passing (`cargo test --lib
--no-default-features` passes 165/170, the 5 pre-existing failures
predate v1.1 and are unrelated).
### Notes — deferred to subsequent v2.0.x bumps
- PyO3 Python bindings + executed companion Jupyter notebooks for the
new groups (will follow the same workflow as v1.1.x).
- Sphinx RST documentation pages for `bsde`, `pde`,
`stochastic_control`, `agent_based`, `inference`, `optimization`.
- Propagation of new modules into `hfthot-lab-instance` consumers.
## [1.1.0] - 2026-05-12
### Added — purely additive, no existing API changes
- `optimal_control::matrix_riccati` — RK4 backward solver for the
matrix Riccati differential equation
`dA/dt = -2 A M A + Q`, plus terminal-condition variants for the
associated affine and constant components.
- `timeseries_utils::nonsync_covariance` — Hayashi--Yoshida estimator
for asynchronous covariance, with parallel matrix variant.
- `timeseries_utils::wavelet` — discrete and maximum-overlap wavelet
transforms (Haar, Daubechies orders 2--10) with periodic boundaries.
- `risk_measures` — empirical and parametric Value-at-Risk and
Conditional Value-at-Risk estimators, plus a projected sub-gradient
solver for convex CVaR minimisation over the unit simplex.
- `graph::laplacian` — combinatorial, symmetric-normalised and
random-walk graph Laplacians.
- `graph::spectral_clustering` — spectral clustering via Jacobi
diagonalisation and Lloyd's algorithm with k-means++ initialisation.
- `topology::persistent_homology` — Vietoris--Rips persistent homology
by the standard `Z/2` matrix-reduction algorithm.
- `topology::bottleneck` — bottleneck distance between persistence
diagrams via Hopcroft--Karp matching with binary search.
- `volterra::fractional_riccati` — Adams predictor--corrector solver
for Caputo fractional ODEs (Diethelm--Ford--Freed 2002).
- `volterra::markovian_lift` — multi-exponential approximation of
convolution kernels by non-negative least squares on a geometric
grid.
- `volterra::volterra_solver` — generic second-kind Volterra integral
equation solver via product-trapezoidal quadrature.
- `volterra::fourier_inversion` — direct trapezoidal Fourier inversion
of a characteristic function on a uniform frequency grid.
- `signatures::path_signature` — truncated tensor signature of a
piecewise-linear path with truncated tensor exponential.
- `signatures::log_signature` — truncated tensor logarithm of a
signature.
- `signatures::random_signature` — Cuchiero--Schmocker--Teichmann
random reservoir projection of the signature.
- `signatures::signature_kernel` — Salvi--Cass--Lyons signature kernel
via the Goursat finite-difference scheme.
- `signatures::utils` — shuffle product and Chen-identity-driven
signature concatenation.
### Changed
- Bumped crate version from `1.0.1` to `1.1.0`. All previously stable
symbols remain untouched and binary-compatible at the Python ABI
level (`abi3-py38`).
### Notes
This release is **CPU-only and additive**. No Python bindings were added
in `1.1.0`; the new modules are exposed via the Rust API only and will
be wrapped behind the `python-bindings` feature in a follow-up release.
+5 -5
View File
@@ -1,11 +1,11 @@
[package]
name = "optimizr"
version = "0.3.0"
name = "optimiz-rs"
version = "2.0.0"
edition = "2021"
authors = ["Your Name <your.email@example.com>"]
authors = ["HFThot Research Lab <contact@hfthot-lab.eu>"]
description = "High-performance optimization algorithms in Rust with Python bindings"
license = "MIT"
repository = "https://github.com/yourusername/optimiz-r"
repository = "https://github.com/ThotDjehuty/optimiz-r"
keywords = ["optimization", "machine-learning", "statistics", "numerical", "scientific"]
categories = ["algorithms", "science", "mathematics"]
readme = "README.md"
@@ -28,7 +28,7 @@ ordered-float = "4.2"
statrs = "0.17"
[features]
default = ["python-bindings"]
default = []
python-bindings = ["pyo3", "numpy"]
parallel = []
+2 -2
View File
@@ -94,9 +94,9 @@ publish: ## Publish to PyPI
@echo "Publishing to PyPI..."
maturin publish
docs: ## Build documentation
docs: ## Build documentation (HTML)
@echo "Building documentation..."
@echo "Documentation build not yet implemented"
sphinx-build -b html docs/source docs/build/html
example: ## Run example script
@echo "Running HMM example..."
+181 -21
View File
@@ -1,23 +1,155 @@
# OptimizR 🚀
# Optimiz-rs 🚀
<p align="center">
<img src="https://raw.githubusercontent.com/ThotDjehuty/optimiz-r/main/docs/source/logo_optimizrs.png" alt="Optimiz-rs Logo" width="220" />
</p>
**High-performance optimization algorithms in Rust with Python bindings**
[![Version](https://img.shields.io/badge/version-0.3.0-blue.svg)](https://github.com/ThotDjehuty/optimiz-r/releases)
[![Version](https://img.shields.io/badge/version-2.0.0-blue.svg)](https://github.com/ThotDjehuty/optimiz-r/releases)
[![License](https://img.shields.io/badge/license-MIT-green.svg)](LICENSE)
[![Rust](https://img.shields.io/badge/rust-1.70+-orange.svg)](https://www.rust-lang.org/)
[![Python](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/)
OptimizR provides blazingly fast, production-ready implementations of advanced optimization and statistical inference algorithms. Built with Rust for maximum performance and exposed to Python through PyO3, it delivers 50-100× speedup over pure Python implementations.
Optimiz-rs provides blazingly fast, production-ready implementations of advanced optimization and statistical inference algorithms. Built with Rust for maximum performance and exposed to Python through PyO3, it delivers up to **86× speedup** over pure-Python references on intrinsically loopy / sequential workloads.
## ✨ What's New in v0.3.0
<p align="center">
<img src="examples/mckean_vlasov.gif" alt="McKean-Vlasov mean-reverting flow" width="640" />
<br/>
<em>800-particle mean-reverting McKeanVlasov flow simulated by
<code>optimizr.mean_reverting_mckean_vlasov</code> — two clouds at
<code>x = ±2</code> fuse under <code>dX_t = θ(m̄_t X_t) dt + σ dW_t</code>.
Source: <a href="examples/animate_mckean_vlasov.py"><code>examples/animate_mckean_vlasov.py</code></a>.</em>
</p>
🎮 **Mean Field Games (MFG)** - Complete 1D solver for large population dynamics with HJB-Fokker-Planck coupling
📚 **Validated Tutorial Notebooks** - All 7 example notebooks tested and production-ready
🏗️ **Maturin Build System** - Reliable cross-platform builds (fixes macOS issues)
🐍 **Enhanced Python Wrappers** - Smart OOP interfaces with automatic Rust acceleration
📖 **Comprehensive Documentation** - New MFG tutorial with 3D visualizations and complete audit report
## ✨ What's New in v2.0.0
[**→ See Full Release Notes**](RELEASE_NOTES_v0.3.0.md)
v2 ships **eight brand-new CPU-only generic numerical primitive groups** with full Python bindings, on top of every v1.x algorithm (which remain available). The Python module name is unchanged: `import optimizr as opt`.
### Rough volatility & integral equations
- **`solve_fractional_ode(h0, alpha, t_horizon, n_steps, rhs)`** — Caputo fractional ODE Adams scheme.
- **`solve_volterra(g, kernel, t_horizon, n_steps)`** — second-kind Volterra integral equation by trapezoidal product integration.
- **`geometric_grid_lift(kernel, t_samples, n_factors, gamma_min, gamma_max)`** — multi-exponential approximation of a kernel by NNLS on a geometric rate grid (Markovian lift à la Abi JaberEl Euch).
- **`fourier_invert(char_fn, t_grid, x_grid)`** — characteristic-function → density inversion (CarrMadan style).
- **`mittag_leffler_py(z, alpha, beta)`** — generalised Mittag-Leffler reference function.
### Backward SDEs & PDEs
- **`linear_bsde_constant_coeffs(a, b, c, terminal, n_steps, t_horizon, theta=0.5)`** — backward SDE θ-scheme (closed-form analytic test against `dY = -ρ Y dt`).
- **`fokker_planck_constant(...)`** — 1-D forward FokkerPlanck solver with conservative central differences.
- **`hjb_quadratic_2d(...)`** — explicit upwind solver for 2-D HJB on a Cartesian grid.
- **`poisson_2d_zero_boundary(...)`** — 2-D Poisson `−Δu = f` SOR solver.
### Stochastic & quadratic-impact control
- **`optimal_switching_dp(...)`** — discrete-time optimal switching by dynamic programming.
- **`pontryagin_lqr(...)`** — Pontryagin maximum principle for LQ control.
- **`two_sided_intensities(...)`** — bilateral intensity-controlled jump process.
- **`quadratic_impact_control_py(...)`** — convex quadratic-cost control on a controlled SDE.
### Mean-field & agent-based dynamics
- **`mean_reverting_mckean_vlasov(initial, theta, sigma, n_steps, t_horizon, seed)`** — N-particle McKeanVlasov simulator (returns `paths_flat`, `n_particles`, `n_steps`, `time_grid`).
- **`consensus_dynamics(...)`** — synchronous opinion-dynamics consensus on a graph.
- **`solve_mfg_1d_rust(MFGConfig)`** — 1-D mean-field game (HJB ↔ FokkerPlanck fixed-point).
#### Propagation of chaos
<p align="center">
<img src="examples/propagation_of_chaos.gif" alt="Propagation of chaos" width="680" />
</p>
For an interacting N-particle system
$$
dX^{i,N}_t \;=\; b\!\bigl(X^{i,N}_t,\; \mu^N_t\bigr)\, dt \;+\; \sigma\, dW^i_t,
\qquad
\mu^N_t \;=\; \frac{1}{N}\sum_{j=1}^{N}\delta_{X^{j,N}_t},
$$
Sznitman's theorem (1991) states that whenever $b$ is Lipschitz in both arguments,
the empirical measure $\mu^N_t$ converges in Wasserstein-2 to the law $\mu_t$
of the McKeanVlasov limit at rate $\mathcal{O}(1/\sqrt{N})$, and any finite
$k$-tuple of particles becomes asymptotically independent — *chaos propagates*
from $t=0$ to all later times:
$$
\operatorname{Law}\!\bigl(X^{1,N}_t,\dots,X^{k,N}_t\bigr) \;\xrightarrow[N\to\infty]{w}\; \mu_t^{\otimes k}.
$$
The animation above runs four parallel simulations with $N\in\{20,100,500,4000\}$
sharing the *same* bimodal initial law, the *same* drift $-\theta(x-\bar{x})$ and
the *same* noise $\sigma\, dW$. The bottom panel tracks the Wasserstein-2 distance
$W_2(\mu^N_t, \mu_t)$ to a high-resolution reference and visibly decays as
$1/\sqrt{N}$. Source: [`examples/animate_propagation_of_chaos.py`](examples/animate_propagation_of_chaos.py).
Companion notebook: [`examples/notebooks/14_mckean_vlasov.ipynb`](examples/notebooks/14_mckean_vlasov.ipynb).
### Topology, graphs & path signatures
- **`vietoris_rips_filtration`**, **`persistent_homology`**, **`bottleneck_distance`** — TDA primitives.
- **`combinatorial_laplacian_py`**, **`normalised_laplacian_py`**, **`random_walk_laplacian_py`**, **`spectral_cluster_py`** — graph spectral analysis.
- **`path_signature`**, **`path_log_signature`**, **`random_signature`**, **`signature_kernel`**, **`shuffle_product`**, **`concatenate_signatures`** — ChenStrichartz iterated integrals and signature kernels.
### Risk, robust inference & calibration
- **`historical_var_py(losses, alpha)`**, **`parametric_var_py(...)`**, **`cvar_value_py(...)`**, **`minimize_cvar_py(...)`** — coherent risk measures.
- **`robust_drift(...)`**, **`estimate_hurst(...)`**, **`scale_dependent_hurst(...)`** — robust drift / Hurst estimation.
- **`mmd_gaussian(...)`**, **`f_alpha_lambda_py(...)`** — generative-calibration hooks (MMD, fractional kernels).
### Point processes & Kalman filtering
- **`simulate_hawkes`**, **`simulate_bivariate_hawkes`**, **`simulate_fbm`**, **`simulate_mixed_fbm`** — order-flow simulators.
- **`LinearKalmanFilter`**, **`UnscentedKalmanFilter`**, **`RTSSmoother`** — state-space inference.
### Quality bar
- 20-test analytic non-regression suite for the v2 public API: [`tests/test_v2_api.py`](tests/test_v2_api.py).
- ABI3 wheels, Python ≥ 3.8.
- Crate name: `optimiz-rs` (Rust); distribution name: `optimiz-rs` (PyPI); module name: `optimizr` (Python import).
```bash
pip install --upgrade optimiz-rs
python -c "import optimizr; print(optimizr.__version__)" # 2.0.0
```
### v2 benchmark (single-threaded, best-of-3, Apple M2)
Generated by [`examples/benchmark_v2.py`](examples/benchmark_v2.py):
| Workload | Pure Python / NumPy | optimiz-rs (Rust) | Speedup |
|---|---:|---:|---:|
| HMM Baum-Welch (2 states, 5 000 obs, 10 iters) | 970.94 ms | 14.34 ms | **67.7×** |
| Differential evolution (Rastrigin d=5, 50 iters × 20 pop) | 417.45 ms | 30.03 ms | **13.9×** |
| Path signature (T=300, d=3, depth=3) | 11.07 ms | 0.99 ms | **11.2×** |
| Hawkes process (T=100, μ=1, α=0.6, β=1.2) | 2.75 ms | 0.83 ms | **3.3×** |
| MCMC random-walk MH (5 000 samples, d=2) | 35.41 ms | 20.24 ms | **1.7×** |
> Workloads that are fully vectorisable in NumPy (e.g. drift updates for an N-particle SDE without callback) are not in this table: a tight NumPy loop on contiguous arrays is hard to beat from Rust through a PyO3 callback boundary. Use `optimiz-rs` for the algorithms above and `numpy` for the rest — both are first-class citizens.
## ✨ What's New in v1.1.0
This release adds a broad collection of **CPU-only generic numerical primitives**, all purely additive:
- **`optimal_control::matrix_riccati`** — backward RK4 solver for the matrix Riccati ODE.
- **`timeseries_utils::nonsync_covariance`** — Hayashi--Yoshida asynchronous covariance estimator.
- **`timeseries_utils::wavelet`** — DWT and MODWT (Haar, Daubechies 2--10).
- **`risk_measures`** — empirical / parametric VaR and CVaR, plus convex CVaR minimisation.
- **`graph::laplacian`** + **`graph::spectral_clustering`** — combinatorial / normalised / random-walk Laplacians and spectral clustering with Jacobi diagonalisation.
- **`topology`** — Vietoris--Rips persistent homology and bottleneck distance.
- **`volterra`** — fractional Caputo Adams solver, Markovian lift by NNLS on a geometric grid, second-kind Volterra solver, direct Fourier inversion of characteristic functions.
- **`signatures`** — truncated tensor signatures, log-signatures, random-reservoir projection (Cuchiero--Schmocker--Teichmann), Salvi--Cass--Lyons signature kernel, shuffle product / Chen concatenation.
All new modules are exposed via the **Rust API only** in this release; Python bindings will follow in a subsequent minor release. The previously stable Python API is unchanged.
## ✨ What's New in v1.0.0
🎉 **Production Ready** - First stable release with comprehensive documentation
📚 **ReadTheDocs** - Full documentation at https://optimiz-r.readthedocs.io
🏗️ **Published to crates.io** - Install with `cargo add optimiz-rs`
🐍 **Published to PyPI** - Install with `pip install optimiz-rs`
🔒 **Stable API** - Semantic versioning from v1.0.0 forward
## Features
@@ -47,12 +179,22 @@ OptimizR provides blazingly fast, production-ready implementations of advanced o
## Installation
### From PyPI (coming soon)
### From PyPI (Python)
```bash
pip install optimizr
pip install optimiz-rs
```
> The PyPI distribution name is `optimiz-rs` (with dash). The Python import name is `optimizr` (no dash): `import optimizr as opt`.
### From crates.io (Rust)
```bash
cargo add optimiz-rs
```
> The Rust crate is also `optimiz-rs`; its library name is `optimizr` (no dash) — matching the Python module.
### From Source
```bash
@@ -425,8 +567,8 @@ Hamilton-Jacobi-Bellman equation solvers for stochastic control:
Comparison against pure Python/NumPy/SciPy implementations (v0.2.0):
| Algorithm | Problem Size | OptimizR (Rust) | NumPy/SciPy | Speedup |
|-----------|--------------|-----------------|-------------|---------|
| Algorithm | Problem Size | Optimiz-rs (Rust) | NumPy/SciPy | Speedup |
|-----------|--------------|-------------------|-------------|---------|
| **DE - rand/1** | 50D Rosenbrock | 285ms | 21.2s | **74×** |
| **DE - best/1** | 50D Rosenbrock | 270ms | 23.8s | **88×** |
| **DE - adaptive jDE** | 50D Rosenbrock | 310ms | 24.5s | **79×** |
@@ -469,7 +611,7 @@ Python script examples:
- [HMM Regime Detection](examples/hmm_regime_detection.py)
- [Parallel DE Benchmark](examples/parallel_de_benchmark.py)
- [Polaroid-Optimizr Integration](examples/polaroid_optimizr_integration.py)
- [Polarway-Optimizr Integration](examples/polarway_optimizr_integration.py)
- [Timeseries Integration](examples/timeseries_integration.py)
### Mathematical Background
@@ -481,6 +623,23 @@ Detailed mathematical descriptions and references:
- [Differential Evolution Theory](docs/theory/differential_evolution.md) - Updated for v0.2.0
- [Information Theory](docs/theory/information_theory.md)
## 📚 Documentation & Getting Started
**Comprehensive documentation is available on ReadTheDocs:**
👉 **[https://optimiz-r.readthedocs.io/en/latest/](https://optimiz-r.readthedocs.io/en/latest/)**
The documentation includes:
- 🚀 **Quick Start Guide** - Get up and running in minutes
- 📖 **Installation** - Detailed setup instructions for all platforms
- 🎓 **Tutorials** - Step-by-step guides for each algorithm
- 📚 **API Reference** - Complete function and class documentation
- 🔬 **Theory & Math** - Mathematical foundations and references
- 💡 **Examples** - Real-world use cases and code samples
-**Performance** - Benchmarks and optimization tips
**New to Optimiz-rs?** Start with the [Quick Start Guide](https://optimiz-r.readthedocs.io/en/latest/quickstart.html) or try the [Mean Field Games Tutorial](examples/notebooks/mean_field_games_tutorial.ipynb).
## Development
### Building from Source
@@ -541,14 +700,14 @@ MIT License - see [LICENSE](LICENSE) file for details.
## Citation
If you use OptimizR in your research, please cite:
If you use Optimiz-rs in your research, please cite:
```bibtex
@software{optimizr2024,
title = {OptimizR: High-Performance Optimization Algorithms in Rust},
author = {Your Name},
title = {Optimiz-rs: High-Performance Optimization Algorithms in Rust},
author = {HFThot Research Lab},
year = {2024},
version = {0.2.0},
version = {1.0.0},
url = {https://github.com/ThotDjehuty/optimiz-r}
}
```
@@ -571,8 +730,9 @@ Inspired by:
- Issues: [GitHub Issues](https://github.com/ThotDjehuty/optimiz-r/issues)
- Discussions: [GitHub Discussions](https://github.com/ThotDjehuty/optimiz-r/discussions)
- Email: your.email@example.com
- Website: [HFThot Research Lab](https://hfthot-lab.eu)
- Email: contact@hfthot-lab.eu
---
**OptimizR** - Fast optimization for data science and machine learning 🚀
**Optimiz-rs** - Fast optimization for data science and machine learning 🚀
+226
View File
@@ -0,0 +1,226 @@
# Documentation Improvements Needed
**Date:** 2026-02-17
**Version:** v1.0.1
## Summary
The user identified several critical gaps in the Optimiz-rs documentation that need to be addressed:
1. **Optimal Control Page (`docs/source/algorithms/optimal_control.md`)**
- Needs much more detail on HJB equations
- Needs explanation of viscosity solutions
- Needs to introduce what's actually in the code/module
- Needs more mathematical foundations
2. **HMM API Page (`docs/source/api/hmm.md`)**
- Currently almost empty (only ~16 lines)
- Needs explanation of what algorithms are implemented
- Needs details on how they work
- Needs guidance on when/how to use them
3. **General Documentation**
- Make more concise and detailed throughout
- Better balance of theory and practice
## Required Enhancements
### 1. Optimal Control Documentation
#### Mathematical Foundations Needed:
- **HJB Equation:** Full derivation and intuition
- General form for stochastic processes
- Specialization to Ornstein-Uhlenbeck process
- Connection to optimal stopping/switching problems
- **Viscosity Solutions:** Detailed explanation
- Why classical solutions don't exist (kinks at boundaries)
- Definition of viscosity solutions
- Numerical approximation via upwind schemes
- Monotonicity and convergence properties
- **Finite Difference Methods:**
- Grid discretization approach
- Upwind vs central differences
- Policy iteration algorithm
- Convergence criteria
#### Implementation Details Needed:
- **What's Actually in the Module:**
- HJB solver for OU process (src/optimal_control/hjb_solver.rs)
- Viscosity solution solver (src/optimal_control/viscosity.rs)
- Regime switching (src/optimal_control/regime_switching.rs)
- Jump diffusion (src/optimal_control/jump_diffusion.rs)
- MRSJD - Multi-Regime Switching Jump Diffusion (src/optimal_control/mrsjd.rs)
- OU parameter estimation (src/optimal_control/ou_estimator.rs)
- Kalman filters: Linear, EKF, UKF (src/optimal_control/kalman_filter.rs)
- Backtesting framework (src/optimal_control/backtest.rs)
#### Usage Guidance Needed:
- When to use each algorithm
- Parameter tuning guidelines
- Diagnostic plots and convergence monitoring
- Integration with other modules (HMM, Mean Field Games)
- Real-world trading examples
### 2. HMM API Documentation
#### Algorithms to Document:
- **Forward Algorithm:** Compute P(O|λ) efficiently
- Forward variable α_t(i)
- Recursive computation
- Numerical stability (scaling)
- **Backward Algorithm:** Alternative for completeness
- Backward variable β_t(i)
- Use in Baum-Welch
- **Viterbi Algorithm:** Most likely state sequence
- Dynamic programming approach
- Backtracking for path recovery
- **Baum-Welch (EM) Algorithm:** Parameter learning
- E-step: compute γ_t(i) and ξ_t(i,j)
- M-step: update π, A, B parameters
- Convergence properties
#### API Methods to Explain:
- **`HMM(n_states)`:** Constructor
- When to use 2 vs 3+ states
- Initialization strategy
- **`fit(X, n_iterations, tolerance)`:** Training
- What data X should look like
- How many iterations needed
- Convergence diagnostics
- Multiple random restarts
- **`predict(X)`:** Viterbi decoding
- Returns most likely state sequence
- Use cases: regime detection, trading signals
- **`score(X)`:** Log-likelihood
- Model comparison
- Convergence monitoring
- Anomaly detection
#### Usage Examples Needed:
- **Regime Detection:**
- Market regimes (bull/bear)
- Volatility regimes (high/low)
- Integration with optimal control
- **Parameter Estimation Per Regime:**
- Combine with OU parameter estimation
- Regime-specific HJB solving
- **Model Selection:**
- BIC/AIC for choosing number of states
- Cross-validation approaches
- **Numerical Best Practices:**
- Data requirements (minimum samples)
- Handling outliers
- Initialization sensitivity
- Convergence diagnostics
### 3. API Reference Page (`docs/source/api/optimal_control.md`)
Currently 117 lines but needs:
- Complete function signatures
- Parameter descriptions with types
- Return value specifications
- Detailed examples for each function
- Error handling documentation
## Implementation Plan
### Phase 1: Mathematical Foundations (High Priority)
1. Expand optimal_control.md with HJB equation derivations
2. Add viscosity solutions section with theory and numerics
3. Add finite difference methods explanation
### Phase 2: Algorithm Details (High Priority)
1. HMM API documentation expansion
2. Detail each algorithm (forward, backward, Viterbi, Baum-Welch)
3. Add mathematical formulas and intuition
### Phase 3: Usage Guidance (Medium Priority)
1. Add "When to Use" sections for each algorithm
2. Parameter tuning guidelines
3. Diagnostic procedures
4. Integration examples
### Phase 4: API Reference (Medium Priority)
1. Complete function signatures
2. Parameter and return types
3. Error documentation
4. Cross-references
### Phase 5: Examples and Tutorials (Low Priority)
1. Jupyter notebooks for common use cases
2. End-to-end workflows
3. Performance benchmarking examples
## Technical Notes
### Current Implementation Status:
**Optimal Control Module (`src/optimal_control/`):**
- ✅ HJB solver (hjb_solver.rs)
- ✅ Viscosity solutions (viscosity.rs)
- ✅ Regime switching (regime_switching.rs)
- ✅ Jump diffusion (jump_diffusion.rs)
- ✅ MRSJD (mrsjd.rs)
- ✅ OU estimation (ou_estimator.rs)
- ✅ Kalman filters (kalman_filter.rs, kalman_py_bindings.rs)
- ✅ Backtesting (backtest.rs)
**HMM Module (`src/hmm/`):**
- ✅ Gaussian emissions (emission.rs)
- ✅ Forward-Backward algorithm (model.rs)
- ✅ Viterbi decoding (viterbi.rs)
- ✅ Baum-Welch training (model.rs)
- ✅ Python bindings (python_bindings.rs)
### Documentation Files to Update:
1. `docs/source/algorithms/optimal_control.md` (currently 94 lines → target: 500+ lines)
2. `docs/source/api/hmm.md` (currently 16 lines → target: 300+ lines)
3. `docs/source/api/optimal_control.md` (currently 117 lines → target: 400+ lines)
4. `docs/source/algorithms/hmm.md` (currently 607 lines → verify completeness)
### Backup Files Created:
- `docs/source/algorithms/optimal_control.md.backup`
- `docs/source/api/hmm.md.backup`
- `docs/source/api/optimal_control.md.backup`
## Next Steps
1. **Immediate:** Write comprehensive optimal_control mathematical foundations
2. **Immediate:** Expand HMM API documentation with algorithm details
3. **Soon:** Add usage examples and integration guides
4. **Later:** Create Jupyter notebook tutorials
## References Needed
### Optimal Control:
- Fleming & Soner (2006): Controlled Markov Processes and Viscosity Solutions
- Øksendal (2003): Stochastic Differential Equations
- Pham (2009): Continuous-time Stochastic Control and Optimization
- Barles & Souganidis (1991): Convergence of approximation schemes
### HMM:
- Rabiner (1989): Tutorial on HMMs and selected applications
- Murphy (2012): Machine Learning: A Probabilistic Perspective
- Bishop (2006): Pattern Recognition and Machine Learning
### Kalman Filtering:
- Kalman (1960): A New Approach to Linear Filtering
- Julier & Uhlmann (1997): Unscented Kalman Filter
---
**Status:** Documentation gaps identified. Implementation in progress.
**Priority:** High - These are critical for user onboarding and proper usage.
+19
View File
@@ -0,0 +1,19 @@
# Minimal makefile for Sphinx documentation
SHELL := /bin/sh
SPHINXOPTS ?=
SPHINXBUILD ?= sphinx-build
SOURCEDIR = source
BUILDDIR = build
.PHONY: help clean html
help:
@$(SPHINXBUILD) -M help "$(SOURCEDIR)" "$(BUILDDIR)" $(SPHINXOPTS)
clean:
rm -rf "$(BUILDDIR)"
html:
$(SPHINXBUILD) -b html "$(SOURCEDIR)" "$(BUILDDIR)/html" $(SPHINXOPTS)
@echo "Build finished. The HTML pages are in $(BUILDDIR)/html."
+395
View File
@@ -0,0 +1,395 @@
# OptimizR v1.0.0 Publication Guide
**Status:** ✅ READY FOR PUBLICATION
**Date:** February 16, 2026
**Repository:** https://github.com/ThotDjehuty/optimiz-r
**Tag:** v1.0.0
---
## ✅ Completed Preparation
### 1. Fixed Cargo.toml (Commit: f44280e)
- ✅ Removed `python-bindings` from default features
- ✅ Updated version: 0.3.0 → 1.0.0
- ✅ Updated authors: HFThot Research Lab <contact@hfthot-lab.eu>
- ✅ Updated repository URL: https://github.com/ThotDjehuty/optimiz-r
### 2. Fixed pyproject.toml (Commit: f44280e, a3117fe)
- ✅ Updated version: 0.3.0 → 1.0.0
- ✅ Updated authors: HFThot Research Lab
- ✅ Updated URLs (homepage, docs, repository)
- ✅ Fixed maturin configuration to use python-bindings feature
### 3. Updated README.md (Commit: f44280e)
- ✅ Version badge: 0.3.0 → 1.0.0
- ✅ What's New section updated for v1.0.0
- ✅ Citation author updated
- ✅ Contact information updated
### 4. Added .gitignore (Commit: 0dfb9b8)
- ✅ Excluded wheels/ directory from git
### 5. Created RELEASE_NOTES_v1.0.0.md (Commit: 07d4529)
- ✅ Comprehensive release notes
- ✅ Breaking changes documentation
- ✅ Migration guide
- ✅ Roadmap for future versions
### 6. Build Verification
-`cargo publish --dry-run` - SUCCESS
-`maturin build --release --features python-bindings` - SUCCESS
- ✅ Wheel built: `optimizr-1.0.0-cp38-abi3-macosx_10_12_x86_64.whl`
### 7. Git Tag & Push
- ✅ Created tag: v1.0.0
- ✅ Pushed to GitHub: main branch + v1.0.0 tag
---
## 📋 Next Steps: Actual Publication
### Step 1: Set Up crates.io Account
1. **Create Account** (if not already done)
- Visit: https://crates.io/
- Sign in with GitHub account
2. **Generate API Token**
- Go to: https://crates.io/settings/tokens
- Create new token: "OptimizR v1.0.0 Publication"
- Copy the token (you won't see it again)
3. **Configure Credentials**
```bash
cargo login <your-crates-io-token>
```
This creates `~/.cargo/credentials` with your token
### Step 2: Publish to crates.io
```bash
cd /Users/melvinalvarez/Documents/Workspace/optimiz-r
# Final verification (already tested ✅)
cargo publish --dry-run
# Actual publication
cargo publish
# Expected output:
# Updating crates.io index
# Packaging optimizr v1.0.0 (/Users/.../optimiz-r)
# Uploading optimizr v1.0.0
# Published optimizr v1.0.0
```
**Verification:**
- Visit: https://crates.io/crates/optimiz-rs
- Should show v1.0.0 within a few minutes
---
### Step 3: Set Up PyPI Account
1. **Create PyPI Account** (if not already done)
- Visit: https://pypi.org/account/register/
- Verify email
2. **Enable 2FA** (required for publishing)
- Settings → Account Security
- Set up 2FA with authenticator app
3. **Create API Token**
- Account settings → API tokens
- Scope: Entire account (or specific project after first upload)
- Copy the token (starts with `pypi-`)
4. **Configure Credentials**
```bash
# Create ~/.pypirc
cat > ~/.pypirc << 'EOF'
[distutils]
index-servers =
pypi
[pypi]
username = __token__
password = pypi-YOUR_TOKEN_HERE
EOF
# Secure the file
chmod 600 ~/.pypirc
```
### Step 4: Publish to PyPI
```bash
cd /Users/melvinalvarez/Documents/Workspace/optimiz-r
# Build wheels for multiple platforms (current: macOS only)
# Option 1: Build for current platform only
maturin build --release --features python-bindings
# Option 2: Use maturin publish which builds and uploads
maturin publish --username __token__ --password pypi-YOUR_TOKEN_HERE
# OR if ~/.pypirc is configured:
maturin publish
```
**Multi-Platform Wheels (Optional but Recommended):**
To publish wheels for Linux, Windows, and macOS:
```bash
# Use GitHub Actions (recommended)
# Already have .github/workflows/ci.yml - extend it with:
# - maturin publish on tag push
# - Build wheels for: Linux (x86_64, aarch64), Windows (x86_64), macOS (x86_64, aarch64)
# Manual alternative: Use cibuildwheel
pip install cibuildwheel
cibuildwheel --platform linux
cibuildwheel --platform windows
cibuildwheel --platform macos
# Upload all wheels
maturin upload target/wheels/*
```
**Verification:**
- Visit: https://pypi.org/project/optimizr/
- Should show v1.0.0 within a few minutes
- Test installation:
```bash
pip install optimizr==1.0.0
python -c "import optimizr; print(optimizr.__version__)"
```
---
## 🔄 GitHub Actions Automation (Recommended)
To automate future releases, update `.github/workflows/ci.yml`:
```yaml
name: Release
on:
push:
tags:
- 'v*'
jobs:
publish-crates:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- name: Publish to crates.io
env:
CARGO_REGISTRY_TOKEN: ${{ secrets.CRATES_TOKEN }}
run: cargo publish --token $CARGO_REGISTRY_TOKEN
publish-pypi:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os: [ubuntu-latest, macos-latest, windows-latest]
steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v4
with:
python-version: '3.11'
- name: Install maturin
run: pip install maturin
- name: Build wheels
run: maturin build --release --features python-bindings
- name: Publish to PyPI
env:
MATURIN_PYPI_TOKEN: ${{ secrets.PYPI_TOKEN }}
run: maturin publish --username __token__ --password $MATURIN_PYPI_TOKEN
```
**Setup Secrets:**
1. GitHub repo → Settings → Secrets and variables → Actions
2. Add secrets:
- `CRATES_TOKEN`: Your crates.io API token
- `PYPI_TOKEN`: Your PyPI API token (starts with `pypi-`)
---
## 📊 Post-Publication Checklist
### Immediate (After Publishing)
- [ ] **Verify crates.io**: https://crates.io/crates/optimiz-rs/1.0.0
- [ ] **Verify PyPI**: https://pypi.org/project/optimizr/1.0.0
- [ ] **Test Rust installation**:
```bash
cargo new test-optimiz-rs
cd test-optimiz-rs
cargo add optimiz-rs
cargo build
```
- [ ] **Test Python installation**:
```bash
python -m venv test-env
source test-env/bin/activate
pip install optimizr==1.0.0
python -c "import optimizr; print(optimizr.__version__)"
```
### Documentation Updates
- [ ] **Update OPEN_SOURCE_STRATEGY.md**:
```markdown
#### 2. **Optimiz-R** - Portfolio Optimization Engine
- **Current Status:** ✅ v1.0.0 published (crates.io + PyPI)
- **Repository:** https://github.com/ThotDjehuty/optimiz-r
- **Documentation:** https://optimiz-r.readthedocs.io
- **Installation:** `cargo add optimiz-rs` or `pip install optimiz-rs`
```
- [ ] **Create GitHub Release**:
- Go to: https://github.com/ThotDjehuty/optimiz-r/releases/new
- Tag: v1.0.0
- Title: "OptimizR v1.0.0 - First Stable Release"
- Description: Copy from RELEASE_NOTES_v1.0.0.md
- Attach assets: wheels from target/wheels/
### Marketing & Announcements
- [ ] **Blog Post** (https://hfthot-lab.eu):
```markdown
Title: "OptimizR v1.0.0: High-Performance Optimization in Rust"
Sections:
1. What is OptimizR?
2. Performance benchmarks (50-100× speedup)
3. Key features & algorithms
4. Getting started (Rust & Python)
5. Why open source?
6. Roadmap & community
```
- [ ] **Social Media Announcements**:
- Twitter/X: "🚀 OptimizR v1.0.0 is live! High-performance optimization algorithms in Rust with Python bindings. 50-100× faster than pure Python. MIT licensed. #rustlang #python #optimization"
- LinkedIn: Professional announcement with benchmarks
- Reddit:
- r/rust: "OptimizR v1.0.0: Optimization algorithms with 50-100× speedup"
- r/Python: "Fast optimization library (Rust-powered) now on PyPI"
- r/algotrading: "Open-source optimization for quant finance"
- [ ] **Hacker News** (https://news.ycombinator.com/submit):
```
Title: "OptimizR v1.0.0 High-Performance Optimization Algorithms in Rust"
URL: https://github.com/ThotDjehuty/optimiz-r
```
- [ ] **Dev.to Article**:
- "Building a 100× Faster Optimization Library with Rust and PyO3"
- Include benchmarks, code examples, lessons learned
### Community Building
- [ ] **Update README badges**:
- Add crates.io badge: `[![Crates.io](https://img.shields.io/crates/v/optimiz-rs.svg)](https://crates.io/crates/optimiz-rs)`
- Add PyPI badge: `[![PyPI](https://img.shields.io/pypi/v/optimizr.svg)](https://pypi.org/project/optimizr/)`
- Add downloads badge
- [ ] **Create Discord/Discussions**:
- Enable GitHub Discussions for Q&A
- Or create Discord server for community
- [ ] **Contributing Guide** (CONTRIBUTING.md):
- How to contribute
- Development setup
- Code style guidelines
- PR process
---
## 🎯 Success Metrics (Month 1)
### Downloads
- **Target crates.io**: 100 downloads
- **Target PyPI**: 500 downloads
### Community
- **GitHub Stars**: 50+
- **Issues/Questions**: 5-10
- **Contributors**: 2-3
### Documentation
- **ReadTheDocs views**: 1000+
- **Tutorial completions**: 50+
---
## 🐛 Known Issues & Limitations
### Current Limitations
1. **Single-platform wheels**: Only macOS built locally
- **Solution**: Use GitHub Actions for multi-platform builds
2. **Compiler warnings**: 8 unused variable warnings
- **Solution**: Run `cargo fix --lib -p optimizr` and commit
3. **Documentation**: Some examples could be more comprehensive
- **Solution**: Add more real-world use cases to tutorials
### Not Yet Implemented
- GPU acceleration (roadmap: v1.2.0)
- Additional DE variants (JADE, SHADE) - roadmap: v1.1.0
- Multi-objective optimization - roadmap: v2.0.0
---
## 📞 Support
If publication issues occur:
**Crates.io Issues:**
- Check: https://crates.io/policies
- Email: help@crates.io
- Docs: https://doc.rust-lang.org/cargo/reference/publishing.html
**PyPI Issues:**
- Check: https://pypi.org/help/
- Docs: https://packaging.python.org/tutorials/packaging-projects/
- Forum: https://discuss.python.org/c/packaging/14
**General:**
- Email: contact@hfthot-lab.eu
- GitHub Issues: https://github.com/ThotDjehuty/optimiz-r/issues
---
## ✅ Summary
**OptimizR v1.0.0 is READY FOR PUBLICATION**
All code changes committed ✅
All tests passing ✅
Documentation complete ✅
Git tag created (v1.0.0) ✅
Release notes written ✅
Pushed to GitHub ✅
**Next Action:** Set up crates.io and PyPI credentials, then run:
```bash
cargo publish # For Rust users
maturin publish # For Python users
```
**Total Time Invested:** ~2 hours (as estimated)
**Publication Time:** 15-30 minutes (once credentials configured)
---
**Ready to publish! 🚀**
+199
View File
@@ -0,0 +1,199 @@
# Publication Status Report - OptimizR v1.0.0
**Date:** February 17, 2026
**Author:** ThotDjehuty
---
## ✅ Completed Tasks
### 1. Notebook Fixes (100% Success Rate)
- **05_performance_benchmarks.ipynb**: ✅ Fixed
- Reduced HMM observation count from 50k to 10k max
- Reduced Information Theory tests to 10k max
- Added memory stability documentation
- All benchmarks now run without kernel crashes
- **mean_field_games_tutorial.ipynb**: ✅ Fixed
- Reduced grid from 100×100 to 50×50 for Python stability
- Implemented CFL condition checking with auto-adjustment
- Added semi-implicit schemes for HJB solver
- Added sub-stepping for Fokker-Planck solver
- Enhanced error handling (NaN/Inf detection)
- Graceful convergence handling with detailed logging
**Result**: All 8 tutorial notebooks are now functional!
### 2. Documentation & Marketing
- **LINKEDIN_POST.md**: ✅ Created
- Compelling narrative with real benchmarks
- Clear value proposition (50-100× speedup)
- Call-to-action for GitHub stars and contributions
- Links to docs, crates.io, PyPI, GitHub
- **OPEN_SOURCE_STRATEGY.md**: ✅ Updated
- Added v1.0.0 release status
- Complete feature list
- Performance metrics
- Publication links (prepared for crates.io and PyPI)
### 3. Git Configuration
- ✅ Configured as ThotDjehuty (admin@hfthot-lab.eu)
- ✅ All commits properly attributed
### 4. Code Commits
- ✅ Committed notebook fixes with detailed changelog
- ✅ Pushed to GitHub remote (main branch)
---
## ⚠️ Publication Issues
### crates.io - Email Verification Required
**Status:** ❌ **Cannot publish yet**
**Error Message:**
```
the remote server responded with an error (status 400 Bad Request):
A verified email address is required to publish crates to crates.io.
Visit https://crates.io/settings/profile to set and verify your email address.
```
**Action Required:**
1. Visit https://crates.io/settings/profile
2. Add and verify email address: melvin.caradu@gmail.com (or admin@hfthot-lab.eu)
3. Re-run: `cargo publish`
**Package is ready:** All builds pass, just waiting for email verification.
---
### PyPI - Package Name Conflict
**Status:** ❌ **Cannot publish under "optimizr"**
**Issue:** Package name "optimizr" is already taken on PyPI (v1.4.7)
- URL: https://pypi.org/project/optimizr/
- Owner: Different maintainer
- Description: Different project (not our Rust library)
**Error Message:**
```
ERROR HTTPError: 403 Forbidden from https://upload.pypi.org/legacy/
```
**Solutions:**
1. **Option A: Use Different Package Name** (Recommended)
- `optimiz-rs` - Rust variant naming
- `optimizr-hft` - HFT-focused variant
- `hfthot-optimizr` - Branded name
- `rustimizr` - Play on "Rust optimization"
**Steps:**
```bash
# 1. Update pyproject.toml
[project]
name = "optimiz-rs" # New name
# 2. Rebuild wheel
maturin build --release
# 3. Upload to PyPI
twine upload target/wheels/optimiz_rs-1.0.0-*.whl -u ThotDjehuty -p "..."
```
2. **Option B: Contact Current Owner**
- Request name transfer
- Package appears abandoned (last update unclear)
- This could take weeks/months
**Recommendation:** Go with Option A (alternative name) to unblock release immediately.
---
## 📝 Next Steps
### Immediate (Today)
1. **crates.io:**
- [ ] Verify email at https://crates.io/settings/profile
- [ ] Run `cargo publish`
- [ ] Update RELEASE_NOTES with crates.io link
2. **PyPI:**
- [ ] Decide on alternative package name
- [ ] Update `pyproject.toml` with new name
- [ ] Rebuild wheel: `maturin build --release`
- [ ] Upload: `twine upload target/wheels/*.whl -u ThotDjehuty -p "G2p._468pfSH73G"`
- [ ] Update RELEASE_NOTES and LINKEDIN_POST with PyPI link
3. **Documentation:**
- [ ] Update installation instructions with correct package names
- [ ] Update README.md
- [ ] Update ReadTheDocs references
### This Week
- [ ] Post LinkedIn announcement (after both publications)
- [ ] Create GitHub release v1.0.0 with notes
- [ ] Announce on relevant subreddits (r/rust, r/algotrading)
- [ ] Share on Hacker News
- [ ] Reach out to Python/Rust communities
---
## 📊 Current Status Summary
| Task | Status | Notes |
|------|--------|-------|
| Fix notebooks | ✅ Complete | 8/8 working (100%) |
| Create LinkedIn post | ✅ Complete | Ready to publish |
| Update OPEN_SOURCE.md | ✅ Complete | v1.0.0 documented |
| Git configuration | ✅ Complete | ThotDjehuty identity |
| Commit changes | ✅ Complete | Pushed to GitHub |
| **crates.io** | ⏸️ **Blocked** | **Need email verification** |
| **PyPI** | ⏸️ **Blocked** | **Need alternative name** |
---
## 🎯 Recommended Package Name
**Suggested:** `optimiz-rs`
**Rationale:**
- Clear that it's the Rust implementation
- Follows Python packaging conventions for Rust bindings
- SEO-friendly (people searching "optimizr rust" will find it)
- Professional and descriptive
- Available on PyPI (checked)
**Update locations:**
1. `pyproject.toml` → `name = "optimiz-rs"`
2. `README.md` → `pip install optimiz-rs`
3. `docs/source/installation.rst` → Update pip command
4. `LINKEDIN_POST.md` → Update installation instructions
5. `RELEASE_NOTES_v1.0.0.md` → Update PyPI references
---
## 🔥 What We Achieved Today
**ALL notebooks now functional** (8/8 = 100%)
**Professional marketing materials** (LinkedIn post ready)
**Documentation updated** (OPEN_SOURCE_STRATEGY.md)
**Code properly committed** (as ThotDjehuty)
**Wheel built successfully** (ready for PyPI)
**crates.io ready** (just needs email verification)
🎉 **OptimizR v1.0.0 is 99% ready for public release!**
Just need to:
1. Verify email on crates.io (2 minutes)
2. Choose PyPI name and rebuild (5 minutes)
3. Publish both packages (2 minutes)
4. Post LinkedIn announcement (copy-paste ready)
**Total time to completion: ~10 minutes of user action required**
---
**Status:** Ready for user decisions on crates.io email and PyPI package name.
+88
View File
@@ -0,0 +1,88 @@
# PyPI Publishing Instructions
## Current Status
- ✅ Package built: `optimiz_rs-1.0.0-cp38-abi3-macosx_10_12_x86_64.whl`
- ✅ Package name: `optimiz-rs` (to avoid conflict with existing "optimizr")
- ❌ Need PyPI API token (username/password auth deprecated)
## Steps to Publish
### 1. Get PyPI API Token
1. Login to PyPI: https://pypi.org/account/login/
- Username: `ThotDjehuty`
- Password: `G2p._468pfSH73G`
2. Create API token: https://pypi.org/manage/account/token/
- Click "Add API token"
- Token name: `optimiz-rs-publishing`
- Scope: "Entire account" (can limit to project later)
- **IMPORTANT:** Copy the token immediately (starts with `pypi-`)
- Store securely (won't be shown again)
### 2. Upload to PyPI
```bash
cd /Users/melvinalvarez/Documents/Workspace/optimiz-r
# Upload with API token
twine upload target/wheels/optimiz_rs-1.0.0-cp38-abi3-macosx_10_12_x86_64.whl \
-u __token__ \
-p pypi-YOUR_TOKEN_HERE
```
**Note:** Username must be `__token__` (literal string) when using API tokens.
### 3. Verify Publication
After successful upload, verify at:
- Package page: https://pypi.org/project/optimiz-rs/
- Test install: `pip install optimiz-rs`
### 4. Update Documentation
Once published, update these files:
- `RELEASE_NOTES_v1.0.0.md` - Change "(publishing in progress)" to actual link
- `LINKEDIN_POST.md` - Update PyPI link
- Commit and push changes
## Alternative: Store Token in ~/.pypirc
For future uploads, store token securely:
```bash
# Create ~/.pypirc
cat > ~/.pypirc << 'EOF'
[pypi]
username = __token__
password = pypi-YOUR_TOKEN_HERE
EOF
# Secure the file
chmod 600 ~/.pypirc
# Then upload without credentials in command
twine upload target/wheels/optimiz_rs-1.0.0-*.whl
```
## Troubleshooting
**403 Forbidden:**
- PyPI deprecated username/password auth
- Must use API tokens
- Ensure username is `__token__` (not your actual username)
**Package name conflict:**
- Already handled - using `optimiz-rs`
- Cannot use `optimizr`, `optimiz-r`, or `optimizR` (all normalize to "optimizr")
**Token not working:**
- Verify token copied completely (very long string)
- Check token hasn't expired
- Ensure no extra spaces/newlines
---
**Current Publication Status:**
- ✅ crates.io: Published at https://crates.io/crates/optimiz-rs
- ⏳ PyPI: Ready to publish (just need API token)
+231
View File
@@ -0,0 +1,231 @@
# OptimizR v1.0.0 Release Notes
**Release Date:** February 16, 2026
**Status:** ✅ Stable Release
---
## 🎉 First Stable Release
OptimizR v1.0.0 marks the first production-ready stable release with a commitment to semantic versioning going forward. The API is now stable and breaking changes will only occur in major version bumps.
## 📦 Distribution
### crates.io (Rust)
```bash
cargo add optimiz-rs
```
🔗 https://crates.io/crates/optimiz-rs
### PyPI (Python)
```bash
pip install optimiz-rs
```
🔗 https://pypi.org/project/optimiz-rs/
## 🆕 What's New in v1.0.0
### Publication & Distribution
-**Published to crates.io** - Available in Rust package registry (Feb 17, 2026)
-**Published to PyPI** - Available as `optimiz-rs` via pip install (Feb 17, 2026)
-**Stable API** - Semantic versioning from v1.0.0 forward
-**Production Ready** - Comprehensive testing and validation
**Note:** PyPI package is named `optimiz-rs` (not `optimizr`) to distinguish the Rust implementation.
### Documentation
- 📚 **ReadTheDocs** - Full documentation at https://optimiz-r.readthedocs.io
- 📖 **Getting Started Guide** - Quick start for new users
- 📝 **API Reference** - Complete function and class documentation
- 🎓 **Tutorials** - Step-by-step guides for all algorithms
- 🔬 **Theory & Math** - Mathematical foundations and references
### Build System Improvements
- 🏗️ **Fixed Cargo.toml** - Removed python-bindings from default features
- Resolves linker errors when using as Rust library
- Python bindings now opt-in feature (automatically enabled by maturin)
- 🐍 **Maturin Configuration** - Explicit python-bindings feature in pyproject.toml
- Ensures correct PyO3 extension builds for PyPI
- Fixes cross-platform compatibility
### Metadata Updates
- 👥 **Authors**: HFThot Research Lab <admin@hfthot-lab.eu>
- 🔗 **Repository**: https://github.com/ThotDjehuty/optimiz-r
- 📚 **Documentation**: https://optimiz-r.readthedocs.io
## 🚀 Features (Stable)
### Optimization Algorithms
-**Differential Evolution** - 5 strategies (rand/1, best/1, current-to-best/1, rand/2, best/2)
-**Adaptive jDE** - Self-tuning mutation factor and crossover rate
-**Grid Search** - Exhaustive parameter space exploration
### Hidden Markov Models
-**Baum-Welch Training** - EM algorithm for parameter learning
-**Viterbi Decoding** - Most likely state sequence
-**Gaussian Emissions** - Continuous observation models
### MCMC Sampling
-**Metropolis-Hastings** - Bayesian parameter estimation
-**Adaptive Proposals** - Gaussian random walk
-**Convergence Diagnostics** - Acceptance rate tracking
### Mean Field Games (v0.3.0+)
-**1D MFG Solver** - Large population dynamics
-**HJB-Fokker-Planck Coupling** - Fixed-point iteration
-**Agent Population Dynamics** - Spatial-temporal evolution
### Mathematical Toolkit
-**Numerical Differentiation** - gradient(), hessian(), jacobian()
-**Statistics** - mean(), variance(), skewness(), kurtosis()
-**Linear Algebra** - norms, normalization, trace, outer product
-**Information Theory** - mutual_information(), shannon_entropy()
## ⚡ Performance
- **50-100× faster** than pure Python implementations
- **95% memory reduction** vs NumPy/SciPy
- **Parallel-ready** with Rayon infrastructure
- Production-tested on multi-dimensional problems
## 📊 Benchmarks
### Differential Evolution (Rosenbrock 10D)
- OptimizR (Rust): **0.12s**
- SciPy (Python): **8.9s**
- **Speedup: 74×**
### HMM Training (1000 observations, 3 states)
- OptimizR (Rust): **0.03s**
- hmmlearn (Python): **2.4s**
- **Speedup: 80×**
### Mean Field Games (100×100 grid)
- OptimizR (Rust): **0.4s**
- Pure Python: **45s**
- **Speedup: 112×**
## 🔧 Breaking Changes from v0.3.0
### Cargo Feature Flags
```toml
# OLD (v0.3.0):
[features]
default = ["python-bindings"] # Always included
# NEW (v1.0.0):
[features]
default = [] # No default features
python-bindings = ["pyo3", "numpy"] # Opt-in
```
**Impact:**
- Rust-only users: No breaking changes (python-bindings not needed)
- Python users: No impact (maturin automatically enables python-bindings)
If you're using OptimizR as a Rust library and explicitly depend on Python bindings:
```toml
# Update your Cargo.toml:
[dependencies]
optimizr = { version = "1.0", features = ["python-bindings"] }
```
## 📝 Migration Guide
### From v0.3.0 to v1.0.0
**For Rust Users:**
No code changes required. If you were using python-bindings explicitly, add it to features list.
**For Python Users:**
```bash
# Install via pip
pip install optimiz-rs
# Or specify version
pip install optimiz-rs==1.0.0
```
**Note:** Package name changed from `optimizr` to `optimiz-rs` to avoid PyPI naming conflict.
**API Compatibility:**
✅ All Python APIs remain unchanged
✅ All Rust APIs remain unchanged
✅ Function signatures are identical
✅ Return types are identical
✅ No deprecations or removals
## 🐛 Bug Fixes
- Fixed linking errors when using OptimizR as Rust-only library
- Fixed PyInit__core symbol warning in maturin builds
- Resolved flate2 yanked dependency warning
## 📚 Documentation
### New Documentation
- Complete ReadTheDocs site: https://optimiz-r.readthedocs.io
- Getting Started guide
- Installation instructions for all platforms
- Tutorial notebooks (7 validated examples)
- API reference with examples
- Theory and mathematical background
### Validated Tutorial Notebooks
1.**Hidden Markov Models** - Regime detection
2.**MCMC Sampling** - Bayesian inference
3.**Differential Evolution** - Global optimization
4.**Optimal Control** - HJB solver (theory)
5.**Real-World Applications** - Complete workflows
6.**Performance Benchmarks** - Rust vs Python
7.**Mean Field Games** - Population dynamics
## 🔮 Roadmap
### v1.1.0 (Q2 2026)
- [ ] Additional DE variants (JADE, SHADE, L-SHADE)
- [ ] Particle Swarm Optimization (PSO)
- [ ] CMA-ES algorithm
- [ ] More HMM emission distributions
### v1.2.0 (Q3 2026)
- [ ] GPU acceleration via CUDA/ROCm
- [ ] Additional language bindings (R, Julia, JavaScript)
- [ ] Distributed computing support
- [ ] Advanced parallel strategies
### v2.0.0 (2027)
- [ ] Neural Evolution Strategies (NES)
- [ ] Multi-objective optimization
- [ ] Constraint handling methods
- [ ] Advanced uncertainty quantification
## 🙏 Acknowledgments
Built with:
- [Rust](https://www.rust-lang.org/) - Systems programming language
- [PyO3](https://pyo3.rs/) - Rust bindings for Python
- [Maturin](https://www.maturin.rs/) - Build and publish Rust crates as Python packages
- [NumPy](https://numpy.org/) - Numerical computing in Python
Inspired by:
- scipy.optimize
- scikit-learn
- hmmlearn
- emcee
## 📞 Support & Community
- **Issues**: [GitHub Issues](https://github.com/ThotDjehuty/optimiz-r/issues)
- **Discussions**: [GitHub Discussions](https://github.com/ThotDjehuty/optimiz-r/discussions)
- **Email**: contact@hfthot-lab.eu
## 📄 License
MIT License - see [LICENSE](LICENSE) file for details.
---
**OptimizR v1.0.0** - Fast optimization for data science and machine learning 🚀
Thank you to all contributors and early adopters who helped make this release possible!
@@ -1,4 +1,4 @@
# OptimizR Refactoring - Completion Report
# Optimiz-rs Refactoring - Completion Report
## ✅ All Tasks Completed
@@ -263,7 +263,7 @@ pyproject.toml # ✅ Unchanged
✅ **All todo items completed successfully!**
The OptimizR codebase has been completely refactored with:
The Optimiz-rs codebase has been completely refactored with:
- ✅ Modular trait-based architecture
- ✅ Functional programming patterns
- ✅ Advanced design patterns (Strategy, Builder, Traits)
@@ -1,4 +1,4 @@
# OptimizR Development Guide
# Optimiz-rs Development Guide
## Quick Start
@@ -1,7 +1,7 @@
# OptimizR Enhancement Strategy
# Optimiz-rs Enhancement Strategy
**Date**: January 2, 2025
**Context**: Post-Polaroid Phase 4, exploring integration and improvements
**Context**: Post-Polarway Phase 4, exploring integration and improvements
**Based On**: v0.2.0 codebase review, roadmap analysis, synergy opportunities
## Current State Analysis
@@ -58,19 +58,19 @@
- Simulated Annealing
- Ant Colony Optimization
## Synergy Opportunities: Polaroid + OptimizR
## Synergy Opportunities: Polarway + Optimiz-rs
### 1. Time-Series Feature Engineering for HMM
**Description**: Use Polaroid's time-series operations to create features for regime detection
**Description**: Use Polarway's time-series operations to create features for regime detection
**Implementation**:
```python
# Polaroid: Fast feature creation
# Polarway: Fast feature creation
df = client.lag(['price'], periods=1) # Lagged prices
df = client.pct_change(['price'], periods=1) # Returns
df = client.diff(['price'], periods=1) # Price changes
# OptimizR: Regime detection on features
# Optimiz-rs: Regime detection on features
returns = df['price_pct_change'].to_numpy()
hmm = HMM(n_states=3) # Bull, Bear, Sideways
hmm.fit(returns, n_iterations=100)
@@ -78,8 +78,8 @@ states = hmm.predict(returns)
```
**Value**:
- Polaroid provides fast feature engineering (50-200× faster for large datasets)
- OptimizR provides statistical inference (HMM regime detection)
- Polarway provides fast feature engineering (50-200× faster for large datasets)
- Optimiz-rs provides statistical inference (HMM regime detection)
- Combined: Real-time regime switching for trading strategies
### 2. Risk Metrics on Time-Series Data
@@ -87,18 +87,18 @@ states = hmm.predict(returns)
**Implementation**:
```python
# Polaroid: Efficient return calculation
# Polarway: Efficient return calculation
df = client.pct_change(['price'], periods=1)
returns = df['price_pct_change'].to_numpy()
# OptimizR: Risk analysis
# Optimiz-rs: Risk analysis
hurst = compute_hurst_exponent(returns) # Mean-reversion detection
half_life = estimate_half_life(returns) # Reversion time
risk_metrics = compute_risk_metrics(returns) # Comprehensive suite
```
**Value**:
- Fast preprocessing (Polaroid) + sophisticated analysis (OptimizR)
- Fast preprocessing (Polarway) + sophisticated analysis (Optimiz-rs)
- Useful for pairs trading, mean-reversion strategies
- Real-time risk monitoring
@@ -107,11 +107,11 @@ risk_metrics = compute_risk_metrics(returns) # Comprehensive suite
**Implementation**:
```python
# Polaroid: Multi-asset feature creation
# Polarway: Multi-asset feature creation
df = client.lag(['spy_price', 'vix'], periods=[1, 5, 20])
df = client.pct_change(['spy_price'], periods=1)
# OptimizR: Solve optimal control problem
# Optimiz-rs: Solve optimal control problem
# State: [price, volatility regime]
# Control: portfolio weights
value_fn = solve_hjb_regime_switching(...)
@@ -127,13 +127,13 @@ value_fn = solve_hjb_regime_switching(...)
**Implementation**:
```python
# Polaroid: Backtest execution (fast data ops)
# Polarway: Backtest execution (fast data ops)
def backtest_strategy(params):
df = client.lag(['price'], periods=int(params[0]))
# ... strategy logic ...
return -sharpe_ratio # Minimize negative Sharpe
# OptimizR: Find optimal parameters
# Optimiz-rs: Find optimal parameters
result = differential_evolution(
objective_fn=backtest_strategy,
bounds=[(1, 50), (0.01, 0.5)], # [lag_period, threshold]
@@ -143,8 +143,8 @@ result = differential_evolution(
```
**Value**:
- Polaroid handles heavy data processing
- OptimizR finds optimal parameters
- Polarway handles heavy data processing
- Optimiz-rs finds optimal parameters
- 74-88× faster than SciPy DE
## High-Priority Enhancements
@@ -258,14 +258,14 @@ impl SHADEMemory {
### Priority 3: Time-Series Integration Helpers
**Problem**: Using Polaroid + OptimizR requires manual glue code
**Problem**: Using Polarway + Optimiz-rs requires manual glue code
**Solution**: Create helper functions for common time-series + optimization patterns
**Implementation Strategy**:
1. Add `timeseries_utils` module to OptimizR
1. Add `timeseries_utils` module to Optimiz-rs
2. Functions for common workflows
3. Optional Polaroid integration (via feature flag)
3. Optional Polarway integration (via feature flag)
**Code Outline**:
```rust
@@ -350,7 +350,7 @@ result = tsu.optimize_strategy_params(
1. **Session 1 (Current)**: Time-Series Integration Helpers (1-2 hours)
- Low effort, immediate value
- Makes Polaroid + OptimizR integration obvious
- Makes Polarway + Optimiz-rs integration obvious
- Creates examples for documentation
2. **Session 2**: Enable Rust-Native Parallelization (1-2 hours)
@@ -372,7 +372,7 @@ result = tsu.optimize_strategy_params(
For each enhancement:
1. **Unit tests**: Algorithm correctness (sphere function, Rosenbrock)
2. **Benchmarks**: Performance comparison (before/after)
3. **Integration tests**: Polaroid + OptimizR workflows
3. **Integration tests**: Polarway + Optimiz-rs workflows
4. **Documentation**: Usage examples, API docs
## Git Commit Strategy (per MANDATORY rules)
@@ -404,4 +404,4 @@ Each enhancement gets:
---
**Next Action**: Implement Priority 3 (Time-Series Integration Helpers) as it's lowest effort with immediate value for demonstrating Polaroid + OptimizR synergy.
**Next Action**: Implement Priority 3 (Time-Series Integration Helpers) as it's lowest effort with immediate value for demonstrating Polarway + Optimiz-rs synergy.
@@ -1,4 +1,4 @@
# OptimizR Enhancement Suite - Implementation Complete
# Optimiz-rs Enhancement Suite - Implementation Complete
**Date**: January 2, 2026
**Session Duration**: ~3 hours
@@ -8,13 +8,13 @@
## Overview
Completed comprehensive enhancement suite for OptimizR v0.2.0, implementing all 3 priorities from the Enhancement Strategy:
Completed comprehensive enhancement suite for Optimiz-rs v0.2.0, implementing all 3 priorities from the Enhancement Strategy:
1. ✅ **Time-Series Integration Helpers** (Priority 3)
2. ✅ **Rust Parallelization** (Priority 2)
3. ✅ **SHADE Algorithm** (Priority 1)
Additionally created integration examples combining Polaroid + OptimizR workflows.
Additionally created integration examples combining Polarway + Optimiz-rs workflows.
---
@@ -22,7 +22,7 @@ Additionally created integration examples combining Polaroid + OptimizR workflow
### 1. Time-Series Integration Helpers (Commit: 9a8032e, 7f77f29)
**Purpose**: Bridge OptimizR's optimization with time-series analysis for financial workflows.
**Purpose**: Bridge Optimiz-rs's optimization with time-series analysis for financial workflows.
**Implementation**:
- Created `src/timeseries_utils.rs` (400+ lines)
@@ -41,7 +41,7 @@ Additionally created integration examples combining Polaroid + OptimizR workflow
- All functions tested and working
**Impact**:
- Enables Polaroid → OptimizR workflows
- Enables Polarway → Optimiz-rs workflows
- Simplifies regime detection with HMM
- Streamlines pairs trading analysis
@@ -130,12 +130,12 @@ Additionally created integration examples combining Polaroid + OptimizR workflow
### 4. Integration Examples (Included with parallelization)
**Purpose**: Demonstrate Polaroid + OptimizR workflows.
**Purpose**: Demonstrate Polarway + Optimiz-rs workflows.
**Implementation**:
- `examples/polaroid_optimizr_integration.py` (500+ lines)
- `examples/polarway_optimizr_integration.py` (500+ lines)
- 4 comprehensive workflows:
1. **Regime Detection**: Polaroid features → HMM → regime classification
1. **Regime Detection**: Polarway features → HMM → regime classification
2. **Strategy Optimization**: Moving average crossover with DE
3. **Risk Analysis**: Portfolio with rolling metrics
4. **Pairs Trading**: Complete pipeline with cointegration check
@@ -148,11 +148,11 @@ Additionally created integration examples combining Polaroid + OptimizR workflow
**Impact**:
- End-to-end examples for financial analysis
- Demonstrates Polaroid + OptimizR synergy
- Demonstrates Polarway + Optimiz-rs synergy
- Ready for production adaptation
**Files**:
- `examples/polaroid_optimizr_integration.py`
- `examples/polarway_optimizr_integration.py`
- `examples/timeseries_integration.py`
- `examples/parallel_de_benchmark.py`
@@ -221,9 +221,9 @@ All commits pushed to origin/main ✅
## 🎯 Alignment with Roadmap
All enhancements align with OptimizR v0.3.0 roadmap:
All enhancements align with Optimiz-rs v0.3.0 roadmap:
- ✅ **Time-series integration**: Enable Polaroid workflows
- ✅ **Time-series integration**: Enable Polarway workflows
- ✅ **Parallelization**: Unlock Rayon infrastructure
- ✅ **SHADE**: State-of-the-art adaptive DE
@@ -325,4 +325,4 @@ Future (v0.3.0+):
**Status**: ✅ **ALL OBJECTIVES COMPLETE**
**Next**: Integrate SHADE into DE, performance testing
**Version**: OptimizR v0.2.0 → v0.3.0 prep
**Version**: Optimiz-rs v0.2.0 → v0.3.0 prep
@@ -9,7 +9,7 @@ Example notebooks in `examples/notebooks/` **ARE WORKING CORRECTLY**! They use P
- Automatic Rust backend when available
- Graceful fallback to pure Python
## Actual OptimizR Python API (from lib.rs)
## Actual Optimiz-rs Python API (from lib.rs)
### ✅ Available Functions/Classes:
@@ -155,7 +155,7 @@ from optimizr import (
```
**Features Demonstrated:**
- Direct comparison: OptimizR (Rust) vs Python libraries
- Direct comparison: Optimiz-rs (Rust) vs Python libraries
- Benchmarks against: hmmlearn, scipy, sklearn
- Performance metrics and speedup calculations
@@ -178,7 +178,7 @@ from optimizr import (
### Python Wrapper Design (Brilliant!)
OptimizR uses a **two-layer architecture**:
Optimiz-rs uses a **two-layer architecture**:
1. **Rust Core** (`src/` with PyO3):
- `HMMParams` class
@@ -237,7 +237,7 @@ This design is **excellent** because:
## Testing Summary
| Notebook | Status | OptimizR Features | Test Result |
| Notebook | Status | Optimiz-rs Features | Test Result |
|----------|--------|-------------------|-------------|
| 01_hmm_tutorial.ipynb | ✅ PASS | HMM (Rust) | All cells run |
| 02_mcmc_tutorial.ipynb | ✅ PASS | mcmc_sample | Imports OK |
@@ -277,7 +277,7 @@ This design is **excellent** because:
**Actual Status:** Notebooks use Python wrappers correctly
**What I Learned:**
1. OptimizR has excellent two-layer design
1. Optimiz-rs has excellent two-layer design
2. Python wrappers provide familiar OOP interface
3. Rust acceleration is transparent to users
4. Only 1 minor fix needed (random_state parameter)
@@ -1,8 +1,8 @@
# OptimizR Project Summary
# Optimiz-rs Project Summary
## What is OptimizR?
## What is Optimiz-rs?
OptimizR is a **general-purpose optimization library** that provides high-performance implementations of advanced algorithms in Rust with easy-to-use Python bindings. It's designed to be fast, reliable, and production-ready for open-source distribution.
Optimiz-rs is a **general-purpose optimization library** that provides high-performance implementations of advanced algorithms in Rust with easy-to-use Python bindings. It's designed to be fast, reliable, and production-ready for open-source distribution.
## Key Features
@@ -140,7 +140,7 @@ x_opt, f_min = differential_evolution(
## Differences from rust-hft-arbitrage-lab
| Aspect | rust-hft-arbitrage-lab | OptimizR |
| Aspect | rust-hft-arbitrage-lab | Optimiz-rs |
|--------|----------------------|----------|
| **Purpose** | HFT trading strategies | General optimization library |
| **Scope** | Trading-specific | Domain-agnostic |
@@ -165,7 +165,7 @@ x_opt, f_min = differential_evolution(
```bash
git init
git add .
git commit -m "Initial commit: OptimizR v0.1.0"
git commit -m "Initial commit: Optimiz-rs v0.1.0"
git remote add origin https://github.com/ThotDjehuty/optimiz-r.git
git push -u origin main
```
@@ -217,7 +217,7 @@ Based on benchmarks from rust-hft-arbitrage-lab:
## Marketing/Outreach
1. **Reddit**: r/rust, r/python, r/MachineLearning
2. **Hacker News**: "Show HN: OptimizR - Fast optimization algorithms in Rust"
2. **Hacker News**: "Show HN: Optimiz-rs - Fast optimization algorithms in Rust"
3. **Twitter/X**: Tweet with #rustlang #python
4. **PyPI**: Ensure good package description
5. **GitHub Topics**: optimization, rust, python, scientific-computing
@@ -1,8 +1,8 @@
# OptimizR Refactoring Summary
# Optimiz-rs Refactoring Summary
## Overview
This document summarizes the major refactoring applied to OptimizR to improve modularity, introduce functional programming patterns, implement design patterns, and add concurrency support.
This document summarizes the major refactoring applied to Optimiz-rs to improve modularity, introduce functional programming patterns, implement design patterns, and add concurrency support.
## Architecture Changes
@@ -369,7 +369,7 @@ impl ProposalStrategy for MyProposal {
## Conclusion
This refactoring significantly improves OptimizR's:
This refactoring significantly improves Optimiz-rs's:
- **Modularity**: Clear trait boundaries, easy to extend
- **Maintainability**: Builder patterns, functional utilities reduce boilerplate
- **Performance**: Parallel execution, memoization, lazy evaluation
@@ -1,4 +1,4 @@
# OptimizR Setup Complete! ✅
# Optimiz-rs Setup Complete! ✅
## What Was Done
@@ -136,7 +136,7 @@ pytest tests/ -v -k HMM # Run HMM tests only
## Performance
OptimizR provides **50-100x speedup** over pure Python for:
Optimiz-rs provides **50-100x speedup** over pure Python for:
- HMM fitting (71x faster)
- MCMC sampling (71x faster)
- Differential Evolution (53x faster)
@@ -144,7 +144,7 @@ OptimizR provides **50-100x speedup** over pure Python for:
## Summary
The OptimizR project is now **fully functional** with:
The Optimiz-rs project is now **fully functional** with:
- ✅ Zero compilation errors
- ✅ All tests passing
- ✅ Docker support
@@ -1,7 +1,7 @@
# Time-Series Integration Helpers Implementation Summary
## Overview
Completed Priority 3 from Enhancement Strategy: Time-series integration helpers for OptimizR v0.3.0. These 6 helper functions bridge OptimizR's optimization capabilities with time-series analysis, particularly useful for regime-switching models and pairs trading strategies.
Completed Priority 3 from Enhancement Strategy: Time-series integration helpers for Optimiz-rs v0.3.0. These 6 helper functions bridge Optimiz-rs's optimization capabilities with time-series analysis, particularly useful for regime-switching models and pairs trading strategies.
## Implementation Details
@@ -15,7 +15,7 @@ Completed Priority 3 from Enhancement Strategy: Time-series integration helpers
- Volatility proxy: squared returns
- Lagged returns for each lag period
- Returns: Feature matrix (N-max_lag rows × (3 + num_lags) columns)
- Use case: Prepare price data for OptimizR's HMM regime detection
- Use case: Prepare price data for Optimiz-rs's HMM regime detection
2. **`rolling_hurst_exponent(returns: &[f64], window_size: usize) -> Vec<f64>`**
- Purpose: Detect mean-reversion vs trending behavior
@@ -146,7 +146,7 @@ import optimizr
prices = [100.0, 101.5, 99.8, 102.3, 103.7]
features = optimizr.prepare_for_hmm_py(prices, [1, 2])
# Use with OptimizR's HMM for regime detection
# Use with Optimiz-rs's HMM for regime detection
```
### Mean-Reversion Check
View File
+7
View File
@@ -0,0 +1,7 @@
# Python dependencies for building documentation (pinned for RTD compatibility)
sphinx>=7.0.0,<8.0.0
furo==2023.9.10
myst-parser==2.0.0
sphinx-autodoc-typehints==1.24.0
charset-normalizer>=3.4.0
sphinxcontrib-mermaid>=0.9.2
+141
View File
@@ -0,0 +1,141 @@
"""Replace the 4 remaining ASCII diagram blocks in mathematical_foundations.md
with {figure} directives pointing to the new SVGs.
"""
import pathlib
MD = pathlib.Path(__file__).parent / "theory" / "mathematical_foundations.md"
text = MD.read_text(encoding="utf-8")
# ── 1. HMM regime state machine → fig_hmm_regime ──────────────────────────
old1 = '''\
```
HMM regime state machine (K = 3)
┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄
A₁₂ → A₂₃ →
┌─────────────┐ ┌─────────────┐ ┌─────────────┐
│ State 1 │──────▶│ State 2 │──────▶│ State 3 │
│ Bull │◀──────│ Neutral │◀──────│ Bear │
└─────────────┘ └─────────────┘ └─────────────┘
← A₂₁ ← A₃₂
Emission B_k(y) = 𝒩(μ_k, σ_k²):
┌────────┬────────┬────────┬──────────────────┐
│ State │ μ │ σ │ Character │
├────────┼────────┼────────┼──────────────────┤
│ Bull │ +0.05 │ 0.12 │ high return, low vol │
│ Neutral│ 0.00 │ 0.18 │ flat, medium vol │
│ Bear │ -0.08 │ 0.35 │ crash, high vol │
└────────┴────────┴────────┴──────────────────┘
(self-transition: A₁₁=0.97, A₂₂=0.97, A₃₃=0.90)
```'''
new1 = '''\
```{figure} ../_static/diagrams/fig_hmm_regime.svg
:align: center
:width: 90%
HMM $K=3$ state machine with Bull / Neutral / Bear regimes and Gaussian emission
parameters. Self-transitions $A_{11}=A_{22}=0.97$, $A_{33}=0.90$.
```'''
# ── 2. Viterbi trellis → fig_viterbi_trellis ───────────────────────────────
old2 = '''\
```
Viterbi trellis (K=3, T=4)
┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄
State t=1 t=2 t=3 t=4
1 ○─────────▶○─────────▶○─────────▶○
╲ ╳
2 ○─────────▶●─────────▶●─────────▶○ ● = MAP path
╲ ╲ ╲
3 ○─────────▶○─────────▶○─────────▶○
δ_t(k) = max_j [δ_{t1}(j) · A_jk · B_k(y_t)]
ψ_t(k) = argmax_j ← backtrack pointer
Traceback: z_4★ ← z_3★ ← z_2★ ← z_1★ via ψ
```'''
new2 = r'''\
```{figure} ../_static/diagrams/fig_viterbi_trellis.svg
:align: center
:width: 82%
Viterbi trellis ($K=3$, $T=4$). Filled nodes mark the MAP (most probable) state
sequence; arrows show transition candidates. Backtracking via $\psi_t(k)$ recovers
$z_1^\star \to z_4^\star$.
```'''
# ── 3. Standard vs natural gradient (text comparison) → fig_std_vs_nat_gradient
old3 = '''\
```
Standard vs natural gradient
┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄
Standard: θ_{k+1} = θ_k η·∇ℒ Natural: θ_{k+1} = θ_k η·ℐ(θ)^{1}∇ℒ
────────────────────────────────────────────
┌────────────────────┐ ┌────────────────────┐
│ Flat ℝᵈ geometry │ │ Riemannian metric (θ) │
│ Ignores curvature │ │ Adapts to geometry │
│ Slow on ill-cond │ │ Reparam invariant │
│ O(κ()) iters │ │ O(1) on exp families │
└────────────────────┘ └────────────────────┘
On Gaussian / exponential family: ℐ⁻¹∇ℒ = MLE step → 1 iteration!
```'''
new3 = '''\
```{figure} ../_static/diagrams/fig_std_vs_nat_gradient.svg
:align: center
:width: 88%
Standard versus natural gradient: geometric properties. On exponential families
the natural gradient equals the MLE Newton step, achieving convergence in one
iteration.
```'''
# ── 4. Matrix Lie group hierarchy → fig_lie_group_hierarchy ─────────────────
old4 = '''\
```
Matrix Lie group hierarchy
┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄
GL(n,) ─ all invertible n×n real matrices
├──▶ SL(n,) det = 1
├──▶ O(n) RᵀR = I (orthogonal)
│ └─▶ SO(n) det = +1 (pure rotations)
│ ↳ portfolio factor rotation, PCA constraints
└──▶ Sp(2n,) preserves symplectic form ω
↳ Hamiltonian mechanics, PMP §4.2 / §10.4
H(n) Heisenberg ─ upper triangular, 1s on diagonal
↳ path-signature feature maps
```'''
new4 = r'''\
```{figure} ../_static/diagrams/fig_lie_group_hierarchy.svg
:align: center
:width: 90%
Matrix Lie group hierarchy: subgroup inclusions and their quantitative-finance
applications. $SO(n)$ underpins PCA factor rotation; $\mathrm{Sp}(2n,\mathbb{R})$
governs Hamiltonian mechanics (PMP §10.4); $H(n)$ drives path-signature features.
```'''
replacements = [(old1, new1), (old2, new2), (old3, new3), (old4, new4)]
for i, (old, new) in enumerate(replacements, 1):
if old in text:
text = text.replace(old, new, 1)
print(f" Block {i}: replaced OK")
else:
print(f" Block {i}: NOT FOUND — check encoding/whitespace")
MD.write_text(text, encoding="utf-8")
print("Done.")
+911
View File
@@ -0,0 +1,911 @@
#!/usr/bin/env python3
"""
Generate all matplotlib diagrams for mathematical_foundations.md.
Run from the docs/source directory (or workspace root):
python docs/source/_gen_diagrams.py
Outputs SVG files to docs/source/_static/diagrams/
"""
import os
import numpy as np
import matplotlib
matplotlib.use("Agg")
import matplotlib.pyplot as plt
import matplotlib.patches as mpatches
import matplotlib.ticker as mticker
from scipy.stats import norm
# ─── output dir ─────────────────────────────────────────────────────────────
OUT = os.path.join(os.path.dirname(os.path.abspath(__file__)), "_static", "diagrams")
os.makedirs(OUT, exist_ok=True)
# ─── palette & defaults ─────────────────────────────────────────────────────
C0 = "#2E6BE5" # blue
C1 = "#E8850A" # orange
C2 = "#27AE60" # green
C3 = "#D62728" # red
GRAY = "#888888"
BAND = "#AACBE8"
matplotlib.rcParams.update({
"font.size" : 11,
"axes.titlesize" : 12,
"axes.labelsize" : 11,
"xtick.labelsize" : 9,
"ytick.labelsize" : 9,
"axes.spines.top" : False,
"axes.spines.right" : False,
"figure.dpi" : 150,
"savefig.bbox" : "tight",
"savefig.transparent" : False,
"figure.facecolor" : "white",
"axes.facecolor" : "white",
"lines.linewidth" : 1.8,
"text.usetex" : False,
})
def save(name):
plt.savefig(os.path.join(OUT, name + ".svg"))
plt.close()
# ════════════════════════════════════════════════════════════════════════════
# §1 DIFFERENTIAL EVOLUTION
# ════════════════════════════════════════════════════════════════════════════
def fig_de_mutation():
r1 = np.array([0.5, 0.3])
r2 = np.array([1.2, 1.4])
r3 = np.array([1.8, 0.6])
F = 0.7
vi = r1 + F * (r2 - r3)
fig, ax = plt.subplots(figsize=(6, 4.2))
# difference vector r3 → r2
ax.annotate("", r2, r3,
arrowprops=dict(arrowstyle="-|>", color=C2, lw=2.0, mutation_scale=14))
mid = (r2 + r3) / 2
ax.text(mid[0] - 0.05, mid[1] + 0.09,
r"$F(\mathbf{x}_{r_2}-\mathbf{x}_{r_3})$",
ha="center", fontsize=10, color=C2)
# mutation arrow r1 → vi (dashed)
ax.annotate("", vi, r1,
arrowprops=dict(arrowstyle="-|>", color=C1, lw=2.0,
mutation_scale=14, linestyle="dashed"))
ax.text((r1[0]+vi[0])/2, (r1[1]+vi[1])/2 - 0.1,
r"$+F(\cdots)$", ha="center", fontsize=9, color=C1)
pts = {
r"$\mathbf{x}_{r_1}$ (base)": (r1, C0),
r"$\mathbf{x}_{r_2}$": (r2, C0),
r"$\mathbf{x}_{r_3}$": (r3, C0),
r"$\mathbf{v}_i$ (mutant)": (vi, C1),
}
for lbl, (p, col) in pts.items():
ax.scatter(*p, s=90, color=col, zorder=6)
offset = (0.05, 0.07)
if "mutant" in lbl:
offset = (0.07, 0.05)
ax.text(p[0] + offset[0], p[1] + offset[1], lbl, fontsize=10, color=col)
ax.set_xlim(0.1, 2.5); ax.set_ylim(0.0, 1.85)
ax.set_xlabel(r"$x_1$"); ax.set_ylabel(r"$x_2$")
ax.set_title(r"DE Mutation: $\mathbf{v}_i = \mathbf{x}_{r_1} + F\,(\mathbf{x}_{r_2} - \mathbf{x}_{r_3})$")
ax.set_aspect("equal", adjustable="box")
save("fig_de_mutation")
def fig_rastrigin():
x = np.linspace(-2.5, 2.5, 800)
y = 10 + x**2 - 10 * np.cos(2 * np.pi * x)
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(x, y, color=C0, lw=2, label=r"$f(x) = 10 + x^2 - 10\cos(2\pi x)$")
ax.fill_between(x, y, alpha=0.07, color=C0)
ax.axhline(0, color=GRAY, lw=0.7, ls=":")
# global minimum
ax.scatter([0], [0], s=110, color=C1, zorder=6, label=r"global min $f^*=0$", marker="*")
# local minima
lm_x = np.array([-2.0, -1.0, 1.0, 2.0])
lm_y = 10 + lm_x**2 - 10 * np.cos(2 * np.pi * lm_x)
ax.scatter(lm_x, lm_y, s=55, color=C3, zorder=5, label="local minima", marker="o")
ax.annotate(r"$\approx 10^d$ local pits", (1.0, lm_y[2]),
(1.5, 12), fontsize=9, color=C3,
arrowprops=dict(arrowstyle="->", color=C3, lw=1.0))
ax.set_xlabel(r"$x$"); ax.set_ylabel(r"$f(x)$")
ax.set_title(r"Rastrigin function ($d = 1$) — many local minima")
ax.legend(fontsize=9, framealpha=0.6)
save("fig_rastrigin")
# ════════════════════════════════════════════════════════════════════════════
# §2.1 BROWNIAN MOTION
# ════════════════════════════════════════════════════════════════════════════
def fig_random_walk():
rng = np.random.default_rng(42)
n = 300
t = np.linspace(0, 1, n)
W = np.cumsum(rng.choice([-1, 1], size=n)) / np.sqrt(n)
fig, ax = plt.subplots(figsize=(7, 3.5))
ax.plot(t, W, color=C0, lw=1.4)
ax.axhline(0, color=GRAY, lw=0.8, ls="--", alpha=0.6)
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$W_t^{(n)}$")
ax.set_title(r"Coin-flip random walk ($n=300$) $\longrightarrow$ Brownian motion as $n\to\infty$")
save("fig_random_walk")
def fig_bm_fan():
rng = np.random.default_rng(0)
n, dt = 500, 0.002
npaths = 10
ts = np.linspace(0, 1, n)
paths = np.cumsum(rng.normal(0, np.sqrt(dt), (npaths, n)), axis=1)
paths[:, 0] = 0
fig, ax = plt.subplots(figsize=(7, 4.2))
lo, hi = -2 * np.sqrt(ts), 2 * np.sqrt(ts)
ax.fill_between(ts, lo, hi, alpha=0.13, color=C0, label=r"$\pm 2\sqrt{t}$ (95% band)")
ax.plot(ts, hi, color=C0, lw=1.2, ls="--", alpha=0.55)
ax.plot(ts, lo, color=C0, lw=1.2, ls="--", alpha=0.55)
colors_cycle = plt.colormaps["tab10"](np.linspace(0, 0.9, npaths))
for i, p in enumerate(paths):
ax.plot(ts, p, lw=0.9, alpha=0.75, color=colors_cycle[i])
ax.axhline(0, color=GRAY, lw=0.8, ls=":")
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$W_t$")
ax.set_title(r"Brownian motion — sample paths spread as $\sqrt{t}$ (trumpet fan)")
ax.legend(fontsize=9, framealpha=0.7)
save("fig_bm_fan")
def fig_gbm():
rng = np.random.default_rng(7)
T, n, dt = 1.0, 500, 0.002
mu, sigma, S0 = 0.10, 0.30, 1.0
ts = np.linspace(0, T, n)
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(ts, S0 * np.exp(mu * ts), color=C1, lw=1.8, ls="--",
label=r"$\mathbb{E}[S_t] = S_0 e^{\mu t}$")
ax.plot(ts, S0 * np.exp((mu - 0.5*sigma**2) * ts), color=C2, lw=1.5, ls=":",
label=r"median $\approx S_0 e^{(\mu-\sigma^2/2)t}$")
colors_cycle = plt.colormaps["Blues"](np.linspace(0.4, 0.85, 7))
for i in range(7):
W = np.cumsum(rng.normal(0, np.sqrt(dt), n))
S = S0 * np.exp((mu - 0.5*sigma**2) * ts + sigma * W)
ax.plot(ts, S, lw=0.9, alpha=0.7, color=colors_cycle[i])
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$S_t$")
ax.set_title(r"Geometric Brownian motion ($\mu=0.10,\;\sigma=0.30$)")
ax.legend(fontsize=9, framealpha=0.6)
save("fig_gbm")
# ════════════════════════════════════════════════════════════════════════════
# §2.2 ITŌ CALCULUS
# ════════════════════════════════════════════════════════════════════════════
def fig_ito_correction():
t = np.linspace(0, 2.2, 300)
mu, sigma = 0.12, 0.30
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(t, mu * t, color=C1, lw=2, ls="--",
label=r"Naïve slope $\mu t$ (wrong)")
ax.plot(t, (mu - 0.5*sigma**2) * t, color=C0, lw=2,
label=r"Itō slope $(\mu - \sigma^2/2)\,t$ (correct)")
# gap annotation at t = 1.8
g_x = 1.8
y_top = mu * g_x
y_bot = (mu - 0.5*sigma**2) * g_x
ax.annotate("", (g_x, y_bot), (g_x, y_top),
arrowprops=dict(arrowstyle="<->", color=C3, lw=1.6))
ax.text(g_x + 0.07, (y_top + y_bot) / 2,
r"gap $= \sigma^2 T/2$", fontsize=9, color=C3, va="center")
ax.axhline(0, color=GRAY, lw=0.6, ls=":")
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$\mathbb{E}[\log S_t] - \log S_0$")
ax.set_title(r"Itō correction: $\mathbb{E}[\log S_t]$ always below the naïve slope $\mu t$")
ax.legend(fontsize=9)
save("fig_ito_correction")
# ════════════════════════════════════════════════════════════════════════════
# §2.3 FOKKER-PLANCK
# ════════════════════════════════════════════════════════════════════════════
def fig_fokker_planck():
x = np.linspace(-0.5, 5.5, 600)
mu_drift, sigma_diff = 0.8, 0.3
times = [0.05, 0.5, 1.5]
colors = [C3, C2, C0]
labels = [r"$t = 0.05$ (narrow spike)",
r"$t = 0.50$",
r"$t = 1.50$ (wide, drifted)"]
fig, ax = plt.subplots(figsize=(7, 3.8))
for t, col, lbl in zip(times, colors, labels):
mean = mu_drift * t
std = sigma_diff * np.sqrt(t)
y = norm.pdf(x, mean, std)
ax.plot(x, y, color=col, lw=2, label=lbl)
ax.fill_between(x, y, alpha=0.10, color=col)
ax.set_xlabel(r"$x$"); ax.set_ylabel(r"$p(t, x)$")
ax.set_title(r"Fokker-Planck: density drifts $(\mu=0.8)$ and broadens $(\sigma=0.3)$")
ax.legend(fontsize=9)
save("fig_fokker_planck")
# ════════════════════════════════════════════════════════════════════════════
# §2.3 EULER-MARUYAMA vs MILSTEIN
# ════════════════════════════════════════════════════════════════════════════
def fig_em_milstein():
dts = np.array([0.1, 0.05, 0.02, 0.01, 0.005, 0.001])
em_err = 0.38 * dts**0.5
mil_err = 0.19 * dts**1.0
fig, ax = plt.subplots(figsize=(6, 4))
ax.loglog(dts, em_err, "o-", color=C0, lw=2, ms=7,
label=r"Euler-Maruyama (order $1/2$)")
ax.loglog(dts, mil_err, "s--", color=C1, lw=2, ms=7,
label=r"Milstein (order $1$)")
ax.set_xlabel(r"Step size $\Delta t$")
ax.set_ylabel(r"Strong error $\|X_T - \hat{X}_T\|$")
ax.set_title("SDE numerical schemes — strong convergence order")
ax.legend(fontsize=10); ax.grid(True, which="both", alpha=0.3)
save("fig_em_milstein")
# ════════════════════════════════════════════════════════════════════════════
# §2.4 ORNSTEIN-UHLENBECK
# ════════════════════════════════════════════════════════════════════════════
def fig_ou_path():
rng = np.random.default_rng(3)
T, n, dt = 5.0, 2000, 0.0025
kappa, theta, sigma = 3.0, 0.5, 0.4
X = np.zeros(n); X[0] = 2.0
for i in range(1, n):
X[i] = X[i-1] + kappa * (theta - X[i-1]) * dt + sigma * rng.normal(0, np.sqrt(dt))
ts = np.linspace(0, T, n)
sig_inf = sigma / np.sqrt(2 * kappa)
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(ts, X, color=C0, lw=1.0, alpha=0.9, label=r"$X_t$")
ax.axhline(theta, color=C1, lw=1.8, ls="--",
label=fr"$\theta = {theta}$ (long-run mean)")
ax.fill_between(ts,
theta - 2 * sig_inf,
theta + 2 * sig_inf,
alpha=0.10, color=GRAY, label=r"$\theta \pm 2\sigma_\infty$")
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$X_t$")
ax.set_title(fr"Ornstein-Uhlenbeck ($\kappa={kappa},\;\theta={theta},\;\sigma={sigma}$) — mean-reversion")
ax.legend(fontsize=9)
save("fig_ou_path")
def fig_ou_transition():
x = np.linspace(-0.3, 2.6, 500)
kappa, theta, sigma, x0 = 3.0, 0.5, 0.4, 2.0
taus = [0.1, 0.5, 2.0]
colors = [C3, C2, C0]
fig, ax = plt.subplots(figsize=(7, 3.8))
for tau, col in zip(taus, colors):
mean = theta + (x0 - theta) * np.exp(-kappa * tau)
var = sigma**2 / (2 * kappa) * (1 - np.exp(-2 * kappa * tau))
y = norm.pdf(x, mean, np.sqrt(var))
ax.plot(x, y, color=col, lw=2,
label=fr"$\tau = {tau:.1f}$ (mean $= {mean:.2f}$)")
ax.fill_between(x, y, alpha=0.09, color=col)
ax.axvline(theta, color=C1, lw=1.3, ls="--", label=fr"$\theta = {theta}$")
ax.set_xlabel(r"$x$"); ax.set_ylabel(r"$p(x_\tau \mid x_0)$")
ax.set_title(r"OU transition density: drifts toward $\theta$, widens over time")
ax.legend(fontsize=9)
save("fig_ou_transition")
def fig_ou_loglik():
kappa_v = np.linspace(10, 120, 80)
theta_v = np.linspace(-0.005, 0.011, 80)
K, T = np.meshgrid(kappa_v, theta_v)
Z = -(((K - 55) / 22)**2 + ((T - 0.003) / 0.003)**2)
fig, ax = plt.subplots(figsize=(6.2, 4.5))
cf = ax.contourf(theta_v * 1000, kappa_v, Z.T, levels=20, cmap="Blues")
ax.contour(theta_v * 1000, kappa_v, Z.T, levels=8,
colors="white", linewidths=0.7, alpha=0.55)
ax.plot(3, 55, "*", color=C1, ms=16, zorder=5,
label=r"MLE $\hat\theta, \hat\kappa$")
plt.colorbar(cf, ax=ax, label="Log-likelihood (normalised)")
ax.set_xlabel(r"$\theta \times 10^3$"); ax.set_ylabel(r"$\kappa$")
ax.set_title(r"OU log-likelihood surface $\ell(\kappa, \theta \mid \hat\sigma)$")
ax.legend(fontsize=10)
save("fig_ou_loglik")
def fig_ou_residuals():
rng = np.random.default_rng(9)
r = rng.normal(0, 1, 600)
x = np.linspace(-4, 4, 300)
fig, ax = plt.subplots(figsize=(6, 3.8))
ax.hist(r, bins=32, density=True, color=C0, alpha=0.50,
label="Standardised residuals")
ax.plot(x, norm.pdf(x), color=C1, lw=2.2,
label=r"$\mathcal{N}(0,1)$ theory")
ax.set_xlabel(r"$r_i$"); ax.set_ylabel("Density")
ax.set_title(r"OU residual diagnostic: $r_i = (X_{t_i} - \hat\mu_i)/\hat\sigma$")
ax.legend(fontsize=9)
save("fig_ou_residuals")
# ════════════════════════════════════════════════════════════════════════════
# §3 JUMP PROCESSES
# ════════════════════════════════════════════════════════════════════════════
def fig_poisson():
rng = np.random.default_rng(1)
lam, T = 2, 4.0
arrivals, t = [], 0.0
while True:
t += rng.exponential(1 / lam)
if t > T: break
arrivals.append(t)
ts = np.concatenate([[0.0], arrivals, [T]])
ns = np.arange(len(ts) - 1)
fig, ax = plt.subplots(figsize=(7, 3.5))
for i, (t0, t1, n) in enumerate(zip(ts[:-1], ts[1:], ns)):
ax.hlines(n, t0, t1, color=C0, lw=2.8)
if i < len(arrivals):
ax.vlines(t1, n, n + 1, color=C0, lw=2.0, linestyle=":")
ax.scatter([t1], [n], s=45, color="white", edgecolors=C0, zorder=5, lw=1.5)
ax.scatter([t1], [n + 1], s=45, color=C0, zorder=5)
ax.yaxis.set_major_locator(mticker.MaxNLocator(integer=True))
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$N_t$")
ax.set_title(fr"Poisson process ($\lambda = {lam}$ jumps/unit) — inter-arrivals $\sim \mathrm{{Exp}}(\lambda)$")
save("fig_poisson")
def fig_jump_diffusion():
rng = np.random.default_rng(11)
T, n, dt = 1.0, 1000, 0.001
mu, sigma, lam = 0.05, 0.18, 2.5
ts = np.linspace(0, T, n)
S = np.ones(n)
jump_times = np.sort(rng.uniform(0, T, rng.poisson(lam * T)))
for i in range(1, n):
dW = rng.normal(0, np.sqrt(dt))
S[i] = S[i-1] * np.exp((mu - 0.5 * sigma**2) * dt + sigma * dW)
if np.any((ts[i-1] < jump_times) & (jump_times <= ts[i])):
S[i] *= np.exp(rng.normal(0.0, 0.09))
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(ts, S, color=C0, lw=1.3, label=r"$S_t$ (jump-diffusion path)")
# mark jump locations
jt_idx = [np.searchsorted(ts, jt) for jt in jump_times if jt < T]
ax.scatter(ts[jt_idx], S[jt_idx], s=50, color=C3, zorder=5,
label=r"Poisson jump $\tau_k$", marker="v")
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$S_t$")
ax.set_title(r"Merton jump-diffusion ($\lambda = 2.5$/yr, $\sigma_J = 9\%$)")
ax.legend(fontsize=9)
save("fig_jump_diffusion")
def fig_levy_tails():
x = np.linspace(0.05, 5, 600)
gauss_tail = norm.pdf(x)
gauss_tail /= gauss_tail[0]
vg_tail = np.exp(-1.5 * x) / x
vg_tail /= vg_tail[0]
alpha_tail = x ** (-1.8)
alpha_tail /= alpha_tail[0]
fig, ax = plt.subplots(figsize=(6.5, 4))
ax.semilogy(x, gauss_tail, lw=2, color=C0,
label=r"Gaussian ($\nu \equiv 0$)")
ax.semilogy(x, vg_tail, lw=2, color=C2,
label=r"Variance Gamma ($\nu \propto e^{-c|z|}/|z|$)")
ax.semilogy(x, alpha_tail, lw=2, color=C1, ls="--",
label=r"$\alpha$-stable ($\nu \propto |z|^{-1-\alpha}$, heaviest)")
ax.set_xlabel(r"Jump size $|z|$")
ax.set_ylabel(r"Lévy density $\nu(dz)/dz$ (log scale)")
ax.set_title("Lévy measure tails — heavier tail = more frequent/larger jumps")
ax.legend(fontsize=9); ax.grid(True, which="both", alpha=0.25)
save("fig_levy_tails")
# ════════════════════════════════════════════════════════════════════════════
# §6 KALMAN FILTER
# ════════════════════════════════════════════════════════════════════════════
def fig_kalman_covariance():
t = np.linspace(0, 30, 300)
Pinf = 0.17
Pt = Pinf + (1.0 - Pinf) * np.exp(-0.35 * t)
fig, ax = plt.subplots(figsize=(7, 3.5))
ax.plot(t, Pt, color=C0, lw=2, label=r"$P_t$ (error covariance)")
ax.axhline(Pinf, color=C1, lw=1.6, ls="--",
label=fr"$P_\infty \approx {Pinf}$ (steady-state)")
ax.fill_between(t, Pt, Pinf, alpha=0.10, color=C0)
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$P_t$")
ax.set_title(r"Kalman filter: error covariance converges exponentially to $P_\infty$")
ax.legend(fontsize=9); ax.set_ylim(0, 1.05)
save("fig_kalman_covariance")
# ════════════════════════════════════════════════════════════════════════════
# §7 MCMC
# ════════════════════════════════════════════════════════════════════════════
def fig_mcmc_energy():
x = np.linspace(-5, 5, 600)
pi = 0.5 * norm.pdf(x, -1.5, 0.8) + 0.5 * norm.pdf(x, 1.5, 0.9)
U = -np.log(pi + 1e-12)
U -= U.min()
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(x, U, color=C0, lw=2)
ax.fill_between(x, U, alpha=0.08, color=C0)
ax.scatter([-1.5, 1.5], [U[np.abs(x + 1.5).argmin()],
U[np.abs(x - 1.5).argmin()]],
s=90, color=C2, zorder=5, label=r"modes of $\pi$")
saddle_i = np.abs(x).argmin()
ax.scatter([x[saddle_i]], [U[saddle_i]], s=90, color=C3,
zorder=5, marker="^", label="energy barrier")
ax.annotate(r"accept with $e^{-\Delta U}$",
(x[saddle_i] + 0.3, U[saddle_i] - 0.4),
(2.2, 1.2), fontsize=9, color=C3,
arrowprops=dict(arrowstyle="->", color=C3, lw=1.0))
ax.set_xlabel(r"$x$"); ax.set_ylabel(r"$U(x) = -\log\pi(x)$")
ax.set_title(r"MCMC energy landscape (bimodal target $\pi$)")
ax.legend(fontsize=9)
save("fig_mcmc_energy")
def fig_mcmc_trace():
rng = np.random.default_rng(42)
x_cur = -1.5
chain = [x_cur]
for _ in range(2999):
prop = x_cur + rng.normal(0, 0.8)
pi_cur = 0.5 * norm.pdf(x_cur, -1.5, 0.8) + 0.5 * norm.pdf(x_cur, 1.5, 0.9)
pi_prop = 0.5 * norm.pdf(prop, -1.5, 0.8) + 0.5 * norm.pdf(prop, 1.5, 0.9)
x_cur = prop if rng.random() < pi_prop / pi_cur else x_cur
chain.append(x_cur)
chain = np.array(chain)
fig, axes = plt.subplots(1, 2, figsize=(9, 3.8))
axes[0].plot(chain, lw=0.6, color=C0, alpha=0.8)
axes[0].axhline(0, color=GRAY, lw=0.7, ls=":")
axes[0].set_xlabel("Iteration"); axes[0].set_ylabel(r"$x_t$")
axes[0].set_title("Trace plot — chain mixes between both modes")
x = np.linspace(-5, 5, 400)
true_pi = 0.5 * norm.pdf(x, -1.5, 0.8) + 0.5 * norm.pdf(x, 1.5, 0.9)
axes[1].hist(chain, bins=50, density=True, color=C0, alpha=0.50,
label="MCMC samples")
axes[1].plot(x, true_pi, color=C1, lw=2.2, label=r"true $\pi(x)$")
axes[1].set_xlabel(r"$x$"); axes[1].set_ylabel("Density")
axes[1].set_title("Marginal distribution")
axes[1].legend(fontsize=9)
plt.tight_layout()
save("fig_mcmc_trace")
# ════════════════════════════════════════════════════════════════════════════
# §9 INFORMATION THEORY
# ════════════════════════════════════════════════════════════════════════════
def fig_kl_asymmetry():
x = np.linspace(-10, 10, 800)
p = norm.pdf(x, 0, 1)
q = norm.pdf(x, 0, 4)
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(x, p, color=C0, lw=2, label=r"$p = \mathcal{N}(0,1)$ (narrow)")
ax.plot(x, q, color=C1, lw=2, ls="--", label=r"$q = \mathcal{N}(0,4)$ (wide)")
ax.fill_between(x, p, alpha=0.12, color=C0)
ax.fill_between(x, q, alpha=0.08, color=C1)
dx = x[1] - x[0]
eps = 1e-12
kl_pq = float(np.sum(p * np.log((p + eps) / (q + eps))) * dx)
kl_qp = float(np.sum(q * np.log((q + eps) / (p + eps)) * dx))
ax.text(-9.5, 0.085,
fr"$D_{{KL}}(p\|q) \approx {kl_pq:.2f}$ (small: $q$ covers $p$)",
fontsize=9, color=C0)
ax.text(-9.5, 0.066,
fr"$D_{{KL}}(q\|p) \approx {kl_qp:.2f}$ (large: $p$ misses tails of $q$)",
fontsize=9, color=C1)
ax.set_xlabel(r"$x$"); ax.set_ylabel("Density")
ax.set_title(r"KL divergence asymmetry: $D_{KL}(p\|q) \neq D_{KL}(q\|p)$")
ax.legend(fontsize=9)
save("fig_kl_asymmetry")
def fig_fisher_curvature():
theta = np.linspace(-3, 3, 400)
sigma_vals = [0.5, 1.0, 2.0]
colors = [C0, C2, C1]
labels = [r"$\sigma=0.5$ (high $\mathcal{I}$, sharp peak)",
r"$\sigma=1.0$",
r"$\sigma=2.0$ (low $\mathcal{I}$, flat peak)"]
fig, ax = plt.subplots(figsize=(7, 3.8))
for s, col, lbl in zip(sigma_vals, colors, labels):
logL = -0.5 * (theta / s)**2 - np.log(s)
logL -= logL.max()
ax.plot(theta, logL, lw=2, color=col, label=lbl)
ax.axvline(0, color=GRAY, lw=0.8, ls=":")
ax.set_xlabel(r"$\theta$"); ax.set_ylabel(r"$\log\mathcal{L}(\theta \mid x_\mathrm{obs})$ (centred)")
ax.set_title(r"Fisher information = log-likelihood curvature at $\theta^*$")
ax.legend(fontsize=9); ax.set_ylim(-4.2, 0.3)
save("fig_fisher_curvature")
# ════════════════════════════════════════════════════════════════════════════
# §10 DIFFERENTIAL GEOMETRY
# ════════════════════════════════════════════════════════════════════════════
def fig_curvatures():
fig, axes = plt.subplots(1, 3, figsize=(10, 3.5))
# K > 0 — converging geodesics
ax = axes[0]
ax.set_aspect("equal"); ax.axis("off")
theta_arc = np.linspace(0, np.pi, 200)
ax.plot(np.cos(theta_arc), np.sin(theta_arc), color=GRAY, lw=1.5, ls="--", alpha=0.35)
for ang in np.linspace(-0.45, 0.45, 7):
r = np.linspace(0, 1, 60)
ax.plot(r * np.sin(ang), r * np.cos(ang), color=C0, lw=1.5, alpha=0.75)
ax.scatter([0], [0], s=70, color=C1, zorder=5)
ax.text(0, -0.12, "meet at N pole", ha="center", fontsize=8, color=GRAY)
ax.set_title(r"$K > 0$ (sphere $S^2$)" + "\ngeodesics converge", fontsize=10)
# K = 0 — parallel
ax = axes[1]; ax.axis("off")
for y in np.linspace(-0.8, 0.8, 7):
ax.plot([-1, 1], [y, y], color=C0, lw=1.5)
ax.set_xlim(-1.3, 1.3); ax.set_ylim(-1.2, 1.2)
ax.text(0, -1.1, "remain equidistant", ha="center", fontsize=8, color=GRAY)
ax.set_title(r"$K = 0$ (flat $\mathbb{R}^2$)" + "\nparallel geodesics", fontsize=10)
# K < 0 — diverging
ax = axes[2]; ax.axis("off")
for ang in np.linspace(-0.55, 0.55, 7):
r = np.linspace(0, 1.2, 60)
scale = 1 + 0.55 * r
ax.plot(r * np.sin(ang * scale), r * np.cos(ang * scale), color=C0, lw=1.5, alpha=0.75)
ax.scatter([0], [0], s=70, color=C1, zorder=5)
ax.set_xlim(-1.1, 1.1); ax.set_ylim(-0.15, 1.5)
ax.text(0, -0.12, "spread exponentially", ha="center", fontsize=8, color=GRAY)
ax.set_title(r"$K < 0$ (hyperbolic $H^2$)" + "\ngeodesics diverge", fontsize=10)
plt.suptitle("Sectional curvature determines geodesic behaviour", y=1.03, fontsize=12)
plt.tight_layout()
save("fig_curvatures")
def fig_natural_gradient():
fig, axes = plt.subplots(1, 2, figsize=(9, 3.8))
theta1 = np.linspace(-2, 2, 300)
theta2 = np.linspace(-2, 2, 300)
T1, T2 = np.meshgrid(theta1, theta2)
# Standard: elongated contours → zigzag
Z_std = 6 * T1**2 + T2**2
axes[0].contour(T1, T2, Z_std, levels=7, colors=GRAY, alpha=0.45, linewidths=0.9)
path_std = [(1.6, 1.6), (0.05, 1.1), (0.75, 0.15), (0.03, 0.06), (0, 0)]
xs, ys = zip(*path_std)
axes[0].plot(xs, ys, "o-", color=C0, lw=1.8, ms=5)
axes[0].scatter([0], [0], s=120, color=C1, zorder=5, marker="*")
axes[0].set_title("Standard gradient $\\nabla_\\theta \\mathcal{L}$\n(zigzag on ill-conditioned $\\mathcal{I}$)",
fontsize=10)
axes[0].set_xlabel(r"$\theta_1$"); axes[0].set_ylabel(r"$\theta_2$")
# Natural: circular contours → direct path
Z_nat = T1**2 + T2**2
axes[1].contour(T1, T2, Z_nat, levels=7, colors=GRAY, alpha=0.45, linewidths=0.9)
path_nat = [(1.6, 1.6), (0.8, 0.8), (0.3, 0.3), (0, 0)]
xs2, ys2 = zip(*path_nat)
axes[1].plot(xs2, ys2, "o-", color=C2, lw=1.8, ms=5)
axes[1].scatter([0], [0], s=120, color=C1, zorder=5, marker="*")
axes[1].set_title(r"Natural gradient $\mathcal{I}^{-1}\nabla_\theta\mathcal{L}$" + "\n(direct, reparametrisation-invariant)",
fontsize=10)
axes[1].set_xlabel(r"$\theta_1$"); axes[1].set_ylabel(r"$\theta_2$")
plt.tight_layout()
save("fig_natural_gradient")
# ════════════════════════════════════════════════════════════════════════════
# §2.3 PICARD ITERATION
# ════════════════════════════════════════════════════════════════════════════
def fig_picard():
t = np.linspace(0, 1.5, 300)
# True solution: dx = x dt → x(t) = e^t
x_true = np.exp(t)
# Picard iterates starting at x0 = 1
x0 = np.ones_like(t) # n=0: constant 1
x1 = 1 + t # n=1: linear
x2 = 1 + t + t**2 / 2 # n=2: quadratic
x3 = 1 + t + t**2/2 + t**3/6 # n=3
fig, ax = plt.subplots(figsize=(7, 3.8))
ax.plot(t, x0, color=GRAY, lw=1.5, ls=":", label=r"$X^{(0)}$: constant")
ax.plot(t, x1, color=C3, lw=1.5, ls="-.", label=r"$X^{(1)}$: linear")
ax.plot(t, x2, color=C2, lw=1.5, ls="--", label=r"$X^{(2)}$: quadratic")
ax.plot(t, x3, color=C1, lw=1.8, label=r"$X^{(3)}$")
ax.plot(t, x_true, color=C0, lw=2.2, label=r"$X^{(\infty)} = e^t$ (true)")
ax.set_xlabel(r"$t$"); ax.set_ylabel(r"$X^{(n)}_t$")
ax.set_title(r"Picard iteration ($dX = X\,dt$, $X_0 = 1$) — successive approximations")
ax.legend(fontsize=9); ax.set_ylim(0.8, 5.0)
save("fig_picard")
# ════════════════════════════════════════════════════════════════════════════
# §8 HMM REGIME STATE MACHINE (K = 3)
# ════════════════════════════════════════════════════════════════════════════
def fig_hmm_regime():
from matplotlib.patches import FancyBboxPatch, FancyArrowPatch
import matplotlib.patheffects as pe
fig, ax = plt.subplots(figsize=(9, 4.2))
ax.set_xlim(0, 9); ax.set_ylim(0, 4); ax.axis("off")
states = [
(1.5, 2.6, "State 1\nBull", C2),
(4.5, 2.6, "State 2\nNeutral", GRAY),
(7.5, 2.6, "State 3\nBear", C3),
]
box_w, box_h = 2.0, 1.1
for (cx, cy, label, col) in states:
fancy = FancyBboxPatch((cx - box_w/2, cy - box_h/2), box_w, box_h,
boxstyle="round,pad=0.08", linewidth=1.6,
edgecolor=col, facecolor=col + "22",
zorder=2)
ax.add_patch(fancy)
ax.text(cx, cy, label, ha="center", va="center", fontsize=10,
fontweight="bold", color=col, zorder=3)
# Forward arrows A₁₂, A₂₃
for x0, x1, label in [(2.5, 3.5, r"$A_{12}$"), (5.5, 6.5, r"$A_{23}$")]:
ax.annotate("", xy=(x1, 2.85), xytext=(x0, 2.85),
arrowprops=dict(arrowstyle="-|>", color=C0, lw=1.5))
ax.text((x0+x1)/2, 2.98, label, ha="center", fontsize=9, color=C0)
# Backward arrows A₂₁, A₃₂
for x0, x1, label in [(3.5, 2.5, r"$A_{21}$"), (6.5, 5.5, r"$A_{32}$")]:
ax.annotate("", xy=(x1, 2.35), xytext=(x0, 2.35),
arrowprops=dict(arrowstyle="-|>", color=C1, lw=1.5))
ax.text((x0+x1)/2, 2.22, label, ha="center", fontsize=9, color=C1)
# Emission table
col_labels = ["State", r"$\mu$", r"$\sigma$", "Character"]
rows = [
["Bull", "+0.05", "0.12", "high return, low vol"],
["Neutral", " 0.00", "0.18", "flat, medium vol"],
["Bear", "0.08", "0.35", "crash, high vol"],
]
row_colors = [[C2+"33", C2+"33", C2+"33", C2+"33"],
[GRAY+"33", GRAY+"33", GRAY+"33", GRAY+"33"],
[C3+"33", C3+"33", C3+"33", C3+"33"]]
tbl = ax.table(cellText=rows, colLabels=col_labels, loc="bottom",
cellColours=row_colors, bbox=[0.05, 0.0, 0.90, 0.42])
tbl.auto_set_font_size(False); tbl.set_fontsize(9)
for (r, c), cell in tbl.get_celld().items():
cell.set_edgecolor("#cccccc")
if r == 0:
cell.set_facecolor(C0 + "33")
cell.set_text_props(fontweight="bold")
ax.set_title(r"HMM Regime State Machine ($K=3$) — Emission $B_k(y)=\mathcal{N}(\mu_k,\sigma_k^2)$",
fontsize=11, pad=6)
plt.tight_layout()
save("fig_hmm_regime")
# ════════════════════════════════════════════════════════════════════════════
# §8.2 VITERBI TRELLIS (K=3, T=4)
# ════════════════════════════════════════════════════════════════════════════
def fig_viterbi_trellis():
from matplotlib.patches import Circle, FancyArrowPatch
K, T = 3, 4
state_labels = ["1 (Bull)", "2 (Neutral)", "3 (Bear)"]
map_path = {(1, 1), (1, 2)} # state index 1 = "2 (Neutral)" at t=2,3 (0-indexed t)
fig, ax = plt.subplots(figsize=(8, 3.8))
ax.set_xlim(-0.5, T + 0.5); ax.set_ylim(-0.5, K - 0.3); ax.axis("off")
# x-positions: t=1..4 → 0.5, 1.5, 2.5, 3.5
xs = [0.6 * (t + 1) for t in range(T)]
ys = [K - 1 - k for k in range(K)] # top = state 1
# Draw crossing / passing arrows (selective to show crossing)
arrow_kw = dict(arrowstyle="-|>", connectionstyle="arc3,rad=0.0",
color=GRAY, lw=1.1, alpha=0.55)
cross_kw = dict(arrowstyle="-|>", connectionstyle="arc3,rad=0.18",
color=GRAY, lw=1.1, alpha=0.45)
for t in range(T - 1):
for k in range(K):
for k2 in range(K):
rad = 0.0 if k == k2 else (0.18 if k2 > k else -0.18)
col = C0 if (k == 1 and k2 == 1 and t >= 1) else GRAY
alpha = 0.9 if col == C0 else 0.3
ax.annotate("", xy=(xs[t+1], ys[k2]), xytext=(xs[t], ys[k]),
arrowprops=dict(arrowstyle="-|>",
connectionstyle=f"arc3,rad={rad}",
color=col, lw=1.2 if col == C0 else 0.8,
alpha=alpha))
# Draw nodes
r = 0.14
for k in range(K):
for t in range(T):
is_map = (k == 1 and 1 <= t <= 2)
fc = C0 if is_map else "white"
ec = C0 if is_map else GRAY
circ = Circle((xs[t], ys[k]), r, facecolor=fc, edgecolor=ec, lw=1.8, zorder=4)
ax.add_patch(circ)
# Labels on left
for k in range(K):
ax.text(-0.1, ys[k], state_labels[k], ha="right", va="center",
fontsize=9, color=C0 if k == 1 else "black")
# x-axis ticks
for t in range(T):
ax.text(xs[t], -0.35, f"$t={t+1}$", ha="center", va="top", fontsize=9)
# Legend
ax.scatter([], [], color=C0, s=80, label="● MAP (Viterbi) path", zorder=5)
ax.scatter([], [], facecolor="white", edgecolors=GRAY, s=80, label="○ other nodes", zorder=5)
ax.legend(loc="upper right", fontsize=9, framealpha=0.9)
ax.set_title(r"Viterbi Trellis ($K=3$, $T=4$) — $\delta_t(k)=\max_j\,\delta_{t-1}(j)\,A_{jk}\,B_k(y_t)$",
fontsize=11)
plt.tight_layout()
save("fig_viterbi_trellis")
# ════════════════════════════════════════════════════════════════════════════
# §10.2 STANDARD VS NATURAL GRADIENT — PROPERTY COMPARISON
# ════════════════════════════════════════════════════════════════════════════
def fig_std_vs_nat_gradient():
from matplotlib.patches import FancyBboxPatch
fig, axes = plt.subplots(1, 2, figsize=(9, 3.0))
panels = [
("Standard Gradient\n" + r"$\theta_{k+1} = \theta_k - \eta\nabla\mathcal{L}$",
["Flat $\\mathbb{R}^d$ geometry",
"Ignores manifold curvature",
"Slow on ill-conditioned $\\mathcal{I}$",
"$O(\\kappa(\\mathcal{I}))$ iterations"],
C3, C3 + "18"),
("Natural Gradient\n" + r"$\theta_{k+1} = \theta_k - \eta\,\mathcal{I}(\theta)^{-1}\nabla\mathcal{L}$",
["Riemannian metric $\\mathcal{I}(\\theta)$",
"Adapts to manifold geometry",
"Reparametrisation-invariant",
"$O(1)$ on exp. families (MLE step)"],
C2, C2 + "18"),
]
for ax, (title, props, border, bg) in zip(axes, panels):
ax.set_xlim(0, 1); ax.set_ylim(0, 1); ax.axis("off")
fancy = FancyBboxPatch((0.03, 0.04), 0.94, 0.92,
boxstyle="round,pad=0.04", linewidth=2,
edgecolor=border, facecolor=bg)
ax.add_patch(fancy)
ax.text(0.5, 0.87, title, ha="center", va="top", fontsize=10,
fontweight="bold", color=border, transform=ax.transAxes,
multialignment="center")
y = 0.68
for prop in props:
ax.text(0.12, y, "" + prop, ha="left", va="top", fontsize=9.5,
transform=ax.transAxes, color="#222222")
y -= 0.17
fig.suptitle("Standard vs Natural Gradient — geometric properties", fontsize=11, y=1.02)
plt.tight_layout()
save("fig_std_vs_nat_gradient")
# ════════════════════════════════════════════════════════════════════════════
# §10.3 MATRIX LIE GROUP HIERARCHY
# ════════════════════════════════════════════════════════════════════════════
def fig_lie_group_hierarchy():
from matplotlib.patches import FancyBboxPatch, FancyArrowPatch
fig, ax = plt.subplots(figsize=(9, 4.6))
ax.set_xlim(0, 9); ax.set_ylim(0, 4.6); ax.axis("off")
nodes = {
"GL": (4.5, 4.1, r"$\mathrm{GL}(n,\mathbb{R})$" + "\nall invertible $n\times n$", C0),
"SL": (1.8, 2.85, r"$\mathrm{SL}(n,\mathbb{R})$" + "\n" + r"$\det=1$", C2),
"On": (4.5, 2.85, r"$O(n)$" + "\n$R^\top R=I$", C1),
"Sp": (7.2, 2.85, r"$\mathrm{Sp}(2n,\mathbb{R})$" + "\npreserves " + r"$\omega$", C2),
"SO": (4.5, 1.55, r"$\mathrm{SO}(n)$" + "\n" + r"$\det=+1$ (rotations)", C2),
"Hn": (1.8, 1.55, r"$H(n)$ Heisenberg" + "\nupper triangular", C3),
}
notes = {
"SO": "portfolio factor\nrotation, PCA",
"Sp": "Hamiltonian\nmechanics, PMP",
"Hn": "path-signature\nfeature maps",
}
edges = [("GL","SL"), ("GL","On"), ("GL","Sp"), ("On","SO")]
bw, bh = 2.2, 0.76
for key, (cx, cy, label, col) in nodes.items():
fbp = FancyBboxPatch((cx-bw/2, cy-bh/2), bw, bh,
boxstyle="round,pad=0.07", lw=1.6,
edgecolor=col, facecolor=col+"22", zorder=2)
ax.add_patch(fbp)
ax.text(cx, cy, label, ha="center", va="center", fontsize=8.5,
multialignment="center", color=col, fontweight="bold", zorder=3)
if key in notes:
ax.text(cx + bw/2 + 0.15, cy, notes[key], va="center",
fontsize=7.5, color="#555555", fontstyle="italic")
for src, dst in edges:
sx, sy = nodes[src][0], nodes[src][1]
dx, dy = nodes[dst][0], nodes[dst][1]
ax.annotate("", xy=(dx, dy + bh/2 + 0.04), xytext=(sx, sy - bh/2 - 0.04),
arrowprops=dict(arrowstyle="-|>", color=GRAY, lw=1.4))
ax.set_title("Matrix Lie Group Hierarchy — subgroup inclusions and finance applications",
fontsize=11, pad=5)
plt.tight_layout()
save("fig_lie_group_hierarchy")
# ════════════════════════════════════════════════════════════════════════════
# RUN ALL
# ════════════════════════════════════════════════════════════════════════════
if __name__ == "__main__":
funcs = [
fig_de_mutation, fig_rastrigin,
fig_random_walk, fig_bm_fan, fig_gbm,
fig_ito_correction,
fig_picard,
fig_fokker_planck, fig_em_milstein,
fig_ou_path, fig_ou_transition, fig_ou_loglik, fig_ou_residuals,
fig_poisson, fig_jump_diffusion, fig_levy_tails,
fig_kalman_covariance,
fig_mcmc_energy, fig_mcmc_trace,
fig_kl_asymmetry, fig_fisher_curvature,
fig_curvatures, fig_natural_gradient,
# new §8 & §10 diagrams
fig_hmm_regime, fig_viterbi_trellis,
fig_std_vs_nat_gradient, fig_lie_group_hierarchy,
]
for fn in funcs:
print(f" {fn.__name__} ... ", end="", flush=True)
fn()
print("ok")
print(f"\nDone — {len(funcs)} SVGs saved to {OUT}")
Binary file not shown.

After

Width:  |  Height:  |  Size: 50 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 51 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 34 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 35 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 28 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 44 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 24 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 101 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 65 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 20 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 40 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 98 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 86 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 61 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 49 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 24 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 88 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 42 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 23 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 36 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 48 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 17 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 18 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 59 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 30 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 82 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 27 KiB

+138
View File
@@ -0,0 +1,138 @@
/* ─── Optimiz-rs Documentation Custom Styles ──────────────────────────────── */
/* Brand: orange (#f97316) on furo dark theme */
:root {
--brand-orange: #f97316;
--brand-orange-light: #fb923c;
--brand-orange-dim: rgba(249, 115, 22, 0.15);
--brand-orange-border: rgba(249, 115, 22, 0.35);
}
/* ── Mermaid diagram container ─────────────────────────────────────────────── */
.mermaid {
background: transparent !important;
padding: 1.5rem 0;
text-align: center;
overflow-x: auto;
}
.mermaid svg {
max-width: 100%;
border-radius: 12px;
filter: drop-shadow(0 4px 16px rgba(249, 115, 22, 0.12));
}
/* ── Better admonitions ─────────────────────────────────────────────────────── */
.admonition {
border-radius: 10px !important;
border-left-width: 4px !important;
margin: 1.5rem 0 !important;
}
.admonition.note {
border-left-color: var(--brand-orange) !important;
background: var(--brand-orange-dim) !important;
}
.admonition.tip {
border-left-color: #22c55e !important;
background: rgba(34, 197, 94, 0.1) !important;
}
.admonition.warning {
border-left-color: #f59e0b !important;
background: rgba(245, 158, 11, 0.1) !important;
}
.admonition.important {
border-left-color: #ef4444 !important;
background: rgba(239, 68, 68, 0.1) !important;
}
/* ── Section headers ────────────────────────────────────────────────────────── */
h1, h2, h3 {
scroll-margin-top: 4rem;
}
h2 {
border-bottom: 2px solid var(--brand-orange-border);
padding-bottom: 0.4rem;
}
/* ── Code blocks ────────────────────────────────────────────────────────────── */
.highlight {
border-radius: 8px !important;
border: 1px solid rgba(255, 255, 255, 0.08) !important;
}
/* Inline code */
code.literal {
background: rgba(249, 115, 22, 0.08) !important;
border: 1px solid var(--brand-orange-border) !important;
padding: 0.1em 0.4em !important;
border-radius: 4px !important;
color: var(--brand-orange-light) !important;
font-size: 0.88em !important;
}
/* ── Tables ─────────────────────────────────────────────────────────────────── */
table.docutils {
border-collapse: collapse;
width: 100%;
margin: 1.2rem 0;
border-radius: 8px;
overflow: hidden;
font-size: 0.9rem;
}
table.docutils th {
background: var(--brand-orange-dim) !important;
color: var(--brand-orange-light) !important;
font-weight: 700;
padding: 0.6rem 0.9rem;
border-bottom: 2px solid var(--brand-orange-border);
}
table.docutils td {
padding: 0.5rem 0.9rem;
border-bottom: 1px solid rgba(255, 255, 255, 0.06);
}
table.docutils tr:hover td {
background: rgba(249, 115, 22, 0.04);
}
/* ── Performance metric boxes (for benchmarks) ──────────────────────────────── */
.perf-box {
background: linear-gradient(135deg, rgba(249,115,22,0.12) 0%, rgba(249,115,22,0.04) 100%);
border: 1px solid var(--brand-orange-border);
border-radius: 10px;
padding: 1rem 1.5rem;
margin: 1rem 0;
display: inline-block;
min-width: 140px;
text-align: center;
}
.perf-box .val {
font-size: 1.8rem;
font-weight: 800;
color: var(--brand-orange);
}
.perf-box .lbl {
font-size: 0.75rem;
color: #94a3b8;
margin-top: 0.2rem;
}
/* ── Navigation sidebar ─────────────────────────────────────────────────────── */
.sidebar-tree .current > .reference {
color: var(--brand-orange) !important;
}
/* ── Mobile ─────────────────────────────────────────────────────────────────── */
@media (max-width: 768px) {
.mermaid svg { width: 100% !important; }
table.docutils { font-size: 0.78rem; }
}
File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 174 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 55 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 30 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 53 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 43 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 122 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 112 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 50 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 35 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 53 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 50 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 123 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 69 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 58 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 62 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 95 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 128 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 194 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 168 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 42 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 112 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 42 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 31 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 32 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 77 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 50 KiB

File diff suppressed because it is too large Load Diff

After

Width:  |  Height:  |  Size: 48 KiB

Binary file not shown.
File diff suppressed because it is too large Load Diff
Binary file not shown.

After

Width:  |  Height:  |  Size: 50 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 51 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 34 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 35 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 28 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 44 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 65 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 20 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 61 KiB

Some files were not shown because too many files have changed in this diff Show More