Do Not Reintroduce a Local Stream Plane — Anti-Regression Reference

Reading Progress70%

Chapter 34: Do Not Reintroduce a Local Stream Plane — Anti-Regression Reference

DEML previously operated an OpenTelemetry Collector → Redpanda → ClickHouse plane for product telemetry. That stack is fully retired. FORJD is the exclusive data plane for sealed ingest, projections, analytics, ML, SIEM/SOAR, replay, and DLQ. The steady-state architecture is described throughout this book; the notes below are an operator anti-regression contract only.

Must not return

  • Do not add an OpenTelemetry Collector, ClickHouse cluster, Redpanda bus, or Kafka-compatible broker for product telemetry.
  • Do not introduce DEML-local projection workers, local outbox relay processes, or in-repo stream consumers for product events.
  • Do not query FORJD Postgres or Dragonfly directly from Django.
  • Do not forward Firebase end-user tokens or deml_… API keys to FORJD.
  • Do not treat a missing FORJD SIEM/analytics route as an empty 200 success list without an explicit degraded: true marker.
  • Do not label plaintext or OTLP product telemetry as E2EE — sealed AES-256-GCM envelopes on /api/v1/ingest is the only production-grade lane.

Steady-state flow

flowchart TB
  subgraph now [Steady state]
    A2[Angular / integrators] -->|Firebase or deml_ key + sealed envelope| DJ[Django BFF]
    DJ -->|fjsvc_| FJ[FORJD API + engine]
    FJ --> DF[(Dragonfly)]
    FJ --> SB[(Supabase Postgres)]
    FJ --> PR[Projections / analytics / ML / SIEM]
    A2 -->|Product reads| DJ
    DJ -.->|BFF adapters| PR
  end

Operator checklist

  1. Confirm FORJD_WRITE_MODE=forjd and FORJD_READ_MODE=forjd (cutover phase 2 is an equivalent legacy alias).
  2. Confirm every account with data-plane access has map_forjd_tenant + secret ref — never a plaintext token in git.
  3. Confirm no OTel Collector, ClickHouse, Redpanda, or Railway-era projection worker appears in the live topology.
  4. Confirm dashboards and CES read through Django BFF adapters to FORJD — not direct columnar DSNs.
  5. On FORJD outage: restore FORJD; do not stand up a temporary broker or warehouse sidecar.

Integration contract: docs/FORJD_INTEGRATION.md. Ownership appendix: Appendix T. Observability chapter (steady state): Chapter 8.