Chapters · #34
Do Not Reintroduce a Local Stream Plane — Anti-Regression Reference
Chapter 34: Do Not Reintroduce a Local Stream Plane — Anti-Regression Reference
DEML previously operated an OpenTelemetry Collector → Redpanda → ClickHouse plane for product telemetry. That stack is fully retired. FORJD is the exclusive data plane for sealed ingest, projections, analytics, ML, SIEM/SOAR, replay, and DLQ. The steady-state architecture is described throughout this book; the notes below are an operator anti-regression contract only.
Must not return
- Do not add an OpenTelemetry Collector, ClickHouse cluster, Redpanda bus, or Kafka-compatible broker for product telemetry.
- Do not introduce DEML-local projection workers, local outbox relay processes, or in-repo stream consumers for product events.
- Do not query FORJD Postgres or Dragonfly directly from Django.
- Do not forward Firebase end-user tokens or
deml_…API keys to FORJD. - Do not treat a missing FORJD SIEM/analytics route as an empty
200success list without an explicitdegraded: truemarker. - Do not label plaintext or OTLP product telemetry as E2EE — sealed AES-256-GCM envelopes on
/api/v1/ingestis the only production-grade lane.
Steady-state flow
flowchart TB
subgraph now [Steady state]
A2[Angular / integrators] -->|Firebase or deml_ key + sealed envelope| DJ[Django BFF]
DJ -->|fjsvc_| FJ[FORJD API + engine]
FJ --> DF[(Dragonfly)]
FJ --> SB[(Supabase Postgres)]
FJ --> PR[Projections / analytics / ML / SIEM]
A2 -->|Product reads| DJ
DJ -.->|BFF adapters| PR
end
Operator checklist
- Confirm
FORJD_WRITE_MODE=forjdandFORJD_READ_MODE=forjd(cutover phase 2 is an equivalent legacy alias). - Confirm every account with data-plane access has
map_forjd_tenant+ secret ref — never a plaintext token in git. - Confirm no OTel Collector, ClickHouse, Redpanda, or Railway-era projection worker appears in the live topology.
- Confirm dashboards and CES read through Django BFF adapters to FORJD — not direct columnar DSNs.
- On FORJD outage: restore FORJD; do not stand up a temporary broker or warehouse sidecar.
Integration contract: docs/FORJD_INTEGRATION.md. Ownership appendix: Appendix T. Observability chapter (steady state): Chapter 8.