Skip to main content

Interactive Production Pipeline Explorer

See a complete production pipeline in action! Use the interactive explorer below to step through 6 stages of enterprise-grade log processing: parse → validate → enrich → filter → redact → fan-out. This is the most comprehensive example combining all patterns.

How to Use This Explorer​

  1. Navigate using arrow keys (← →) or click the numbered stage buttons
  2. Compare the Input (left) and Output (right) showing transformations at each stage
  3. Observe how raw logs become production-ready analytics data
  4. Inspect the YAML code showing real-world pipeline configuration
  5. Learn from the stage description explaining each processing step

Interactive Production Pipeline Explorer​

Raw HTTP Input

Production systems receive raw unstructured logs via HTTP POST. No validation, no metadata, no structure - just raw text that needs comprehensive processing before analytics.

Use ← → arrow keys to navigate
📥Input
{"msg":"User login","user":"[email protected]"}
📤Output
❌ Raw, Unstructured:
No timestamp
No correlation ID
PII exposed (email)
No priority/severity
Added/Changed
Removed
Completed Step
Current Step
Not Done Yet
📄New Pipeline Stepstep-0-raw-input.yaml
input:
  http_server:
    address: 0.0.0.0:8080
    path: /logs

Try It Yourself​

Ready to build production log pipelines? Follow the step-by-step tutorial:

Deep Dive into Each Step​

Next: Set up your environment to build production pipelines yourself