Interactive Content Splitting Explorer
See content splitting in action! Use the interactive explorer below to step through 5 stages of message splitting transformation. Watch as bundled sensor arrays are progressively split into individual messages with preserved context.
How to Use This Explorer
- Navigate using arrow keys (← →) or click the numbered stage buttons
- Compare the Input (left) and Output (right) JSON at each stage
- Observe how the array is split (red strikethrough) and context is preserved (green highlight)
- Inspect the YAML code showing exactly what processor was added
- Learn from the stage description explaining the technique and benefit
Interactive Content Splitting Explorer
Original Bundled Message
Single message containing multiple sensor readings bundled in an array. This format is efficient for transport but prevents individual routing and processing.
Use ← → arrow keys to navigate
📥Input
{
"device_id": "sensor-001",
"timestamp": "2025-10-20T10:00:00Z",
"location": "warehouse-a",
"readings": [
{"sensor": "temp-1", "value": 72.5, "unit": "F"},
{"sensor": "temp-2", "value": 85.3, "unit": "F"},
{"sensor": "temp-3", "value": 68.1, "unit": "F"}
]
}
📤Output
{
"device_id": "sensor-001",
"timestamp": "2025-10-20T10:00:00Z",
"location": "warehouse-a",
"readings": [
{"sensor": "temp-1", "value": 72.5, "unit": "F"},
{"sensor": "temp-2", "value": 85.3, "unit": "F"},
{"sensor": "temp-3", "value": 68.1, "unit": "F"}
]
}
Added/Changed
Removed
Completed Step
Current Step
Not Done Yet
📄New Pipeline Steppipeline.yaml
# Original input - bundled sensor array
input:
http_server:
address: 0.0.0.0:8080
path: /sensors/bulk
# No processing yet - raw input
pipeline:
processors: []
output:
file:
path: /var/log/raw-input.jsonlTry It Yourself
Ready to build this content splitting pipeline? Follow the step-by-step tutorial:
Deep Dive into Each Step
Want to understand each transformation in depth?
- Step 1: Split JSON Arrays - Master the unarchive processor and metadata patterns
- Step 2: Split CSV Batches - Handle file input and line-by-line processing
- Step 3: Split Nested Structures - Work with complex JSON hierarchies
- Step 4: Advanced Patterns - Split-and-rebatch optimization strategies
- Step 5: Production Considerations - Memory limits, error handling, and edge deployment
Next: Set up your environment to build this content splitting pipeline yourself