Skip to main content

Inspect PII removal

Follow a synthetic purchase record as selected fields are deleted, hashed, pseudonymized, or generalized.

Interactive pipeline

PII removal pipeline

Six-stage curated walkthrough

Stage 1 of 6

Original Input

Start with a synthetic purchase record containing payment, identity, network, and location fields.

  • 0Added
  • 0Updated
  • 0Removed
Copy & download

Input

{"event_id": "evt_20240115_1030","timestamp": "2024-01-15T10:30:00Z","event_type": "purchase","user_name": "Sarah Johnson","email": "[email protected]","ip_address": "192.168.1.100","payment_method": {"type": "credit_card","full_number": "4532-1234-5678-9010","expiry": "12/25","last_four": "9010"},"location": {"latitude": 37.7749,"longitude": -122.4194,"city": "San Francisco","country": "USA"},"purchase_amount": 49.99,"currency": "USD"}

Output

{"event_id": "evt_20240115_1030","timestamp": "2024-01-15T10:30:00Z","event_type": "purchase","user_name": "Sarah Johnson","email": "[email protected]","ip_address": "192.168.1.100","payment_method": {"type": "credit_card","full_number": "4532-1234-5678-9010","expiry": "12/25","last_four": "9010"},"location": {"latitude": 37.7749,"longitude": -122.4194,"city": "San Francisco","country": "USA"},"purchase_amount": 49.99,"currency": "USD"}
Stage configurationremove-pii-complete.yaml#config-input
input:
  http_server:
    address: '0.0.0.0:8080'
    path: /events/ingest
    allowed_verbs: [POST]
    timeout: 30s

# Five field transformations. Review these choices for your own data model.