IntermediateScenario
10 min
Slow Log Pipeline Delaying Alerts
LoggingMonitoringPipelines
Advertisement
Interview Question
Alerts based on log ingestion are delayed by 15 minutes. Walk through diagnosing and fixing pipeline slowness.
Key Points to Cover
- Check ingestion lag via Kafka/Fluentd/ELK metrics
- Identify slow parsing/transform stages
- Scale collectors or add parallel pipelines
- Tune buffer/flush intervals and batching
- Add alerts on pipeline lag itself
Evaluation Rubric
Measures ingestion lag accurately30% weight
Identifies bottleneck stages30% weight
Suggests scaling/tuning fixes20% weight
Adds monitoring for lag itself20% weight
Hints
- 💡ELK indexers often bottleneck under load.
Potential Follow-up Questions
- ❓How to design log pipelines for elasticity?
- ❓What about sampling?
Advertisement