Fortune 500 · scale and costOngoing
Observability at 150TB+/day
Fortune 500 POC engagements scaling to 150TB+/day ingestion, with a 30-40% compute cost reduction versus incumbent Elastic stacks at equivalent workloads.
OpenObserveClickHouseElasticsearchKubernetesTerraform
architecturescroll to pan →
Problem
Fortune 500 environments running incumbent Elastic and Grafana stacks needed to ingest at 150TB+ a day while cutting the compute bill. The evaluation covered ingestion headroom, query performance, and the effort of migrating off the existing stack.
My role
Designed and tuned cluster configurations end to end, and built the migration path off Elastic and Grafana stacks for an ongoing enterprise POC.
What shipped
- +Cluster configurations tuned end to end for 150TB+/day ingestion
- +Migration path off incumbent Elastic and Grafana stacks
- +Capacity and cost modeling versus the incumbent
Outcome
- →150TB+/day peak ingestion supported and scaled
- →30-40% compute cost reduction versus Elastic at equivalent workloads
- →Some engagements converted to production, others ongoing