Regulated banking · big data · 5PiBProduction
Cloudera Hadoop big data cluster
A 300-node Cloudera Hadoop cluster managing 5PiB of banking big data, secured with Kerberos, TLS, and Vault dynamic secrets, with 70% of routine operations automated.
Cloudera / HadoopKerberosVaultBare metal
architecturescroll to pan →
Problem
A regulated banking environment ran 5PiB of big data on a 300-node Cloudera Hadoop cluster that had to stay secure and highly available while routine operations consumed most of the team.
My role
Operated the 300-node Cloudera Hadoop cluster: secured it with Kerberos, TLS, and HashiCorp Vault dynamic secrets, tuned performance, and automated routine operations.
What shipped
- +300-node Cloudera Hadoop cluster operated in production
- +Kerberos, TLS, and Vault dynamic secrets across the cluster
- +70% of routine operations automated
- +25% improvement in critical task processing time through tuning
Outcome
- →5PiB of banking big data managed on a secured cluster
- →70% of routine operations automated