Platform Architect

About This Role

Serve as the technical lead for the design, integration, and evolution of the client's data platform across on-prem, hybrid, and cloud environments. Architect scalable, secure solutions and guide platform engineers in best practices.

Responsibilities

• Architect and evolve the end-to-end client platform across on-prem, hybrid, and cloud environments based on customer requirements and limitations
• Design and designate integration points for data services, pipelines, orchestration, governance, and security layers
• Translate solution requests and business requirements into scalable, compliant architecture blueprints
• Lead and participate in Architecture Review Boards (ARBs) to align deployments with enterprise standards
• Define and maintain reference architectures, design patterns, and integration frameworks
• Guide platform engineers and client teams in implementing best practices for security, observability, and reliability
• Oversee the selection, integration, and tuning of open-source components such as Airflow, Spark, Trino, YuniKorn, Superset, S3, NiFi, Ranger, and DataHub
• Partner with product and engineering leadership to evolve the client's "North Star" architecture and roadmap
• Mentor engineers and collaborate with DevOps, Security, and DataOps to drive alignment and platform maturity

Requirements

• Senior architect experience supporting and building platforms
• Strong data and platform experience
• Strong with Kubernetes
• Ideally Terraform (automation for the project is terraform helm, able to write python code and scripts)
• Deep experience with Spark and troubleshooting
• Understanding of Airflow orchestration and deployment for Airflow jobs
• 8+ years of hands-on experience integrating and operating open-source data tools across hybrid-cloud and containerized environments
• 10+ years of experience designing or implementing large-scale distributed data platforms in regulated industries
• Extensive experience with Microservices, containers, kubernetes, automation with terraform, and helm scripting

Qualifications

• 8+ years of hands-on experience integrating and operating open-source data tools across hybrid-cloud and containerized environments; 10+ years of experience designing or implementing large-scale distributed data platforms in regulated industries.

Nice to Have

• Proven track record as a technical architect or lead engineer at Cloudera, Databricks, AWS EMR, or similar open-source platform providers
• Strong understanding of enterprise governance and security frameworks (SOX, FFIEC, GDPR)
• Exceptional communication and stakeholder engagement skills to influence architecture decisions across engineering and client teams

Skills

* Required skills

Benefits