Managing Data Architect - Azure Databricks Architect

About This Role

Lead the architecture and implementation of scalable data integration and analytics solutions using Azure Data Services, ensuring delivery excellence and fostering a culture of accountability within technical teams.

Responsibilities

• Architect and implement scalable data integration and analytics solutions using Azure Data Services (Databricks, Synapse, ADF)
• Lead development of reusable frameworks for data ingestion, transformation, and analytics
• Ensure delivery excellence through code quality, performance optimization, and best practices in Python, PySpark, and SQL
• Apply Azure identity and security principles including Managed Identities, Azure AD authentication, Key Vault integration, Networking, and RBAC
• Maintain a high standard of documentation hygiene across solution components and processes
• Mentor and guide a team of data engineers and developers, fostering a culture of accountability
• Conduct regular code reviews, pair programming sessions, and internal knowledge sharing sessions with delivery team
• Plan and manage workstreams, delegating effectively to reduce dependencies and minimize technical debt
• Lead technical discussions with clients, clearly documenting assumptions, expectations and solution design
• Collaborate with business stakeholders to understand requirements, translate them into technical solutions, and manage expectations

Requirements

• 10+ years of experience in data engineering, analytics, or solution architecture
• Strong hands-on experience with Azure Databricks (Spark, Delta, ML runtime)
• Strong hands-on experience with Azure Synapse Analytics (serverless, pipelines, dedicated pools)
• Strong hands-on experience with Azure Data Factory / Synapse Pipelines
• Strong hands-on experience with Data Lake Storage Gen2, Databricks Unity Catalog, Spark SQL
• Strong hands-on experience with Python, PySpark, Spark optimization
• Strong hands-on experience with Azure DevOps, CI/CD, and Infrastructure as Code
• Strong hands-on experience with Cloud security & identity (Managed identities, Azure AD, Key Vault, RBAC, networking fundamentals)
• Experience with Compute Vision and AI/ML implementation
• Proven experience in leading technical teams and managing delivery in Agile framework
• Excellent communication and interpersonal skills
• Experience in stakeholder management, risk assessment, and project planning

Qualifications

• 10+ years of experience in data engineering, analytics, or solution architecture

Nice to Have

• Experience with C#
• Azure Solutions Architect Expert certification
• Azure Data Engineer Associate certification
• Databricks certifications
• Experience in oil & gas, industrial or asset-heavy domains

Skills

* Required skills

Benefits