We are looking for a highly skilled Databricks Solution Architect to lead the design and implementation of scalable, high-performance data and AI solutions on the Databricks platform across Microsoft Azure and Amazon Web Services (AWS).
As a Solution Architect, you will act as the trusted advisor to clients and internal stakeholders, translating complex business requirements into robust Databricks architectures while ensuring best practices in data engineering, data science, machine learning, and analytics.
DUTIES AND RESPONSIBILITIES
- Design end-to-end Databricks solutions on Azure Databricks and AWS Databricks (multi-cloud capable)
- Lead technical workshops, architecture reviews, and proof-of-concept projects
- Architect scalable data lakes, lakehouse platforms, ETL/ELT pipelines, and real-time streaming solutions using Databricks
- Integrate Databricks with key cloud services:
- Azure: Azure Data Factory, Synapse, ADLS Gen2, Key Vault, Azure Active Directory, Purview
- AWS: S3, Glue, IAM, Redshift, Kinesis, Lake Formation
- Optimize performance, cost, security, and governance of Databricks workloads
- Provide technical leadership and mentoring to data engineering teams
- Develop reference architectures, best practices, and reusable solution patterns
- Support pre-sales activities including solution design, scoping, and effort estimation
- Ensure solutions comply with security, compliance, and data governance standards