Databricks Data Engineering Manager (AWS/AZURE)
Mississauga, ON, CanadaYesterday
Key details
- Salary
- CA$140K–CA$170K/yr
- Location
- Mississauga, ON, Canada
- Work style
- Onsite
- Level
- Senior
- Job type
- Full-time
- Experience
- 10–13 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- Yesterday
Skills
agileai/mlairflowawsazurebatch processingci/cdcode reviewscsmdata architecturedata governancedata integrationdata lakesdata qualitydata warehousingdatabricksdbtdevopsetlgenerative aikafkamachine learningmlopsperformance optimizationpmppysparkpythonsnowflakesparksql
About the role
We are looking for a Senior Databricks Manager to design and lead scalable, secure, and high-performance cloud data platforms across AWS and/or Azure." Mississauga, ON (Hybrid – 3 Days Onsite Per Week) .
Job Title: Databricks Data Engineering Manager – (AWS/Azure)Location: Mississauga, ON (Hybrid – 3 Days Onsite Per Week)
Employment Type: Full-Time/CTH
Key Responsibilities
- Lead and manage Data Engineering teams responsible for building enterprise-scale data platforms using Databricks on AWS and/or Azure.
- Drive end-to-end delivery of modern data engineering solutions, including Data Lakes, Lakehouses and Data Warehouses.
- Define and implement scalable data engineering strategies, architecture standards and best practices.
- Lead the design and implementation of Medallion Architecture (Bronze, Silver and Gold layers).
- Oversee the development of robust ETL/ELT pipelines, batch processing and real-time streaming solutions.
- Ensure data platform scalability, reliability, performance optimization and cost efficiency.
- Drive engineering excellence through code reviews, CI/CD automation, DevOps practices and reusable frameworks.
- Establish data governance, data quality, security and compliance standards across data platforms.
- Collaborate with Enterprise Architects, Product Owners, Business Stakeholders and cross-functional teams.
- Manage project execution, resource allocation, delivery timelines, risks and technical dependencies.
- Mentor and develop Data Engineers, Senior Engineers and Technical Leads.
- Drive cloud data modernization initiatives and continuous improvement across engineering processes.
- 10+ years of experience in Data Engineering, with at least 2–4 years in a Data Engineering Manager / Technical Lead / Engineering Lead role.
- Strong hands-on experience with Databricks and Apache Spark.
- Expertise in AWS and/or Azure cloud data platforms.
- Strong understanding of Data Lakes, Lakehouses, Data Warehousing and Medallion Architecture.
- Experience designing and implementing scalable ETL/ELT pipelines and data integration frameworks.
- Strong proficiency in SQL and Python/PySpark.
- Experience with Kafka, Airflow, dbt or equivalent orchestration and streaming technologies.
- Experience with structured, semi-structured and unstructured data.
- Strong understanding of Data Governance, Security, CI/CD, DevOps and data quality frameworks.
- Proven experience managing engineering teams, technical delivery and stakeholder expectations.
- Excellent leadership, communication, problem-solving and people management skills.
· PMP, PMI-ACP, CSM or SAFe certifications.
- AWS/Azure cloud certifications.
- Databricks certifications.
- Snowflake experience.
- Experience with Data Mesh and enterprise data architecture.
- Exposure to MLOps, AI/ML data platforms and GenAI data engineering.
- Experience managing distributed engineering teams and Agile delivery models.
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.