Manager, Software Engineering
Westchester, IL, United States7h ago
Key details
- Location
- Westchester, IL, United States
- Work style
- Hybrid
- Level
- Senior
- Job type
- Full-time
- Experience
- 15–18 yrs
- Function
- Software engineering
- Focus area
- Data engineering & Analytics
- Posted
- 7h ago
Skills
About the role
We are seeking a Manager of Data Engineering to lead a team responsible for building, modernizing, and operating data platforms and data products to support IAA global operations. This leader will deliver trusted, scalable, and well-governed data capabilities that enable operational reporting, analytics, and advanced data-driven use cases. The role will lead data engineering delivery across Azure, Databricks, Microsoft Fabric, and Power BI, establishing reliable data pipelines, curated data layers, reusable data models, and enterprise reporting capabilities. The Manager will partner closely with business stakeholders, Product, Performance Analytics, Data Governance, Security, and infrastructure teams to translate business needs into prioritized data solutions and deliver measurable outcomes.
What you will do
- Lead, coach, and develop a team of data engineers and analytics engineers responsible for delivering and supporting IAA global operations data solutions.
- Plan and manage delivery of data engineering projects and workstreams, including scope, milestones, dependencies, resource plans, risks, and delivery commitments.
- Design, build, and modernize scalable data pipelines and data processing solutions using Azure services, Azure Databricks, and Microsoft Fabric.
- Establish and implement robust data ingestion, transformation, orchestration, and integration patterns for batch and near-real-time data from enterprise and operational source systems.
- Partner with business and technology stakeholders to understand requirements, define data products and reporting needs, and translate them into clear technical designs and delivery plans.
- Develop and maintain curated data layers, dimensional models, reusable datasets, and semantic models that support trusted enterprise reporting, analytics, and self-service consumption.
- Lead engineering practices across the data delivery lifecycle, including source control, CI/CD, automated testing, deployment automation, environment management, and release governance.
- Ensure data solutions meet expectations for data quality, accuracy, freshness, availability, scalability, performance, and cost efficiency.
- Establish monitoring, alerting, logging, and operational support practices for data pipelines and platforms; drive timely issue resolution and root-cause remediation.
- Define team goals, delivery plans, engineering metrics, and operating cadences; communicate progress, risks, dependencies, and tradeoffs to stakeholders and leadership.
- Mentor engineers in data architecture, engineering standards, coding practices, performance optimization, troubleshooting, and pragmatic solution delivery.
- Implement data security and compliance practices, including role-based access, least privilege, sensitive-data protection, secure secrets management, auditability, and governed data access.
- Coordinate with architecture, infrastructure, security, governance, BI, and implementation partners to deliver integrated solutions across multiple systems and teams.
Core leadership accountabilities
This role is expected to demonstrate strong people leadership, hands-on technical judgment, and accountability for delivery across the following areas:
Results & Impact
- Deliver high-quality data engineering solutions that address business priorities and improve operational visibility, decision-making, and efficiency.
- Manage multiple project activities and priorities, remove delivery impediments, and adjust plans when outcomes, timelines, or quality are at risk.
Ownership & Decision Making
- Take ownership of the reliability and supportability of data pipelines and products within the team's domain; drive root-cause analysis and durable corrective actions.
- Make sound technical and delivery decisions, balancing business value, quality, scalability, maintainability, and cost; escalate material risks and decisions appropriately.
Operational Excellence
- Establish consistent engineering practices for development, testing, deployment, monitoring, incident response, and production support.
- Maintain solution documentation, data lineage, runbooks, support procedures, and operational readiness standards.
Planning & Change Management
- Translate the data platform and analytics roadmap into achievable team plans, estimates, milestones, and delivery increments.
- Lead the team through platform modernization, evolving business requirements, and changes in priorities while maintaining delivery focus.
Talent & Culture
- Recruit, onboard, coach, and develop team members; set clear expectations, provide feedback, and support performance and career development.
- Promote consistent engineering standards for data pipeline design, Python/SQL development, data modeling, orchestration, testing, and reusable components.
- Apply Azure and Databricks platform capabilities and Microsoft Fabric services appropriately to build secure, scalable, maintainable data solutions.
- Promote effective Power BI practices, including governed semantic models, reusable datasets, performance optimization, and secure self-service reporting.
- Strong hands-on experience designing and implementing enterprise data engineering solutions using SQL and modern data processing technologies.
- Strong experience with Microsoft Azure data services and cloud fundamentals, including identity, networking, security, monitoring, and cost management.
- Demonstrated experience with Databricks and/or Microsoft Fabric for data ingestion, transformation, orchestration, lakehouse patterns, and production data workloads.
- Build a collaborative, inclusive, accountable team culture focused on engineering quality, continuous improvement, and business outcomes.
Technical Craft
- Guide technical design and implementation discussions with an emphasis on data quality, reliability, scalability, performance, security, and simplicity.
- Promote reusable patterns, automation, documentation, and engineering standards that reduce complexity and long-term maintenance effort.
Qualifications
- 15+ years of overall IT experience, including 10+ years of hands-on experience in data engineering, data integration, data platforms, or related data disciplines.
- Demonstrated experience leading data engineering teams and managing delivery of enterprise data engineering projects or programs.
- Strong experience designing, developing, and supporting data pipelines, data transformations, data models, and production data solutions at enterprise scale.
- Hands-on experience with Azure and one or more modern data platforms, with strong working knowledge of Azure Databricks and/or Microsoft Fabric.
- Experience with SQL and data engineering languages such as Python; familiarity with Spark, Delta Lake, lakehouse architecture, and medallion patterns is highly desirable.
- Experience implementing data orchestration, CI/CD, source control, automated testing, deployment practices, and SDLC controls for data solutions.
- Experience with Power BI, including semantic models, datasets, data integration, performance optimization, and enterprise reporting practices.
- Strong understanding of data architecture, dimensional modeling, data quality, metadata, lineage, governance, and secure data access principles.
- Excellent communication and stakeholder management skills, with the ability to explain technical concepts, manage dependencies, and drive alignment across business and technology teams.
Preferred qualifications
- Experience modernizing enterprise data warehouses, ETL/ELT platforms, or legacy reporting environments to cloud-based lakehouse or modern analytics architectures.
- Experience with Microsoft Fabric workloads such as OneLake, Data Factory, Lakehouse, Warehouse, and Direct Lake, or equivalent Azure/Databricks capabilities.
- Experience developing enterprise Power BI reporting solutions and governed self-service analytics capabilities.
- Experience supporting operationally critical or regulated data environments with strong security, audit, data retention, and change-management requirements.
- Exposure to cloud cost optimization, capacity planning, platform performance tuning, and establishing service-level expectations for data products.
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.