Data Engineer- DBT
Bengaluru, KA, IndiaYesterday
Key details
- Location
- Bengaluru, KA, India
- Work style
- Onsite
- Level
- Mid level
- Job type
- Full-time
- Experience
- 3–8 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- Yesterday
Skills
About the role
What We Do
We work across industries such as healthcare, high-tech, consumer packaged goods (CPG), finance, and more across sales, marketing, and customer support functions. We help our clients accelerate their digital and AI journeys through:
- AI Application Development
- Data, Digital and Cloud acceleration using AI
- AI Native Product Engineering
Location: India
Level: Manager / Senior Associate/Experienced Associate
Required Experience: 3 – 8 years
Role Summary
We are looking for an AI-native Data Engineer to own the end-to-end health of a client's enterprise data estate, operating as the single accountable control tower across a hybrid platform. What distinguishes this role is how you get there: you will build a service that detects, correlates and increasingly resolves on its own, applying AIOps and GenAI to compress triage, predict failure on the critical path, and convert repetitive manual intervention into automation — while keeping human judgement at the decision gates that matter.
Responsibilities
- Own end-to-end data pipeline reliability, covering ingestion, transformation, data quality, reconciliation and consumption layers.
- Design and implement AI-driven operational workflows using Snowflake Cortex, LLMs and agentic AI capabilities.
- Build intelligent agents for incident investigation, root cause analysis, log analysis, data reconciliation and automated resolution recommendations.
- Leverage AI to analyze historical incident patterns, identify recurring failure signatures and predict potential pipeline failures.
- Establish automated data quality frameworks covering completeness, accuracy, freshness, consistency, referential integrity and anomaly detection
- Explore AI-assisted engineering for dbt code analysis, SQL optimization, test generation, documentation and impact assessment.
- Review new business demands, own screening and qualifications of the demand, effort sizing and implementation roadmap
- Lead diagnosis on major incidents across domain boundaries — distinguishing an ETL fault from a database fault, a connector fault from a source schema change, a report failure from warehouse contention.
Requirements
- Bachelor’s/Master’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).
- 5-8 years in data engineering, data warehousing, with experience of working in managed service or Data Operations function.
- Working expertise across a modern cloud data stack — Snowflake, dbt, and a managed ingestion tool such as Fivetran, Airbyte or Matillion.
- Strong SQL and data modelling expertise, including dimensional modelling and warehouse performance tuning.
- Experience implementing AIOps or intelligent observability in a production environment —using platforms such as ServiceNow AIOps/ITOM, Dynatrace, Datadog or an equivalent in-house build.
- Practical grasp of how to apply ML and GenAI to operations: baselining and anomaly detection on time-series operational data, log and incident clustering, and LLM-assisted triage, incident summarisation or runbook generation.
- Excellent written and verbal communication — able to translate a technical fault into business impact for an executive audience.
Preferred
- Familiarity with Python or PySpark for operational tooling and automation.
- Exposure to cloud cost management and FinOps practice
- Experience introducing observability, alert-quality review and toil reduction into an inherited support estate.
- Working knowledge of MicroStrategy or a comparable enterprise BI platform.
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.