Lead Data Engineer (Banking)
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.
Key details
- Location
- Singapore
- Work style
- Onsite
- Level
- Senior
- Job type
- Full-time
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 2w ago
Skills
About the role
Role: Lead Data Engineer (Banking)
Must-have skills
Banking and domain
• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.
Core data engineering
• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.
Requirements
Experience:
- Lead: 12+ years, including 6+ in banking.
- Senior: 8+ years, including 4+ in banking ·
Banking and domain
• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.
Core data engineering
• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.
Integration and platforms
• Kafka, Spark Streaming, Informatica (PowerCenter, IDMC, IDL) and Talend; REST API development.
• Denodo, Snowflake and NoSQL databases.
• Airflow, Control-M or Autosys; Git, CI/CD, GitOps and Kubernetes.
Delivery and communication (Lead)
• Framework design, code standards, code reviews and estimation.
• Guiding a team of engineers and working with architects and analysts.
Good-to-have skills
• Databricks: Delta Lake, Unity Catalog and Workflows.
• Data services on Azure, Google Cloud, Huawei Cloud or Alibaba Cloud.
• Data modelling for Qlik Sense or Power BI.
Certifications (preferred): Teradata Vantage; Cloudera Data Engineer; Databricks Data Engineer Associate or Professional
Get jobs like this as soon as they're posted
ApplyHour checks company career sites all day and ranks every opening against your profile. Free to join.