Assistant Manager-KDNI

Bengaluru, KA, India1w ago

Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.

Skills

azureazure data factoryazure devopsazure functionsbig datadata engineeringdata ingestiondata integrationdata pipelinesdata securitydatabricksetlgitmicrosoft fabricpysparkpythonsparksqlsql server

About the role

Data Engineer proficitient in Databricks/Microsoft Fabric and AI capabilities in Data Engineering.

Azure Data Engineer responsible for designing, building, and maintaining scalable data framework on the data requirements. The role involves developing and managing end‑to‑end data pipelines, integrating data from multiple sources, and ensuring reliable data ingestion, transformation and processing using spark. The Azure Data Engineer also implements data security, privacy, and governance controls, monitors and troubleshoots data workflows, and continuously optimizes data storage and processing to achieve high performance and cost efficiency across Azure data platforms

Required skills

Bachelor’s degree in Computer Science or related discipline, or equivalent professional experience (4+ years).

6+ years of consulting or client service delivery experience in Azure Microsoft data engineering.

4+ years of experience designing and building data ingestion, processing, and analytical pipelines using SQL Server, Databricks, and Microsoft Fabric.

Hands-on experience implementing ETL and data processing using Microsoft Fabric, OneLake, ADLS, Azure Data Factory, and Azure Functions.

• 5+ years of hands-on experience with Azure and Big Data technologies, including Fabric, Databricks, Python, SQL, ADLS/Blob Storage, PySpark, and Spark SQL.

• 3+ years of experience working with RDBMS technologies. Experience with big data file formats and compression techniques.

Proficiency with developer tools such as Azure DevOps, Git, and Visual

Bachelor of Engineering / Master of Engineering