Data Engineer
Dubai, United Arab Emirates4mo ago
Key details
- Location
- Dubai, United Arab Emirates
- Work style
- Onsite
- Level
- Senior
- Job type
- Full-time
- Experience
- 7–10 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 4mo ago
Skills
azureazure data factoryazure devopsbig datadata pipelinesdatabricksnosqlpower biprototypingpysparkpythonsapsparksqltableau
About the role
- Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
- Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
- Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
- Required to participate in early state design and feature definition activities.
- Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
- Responsible for creating reusable and scalable data pipelines
- Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
Requirements
- Advanced working knowledge and experience with relational and non-relational databases
- Experience building and optimizing Big Data pipelines, architectures, and data sets
- Strong analytic skills related to working with unstructured datasets
- Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL.
- Azure DevOps experience mandatory to deploy the data objects.
- 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
- Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
- Automotive domain experience is a must.
- Knowledge/Experience with Azure cloud stack.
- Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
- Certification on Azure platform toolset will be considered as added advantage
- Bachelor’s degree in Computers or allied field of study.
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.