Counsultant - Databricks AWS
Bengaluru, KA, India56m ago
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Key details
- Location
- Bengaluru, KA, India
- Work style
- Onsite
- Level
- Senior
- Job type
- Full-time
- Experience
- 5–8 yrs
- Function
- other
- Focus area
- other
- Posted
- 56m ago
Skills
awsaws sagemakerdata architecturedata engineeringdata modelingdata pipelinesdata structuresdata warehousingdatabricksdynamodbec2elasticsearchemretlkafkakinesiskpispythonredshiftroot cause analysiss3sparksql
About the role
Mandatory Skills
- Bachelor’s degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline
- 5+ years of relevant experience in data engineering roles
- Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding
- Proficient in programming languages: Python
- Experienced with Databricks designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools(Unity Catalog, Workflow, Autoloader, delta sharing) to process large datasets and extract actionable business insights.
- Experienced with AWS services such as Redshift, S3, EC2, Lambda, Athena, EMR, AWS Glue, Datapipeline.
- Experience building metrics deck and dashboards for KPIs including the underlying data models.
- Understand how to design, implement, and maintain a platform providing secured access to large datasets
- Master’s degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline
- 5+ years of work experience with ETL, Data Modelling, and Data Architecture.
- Experienced with Databricks designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools(Unity Catalog, Workflow, Autoloader, delta sharing) to process large datasets and extract actionable business insights.
- Experience or familiarity with newer analytics tools such as AWS Lake Formation, Sagemaker, DynamoDB, Lambda, ElasticSearch.
- Experience with Data streaming service e.g Kinesis Kafka
- Ability to develop experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations
- Proven track record partnering with business owners to understand requirements and developing analysis to solve their business problems
- Proven analytical and quantitative ability and a passion for enabling customers to use data and metrics to back up assumptions, develop business cases, and complete root cause analysis
- Master’s degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline
- 5+ years of work experience with ETL, Data Modelling, and Data Architecture.
- Experienced with Databricks designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools(Unity Catalog, Workflow, Autoloader, delta sharing) to process large datasets and extract actionable business insights.
- Experience or familiarity with newer analytics tools such as AWS Lake Formation, Sagemaker, DynamoDB, Lambda, ElasticSearch.
- Experience with Data streaming service e.g Kinesis Kafka
- Ability to develop experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations
- Proven track record partnering with business owners to understand requirements and developing analysis to solve their business problems
- Proven analytical and quantitative ability and a passion for enabling customers to use data and metrics to back up assumptions, develop business cases, and complete root cause analysis