AWS– Spark –Python Data Engineer
Virginia, United States60mo ago
Key details
- Location
- Virginia, United States
- Work style
- Onsite
- Level
- Mid level
- Job type
- Full-time
- Experience
- 2–5 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 60mo ago
Skills
agileamazon rdsawsci/cdcloudwatchdata pipelinesec2emrevent-driven architectureidentity and access managementkafkapysparkpythons3sdlcsparksqsstep functionsvpc
About the role
Digital Alpha is looking for passionate data engineers to join our team. As an experienced member we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge, attention to detail and expertise to all aspects of the software development lifecycle. We embrace a culture of experimentation and constantly strive for improvement and learning. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
Requirements
- Strong hands on experience building data pipelines using Apache Spark in AWS.
- Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
- Proficient in python programming language.
- Proficient in PySpark.
- Knowledge of application development lifecycles, & continuous integration/deployment practices
- Experience with development on AWS and cloud native applications
- Kafka and event driven architectures exposure is a plus
- Experience with Developing Data Platforms on AWS
- Proficient in Agile Software Development methodology, processes, and practices.
Qualifications:
- Bachelor’s degree in related field
- Strong, analytical, focused, self-driven with excellent problem-solving skills
- Minimum 2+ years of hands on in-depth experience of AWS Data Pipelines development and implementation is required
- AWS Architect Associate or Professional level certifications is a plus
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.