PySpark Data Engineer
Marktine Technology Solutions Private Limited
Jaipur, RJ, India64mo ago
Key details
- Location
- Jaipur, RJ, India
- Work style
- Onsite
- Level
- Mid level
- Job type
- Full-time
- Experience
- 3–6 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 64mo ago
Skills
airflowhadooppysparkpythonscalasparksqltroubleshooting
About the role
Roles and
Responsibilities:
- Responsible
for developing and maintaining applications with PySpark
- Contribute
to the overall design and architecture of the application developed and
deployed.
- Performance
Tuning wrt to executor sizing and other environmental parameters, code
optimization, partitions tuning, etc
- Interact
with business users to understand requirements and troubleshoot issues.
- Implement
Projects based on functional specifications.
Must-Have
Skills:
- Relevant
Experience: 3-6 Years
- SQL -
Mandatory
- Python -
Mandatory
- SparkSQL -
Mandatory
- PySpark -
Mandatory
- Hive -
Mandatory
- HDFS and
Spark - Mandatory
- Scala -
Advantage
- Apache
Airflow - Advantage
Requirements
3-6 Years of Experience
Must Have: PySpark/Spark, Python, SQL, Knowledge on Hadoop ecosystem
Good to have: Airflow, Scala
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.