Data Engineer
Tokyo, Japan10mo ago
Key details
- Location
- Tokyo, Japan
- Work style
- Onsite
- Level
- Senior
- Job type
- Full-time
- Experience
- 6–9 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 10mo ago
Skills
azurebusiness analysisci/cdcloud computingdata ingestiondata migrationdata pipelinesdata validationdistributed systemsetlgithadoopjavalinuxnosqloracle databasepythonrestscalashell scriptingsparksqlsql servertechnical supporttest automationunit testing
About the role
-Collaborate with users and project team on requirements and expectations
-Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
-Design and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of data
-Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
-Create scripts for test automation, CI/CD, data migrations, data validations
-Provide technical support for incident recovery
Requirements
-Minimum 3~6 years of working experience as developer or data engineer
-Strong programming skills and has software development experience in Scala, Java or Python
-Deep understanding of distributed systems (Hadoop, Spark, etc.) and its optimization
-Experience in public cloud technologies, preferably Azure
-Good knowledge of Oracle database, MS-SQL Server, Linux, networking
-Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
-Understanding of design principles, coding standards and best practices
-Strong learning ability and problem-solving skills
-Excellent communication, presentation, and interpersonal skills
Preferable:
-Understanding of REST API, NoSQL, micro-services, ETL
-Hand-on experience with Cloud services is preferred
-Understanding of streaming data processing and change data capture is preferred
-Experience with BI tools is preferred
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.