Senior DataOps Architect
Tokyo, Japan7mo ago
Key details
- Location
- Tokyo, Japan
- Work style
- Onsite
- Level
- Lead / Staff+
- Job type
- Full-time
- Experience
- 10–13 yrs
- Function
- Software engineering
- Focus area
- Infrastructure / Cloud
- Posted
- 7mo ago
Skills
About the role
Position Details:
- Design and implement scalable data platform solutions across on-premises and GCP hybrid environments, ensuring seamless integration and optimal performance
- Architect DataOps pipelines and infrastructure automation using Infrastructure as Code (Terraform, Ansible) for multi-environment deployments
- Lead the design and maintenance of large-scale data systems spanning on-prem data centers and cloud platforms (GCP primary, Azure secondary)
- Develop and enforce DataOps best practices including CI/CD for data pipelines, data quality frameworks, and automated testing strategies
- Define cloud migration strategies from on-premises to GCP, including hybrid architecture patterns and data residency considerations
- Build and optimize data infrastructure using Kubernetes, containerization, and orchestration tools for both on-prem and cloud environments
- Create and maintain comprehensive technical and architectural documentation for data platforms and DataOps workflows
- Drive technological innovation by evaluating and introducing modern DataOps tools, platforms, and methodologies aligned with business objectives
- Mentor engineering teams on DataOps principles, cloud-native architectures, and infrastructure automation practices
- Collaborate with data engineering, platform engineering, and security teams to establish governance, compliance, and operational excellence
- Monitor industry trends in DataOps, cloud technologies, and data infrastructure to proactively recommend improvements
Requirements
Mandatory Qualifications:
- Bachelor’s degree in computer science, Data Engineering, or related field
- 10+ years of experience in infrastructure/DevOps/DataOps
- Proven track record architecting and managing on-premises data infrastructure and hybrid cloud environments
- Deep expertise with GCP services (BigQuery, Dataflow, Composer, GKE, Cloud Storage, IAM) for data platforms (5+ years)
- Hands-on experience with on-premises infrastructure including bare metal, virtualization (VMware, KVM), storage systems, and networking (5+ years)
- Expert-level proficiency with Kubernetes, Helm, and service mesh technologies (Istio, Linkerd) in production environments (5+ years)
- Experience with data pipeline orchestration tools (Apache Airflow, Prefect, Dagster)
- Knowledge of monitoring and observability stacks (Prometheus, Grafana, ELK, Datadog)
- Experience with GitOps workflows and CI/CD platforms (GitLab CI, GitHub Actions, Jenkins)
- Background in data security, compliance frameworks, and disaster recovery planning
- Excellent communication skills with ability to translate technical concepts to non-technical stakeholders
- Strong experience with Infrastructure as Code tools: Terraform, Ansible, CloudFormation
- Proficiency with Azure cloud services and hybrid connectivity (ExpressRoute, VPN) is a plus
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.