Clinical Data Engineer
India6h ago
Key details
- Location
- India
- Work style
- Remote
- Level
- Senior
- Job type
- Full-time
- Experience
- 5–8 yrs
- Function
- Data & ML
- Focus area
- Data engineering & Analytics
- Posted
- 6h ago
Skills
About the role
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Clinical Data Engineer based in India.
As a Clinical Data Engineer, you will play a key role in developing, maintaining, and optimizing clinical data pipelines across cloud-based data lake and data warehouse environments. You will help ensure the reliable, timely, and compliant flow of clinical data from multiple sources to downstream teams and stakeholders. Working with technologies such as AWS, Azure, Python, SQL, and Databricks, you will contribute to data ingestion, transformation, automation, and integration processes. You will also support operational monitoring, troubleshooting, and continuous improvement initiatives to enhance data quality and pipeline performance. Collaborating with clinical data, analytics, and statistical programming teams, you will help deliver accurate and accessible datasets that support clinical research. This is an opportunity to contribute to meaningful healthcare advancements within a collaborative, international, and regulated environment.
Accountabilities:
- Support the end-to-end operation of clinical data pipelines across cloud-based data lakes and data warehouses, including development, monitoring, maintenance, and troubleshooting.
- Develop, enhance, and maintain ETL/ELT pipelines using AWS and Azure services, following established technical frameworks and standards.
- Automate data ingestion, scheduling, transformation, and quality checks to improve pipeline reliability, efficiency, and delivery timelines.
- Monitor pipeline performance, investigate incidents, support root cause analysis, and contribute to corrective and preventive actions.
- Design, develop, and maintain operational dashboards and data visualizations, primarily using Tableau, to monitor pipeline health, data quality, and operational performance.
- Support integrations with external vendors and internal systems, particularly through file-based transfers such as SFTP, ensuring accurate data validation and reconciliation.
- Collaborate with downstream teams, including Statistical Programming, SDTM, Analytics, and Clinical Data Programming, to understand data requirements and deliver appropriate datasets and exports.
- Work with clinical data platforms such as Veeva CDB and Elluminate/JReview, supporting data integration and transfer activities.
- Track and report operational KPIs, including delivery timeliness, pipeline success rates, and data defects, to support continuous improvement.
- Maintain controlled documentation, testing evidence, traceability, and change records in accordance with GxP and Computerized System Validation (CSV) requirements.
- Apply data integrity principles, including ALCOA+ expectations, while ensuring compliance with access controls, audit trails, and logging requirements.
- Work closely with technical, business, quality, compliance, and IT stakeholders to resolve data-related challenges and ensure high-quality deliverables.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience.
- At least 5 years of professional experience in data engineering, data pipeline development and operations, and multi-source data integration. Experience in clinical research, biopharmaceuticals, or healthcare is strongly preferred.
- Advanced proficiency in Python or R and SQL, with the ability to develop, maintain, and troubleshoot data pipelines.
- Strong understanding of data modeling, data integration patterns, data transformation, and data quality validation techniques.
- Hands-on experience building and managing cloud-based data pipelines, preferably using AWS services such as EMR, S3, Glue, and RDS.
- Familiarity with Azure and modern data platforms such as Snowflake, Databricks, Delta Lake, and Spark.
- Practical experience with pipeline development and deployment using CI/CD practices, GitHub Actions, and version control platforms such as GitHub or GitLab.
- Experience working with file-based and API-based integrations, including SFTP, CSV, JSON, and XML, with the ability to follow transfer specifications and validate data outputs.
- Experience with Databricks and Delta Lake integrations, particularly in environments involving clinical data platforms such as Veeva CDB and Elluminate/JReview.
- Hands-on experience developing and maintaining operational dashboards and data visualizations using Tableau. Familiarity with Power BI or QlikView is also valuable.
- Understanding of clinical data standards, including CDISC, CDASH, and SDTM, and their impact on downstream clinical research deliverables.
- Knowledge of GxP-regulated environments, data integrity principles, documentation standards, change control, and audit readiness.
- Familiarity with software development lifecycle (SDLC) practices, Agile methodologies, and collaboration tools such as Jira and Confluence.
- Strong analytical and problem-solving abilities, particularly when investigating data transfer issues and pipeline failures.
- Excellent communication and collaboration skills, with the ability to engage effectively with technical teams, business stakeholders, and downstream users.
- Highly organized, proactive, and detail-oriented, with the ability to manage competing priorities and deliver high-quality work within deadlines.
- Previous experience supporting regulatory inspections or audits is an advantage.
- AWS or Azure certifications, as well as relevant Python certifications, are considered a plus.
- Competitive base salary and performance-related incentives.
- Medical, dental, and vision coverage, depending on location and eligibility.
- Retirement and pension plans.
- Life assurance and disability coverage.
- Employee assistance programmes and access to wellbeing resources.
- Health and wellness initiatives designed to support overall employee wellbeing.
- Learning and development opportunities through structured training programmes and career development pathways.
- Opportunities to work within an international, collaborative, and diverse professional environment.
- Exposure to modern cloud technologies, clinical data platforms, and innovative data engineering practices.
- The opportunity to contribute to clinical research and the development of treatments that improve patients' lives.
Requirements:
Benefits:
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.