ETL/ Bigdata Tester
Indore, MP, India1w ago
Key details
- Location
- Indore, MP, India
- Work style
- Remote
- Level
- Senior
- Job type
- Full-time
- Experience
- 5–8 yrs
- Function
- other
- Focus area
- other
- Posted
- 1w ago
Skills
bddbig dataci/cddata lakesdata pipelinesdata qualitydata validationdata warehousingetlfunctional testinggithub actionsgitlab ciintegration testingjavajenkinsjirapytestpythonquality assurancereconciliationregression testingroot cause analysisseleniumsqltest automation
About the role
We are seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.
Location: Indore, Gurugram, Raipur
Key Responsibilities
- Test Framework Development: Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python.
- ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
- UI & BDD Automation: Automate functional, regression, and end-to-end user workflows using Selenium WebDriver integrated with BDD Cucumber.
- Service & Pipeline Testing: Build and execute test suites using Pytest for data scripts, API services, and scheduled pipeline jobs.
- Database & Query Verification: Author advanced SQL queries to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
- Functional & Integration Testing: Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
- CI/CD Integration: Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
- Defect Management: Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.
Required Qualifications
- Experience: 5 years of hands-on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
- Programming Languages: Strong proficiency in both Java and Python.
- Automation Tools & Frameworks:
- Hands-on expertise with Selenium WebDriver.
- Strong working knowledge of BDD frameworks (Cucumber / Gherkin syntax).
- Deep experience with Pytest for Python-based test development.
- Database & ETL Skills:
- Advanced SQL skills (joins, window functions, aggregations, subqueries) for large-scale data validation.
- Proven experience in ETL/ELT Testing, validating source-to-target data mappings, reconciliation, and schema integrity.
- Testing Methodologies: Solid foundation in Functional Testing, Regression Testing, End-to-End Testing, and Data Quality Assurance best practices.
- Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).
Why Join Us?
- Work on cutting-edge cloud data projects.
- Leadership opportunity with high ownership.
- Dynamic and growth-oriented work environment.
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.