ETL/ Bigdata Tester
Nucleusteq · Indore, IN · Full time
Posted 2026-11-09
What this role cares about
- Testing
- Data Pipelines
- Troubleshooting/Debugging
- CI/CD Pipelines
- API Programming
- Database Management
- Full Stack Development
Tools: CI/CD, Extract, ETL, GitHub, GitLab, JIRA, Java, Jenkins, Python, SQL, Selenium, Integration Testing, BDD, API
Job description
We are seeking an experienced
Big Data Test Automation Engineer
to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.
Location: Indore, Gurugram, Raipur
Key Responsibilities
Test Framework Development:
Design, implement, and maintain scalable test automation frameworks from scratch using
Java
and
Python
.
ETL & Big Data Validation:
Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
UI & BDD Automation:
Automate functional, regression, and end-to-end user workflows using
Selenium WebDriver
integrated with
BDD Cucumber
.
Service & Pipeline Testing:
Build and execute test suites using
Pytest
for data scripts, API services, and scheduled pipeline jobs.
Database & Query Verification:
Author advanced
SQL queries
to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
Functional & Integration Testing:
Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
CI/CD Integration:
Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
Defect Management:
Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.
Required Qualifications
Experience:
5 years of hands-on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
Programming Languages:
Strong proficiency in both
Java
and
Python
.
Automation Tools & Frameworks:
Hands-on expertise with
Selenium WebDriver
.
Strong working knowledge of
BDD frameworks (Cucumber / Gherkin syntax)
.
Deep experience with
Pytest
for
Python-based
test development.
Database & ETL Skills:
Advanced
SQL
skills (joins, window functions, aggregations, subqueries) for large-scale data validation.
Proven experience in
ETL/ELT Testing
, validating source-to-target data mappings, reconciliation, and schema integrity.
Testing Methodologies:
Solid foundation in Functional Testing, Regression Testing, End-to-End Testing, and Data Quality Assurance best practices.
Education:
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).
Why Join Us?
Work on cutting-edge cloud data projects.
Leadership opportunity with high ownership.
Dynamic and growth-oriented work environment.