ES
Data Quality Engineer
Accepting applicationsEPAM Systems · Coimbatore, Tamil Nadu, India
Full-Time Associate Pythonaiasicaterf
Posted
3d ago
Category
Test
Experience
Associate
Country
India
We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.
The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.
Responsibilities
Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
Develop reusable and scalable test automation frameworks using Python and SQL
Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming
Requirements
3.5+ years of hands-on experience in Data Quality Engineering
Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
Proficiency in SQL for data validation and test automation
Good knowledge of Python for scripting and framework development
Experience with one or more Test Automation Frameworks
Knowledge of Cloud Data Services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), or GCP (BigQuery)
Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
Familiarity with Agile/Scrum methodologies with a proven ability to contribute effectively
English language proficiency at an Upper-Intermediate level (B2) or higher
Nice to have
Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
Basic understanding of data governance and metadata management concepts
Certification in cloud platforms (Azure/AWS/GCP)
Show more Show less
The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.
Responsibilities
Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
Develop reusable and scalable test automation frameworks using Python and SQL
Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming
Requirements
3.5+ years of hands-on experience in Data Quality Engineering
Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
Proficiency in SQL for data validation and test automation
Good knowledge of Python for scripting and framework development
Experience with one or more Test Automation Frameworks
Knowledge of Cloud Data Services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), or GCP (BigQuery)
Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
Familiarity with Agile/Scrum methodologies with a proven ability to contribute effectively
English language proficiency at an Upper-Intermediate level (B2) or higher
Nice to have
Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
Basic understanding of data governance and metadata management concepts
Certification in cloud platforms (Azure/AWS/GCP)
Show more Show less