Senior Data Quality Engineer (with databricks)

We are seeking a Senior Data Quality Engineer to support three key engineering streams (Data Product Engineering Framework, Polarmesh Portal, Platform Engineering Team). You will collaborate closely with Data Engineers, Platform Engineers, and DevOps teams to design, build, and maintain automated testing solutions across data pipelines, APIs, and platform components in a modern Azure-based ecosystem.

Unlock the potential of remote work in Kazakhstan, giving you the flexibility to work from home or access our offices in Astana, Almaty or Karaganda.

Responsibilities

• Design and build automated testing solutions across data pipelines, APIs, and platform components

• Maintain and enhance test automation frameworks within an Azure-based ecosystem

• Validate data quality, data transformations, and pipeline outputs using SQL and/or Python

• Collaborate closely with Data Engineers, Platform Engineers, and DevOps teams on testing strategy

• Integrate automated tests into CI/CD pipelines

• Monitor, log, and troubleshoot pipeline failures

• Support the maintenance and optimization of ETL/ELT processes and data pipelines

• Contribute to testing efforts across three engineering streams, including the Data Product Engineering Framework, Polarmesh Portal, and Platform Engineering Team

Requirements

• 5+ years of experience as a QA Engineer / Test Automation Engineer in Data Engineering or Data Platform environments

• Strong hands-on experience with Azure cloud services

• Experience working with Azure Databricks, Spark/PySpark, or similar big data platforms

• Understanding of data pipelines, ETL/ELT processes, and data pipeline maintenance

• Skills in testing data quality, data transformations, and pipeline outputs using SQL and/or Python

• Experience with CI/CD pipelines, preferably using Azure DevOps, GitHub Actions, or similar tools

• Knowledge of automated testing approaches for data pipelines, APIs, and platform components

• Familiarity with version control systems such as GitHub

• Understanding of monitoring, logging, and troubleshooting pipeline failures

• Ability to work closely with Data Engineers, Platform Engineers, and DevOps teams

Nice to have

• Experience with Delta Lake, Azure Data Factory, ADLS, Synapse, or Event Hub

• Knowledge of infrastructure as code tools such as Terraform or ARM/Bicep

• Experience with data quality tools/frameworks

• Basic understanding of Docker, Kubernetes, or containerized environments

• Experience in Agile/Scrum teams

We offer/Benefits

We connect like-minded people:

• Delivering innovative solutions to industry leaders, making a global impact 
• Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
• Opportunity to work abroad for up to two months per year 
• Relocation opportunities within our offices in 55+ countries
• Corporate and social events   

We invest in your growth: 

• Leadership development, career advising, soft skills and well-being programs 
• Certifications, including GCP, Azure and AWS
• Unlimited access to EPAM's internal learning database
• Free English classes with certified teachers 
• Discounts in local language schools, including online courses for the Kazakh language

We cover it all:

• Participation in the Employee Stock Purchase Plan 
• Monetary bonuses for engaging in the referral program 
• Medical & family care package   
• Six trust days per year (sick leave without a medical certificate)   
• Coverage of psychology sessions of your choice
• Benefits package (sports activities, a variety of stores and services)
• Housing support program: preferential mortgage access via Otbasy Bank partnership

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.