Астана
We are seeking an open-minded Senior Data Software Engineer to drive the development and maintenance of our data-driven architecture.
In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality. If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.
This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.
Responsibilities
Design and implement data pipelines
Perform data ingestion processes to integrate existing data sources into the new platform
Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators and exploratory environments
Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
Take part in the design of on-premises to cloud migration activities
Requirements
Strong production experience in Java, Python or Scala
Proficiency in SQL
Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)
Familiarity with data modeling concepts such as relational/dimensional data, SCD and snowflaking
Hands-on production experience with any major cloud provider: Azure, AWS or GCP
B2 English level, both verbal and written
Hands-on production experience with any major cloud provider: Azure, AWS or GCP
Nice to have
Competency in common data-related architectures such as Data Hub or Data Lake
Knowledge of Databricks
We offer/Benefits
We connect like-minded people:
We invest in your growth:
We cover it all:
EPAM is a team of technologists and innovators united by a passion for technology. In Kazakhstan, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation.