Data Engineer

IDF Technology is a successful IT company specializing in credit scoring, Data Science and financial digital technologies. And we invite Data Engineer to become a part of our company!

What You’ll Do

• Develop and maintain a robust corporate Data Warehouse (DWH) and the ETL/ELT pipelines that feed into it.

• Design and optimize the data architecture and warehouse schemas to ensure performance and scalability.

• Collaborate closely with data scientists, software engineers, and product teams to make data easily accessible and actionable.

• Continuously improve existing systems and identify areas for automation and performance optimization.

What We’re Looking For

• 3+ years of hands-on experience with corporate Data Warehouses.

• Strong understanding of SQL and NoSQL databases, including data modeling and DWH architecture.

• At least 1 year of experience working with ClickHouse – this is a must!

• Proficient in SQL and Python for data manipulation and scripting.

• Solid experience with Apache Kafka and Airflow (including complex DAGs, custom operators, and sensors).

• Comfortable communicating in English (intermediate level or higher).

• Willingness to relocate to Poland after a probationary period.

Nice to Have

• Experience with BI tools such as Tableau or Apache Superset.

• Familiarity with dbt (data build tool).

Tech Stack

• Languages: Python, SQL

• Databases: ClickHouse, MySQL, MongoDB, MSSQL

• Tools: Apache Airflow, Kafka, Docker

• Visualization: Tableau, Superset