Senior Data Engineer

Description:

We are looking for a Senior Data Engineer to support the data platform and help scale data gathering, processing, and orchestration capabilities. The role involves building and maintaining reliable data pipelines, improving platform performance, and ensuring high-quality data is available for business and engineering teams.

Responsibilities:

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and support batch and streaming data workflows.
• Improve reliability, monitoring, and performance of the data platform.
• Build integrations between various internal and external data sources.
• Implement data gathering mechanisms on remote IoT connected devices
• Troubleshoot production issues and perform root cause analysis.
• Work closely with software engineers, analysts, and platform teams.
• Participate in architecture and technical design discussions.
• Contribute to automation, testing, and CI/CD practices.

Required Skills:

• Strong Python and SQL experience.
• Strong Experience building ETL/ELT pipelines.
• Strong Linux fundamentals.
• Experience with data warehousing solutions (Clickhouse, Redshift, etc.).
• Strong Experience with cloud-based data platforms.
• Hands-on experience with Airflow or similar orchestration tools.
• Experience with Kafka or other event-driven/data streaming technologies.
• Knowledge of CI/CD and automated testing.
• Ensure data quality, consistency, and availability.
• Strong debugging and problem-solving skills.
• Ability to work independently and take ownership.

Nice to Have:

• Spark / PySpark.
• Terraform.
• Kubernetes and Docker.
• Data modeling and data governance experience.
• Experience supporting large-scale production data platforms.
• AI/ML data pipeline experience.

Seniority:

• Senior Engineer.
• Strong ownership mindset.
• Able to drive technical solutions from requirements through production.
• Comfortable supporting production systems and handling platform issues.

What you will love about working here?

• We care about all our employees and want them to feel as comfortable as possible. That's why we offer them health insurance from the first days, regardless of the probationary period.
• The gift from the company - Christmas holidays from 25 December to 31 December.
• Сooperation with Superhumans center and Veteran HUB. Capgemini Engineering has supported the launch of psychological rehabilitation department of Superhumans. Our team also donnated over UAH 500 000 prosthetics for three Ukrainian defenders. Currently, we support psychological counseling provided by the Veteran Hub, and we have implemented a internal policy making the company friendly to military and veterans with the assistance of the Hub.