Senior Cloud Engineer

Your Role

• Design and implement scalable data pipelines using Azure Data Factory, Data Lake, and Databricks ensuring they are optimized for data processing and analytics.

• Develop and optimize PySpark and SQL workflows for data transformation and orchestration. 

• Create and refine processes for data modelling, mining and production to support operational and analytical needs.
• Establish and enforce data quality checks and validation routines to maintain high standards of data accuracy and reliability.

Your Profile

• Over 6 years of hands-on experience with Azure Data Services including Data Lake, Data Factory, Key Vault and Cognitive Search. 

• Proficient in Databricks ecosystem including cluster optimization, performance tuning with expertise in Delta Lake, PySpark and orchestrating workflows. 
• Experience with any relational SQL (SQL Server/Oracle) and NoSQL (MongoDB/DynamoDB) databases including Snowflake along with strong expertise in Python/PySpark for large‑scale data processing. 
• Experience with real-time systems like Event Hubs, Apache Kafka, Spark-Streaming, etc.