Azure Data Engineer

About the Job you are considering:

We are seeking an experienced Azure Data Engineering Lead with deep expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, SQL, Delta Lake, and Azure cloud-native data services to drive the design and delivery of enterprise-scale data platforms for leading banking and financial services clients.

The ideal candidate will possess strong hands-on data engineering experience, a proven track record of leading teams, and extensive exposure to modern cloud-based data architectures. This role requires expertise in building secure, scalable, and high-performance data solutions capable of processing large volumes of structured, semi-structured, and streaming data within highly regulated banking environments.

Hybrid working:

The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

Your Role:

• Strong hands-on experience with Azure Databricks, Azure Data Factory (ADF), and ADLS Gen2.
• Expertise in designing scalable, resilient, and enterprise-grade Azure data solutions.
• Advanced proficiency in PySpark, Python, Spark SQL, and SQL.
• Strong experience with SQL optimization, performance tuning, joins, window functions, and stored procedures.
• Extensive experience in developing and optimizing large-scale ETL/ELT pipelines.
• Strong knowledge of Delta Lake, Lakehouse, and Medallion Architecture.
• Experience integrating data from databases, APIs, files, cloud storage, and streaming sources.
• Expertise in data quality, validation, reconciliation, lineage, audit, and monitoring frameworks.
• Strong understanding of data governance, regulatory reporting, compliance, and data quality standards.
• Hands-on experience with Azure DevOps, Git, CI/CD pipelines, release management, and automation.
• Experience with job scheduling, orchestration, dependency management, and error handling frameworks.
• Strong knowledge of Azure security including Key Vault, Managed Identities, RBAC, encryption, and secure access controls.
• Experience working in Banking and Financial Services environments with a strong focus on security, governance, risk, and compliance.

Your Skills:

• Experience leading data engineering teams and large-scale delivery engagements.
• Knowledge of streaming technologies such as Azure Event Hub or Kafka.
• Understanding of data warehousing concepts and modern analytical platforms.
• Experience with regulatory and compliance-driven banking data environments.
• Azure Data Engineering certifications are highly desirable.

"We are a Disability Confident Employer:

Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

• Declare they have a disability, and 
• Meet the minimum essential criteria for the role.

Please opt in during the application process.

Make It Real (what does it mean for you):

• You’d be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation.  We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. 
  To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.
• You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more.
• You will be joining one of the World’s Most Ethical Companies®, as recognised by Ethisphere® for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping to create a future we can all be proud of.

Why you should consider Capgemini:

Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask.  When you join Capgemini, you’ll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts.  We find new ways technology can help us reimagine what’s possible.  It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future.  By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

About Capgemini:

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organisations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com