(Senior) Databricks Engineer

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.

Your role

You will build lakehouse platforms on Databricks for our clients, end to end: workspace and platform setup, ingestion, pipelines, data model, data products for analytics and machine learning, and the operations that keep it all running. Our engineers are not split into platform people and pipeline people; you cover the whole stack and grow across it. As an engineer you own pipelines, data products and parts of the platform inside a workstream. As a senior engineer you own the technical design of a workstream or of a whole platform, review the work of the other engineers and are the person the client's architects talk to. You will work with the Databricks Lead on architecture, with the Senior Databricks Engineer - Governance when governance is part of the engagement, and with the client's data teams every day. We hire at both levels on this description; what changes is the share of design and review versus building.

Your tasks

• Set up and configure Databricks platforms: workspaces, compute policies, Unity Catalog basics, networking and identity with the platform team; at senior level, own the platform design and its cost model.
• Build ingestion and pipelines: Lakeflow Connect and Auto Loader, Lakeflow pipelines in batch and streaming, Spark and SQL transformations, Delta Lake tables in a medallion model; at senior level, set the patterns the other engineers follow.
• Model data for consumption: data products, Databricks SQL and AI/BI dashboards, feature tables and model serving with MLflow; at senior level, decide the modelling approach with the client.
• Migrate workloads from legacy warehouses, Hadoop or notebooks to Databricks; refactor what cannot be migrated as it is.
• Engineer like software: Git, CI/CD with Databricks Asset Bundles, infrastructure as code with Terraform, automated tests, code review; at senior level, run the reviews and own the release process.
• Run and optimise: monitoring, job orchestration, performance tuning, cost control (cluster sizing, serverless, Photon, query tuning).
• Support the governance layer where the engagement includes it: data quality expectations in pipelines, lineage, access requests in Unity Catalog, together with the governance engineer.
• At senior level: estimate and plan workstreams, support bids with the Databricks Lead, coach engineers and keep certifications current across the team.

Your profile

• Engineer: 3+ years in data engineering, with at least one year hands-on on Databricks in production. Senior Engineer: 5+ years, at least three on Databricks, with hands-on work in at least three of: platform setup, batch and streaming pipelines, data modelling, migration, CI/CD and infrastructure as code, performance and cost tuning, and a track record of leading the technical side of a workstream.
• Strong Spark (PySpark or Scala) and SQL; Python; Delta Lake; Lakeflow pipelines and jobs; Databricks SQL.
• Working knowledge of one cloud (Azure preferred; AWS or GCP): storage, identity and networking as they apply to Databricks.
• Git and CI/CD; experience with Databricks Asset Bundles or Terraform (both, at senior level).
• Databricks Certified Data Engineer Associate held or in progress (Professional, at senior level).
• Unity Catalog basics: catalogs, permissions, lineage; interest in data governance is a plus.
• Clear communication with client data teams; fluent English; at senior level, the ability to present a technical design to client architects.
• Experience in financial services, energy, pharma or public sector is a plus.

What You'll love about working here

• Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
• Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings.
• Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.
• Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.

Get to know us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.

Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube. 

About Capgemini

Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market-leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.

Make it real | www.capgemini.com