Data Engineer - National Security
Who You Will Be Working With...
Build data platforms that help keep the UK safe
Most data engineers never see their work reach the people it was built for. In this role you will. You'll design, build and run production data platforms for UK national security customers. These are mission-critical platforms where reliability, assurance and impact matter.
Capgemini already has a strong foundation in this part of government, and we plan to grow significantly.
You'll join at an important point. Our customers are moving to a new secure cloud and want to bring frontier AI, including the latest generative and agentic models, safely into some of the most secure environments in the country. That can't happen without modern, well-governed data platforms, and you'll build them. You'll also help build the team, practices and reputation that come with that growth.
The Work
We can't say much about specific programmes, but we can tell you what the work involves:
- Real engineering constraints. Classified and restricted environments, often with limited or no internet connectivity. You'll solve problems that most data engineers never meet.
- Legacy to modern cloud. You'll move legacy data platforms onto a modern, secure cloud architecture that can meet emerging AI demand. You'll own systems from design through deployment, monitoring and continuous improvement.
- The foundation for AI. The pipelines, governance and lineage you build are what make safe, assured AI possible in these environments.
- Mission impact. The users are operational teams whose work protects the public. What you build will make a difference to that work.
PLEASE NOTE:
Security Clearance: DV (Developed Vetting clearance) - DV clearance sponsored by Capgemini
UK Passport Holders only can be considered for this due to the DV Clearance requirement - You do not currently need to have DV, Capgemini will undertake the vetting on your behalf.
The Focus Of Your Role
We're looking for a code-first Data Engineer to design and build scalable, resilient data applications for Defence customers. This role sits at the intersection of software engineering and data engineering, working on mission-critical systems where reliability, security and auditability are essential.
You'll build data applications that process high-volume, high-velocity data, orchestrate complex workflows, and deploy your own solutions into secure containerised environments. You'll work across the full lifecycle, from development through to production, shaping architectures that support operational users, analytics and AI-enabled capabilities. Increasingly that includes GenAI and agentic systems that must run inside secure, and sometimes disconnected, environments, which is a genuinely hard problem and a distinctive part of what makes this role interesting.
This role is hands-on and engineering-led. You'll write production-grade code, contribute to secure platform patterns, and make sure your data services run predictably in tightly governed Defence environments..
What You Will Be Doing
- Develop modular, maintainable components that process, transform and expose data for analytical, operational and AI use cases. Build testing and observability in from the start.
- Design and implement ingestion and event-driven patterns for real-time and near-real-time data flows, so they stay reliable under demanding operational conditions.
- Define data workflows as code, managing dependencies, scheduling and error recovery within secure, assured environments.
- Package, deploy and monitor ML workloads, and increasingly GenAI and agentic ones. This includes self-hosted or open-weight models, RAG and vector search over governed data, and the guardrails, evaluation and human oversight these systems need. Running these patterns where internet-connected AI services aren't available is a core part of the role's future.
- Containerise your services and deploy them to secure Kubernetes and cloud environments, using CI/CD adapted for high-assurance delivery. You'll own your applications in production.
- Implement health monitoring, structured logging, metrics and lineage to meet requirements for auditability, security and operational assurance, including for agentic behaviour. Design systems that self-heal or fail gracefully.
- Provision infrastructure as code, working closely with platform teams to stay aligned with accredited architectures.
Growing with us
As we expand in national security, you'll have room to shape more than your own project:
- Business development: build demos and technical deep-dives that help us win new mission work.
- Reusable assets: create frameworks and accelerators for secure data delivery across our accounts.
- Thought leadership: lead internal thinking on AI-driven data engineering in high-assurance settings.
- Career development: gain vendor certifications and use a curated training framework to build your technical and professional skills.
What You Will Bring
We don't expect you to have everything below. We're looking for strong foundations, curiosity and the drive to learn fast.
- Core engineering: expert-level Python and strong software engineering foundations, including object-oriented design, automated testing and version control.
- Production delivery: hands-on experience delivering data pipelines and platforms in production.
- Data engineering stack: streaming frameworks, distributed processing and relational or analytical storage (e.g. Kafka, Spark, PostgreSQL).
- AWS: Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift and S3 data lakes. For AI work, Amazon Bedrock and Knowledge Bases for Bedrock.
- Orchestration: modern workflow frameworks (e.g. Airflow, Dagster or Prefect).
- Data quality and lineage: data testing, documentation and lineage tools (e.g. Great Expectations or dbt).
- MLOps and emerging LLMOps: operationalising ML in production (packaging, monitoring, controlled deployment), and an understanding of how serving GenAI and agentic systems differs, including evaluation, guardrails and observability.
- Containers and DevOps: Docker and Kubernetes (services, pods, deployments), and hands-on CI/CD (e.g. GitLab CI, GitHub Actions or Argo), with a belief in owning what you build.
- Motivation to work on technology that serves the national interest.
Nice to have:
- Infrastructure as code or configuration management (e.g. Terraform or Ansible).
- Experience in secure, restricted or air-gapped environments.
- Hands-on experience with GenAI building blocks: RAG, vector databases, LLM orchestration and evaluation.
- Experience using AI coding assistants within strict data-handling and security boundaries. Experience with Anthropic models is a plus.
- Knowledge of lakehouse architectures and NoSQL stores.
- Familiarity with API gateways and integration patterns.
Clearance and eligibility
- This role requires DV clearance. Capgemini will sponsor your clearance. You don't need it already, but you must be eligible and willing to go through DV vetting. Existing DV clearance is desirable.
- DV vetting normally requires 10 years of UK residency.
- Most of the work is on-site at secure locations in London. We'll also consider candidates who can work from Manchester or Gloucester. There's some remote working where the work allows.
About Capgemini
Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.
If you are successfully offered this position, you will go through a series of pre-employment checks, including: identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)
What we’ll offer you
You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements.
You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard Manage Mentor, Cybersecurity qualifications and much more.
Why we’re different
At Capgemini, we help organisations across the world become more agile, more competitive, and more successful. Smart, tailored, often ground-breaking technical solutions to complex problems are the norm. But so, too, is a culture that’s as collaborative as it is forward thinking. Working closely with each other, and with our clients, we get under the skin of businesses and to the heart of their goals. You will too.
Capgemini is proud to represent nearly 130 nationalities and its cultural diversity. Our holistic definition of diversity extends beyond gender, gender identity, sexual orientation, disability, ethnicity, race, age, and religion. Capgemini views diversity as everything that makes us who we are as an organization, including our social background, our experiences in life and work, our communication styles and even our personality. These dimensions contribute to the type of diversity we value the most: diversity of thought.
Bristol, GB London, GB Manchester, GB