Big Data Backend Engineer (Java/Spark)
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
RESPONSABILITIES
We are looking for a Big Data Backend with Java and Spark to implement and maintain data collection, data structuring, and storage pipelines, as well as to trigger processing through rules or analytical models within a Big Data environment. These data will be used for network supervision or for offline (batch) analysis. The data flows to be processed are very large, on the order of tens of terabytes per day. The ideal candidate must therefore be comfortable with scalability constraints.
REQUIREMENTS
- Strong expertise in Java (Expert level)
- Solid experience with Spring Framework
- Confirmed experience with Spark
- Strong backend development experience (preferably within Big Data environments)
- Familiarity with the Big Data ecosystem
- Experience with Kafka
- Experience with Object Storage solutions (S3, MinIO)
- Experience working in an Agile environment
- Good knowledge of distributed systems and scalability constraints
- Professional proficiency in English (B2 minimum) and Native in Portuguese
Nice to have;
- Experience with Elasticsearch
- Knowledge of Python
- Experience with container orchestration (Kubernetes) in production environments
- Previous experience in telecom or large-scale data processing environments
- French language skills
What you will love about working here
- Enjoy a supportive atmosphere promoting work-life balance.
- Join a multicultural and inclusive team environment.
- Engage in exciting national and international projects.
- Hybrid work.
- Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities.
- Training and certifications programs.
- Health and life insurance.
- Referral program with bonus for talent recommendations.
- Great office locations.
About Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Lisboa, PT Vila Nova de Gaia, PT Fundão, PT