Data Engineer - Databricks (Remote, México)
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
Your role
As a Data Engineer, you will design, develop, and maintain scalable data solutions leveraging modern data engineering practices and platforms. You will collaborate with cross-functional teams to deliver reliable, high-quality data products that support business and technology needs.
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks.
- Develop data processing and transformation solutions using Spark and PySpark.
- Build, optimize, and maintain Databricks notebooks, workflows, and jobs.
- Integrate data from multiple sources, including databases, APIs, files, and cloud storage, while performing data cleansing, enrichment, and validation activities.
- Optimize data pipelines and Spark workloads for performance, scalability, reliability, monitoring, logging, and troubleshooting.
- Collaborate with analysts, developers, architects, and business teams while participating in code reviews, testing, documentation, CI/CD, and production support activities.
Your profile
-
Strong hands-on experience with Python, Databricks, Apache Spark, and PySpark.
-
Experience building and supporting production-grade ETL/ELT data pipelines.
-
Strong SQL skills and experience with data modeling, data transformation, and data quality practices.
-
Experience working with Delta Lake and Lakehouse architectures.
-
Experience integrating data from databases, APIs, files, and cloud storage, with understanding of Git, CI/CD, testing, and engineering best practices.
What you will love
-
Work on meaningful projects that use technology to solve real-world challenges.
-
Access continuous learning through internal academies, certifications, and mentorship.
-
Professional communities to connect with and support career growth
Need to know
- This position is offered in a remote work model.
- Employees have access to Capgemini offices located in Mexico City, Aguascalientes, and Guadalajara, providing flexibility for collaboration and team interactions when needed.
About Capgemini
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations.
At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.
Aguascalientes, MX