Apply now »

PySpark Developer | 4 to 10 Years | PAN INDIA

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Job Description

  • 4+ years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
  • Must have excellent knowledge in Apache Spark and Python programming experience.
  • Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.
  • Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
  • Should have experience in fine-tuning process and troubleshooting performance issue.
  • Experience in source code control systems like git, GitHub, SVN etc.
  • Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.

Primary Skills

  • Pyspark.
  •  Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.

Secondary Skills

  • Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
  • Should have experience in fine-tuning process and troubleshooting performance issue

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion. 

Ref. code:  20232
Posted on:  Aug 27, 2024
Experience Level:  Experienced Professionals
Contract Type:  Permanent
Location: 

Bangalore, IN

Brand:  Capgemini Engineering
Professional Community:  Cloud Infrastructure Management

Apply now »