AWS Data Engineer - Terraform

Job Location - Fort Mill SC (Day One Onsite - Hybrid)

About the Project

• We are developing a modern Data Lakehouse on AWS, leveraging S3, Glue, Iceberg tables, and Snowflake to enable analytics, governance, and scalability.
• The environment will be provisioned through Terraform, orchestrated via Airflow, and driven by robust data pipelines with Glue based Framework.
• We're seeking an experienced AWS Data Engineer with expertise in Glue, Terraform, and Airflow, and strong SQL development skills to help design, automate, and scale this cloud-based data platform.

Key Responsibilities

• Design, develop, and deploy AWS infrastructure using Terraform, including S3, Glue, IAM, Lake Formation, and Athena resources.
• Develop and maintain AWS Glue ETL jobs (PySpark or Python shell) for data ingestion, transformation, and curation across raw → clean → curated layers.
• Integrate Airflow (Amazon MWAA or self-managed) for orchestrating Glue jobs, data pipelines, and dependencies.
• Build and maintain Glue Catalog, manage metadata, and align with Lake Formation security policies.
• Write complex SQL queries for data validation, transformation, and reporting logic, ensuring efficient query performance.
• Manage Terraform state files, backend setup (S3 + DynamoDB), and environment-based deployments.
• Implement data ingestion frameworks for batch and near real-time pipelines.
• Collaborate with Snowflake and BI teams for seamless data consumption.
• Contribute to high availability (multi-AZ) and disaster recovery (multi-region) strategies for core data components.

Required Skills

• 6 years of experience as a Data Engineer or Cloud Engineer.
• Strong expertise in AWS Services: S3, Glue, Glue Catalog, Lake Formation, IAM, Athena, CloudWatch, Lambda (preferred).
• Hands-on proficiency in Terraform (HCL) for infrastructure automation.
• Experience with Airflow DAGs for orchestration of Glue, S3, and external data flows.
• Solid understanding of PySpark / Python for ETL scripting.
• Strong ability to write and optimize complex SQL (joins, window functions, CTEs, and analytical queries).
• Familiarity with data lake formats (Iceberg, Parquet, Delta, etc.).
• Experience with CI/CD pipelines (GitHub Actions, CodePipeline, or Jenkins).

Preferred Skills

• Exposure to Snowflake or similar cloud data warehouses.
• Knowledge of data modeling, partitioning, and schema evolution.
• Familiarity with AWS security best practices, including encryption, IAM roles, and cross-account access.
• Familiarity with AWS Datazone and other services such as Cloud Trail, SNS"

Life At Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: 

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law

Salary Transparency

Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $103330 to $128656 /yearly.  

This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.