Senior Software Engineer - C

Job Description

As an Intermediate Azure Data Engineer, will be in charge  methodology, developing, and maintaining robust data solutions using Azure technologies. Candidate will work closely with PowerBI, and other stakeholders to ensure data is accessible, reliable, and valuable for business insights.

Key Responsibilities:

Design and implement data pipelines using PySpark and SQL to ingest, transform, and load data from various sources into Azure Synapse or ADF

Implement and manage ETL end to end pipeline by using Synapse or ADF Pipeline activity for eg(Copy, foreach, if condition, lookup, metadata, dataflow and more…)

Job Description - Grade Specific

Develop and optimize data models in Azure Synapse to support efficient querying and reporting.

Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs.

Implement and manage CI/CD pipelines for data solutions using Azure DevOps, ensuring smooth and efficient deployment processes.

Monitor and maintain data pipeline performance, troubleshooting and resolving any issues that arise.