Azure Data Tech Lead

Job Description - Grade Specific

Position: Developer / Software Engineer

Experience Required:

1. Microsoft Azure: 6-9 years
2. Azure Data Factory: 6-9 years
3. Azure Databricks: 6-9 years

Responsibilities:

1. Ingest structured/unstructured data (batch or real-time) into the Azure lake and perform data cleaning and aggregation.
2. Collaborate with business stakeholders to create data marts for reporting.
3. Develop and maintain data pipelines to transform and load data from Databricks into Datawarehouse models.
4. Create and maintain data marts, data catalogues, and data lineage.
5. Implement data quality checks and scheduling for timely data delivery.

Professional Experience:

1. Knowledge of data warehouse concepts (Star or Snowflake methodology) and experience in designing data warehouse dimensional models.
2. Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics/Datawarehouse, Spark programming in Scala or Python (for batch and real-time), and Python.
3. At least three years of hands-on experience as a Data Engineer, including at least two years using Microsoft data tools.

Personal Attributes:

1. Positive attitude and disposition.
2. Ability to function independently or as a team player.
3. Technical aptitude.
4. Organized, systematic, and logical.
5. Willingness to learn.

Qualification:

1. Degree from a recognized university, preferably in Data Analytics or Computer Science.

Job Description

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.

Skills (competencies)