Data Engineer | 6 to 9 years | Bengaluru
Job Description
Skilled and motivated Data Engineer to join our dynamic technology team. The ideal candidate will have a strong background in data processing, cloud computing, and software development, with hands-on experience in Python, PySpark, Java, and Microsoft Azure. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support advanced analytics and data science initiatives.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines using PySpark, Python, and Java.
- Implement and manage data workflows on Microsoft Azure and other public cloud platforms.
- Collaborate with data scientists, analysts, and IT operations to ensure seamless data integration and availability.
- Optimize data systems for performance, scalability, and reliability.
- Ensure data quality, governance, and security across all data platforms.
- Support DevOps practices for continuous integration and deployment of data solutions.
- Monitor and troubleshoot data infrastructure and resolve system issues.
- Document processes and maintain data architecture standards.
Required Skills & Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
- 3+ years of experience in data engineering, software development, or IT operations.
- Proficiency in Python, PySpark, and Java.
- Experience with cloud computing platforms, especially Microsoft Azure.
- Strong understanding of data management, data processing, and data analysis.
- Familiarity with multi-paradigm programming and modern software development practices.
- Knowledge of DevOps tools and methodologies.
- Experience with system administration and cloud providers.
- Excellent problem-solving and communication skills.
Preferred Qualifications:
- Certifications in Azure, Python Data Science, or related technologies.
- Experience with public cloud environments like AWS or GCP.
- Familiarity with big data tools and frameworks.
- Exposure to data science workflows and tools.
Skilled and motivated Data Engineer to join our dynamic technology team. The ideal candidate will have a strong background in data processing, cloud computing, and software development, with hands-on experience in Python, PySpark, Java, and Microsoft Azure. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support advanced analytics and data science initiatives.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines using PySpark, Python, and Java.
- Implement and manage data workflows on Microsoft Azure and other public cloud platforms.
- Collaborate with data scientists, analysts, and IT operations to ensure seamless data integration and availability.
- Optimize data systems for performance, scalability, and reliability.
- Ensure data quality, governance, and security across all data platforms.
- Support DevOps practices for continuous integration and deployment of data solutions.
- Monitor and troubleshoot data infrastructure and resolve system issues.
- Document processes and maintain data architecture standards.
Required Skills & Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
- 3+ years of experience in data engineering, software development, or IT operations.
- Proficiency in Python, PySpark, and Java.
- Experience with cloud computing platforms, especially Microsoft Azure.
- Strong understanding of data management, data processing, and data analysis.
- Familiarity with multi-paradigm programming and modern software development practices.
- Knowledge of DevOps tools and methodologies.
- Experience with system administration and cloud providers.
- Excellent problem-solving and communication skills.
Preferred Qualifications:
- Certifications in Azure, Python Data Science, or related technologies.
- Experience with public cloud environments like AWS or GCP.
- Familiarity with big data tools and frameworks.
- Exposure to data science workflows and tools.
Bangalore, IN