Devops

• Migration exp from Apache Kafka to Confluent Kafka
• Devops, Kubernetes
• Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).
• Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.
• Monitor Kafka infrastructure performance and ensure high availability and low-latency data transmission.
• Collaborate with DevOps and development teams to optimize Kafka configurations for performance and scalability.
• Troubleshoot and resolve issues related to Kafka cluster connectivity, broker performance, and data replication.
• Implement Kafka producers and consumers, ensuring data pipelines are robust and efficient.
• Develop automation scripts (e.g., using Ansible, Shell scripting) for Kafka cluster provisioning and maintenance tasks.
• Provide guidance and mentorship to junior members of the Kafka administration team.
• Stay updated with Kafka community developments and best practices, recommending upgrades and improvements

Skills and Qualifications:

• Extensive experience with Apache Kafka and its ecosystem (Kafka Connect, Kafka Streams, Schema Registry).
• Proficiency in Linux/Unix system administration and networking fundamentals.
• Strong understanding of distributed computing principles and real-time data processing concepts.
• Experience with cloud platforms (GCP) and container orchestration (Kubernetes) is a plus.
• Excellent problem-solving and analytical skills, with a proactive approach to identifying and resolving issues.
• Effective communication skills, capable of articulating technical concepts to non-technical stakeholders.