Software Engineer

Job Description

- 5-8 years of proven experience as ETL (Extract Transform and Load) Developer.

- Strong experience in Python programming language. 

- Extensive experience with SQL, NoSQL technologies like mongoDB, Time Series DB, AWS DynamoDB

- Understands evolution of databases for in-memory, SQL, NoSQL & indexing technologies along with experience on real-time & stream processing systems like AWS streaming technologies, Spark Streaming, Kafka.

- Good experience in AWS with enterprise implementations including expertise with services such as AWS Batch Processing, Glue, Spark Processing, S3, Data/ML Pipeline, EMR

- Strong Experience on REST APIs for creating and managing data integration job.

- DevOps experience using tools like Jira, Github, Jenkins and CICD pipelines

- Experience on various AWS cloud services: CloudWatch, lambda, ECS, Kinesis, Compute, Storage, Database Services

- Experience with AWS Core services SNS, SQS etc. is a plus.

- Good to have experience on Distributed computing services like Databricks, Pyspark, Delta Lakes Ecosystem

- Good to have experience on Nodejs/Typescript, ReactJS, GraphQL interfaces

- Experience using monitoring solutions like Datadog, Grafana and Prometheus

- Access Control Automation - Unity Catalogue, AWS Lake Formation

- Understanding of Kubeflow, Kubernetes