This role requires 5+ years of experience and the ability to work closely with project leads and clients.
As a Sr.Data Engineer, you'll join our team to design and develop scalable data processing systems. You'll gather requirements, create end-to-end solutions, and oversee projects from conception to production. Key responsibilities include mentoring team members and translating complex business needs into robust technical solutions using cutting-edge technologies.
Technical Skills:
• Must have Strong expertise in Python, PySpark, Spark architecture and performance tuning
• Must have proficiency in writing optimized SQL with performance tuning aspects.
• Must have strong expertise in AWS data engineering services (Glue, Lambda, API Gateway, S3).
• Ability to translate complex business requirements into technical solutions.
• Good to have working knowledge of Unix.
• Good to have Hands-on experience with CloudFormation Experience with CI/CD pipeline.