Job Title: Lead Data Engineer (AWS)

Experience Required: 8–10 Years
Skill: AWS, PySpark, Glue

Location: Pune, Bangalore, Chennai, Hyderabad, Gurgaon, Trivandrum, Kochi

 

Job Overview:

UST is seeking a highly experienced Lead Data Engineer with a strong background in AWS and big data technologies. This role is ideal for a seasoned professional with 8–10 years of experience in data engineering, team leadership, and project management. As a Lead AWS Data Engineer, you will be responsible for architecting scalable data solutions, leading engineering teams, and ensuring alignment with business objectives.

Key Responsibilities:

Provide technical leadership and mentorship to data engineering teams. Architect, design, and deploy scalable, secure, and high-performance data pipelines. Collaborate with stakeholders, clients, and cross-functional teams to deliver end-to-end data solutions. Drive technical strategy and implementation plans in alignment with business needs. Oversee project execution using tools like JIRA, ensuring timely delivery and adherence to best practices. Implement and maintain CI/CD pipelines and automation tools to streamline development workflows. Promote best practices in data engineering and AWS implementations across the team.

Technical Skills:

Strong hands-on expertise in Python, PySpark, and Spark architecture, including performance tuning and optimization. Advanced proficiency in SQL and experience in writing optimized stored procedures. In-depth knowledge of the AWS data engineering stack, including: AWS Glue Lambda API Gateway EMR S3 Redshift Athena Experience with Infrastructure as Code (IaC) using CloudFormation and Terraform. Familiarity with Unix/Linux scripting and system administration is a plus. Proven ability to design and deploy robust, production-grade data solutions.