Technical Lead - Data Engineering (Python/Databricks)

Key Responsibilities Lead the design, development, and support of data pipelines and analytics solutions using Python, Databricks, and AWS. 

Architect scalable and secure cloud-based data platforms.

Collaborate with cross-functional teams including data engineers, Product, and business stakeholders to understand requirements and deliver solutions. 

Mentor and guide a team of engineers, fostering a culture of technical excellence and continuous improvement.

Ensure best practices in coding, testing, and deployment.

Manage project timelines, deliverables, and stakeholder expectations.

Integrate and optimize data workflows with Databricks and other data platforms. 

Conduct code reviews and provide technical leadership in sprint planning and retrospectives.

Required Experience 7+ years of experience in software/data engineering.

Strong proficiency in Python for data processing and automation.

Hands-on experience with Databricks (Spark, Delta Lake, notebooks). 

Deep understanding of AWS services (e.g., S3, Lambda, Glue, EC2, IAM).

Experience with CI/CD pipelines, version control (Git), and infrastructure as code.

Must have worked in a Agile/Scrum environment Proven experience in leading technical teams

Excellent communication and stakeholder management skills.

Good to Have AWS certification (e.g., Solutions Architect, Data Analytics). 

Familiarity with Snowflake for data warehousing and analytics.

Knowledge of data governance, security, and compliance.