**_This position will follow our hybrid work model, we expect the selected candidate to be in office 2-3 days a week(10-12 days a month ) at the following office location: St. Petersburg, FL._** **Job Summary:** This Lead Engineer, Technology will partner closely work with the **Compliance and Supervision Business Unit** on solutions from inception through ongoing maintenance. The role will focus on building out Supervision and Compliance Surveillance controls within Wealth Management. The ideal candidate will have extensive experience with **AWS Glue, PySpark, and Python programmin** g. This position will be responsible for designing, implementing, and developing business controls and collaborating with cross-functional teams to meet business needs. This hybrid position will be based out of our corporate headquarters in Saint Petersburg, FL. **Responsibilities:** + Design and develop business controls using **AWS Glue and PySpark.** + Integrate data from various sources into **Amazon Redshift** , ensuring data quality and consistency. + Optimize the performance of data processing jobs and fine tune queries. + Monitor and troubleshoot data pipelines to ensure reliability and efficiency. + Collaborate with data scientists, analysts, and other stakeholders to understand data requirements. + Ensure compliance with security policies and regulations. + Document data workflows and best practices. + Mentor and guide junior engineers on the team. + Continuously explore new AWS services and technologies to improve existing solutions. **Skills:** **Data Engineering Tools:** + Experience in **Airflow** + **PySpark** and experience with caching, RDD, multithreading , in-memory computations of very large datasets. + Experience in open table format; Ex: Iceberg , Delta Lake, Avro , Parquet + Solid knowledge and experience with Glue Notebook and EMR/Databricks. + Experience with **DataLake** concept on Distributed object store. + **Python programming** **Exp SQL:** + **Advanced** experience in writing **complex SQL queries** **Data Warehousing:** + Solid Knowledge of OLTP and OLAP + AWS Services Experience minimum 3 years: + Glue + EMR + S3 + Redshift + Athena + Lambda + Step Functions + Data pipeline and migration + Terraform + CI/CD pipeline **Generic domain background:** + Data Analysis and Reporting: **Proficiency is SQL** + Data Analysis using large data sets + System Integration: Experience with integrating compliance systems with other enterprise systems. + Financial Industry Experience: Experience working in financial firms, understanding their unique compliance challenges and regulatory environments. + Knowledge in TFS is a plus. + Knowledge in Jenkins pipeline and deployment. **Ability to:** + Identify and understand issues, problems and opportunities for automation. + Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message. + Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences. + Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise. + Develop and use collaborative relationships to facilitate the accomplishment of work goals. + Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.