Senior AWS Data Engineer
Insight Global
Job Description
Insight Global is seeking skilled AWS Data Engineers to join our banking client to support a large scale SaaS to AWS transformation project. Candidates will be involved in an initiative to build a new cloud platform tool in AWS for Wealth Data Solutions and moving data from Hadoop to AWS. The ideal candidates will have a strong background in data engineering, AWS webservices, and a strong understanding of data warehousing and batch processing. These individuals should be confident to work in an agile environment (Scrum, Kanban) and to collaborate with other functional roles in delivery including testing, analysis, architecture, and business stakeholders. Main themes for these individuals to consider are data storage, data movement, meta data & governance, infrastructure, and security/IAM. This role will hybrid in Toronto, ON on a 6 month contract with potential for extensions and conversion to full time. \
Responsibilities:
- Perform data/file transformation using AWS services.
- Utilize AWS Glue for batch processing (Spark or Python).
- Implement data warehousing solutions using Amazon S3, Redshift (analytics and BI), Aurora/RDS (operational data stores).
- Ensure metadata and governance using AWS Glue Catalog, Lake Formation, and Macie.
- Create operational dashboards using AWS QuickSight and Power BI.
- Deploy and manage ML models in AWS SageMaker.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
- 8-10+ years of experience in data engineering, ideally in large enterprise banking/financial services environments.
- 8+ years of experience with AWS Services for data ingestion and movement including AWS Glue (batch processing and ETL), AWS Data Sync, AWS Transfer Family (SFTP).
- Excellent experience with data storage in AWS including AWS S3, Redshift (analytics and BI), Aurora/RDS (operational data stores).
- Experience with efficient data processing, querying, and serverless computing using AWS Athena, Redshift Spectrum, Lambda.
- Knowledge of metadata and governance using AWS Glue Catalog, Lake Formation (concepts/frameworks), and Macie (data recovery/protection)
- Expertise with data analytics and visualizations using AWS Quicksight and Power BI.
- Excellent communication skills with an ability to present ideas clearly to stakeholders. - Expertise with ML models and frameworks in AWS SageMaker and AWS Redshift ML is highly preferred to incorporate ML models in data solution. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
Por favor confirme su dirección de correo electrónico: Send Email