Machine Learning Engineer II, AWS Just-Walk-Out Science Team
Amazon.com
As part of the AWS Solutions organization, we have a vision to provide business applications, leveraging Amazon’s unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers’ businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon’s real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use.
The Team
Just Walk Out (JWO) is a new kind of store with no lines and no checkout—you just grab and go! Customers simply use the Amazon Go app to enter the store, take what they want from our selection of fresh, delicious meals and grocery essentials, and go!
Our checkout-free shopping experience is made possible by our Just Walk Out Technology, which automatically detects when products are taken from or returned to the shelves and keeps track of them in a virtual cart. When you’re done shopping, you can just leave the store. Shortly after, we’ll charge your account and send you a receipt. Check it out at amazon.com/go. Designed and custom-built by Amazonians, our Just Walk Out Technology uses a variety of technologies including computer vision, sensor fusion, deep learning, and foundation models. Innovation is part of our DNA! Our goal is to be Earths’ most customer centric company and we are just getting started. We need people who want to join an ambitious program that continues to push the state of the art in computer vision, deep learning, real-time and distributed systems, and hardware design.
Everyone on the team needs to be entrepreneurial, wear many hats and work in a highly collaborative environment that’s more startup than big company. The team works on designing autonomous AI agents that can make intelligent decisions based on visual inputs, understand customer behavior patterns, and adapt to dynamic retail environments. This includes developing systems that can perform complex scene understanding, reason about object permanence, and predict customer intentions through visual cues.
Key job responsibilities
- Collaborate with Applied Scientists to integrate state-of-the-art model architectures into the training pipeline, integrate state-of-the-art MLLMs into the auto-labelling pipeline.
- Collaborate with Applied Scientists to process massive data, scale machine learning models while optimizing GPU utilization, memory management, and the training workflows (like kernel fusion, mixed-precision training, gradient accumulation, offloading optimizer states, massive parallelization, etc).
- Design and maintain large-scale distributed training systems to support multi-modal foundation models for autonomous retailing. Optimize GPU utilization for efficient model training and fine-tuning on massive datasets.
- Develop robust monitoring and debugging tools to ensure the reliability and performance of training workflows on large GPU clusters. Design and maintain large-scale auto-labeling pipeline.
- Collaborate with Engineers and Applied Scientists to investigate design approaches, prototype new technology and evaluate technical feasibility, identify and solve complex problems.
A day in the life
As a MLE with the JWO team, you will be responsible for leading the development of novel algorithms and modeling techniques to advance the state of the art of model training using hardware like NVDIA GPUs. Your work will directly impact our customers in the form of products and services that make use of Just-Walk-Out innovations. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate development with multi-modal Foundation Models and other Artificial Intelligence (AI) applications. As a key player in our team, you'll have a significant influence on our overall strategy, shaping the future direction of JWO at Amazon. You'll be the driving force behind our system architecture and the champion of best practices that will ensure an unparalleled infrastructure of the highest quality. Work in an Agile/Scrum environment to move fast and deliver high quality software.
The Team
Just Walk Out (JWO) is a new kind of store with no lines and no checkout—you just grab and go! Customers simply use the Amazon Go app to enter the store, take what they want from our selection of fresh, delicious meals and grocery essentials, and go!
Our checkout-free shopping experience is made possible by our Just Walk Out Technology, which automatically detects when products are taken from or returned to the shelves and keeps track of them in a virtual cart. When you’re done shopping, you can just leave the store. Shortly after, we’ll charge your account and send you a receipt. Check it out at amazon.com/go. Designed and custom-built by Amazonians, our Just Walk Out Technology uses a variety of technologies including computer vision, sensor fusion, deep learning, and foundation models. Innovation is part of our DNA! Our goal is to be Earths’ most customer centric company and we are just getting started. We need people who want to join an ambitious program that continues to push the state of the art in computer vision, deep learning, real-time and distributed systems, and hardware design.
Everyone on the team needs to be entrepreneurial, wear many hats and work in a highly collaborative environment that’s more startup than big company. The team works on designing autonomous AI agents that can make intelligent decisions based on visual inputs, understand customer behavior patterns, and adapt to dynamic retail environments. This includes developing systems that can perform complex scene understanding, reason about object permanence, and predict customer intentions through visual cues.
Key job responsibilities
- Collaborate with Applied Scientists to integrate state-of-the-art model architectures into the training pipeline, integrate state-of-the-art MLLMs into the auto-labelling pipeline.
- Collaborate with Applied Scientists to process massive data, scale machine learning models while optimizing GPU utilization, memory management, and the training workflows (like kernel fusion, mixed-precision training, gradient accumulation, offloading optimizer states, massive parallelization, etc).
- Design and maintain large-scale distributed training systems to support multi-modal foundation models for autonomous retailing. Optimize GPU utilization for efficient model training and fine-tuning on massive datasets.
- Develop robust monitoring and debugging tools to ensure the reliability and performance of training workflows on large GPU clusters. Design and maintain large-scale auto-labeling pipeline.
- Collaborate with Engineers and Applied Scientists to investigate design approaches, prototype new technology and evaluate technical feasibility, identify and solve complex problems.
A day in the life
As a MLE with the JWO team, you will be responsible for leading the development of novel algorithms and modeling techniques to advance the state of the art of model training using hardware like NVDIA GPUs. Your work will directly impact our customers in the form of products and services that make use of Just-Walk-Out innovations. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate development with multi-modal Foundation Models and other Artificial Intelligence (AI) applications. As a key player in our team, you'll have a significant influence on our overall strategy, shaping the future direction of JWO at Amazon. You'll be the driving force behind our system architecture and the champion of best practices that will ensure an unparalleled infrastructure of the highest quality. Work in an Agile/Scrum environment to move fast and deliver high quality software.
Por favor confirme su dirección de correo electrónico: Send Email