Amazon Worldwide Grocery Tech is seeking an exceptional Software Development Manager to lead our Edge ML Inference Systems team. This team is responsible for designing, developing, and operating high-performance machine learning inference systems that power real-time computer vision and AI applications across our grocery store locations. Our solutions run on edge devices and enable crucial in-store experiences, from computer vision-based inventory management to smart checkout systems.

Key job responsibilities
- Lead a team of engineers developing high-performance ML inference systems for edge devices.
- Drive architectural decisions for deploying and managing ML models across distributed edge locations.
- Establish performance benchmarks and optimization strategies for ML inference.
- Collaborate with AI/ML teams to enable efficient deployment of new models to production.
- Define and implement strategies for model compression, quantization, and optimization.
- Develop systems for remote monitoring, updating, and management of edge ML infrastructure.
- Partner with hardware teams to optimize ML workloads for specific edge computing platforms.
- Ensure high availability and reliability of inference systems in production environments.