Senior Software Dev Engineer, EC2 Nitro

About This Role

Join the EC2 Nitro Machine Learning Systems team to build and optimize infrastructure powering computationally intensive AI/ML workloads. This role involves establishing EC2 as the definitive source for best-known-configurations across diverse ML applications and influencing future accelerated platform designs.

Responsibilities

• Design and implement scalable performance measurement infrastructure for ML benchmarking across AWS, incorporating critical metrics
• Lead technical projects establishing EC2 as the definitive source for ML performance best practices across diverse applications
• Develop and maintain comprehensive regression testing systems that validate performance across major component releases
• Collaborate with hardware engineering teams to influence future accelerator platform designs based on performance insights
• Build customer relationships by investigating complex performance challenges, developing solutions, and publishing actionable best practices

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques

Qualifications

• Bachelor's degree in computer science or equivalent
• 5+ years of non-internship professional software development experience, including programming and leading design or architecture of new and existing systems.

Nice to Have

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
• Knowledge of machine learning model architecture and inference

Skills

* Required skills

Benefits