Product Manager - Infrastructure

About This Role

Own the roadmap for core inference and compute infrastructure, ensuring the platform delivers world-class reliability, scalability, and performance for AI companies. This deeply technical role bridges engineering excellence and customer impact.

Responsibilities

• Define the product vision and roadmap for Baseten’s inference, serving, and orchestration infrastructure
• Collaborate with engineering to improve the reliability, latency, and cost efficiency of model deployments
• Partner with Forward Deployed Engineering and customer teams to translate performance needs into infrastructure investments
• Drive internal platform scalability from multi-GPU support to hybrid cloud architecture
• Establish metrics for uptime, latency, and cost, ensuring best-in-class performance and efficiency
• Lead cross-functional initiatives around observability, deployment automation, and infrastructure security

Requirements

• 4+ years of Product Management experience in developer platforms, infrastructure, or ML systems
• Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer)
• Strong technical understanding of distributed systems, cloud computing, and GPU-based workloads
• Proven track record of shipping technical products with measurable reliability or performance improvements
• Excellent communication and prioritization skills with deeply technical teams

Qualifications

• Degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer
• 4+ years of Product Management experience in developer platforms, infrastructure, or ML systems

Nice to Have

• Experience with Kubernetes, autoscaling systems, or inference optimization
• Understanding of LLM and multimodal model serving
• Prior experience at a company building infrastructure for ML or developer tools

Skills

* Required skills

Benefits