Senior Product Manager, AI Infrastructure in United States at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager, AI Infrastructure based in United States.

This role sits at the core of defining and shaping next-generation AI infrastructure for large-scale workloads across GPU-driven environments.
You will work closely with enterprise customers to deeply understand their AI training and inference needs at scale.
The position requires translating complex infrastructure requirements into clear product direction and engineering priorities.
You will collaborate across engineering, networking, storage, and operations teams to deliver high-performance cloud solutions.
The environment is highly technical, fast-moving, and centered on solving real-world AI infrastructure challenges.
You will help build scalable offerings that extend beyond individual customers into repeatable platform capabilities.
This is a high-impact opportunity to influence the future of AI infrastructure used globally.

• Own discovery and definition of customer needs for AI infrastructure, including GPU compute, inference, training workloads, storage, networking, and orchestration systems
• Work directly with strategic enterprise customers to understand deployment requirements, performance expectations, and success criteria
• Translate customer and market needs into detailed product requirements, technical specifications, and roadmap priorities
• Partner with engineering, infrastructure, networking, storage, and operations teams to design and deliver scalable solutions
• Drive alignment between customer expectations, product strategy, architecture decisions, and execution plans
• Define requirements across distributed systems, cluster orchestration environments, and high-performance computing infrastructure

Requirements:

• 5+ years of experience in technical product management within infrastructure, cloud computing, or AI/ML platforms
• Strong understanding of GPU compute systems, distributed storage, and high-performance networking technologies such as InfiniBand or RoCE
• Experience working directly with enterprise or strategic customers on infrastructure design and requirements gathering
• Solid knowledge of AI/ML workloads including training, fine-tuning, and inference at scale
• Familiarity with orchestration frameworks such as Kubernetes and Slurm in production environments
• Proven ability to collaborate with engineering teams on complex distributed infrastructure products
• Excellent communication skills with the ability to engage both technical and executive stakeholders
• Bachelor’s degree in Computer Science, Engineering, or related technical field (advanced degree preferred)

Benefits:

• Competitive compensation package: 130,000 to 165,000 USD depending on experience and location
• 100% employer-paid medical, dental, and vision insurance
• 401(k) with 100% match up to 4% and immediate vesting
• Annual professional development reimbursement of 2,500 USD
• Paid holidays, PTO accrual with rollover, and extended leave benefits including sabbaticals
• Remote work support stipend and annual internet reimbursement
• Wellness perks including gym reimbursement and subscription access to wellness platforms
• Long-term employee recognition programs including anniversary bonuses and additional PTO over tenure