AI infrastructure Engineer (SRE) in India at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Infrastructure Engineer (SRE) based in India.

This role offers the opportunity to build and maintain the infrastructure powering advanced artificial intelligence systems.
You will ensure the reliability, scalability, and performance of production environments supporting high-demand AI workloads.
The position combines software engineering, systems operations, automation, and cloud infrastructure expertise.
You will work on complex distributed systems while improving availability and operational excellence.
The role provides exposure to cutting-edge AI infrastructure technologies and large-scale computing challenges.
This is an ideal opportunity for an experienced SRE professional passionate about automation, reliability, and AI innovation.

As an AI Infrastructure Engineer (SRE), you will be responsible for maintaining highly reliable production systems, improving infrastructure automation, and ensuring seamless service delivery for AI-powered platforms.

• Participate in an on-call rotation to respond quickly to incidents affecting service availability and performance.
• Build, operate, and scale infrastructure using tools such as Ansible, Terraform, and Kubernetes.
• Manage and optimize AI infrastructure environments, including GPU-enabled Kubernetes clusters supporting machine learning workloads.
• Develop monitoring, alerting, and observability solutions to maintain high-quality services.
• Design and implement operational processes for deployments, upgrades, and infrastructure lifecycle management.
• Troubleshoot production issues across infrastructure, applications, and distributed system layers.
• Identify opportunities to improve system architecture, reliability, scalability, and performance.
• Contribute to infrastructure capacity planning and future growth strategies.
• Collaborate with engineering teams and technical stakeholders to deliver resilient and efficient platforms.

The ideal candidate is an experienced infrastructure professional with strong SRE expertise and a deep understanding of cloud-native systems, automation, and AI infrastructure environments.

• 7+ years of professional experience in Site Reliability Engineering, Infrastructure Engineering, DevOps, or a related field.
• Hands-on experience operating GPU-enabled Kubernetes clusters or AI infrastructure supporting machine learning training and inference workloads.
• Bachelor’s degree in Computer Science, Engineering, or a related discipline, or equivalent practical experience.
• Expert knowledge of Kubernetes administration and container orchestration.
• Strong proficiency with infrastructure automation tools including Ansible and Terraform.
• Experience with programming or scripting languages for automation and operational improvements.
• Solid understanding of monitoring, observability, logging, and alerting practices.
• Advanced knowledge of cloud platforms and cloud-native infrastructure concepts.
• Strong troubleshooting skills across operating systems, networking, storage systems, and distributed architectures.
• Ability to work effectively in a collaborative environment with multiple teams and technical stakeholders.
• Strong ownership mindset with a focus on reliability, scalability, and continuous improvement.

• Competitive compensation package.
• Remote work flexibility with opportunities to collaborate with a global engineering team.
• Opportunity to work on advanced AI infrastructure and large-scale distributed systems.
• Exposure to innovative technologies across cloud computing, Kubernetes, automation, and machine learning platforms.
• Professional growth opportunities through challenging technical projects and continuous learning.
• Collaborative environment focused on engineering excellence and innovation.
• Opportunity to contribute to the development of next-generation AI infrastructure.