Senior Software Engineer (AI Engineer) in India at Jobgether

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer (AI Engineer) in India.

This role is an opportunity to work at the forefront of applied AI, designing and delivering intelligent, production-grade systems for complex real-world products. You will take ownership of building end-to-end AI-powered applications, from data ingestion and model integration to deployment and monitoring in scalable cloud environments. The position sits within a highly experienced, remote-first engineering culture where clarity, craftsmanship, and thoughtful use of AI are core principles. You will work closely with product and engineering teams to translate advanced AI capabilities into reliable, user-facing features. The environment emphasizes deep technical work, autonomy, and high-impact problem solving across generative AI and agentic systems. This is an ideal role for an engineer passionate about LLMs, system design, and building production-ready AI solutions at scale.

You will design, build, and maintain advanced AI systems, ensuring they are scalable, reliable, and effectively integrated into production products.

• Design and implement end-to-end AI architectures including data pipelines, model inference, and structured outputs
• Build and optimize generative AI solutions such as RAG systems and agent-based workflows using modern frameworks
• Deploy and maintain AI models in production using cloud platforms such as AWS, GCP, or Azure with Docker and Kubernetes
• Implement evaluation and monitoring systems to track model performance, drift, accuracy, and hallucinations
• Collaborate with engineers and product managers to integrate AI capabilities into core product experiences
• Fine-tune and optimize open-source models such as Llama or Mistral for latency, cost, and domain-specific performance
• Contribute to engineering best practices including CI/CD, version control, and system reliability

The ideal candidate has strong software engineering fundamentals combined with deep hands-on experience in modern AI/ML systems and production-grade deployments.

• 5+ years of experience in software engineering with strong proficiency in Python or similar languages (Java, Scala, JavaScript, etc.)
• Strong understanding of transformer architectures, embeddings, and vector similarity search
• Hands-on experience integrating and working with LLM APIs such as OpenAI, Anthropic, or Google Vertex AI
• Experience building agentic and RAG-based systems using frameworks like LangChain, LangGraph, ADK, or Genkit
• Familiarity with vector databases, SQL/NoSQL systems, and data storage solutions
• Experience deploying applications on cloud platforms (preferably GCP or AWS) using containerization tools like Docker and Kubernetes
• Solid understanding of modern AI patterns such as few-shot prompting, fine-tuning, and retrieval-augmented generation
• Strong engineering practices including Git, CI/CD, and production debugging experience

Nice to have:

• Experience with Google Cloud Platform services such as Vertex AI, Firestore, or Cloud Functions
• Knowledge of advanced prompt engineering techniques (Chain-of-Thought, ReAct, Tree of Thoughts)
• Experience building autonomous agentic systems capable of tool or API execution

The role offers a strong mix of flexibility, career growth, and comprehensive employee support within a high-performance engineering environment.

• Remote-first work setup with flexibility and home office support
• Competitive salary aligned with experience and impact
• Profit-sharing opportunities to participate in company success
• Localized healthcare coverage for employees and families
• Flexible paid time off with a minimum of 3 weeks annually plus holidays
• Wellness allowance to support physical and mental wellbeing
• Dedicated learning and professional development budget
• “No internal meetings” Fridays for focused deep work
• Annual in-person offsites for team connection and collaboration
• Paid sabbatical program for rest and renewal