Lead Software Engineer - Core AI in United States at Jobgether
Explore Related Opportunities
Job Description
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Lead Software Engineer - Core AI in United States.
This role sits at the forefront of building next-generation AI infrastructure, focused on designing and scaling enterprise-grade generative AI platforms and agentic systems. You will lead the technical direction for highly scalable, secure, multi-tenant AI services that power large language model (LLM) applications and experimentation frameworks. Working in a fast-evolving AI-first environment, you will collaborate with research, product, and engineering teams to bring cutting-edge AI capabilities into production. The role combines deep architectural ownership with hands-on engineering and technical leadership. You will help define best practices for reliability, observability, and performance in distributed AI systems. This is a high-impact position where your work directly shapes how advanced AI is deployed at scale across real-world applications.
In this role, you will lead the architecture, development, and evolution of core AI platform systems, ensuring scalability, security, and reliability while enabling advanced generative AI capabilities across the organization.
- Define technical direction and architect scalable, multi-tenant generative AI platform systems
- Lead development of secure and high-performance AI infrastructure and developer tooling for agentic and LLM-based applications
- Integrate generative AI frameworks, large language models, and evaluation systems into production-ready solutions
- Solve complex engineering challenges related to distributed systems, reliability, and performance at scale
- Collaborate with Research, Product, and Engineering teams to deliver AI-driven capabilities into real-world applications
- Establish best practices for system design, security, and observability across AI platform components
- Mentor and guide engineers, supporting technical growth and architectural decision-making
This role requires strong backend engineering expertise combined with deep experience in AI systems, distributed architectures, and platform development. Candidates should bring both hands-on technical depth and leadership capability.
- 8+ years of software engineering experience
- Strong proficiency in at least one major programming language (C#, Java, JavaScript, Go, or Python)
- Experience building or working with generative AI systems, LLMs, or AI platforms
- Familiarity with cloud infrastructure and distributed system design
- Experience with GenAI ecosystem tools such as MCP, LangGraph, OpenAI, or AWS Bedrock is highly valued
- Strong architecture, system design, and problem-solving skills
- Experience building secure, scalable, and reliable production systems
- Proven ability to mentor engineers and influence technical direction
- Strong collaboration and communication skills across technical and non-technical teams
- Competitive salary ($200,000 – $215,000 depending on location and experience)
- Employee equity program
- Unlimited paid time off
- Comprehensive medical, dental, and vision coverage
- Employee discounts and wellness programs (including virtual wellness classes)
- Pet insurance benefits
- Inclusive and collaborative workplace culture
- Opportunities to work on cutting-edge AI and GenAI systems at scale