Senior AI & ML Engineer in United States at Jobgether
Explore Related Opportunities
Job Description
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior AI & ML Engineer in United States.
This role sits at the forefront of building next-generation AI-driven conversational and agentic systems used by millions of users interacting with live experiences. You will design and scale production-grade LLM-powered features that power intelligent workflows, recommendation systems, and conversational interfaces. The position blends applied machine learning, backend engineering, and product thinking in a fast-moving, experimentation-heavy environment. You will be responsible for taking LLM concepts from prototype to production while ensuring reliability, observability, and measurable quality. The work spans orchestration, evaluation frameworks, prompt optimization, and multi-step agent systems. This is a high-impact role where your work directly shapes how users discover and engage with real-world experiences. You’ll operate in a collaborative, AI-first engineering culture that values speed, ownership, and continuous learning.
- Design, build, and deploy LLM-powered features and agentic workflows in production systems used by end users at scale.
- Develop orchestration layers for multi-step AI systems, including tool use, routing, state management, and workflow coordination.
- Build and maintain evaluation frameworks, regression tests, and LLM quality pipelines to ensure consistent system performance.
- Implement prompt engineering strategies, structured outputs, and retrieval-augmented generation (RAG) patterns to optimize model behavior.
- Collaborate cross-functionally with product, data, and engineering teams to translate user needs into AI system designs.
- Define technical architecture and design decisions for scalable, maintainable AI systems in partnership with technical leadership.
- Continuously monitor system performance and iterate quickly based on experimentation, feedback, and production data.
This role requires strong experience building production AI systems, deep Python expertise, and a practical understanding of LLM-based architectures, alongside strong communication and collaboration skills in cross-functional environments.
- 5–8 years of software engineering experience, including at least 1+ year building production AI/ML or LLM-powered systems.
- Strong proficiency in Python and experience with LLM SDKs and agent frameworks (e.g., OpenAI Agents SDK or similar tools).
- Hands-on experience designing evaluation systems, prompt testing pipelines, or model quality frameworks.
- Solid backend engineering skills including APIs, distributed systems, state management, and cloud infrastructure.
- Experience with agentic workflows, tool calling, multi-agent orchestration, or similar AI system patterns.
- Strong understanding of prompt engineering, structured outputs, and LLM integration best practices.
- Excellent communication skills with ability to explain technical tradeoffs to both technical and non-technical stakeholders.
- Demonstrated ability to work in ambiguous environments with high ownership and delivery focus.
- Competitive base salary range of $194,000 – $228,000 USD depending on experience and location.
- Equity compensation and performance-based incentives.
- Comprehensive health, dental, and vision insurance coverage.
- Retirement and financial wellness programs.
- Remote-first flexibility with opportunities for in-person collaboration sessions.
- Paid time off, parental leave, and wellness support programs.
- Learning budget and continuous development opportunities in AI and machine learning domains.