Staff AI Software Engineer in United States at Jobgether
Explore Related Opportunities
Job Description
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Staff AI Software Engineer in the United States.
This role sits at the forefront of applied AI engineering, focusing on the design and deployment of advanced agentic systems that power real-world enterprise workflows. You will build and scale autonomous AI agents across research, automation, analytics, and conversational use cases, turning complex business needs into intelligent, production-grade systems. Operating in a highly collaborative and fast-moving environment, you will own solutions end-to-end—from architecture and prototyping to deployment and monitoring. The role emphasizes hands-on engineering, rapid iteration, and strong ownership of AI-driven product outcomes. You will work closely with product and engineering teams to define how modern LLM systems are integrated into core platforms. This is an opportunity to shape foundational AI capabilities while delivering measurable impact at scale across mission-critical systems.
- Design, build, and deploy autonomous AI agents across research, coding, analytics, scheduling, and workflow automation use cases.
- Own end-to-end agent lifecycle including ingestion, reasoning, tool use, action execution, evaluation, and monitoring.
- Architect multi-step agent systems with memory, planning, context tracking, and API orchestration capabilities.
- Build and optimize retrieval-augmented generation (RAG) pipelines, embeddings, vector databases, and knowledge systems.
- Develop scalable agent architectures using frameworks such as LangChain, LlamaIndex, OpenAI Assistants, MCP, or custom orchestration systems.
- Deploy agents as production-grade microservices with observability, guardrails, and performance monitoring.
- Run structured evaluations to improve accuracy, groundedness, latency, and task completion rates.
- Collaborate with product teams to translate requirements into scalable AI-driven solutions and reusable frameworks.
- 8+ years of software engineering experience with strong full-stack or backend development expertise.
- 2+ years of hands-on experience building and deploying AI/LLM-based systems in production environments.
- Proven experience building at least two production AI agents within the past 12 months.
- Strong knowledge of LLM ecosystems (OpenAI, Anthropic, Gemini, Llama, or similar).
- Experience with agent frameworks such as LangChain, OpenAI Agent SDK, or custom orchestration/state machine systems.
- Solid understanding of RAG architectures, vector databases (Pinecone, Weaviate, Chroma, PGVector), and embedding pipelines.
- Proficiency in backend technologies such as .NET, Python, or Node.js, and experience with APIs and microservices.
- Experience working with relational databases (Postgres, SQL Server) and message queues (Kafka, RabbitMQ, SQS, or similar).
- Familiarity with CI/CD pipelines, cloud environments (AWS or Azure preferred), and containerization (Docker).
- Strong communication skills, a proactive mindset, and ability to thrive in fast-paced Agile environments.
- Remote-friendly work environment across the United States
- Competitive medical, dental, and vision insurance plans
- Retirement savings plan (401k/RRSP equivalents depending on region)
- Paid time off and flexible work culture
- Annual fitness and wellness allowance
- Mental health support, including meditation and therapy resources
- Learning and development budget with access to training platforms (e.g., Udemy)
- Certification support and internal career growth programs
- Home office and internet stipend support
- Inclusive and collaborative, values-driven engineering culture