Staff Software Engineer, Applied AI in United States at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Software Engineer, Applied AI based in the United States.
This role sits within a fast-moving, incubation-style AI team focused on expanding intelligent capabilities across a healthcare technology ecosystem. You will design and ship production-grade AI systems that directly impact how patients access critical medical equipment and supplies at home. The work spans applied machine learning, LLM-driven agentic workflows, and full-stack product engineering in a highly iterative environment. You will collaborate closely with product and engineering teams to identify high-impact use cases and bring AI solutions from concept to production. This is a hands-on role for someone who thrives at the intersection of AI research pragmatism and real-world software delivery. You will also help define best practices for evaluation, reliability, and observability of LLM-powered systems.
- Design and build agentic LLM pipelines that power AI-driven product features across the platform, ensuring scalability and production reliability.
- Develop full-stack applications using Python (FastAPI) and TypeScript/React to support AI-enabled workflows and user-facing tools.
- Build and maintain robust evaluation frameworks, including curated datasets, automated testing, regression detection, and performance benchmarking for LLM systems.
- Iterate on prompt engineering strategies and model usage, balancing accuracy, latency, and cost considerations.
- Enhance production observability by implementing feedback loops, monitoring accuracy signals, and improving system reliability over time.
- Partner with cross-functional product and engineering teams to identify opportunities for AI integration and guide implementation strategy.
- Provide technical direction on when and how to apply AI/LLM solutions effectively to maximize impact and avoid unnecessary complexity.
- 5+ years of professional software engineering experience in production environments.
- Strong background in full-stack development, particularly with Python-based web applications (FastAPI or similar frameworks).
- Proven experience building and shipping agentic LLM workflows to production using orchestration tools (e.g., LangChain, LangGraph, or similar).
- Hands-on experience designing evaluation systems for LLM applications, including test datasets, eval harnesses, and regression tracking.
- Familiarity with prompt engineering and iterative LLM optimization practices.
- Experience working in fast-paced startup or 0-to-1 environments with high ownership and autonomy.
- Strong communication skills with the ability to drive alignment across technical and non-technical stakeholders.
- Must be legally authorized to work in the United States.
- Medical, dental, and vision insurance with low-to-no-cost premium options.
- Employer-funded Health Savings Account (HSA) contributions.
- 401(k) retirement savings plan.
- Equity incentive plan participation.
- Annual performance-based bonus opportunity of up to 15%.
- Remote-first work culture with access to a NYC office and co-working space reimbursement.
- Flexible vacation policy plus additional summer Fridays off.
- Home office setup and wellness stipend.
- Monthly internet reimbursement.
- Annual learning and professional development budget.