Senior Software Engineer - LLM Observability in United States at Jobgether

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer – LLM Observability in the United States.

Join a highly collaborative engineering team building the foundational infrastructure that enables observability for modern AI and large language model applications. In this role, you will help define how AI systems are represented, measured, and analyzed in production environments, powering critical insights around performance, cost, reliability, and behavior. You will work across backend and full-stack systems, designing scalable services and customer-facing features that support next-generation observability experiences. The position offers significant technical ownership, opportunities to influence architecture and product direction, and the chance to contribute to emerging standards in AI telemetry. Working within a distributed, engineering-driven culture, you’ll collaborate closely with product and design partners while mentoring peers and leading complex technical initiatives. This is an ideal opportunity for engineers passionate about observability, developer tools, and the future of AI infrastructure.

• Design, develop, and maintain scalable backend systems, APIs, and services with a strong focus on performance, reliability, and maintainability.
• Build and enhance full-stack product capabilities using modern frontend and backend technologies, delivering impactful customer-facing features.
• Define technical patterns, best practices, and operational standards that improve engineering quality and scalability across teams.
• Lead complex cross-functional projects, coordinating dependencies and ensuring successful delivery from planning through deployment.
• Collaborate closely with product managers and designers to shape solutions, prioritize initiatives, and align technical decisions with business goals.
• Support production systems through monitoring, troubleshooting, and participation in on-call rotations, ensuring high service reliability.
• Contribute to AI observability infrastructure by helping standardize telemetry models and enabling deeper visibility into AI workloads.
• Mentor engineers, conduct technical reviews, and promote knowledge sharing to elevate overall team effectiveness.

• Extensive experience designing, building, and maintaining backend systems and APIs using Go or comparable programming languages.
• Professional experience delivering full-stack software solutions, including frontend development with React and TypeScript.
• Proven ability to lead large-scale technical projects involving multiple teams, systems, or external dependencies.
• Strong understanding of software architecture, API design, scalability, observability, and production operations.
• Demonstrated ownership mindset with the ability to independently identify problems, drive solutions, and manage projects end-to-end.
• Experience mentoring engineers, leading technical discussions, and improving engineering standards within a team.
• Excellent communication and collaboration skills, with the ability to work effectively across technical and non-technical stakeholders.
• Experience supporting software in production environments and contributing to operational excellence.
• Interest in observability technologies, distributed systems, and AI-powered applications.
• Familiarity with AI-assisted development tools and workflows is considered a plus.

• Competitive salary ranging from approximately $183,340 to $206,000 annually, based on experience and level.
• Equity participation program with employee-friendly ownership opportunities.
• Fully remote work environment with a distributed-first culture.
• Unlimited paid time off to support work-life balance and personal well-being.
• Home office, coworking, and internet reimbursement stipend.
• Comprehensive healthcare coverage, including options for dependents.
• Up to 16 weeks of paid parental leave regardless of family-building path.
• Annual professional development allowance to support learning and career growth.
• Collaborative, inclusive culture that values autonomy, trust, and continuous improvement.
• Additional wellness, financial, and employee support programs.