Principal Software Engineer - Core GenAI Platform at Jobgether – United States

Principal Software Engineer - Core GenAI Platform

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Principal Software Engineer - Core GenAI Platform in United States.In this role, you will lead the design, development, and strategic direction of a next-generation GenAI platform that supports engineers and business teams alike. You will influence architecture, adoption, and best practices for LLMs, shaping how AI is safely and efficiently integrated across multiple domains. This position combines hands-on engineering with technical leadership, mentorship, and cross-functional collaboration. You will help de-risk ambitious AI initiatives while building scalable, high-impact systems that accelerate productivity and adoption. The environment is fast-paced, innovative, and mission-driven, offering a rare opportunity to define standards, operational practices, and the long-term roadmap for generative AI. Success in this role will directly impact organizational capabilities and the responsible application of AI technologies.Accountabilities:

• Define and drive the multi-year technical roadmap for the Core GenAI Platform, aligning multiple engineering teams around vision and adoption
• Lead the architecture and design of large-scale, mission-critical systems for model inference, orchestration, and compliance
• Identify and mitigate systemic technical risks affecting business-critical AI initiatives
• Build high-leverage, reusable platform components to accelerate engineer productivity and cross-team capabilities
• Mentor senior engineers and cultivate future technical leaders, fostering a culture of learning and excellence
• Collaborate with executive leadership to influence business strategy using technical insight
• Establish operational standards for GenAI integrations, ensuring security, fairness, and reliability at scale
• Represent the organization internally and externally as a thought leader in GenAI systems

Requirements:

• 10+ years of professional software engineering experience, including at least 3 years leading large-scale, cross-team technical initiatives
• Proven ability to deliver complex, distributed systems and platform infrastructure spanning multiple teams
• Deep expertise in backend systems, Kubernetes, Docker, Terraform, and cloud-native architectures
• Experience designing and operationalizing ML/LLM platforms at scale, optimizing for cost, latency, and reliability
• Strong record of setting long-term technical direction and influencing organizational strategy
• Excellent communication skills with experience driving alignment across engineering and business stakeholders
• Preferred: full-stack engineering experience (Python, FastAPI, Kotlin, Spring, React/TypeScript), LLM infrastructure expertise (inference optimization, RAG, vector databases), hands-on experience with LLM toolchains, and familiarity with GenAI risks including hallucinations, fairness, and privacy
• Demonstrated mentoring of senior engineers and shaping organizational operational standards

Benefits:

• Competitive compensation package (base + bonus & equity)
• Comprehensive medical, dental, and vision coverage with HSA contributions
• 401(k) with 100% company match up to $4,500 and immediate vesting
• Employee Stock Purchase Plan (ESPP)
• Life and disability insurance
• Generous holiday, vacation, sick, and safety leave
• Supportive parental, family care, and military leave programs
• Annual wellness, technology, and ergonomic reimbursement programs
• Social activities including team events, all-company updates, ERGs, book clubs, fitness, volunteering, and catered office lunches/snacks when on-site.

Why Apply Through Jobgether?We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.We appreciate your interest and wish you the best! Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1