Principal Software Engineer, AI in United States at Jobgether
Explore Related Opportunities
Job Description
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Principal Software Engineer, AI in the United States.
You will join a high-impact AI Platform organization building the next generation of enterprise revenue intelligence systems powered by real-time data and advanced AI.
This role focuses on designing and evolving a critical AI Context Layer that enables intelligent agents to access high-quality, governed enterprise knowledge.
You will work across multiple engineering teams to translate product needs into scalable platform capabilities and data systems.
Your work will span knowledge graphs, retrieval systems, RAG architectures, and AI-ready data infrastructure at enterprise scale.
You will define how context is modeled, secured, and served to AI systems through robust APIs, SDKs, and platform services.
This is a highly cross-functional, technical leadership role with significant influence over architecture, strategy, and AI platform direction.
- Lead the design and evolution of an AI Context Layer that powers retrieval, knowledge, and reasoning capabilities for enterprise AI systems.
- Collaborate with feature teams to understand context requirements and translate them into scalable platform capabilities and data products.
- Architect and build core systems including knowledge graphs, retrieval pipelines, RAG infrastructure, and search services.
- Define and implement access control, RBAC models, and governance frameworks for secure, multi-tenant AI data usage.
- Design and maintain developer-facing APIs, SDKs, and interfaces to ensure usability, scalability, and adoption across engineering teams.
- Partner with data engineering to ensure reliable, high-quality data pipelines and infrastructure alignment.
- Drive technical standards through architecture reviews, design discussions, and code reviews across multiple teams.
- Ensure data governance, lineage, and auditability requirements are met across all AI context systems.
- Contribute to hiring, onboarding, and internal enablement to scale platform adoption and team capability.
- 12+ years of software engineering experience, with strong focus on data platforms, search, or retrieval systems.
- Proven experience building production-grade knowledge graphs, search systems, or large-scale retrieval architectures.
- Deep expertise in RAG systems, vector databases, embeddings, and relevance tuning techniques.
- Strong understanding of multi-tenant access control, RBAC design, and secure data architecture tradeoffs.
- Experience designing developer platforms, APIs, and SDKs with strong adoption and usability outcomes.
- Solid background in data governance, lineage, security, and auditability in enterprise environments.
- Proven ability to lead cross-team technical strategy and deliver complex, distributed platform systems.
- Proficiency in Python and/or Java, with experience across backend systems and data infrastructure.
- Excellent communication and collaboration skills across engineering, product, and leadership stakeholders.
- Remote-first role within the United States
- Competitive base salary (range: $1 – $100,000 USD) with potential performance-based bonuses
- Comprehensive healthcare coverage and wellness support (where applicable)
- Flexible work environment supporting autonomy and work-life balance
- Opportunity to work on cutting-edge AI systems at enterprise scale
- High-impact role with significant technical ownership and leadership visibility
- Inclusive, collaborative engineering culture focused on innovation and continuous learning
- Career growth opportunities within a fast-evolving AI and data platform organization.