Software & AI Architect in New York at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software & AI Architect based in United States.

This is a high-impact, hands-on architecture role responsible for shaping the technical foundation of an AI-native enterprise software platform.
You’ll own architecture across core software, AI capabilities, development workflows, infrastructure, security, and governance.
The role combines strategic influence with deep technical execution, requiring you to write code, prototype solutions, and ship production systems.
You’ll help define where AI can create measurable customer and business value, while building scalable capabilities around LLMs, agents, and intelligent workflows.
Working closely with product, engineering, and executive leadership, you’ll translate complex technical decisions into clear priorities and measurable outcomes.
The environment is fast-moving and growth-oriented, with significant autonomy to establish new systems and prove their value before scaling them into dedicated teams.
This is an opportunity for an experienced architect who thrives on ambiguity, values building over presenting, and wants to shape the future of enterprise AI.

• Own the end-to-end technical architecture of the product portfolio, making decisions that support scalability, security, reliability, performance, and rapid product evolution.
• Establish engineering standards and architectural practices appropriate for enterprise, federal, and international customers handling sensitive financial and operational data.
• Define the organization’s AI strategy and roadmap, identifying opportunities where AI can deliver meaningful customer or business outcomes and prioritizing initiatives based on measurable value.
• Design and build AI-native product capabilities, including agentic functionality, LLM-based workflows, retrieval-augmented generation, model orchestration, prompt and agent architectures, and evaluation frameworks.
• Develop and operate an AI-driven development lifecycle that helps engineering teams move efficiently from concepts to production-ready software.
• Build and validate technical solutions directly within the codebase, using working prototypes and production systems to demonstrate the value of new architectural and AI initiatives.
• Own the technical foundation for responsible AI adoption, including model and vendor evaluation, data handling, access controls, security guardrails, and integration standards.
• Collaborate with internal AI adoption stakeholders to establish the infrastructure and controls required for secure, company-wide use of AI technologies.
• Operate as an individual contributor initially, taking ownership of architecture and AI initiatives while identifying when proven solutions warrant dedicated teams and additional investment.
• Partner with executive and engineering leadership on technology and AI investment decisions, connecting initiatives to measurable outcomes such as adoption, development velocity, cost efficiency, or revenue.
• Communicate initiative progress through clear metrics, transparent status reporting, and evidence-based recommendations.
• Build toward scalable or standalone SaaS architecture where appropriate, reducing unnecessary dependency on individual platforms while preserving enterprise-grade capabilities.

• 8+ years of software engineering or architecture experience, including direct responsibility for designing and shipping production systems at scale.
• 3+ years of experience leading or contributing to teams in AI-native environments, with strong expertise in LLMs, RAG, agentic systems, and multi-agent architectures.
• Demonstrated hands-on software architecture experience, including ownership and evolution of production platform architecture rather than solely reviewing other teams’ designs.
• Proven hands-on AI architecture experience involving production LLM tooling, agentic workflows, and AI-native product capabilities.
• Direct experience within the ServiceNow ecosystem, ideally including hands-on architecture of ServiceNow applications rather than only external integrations.
• Experience launching systems, initiatives, or technical functions from the ground up without an established team or playbook.
• Strong ability to operate as a hands-on individual contributor while possessing the leadership range to recruit and build a team as initiatives mature.
• Deep engineering fluency, including the ability to write and review code and make informed architectural and technical trade-offs across conventional software and AI-native systems.
• Working knowledge of enterprise security, data governance, AI safety, access management, and technical guardrails applicable to enterprise, federal, and international environments.
• Strong executive communication skills, with the ability to translate technical complexity and trade-offs into actionable business decisions.
• A strong bias toward execution, experimentation, and measurable results rather than presentation-driven progress.
• Sound judgment and adaptability when operating in ambiguous environments where architecture and AI strategy are still being established.
• Bachelor’s degree in computer science, engineering, or a related discipline, or equivalent professional experience.
• Experience in IT Financial Management (ITFM), Technology Expense Management (TEM), FinOps, or enterprise IT cost management is preferred.
• Experience architecting beyond a single platform dependency and developing paths toward decoupled or standalone SaaS solutions is advantageous.
• Familiarity with FedRAMP or other federal SaaS compliance frameworks is a plus.
• Experience in a private-equity-backed or high-growth SaaS environment is preferred.
• Experience establishing technical foundations for company-wide AI adoption, including security guardrails, access management, or AI tooling standards, is highly desirable.
• Must be US-based and comfortable working remotely in a remote-first environment.

• Competitive total compensation with a salary range of $200,000–$240,000 OTE.
• Comprehensive health, dental, and vision insurance.
• Paid time off with an emphasis on work-life balance and taking time away from work.
• 401(k) plan with employer matching.
• Remote-first working environment for US-based employees.
• Opportunity to shape enterprise AI architecture and technical strategy at a growth-stage organization.
• Significant autonomy and ownership over new technology initiatives and architectural direction.
• Opportunity to build and eventually lead a technical team as initiatives scale.
• Work on AI, software architecture, security, and enterprise technology challenges with direct executive visibility.
• Full-time, US-exempt position.