Can I apply directly for this job on this page?

Yes, you can begin your application on this page using a quick form. You'll then be redirected to the employer's career site to complete the full application process.

What is the role of a Technical Director - Mainframe AI Infrastructure at Jobgether?

The Technical Director - Mainframe AI Infrastructure position at Jobgether is a Full-time or part-time position opportunity in the Professional Services field.

What type of employment is offered for this Technical Director - Mainframe AI Infrastructure role?

Full-time or part-time position

What is the expected salary for this Technical Director - Mainframe AI Infrastructure job?

Compensation will be discussed during the hiring process.

Technical Director - Mainframe AI Infrastructure job near me in United States, Other / Non-US at Jobgether | Jobs and Employment

Technical Director - Mainframe AI Infrastructure

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Technical Director - Mainframe AI Infrastructure in United States.

This role sits at the intersection of AI innovation and enterprise mainframe modernization, leading the technical strategy for next-generation, AI-powered capabilities across large-scale infrastructure environments. You will shape how intelligent systems are designed, built, and deployed within complex enterprise software ecosystems, with a strong focus on production-grade LLM and agentic architectures. Acting as a hands-on technical leader, you will translate product vision into scalable engineering execution while ensuring reliability, safety, and measurable business impact. The position requires deep expertise in AI systems, distributed architecture, and enterprise platforms, combined with strong product thinking and leadership capabilities. You will collaborate closely with product, engineering, and go-to-market teams to deliver meaningful customer outcomes. This is a high-impact leadership role driving both technical excellence and AI transformation at scale.

Accountabilities:

Define and execute the AI technical strategy for mainframe and infrastructure modernization initiatives, translating it into actionable roadmaps, OKRs, and delivery milestones aligned with business priorities.
Lead architecture design for LLM-based and agentic systems, including orchestration, retrieval-augmented generation, tool usage, memory, security, observability, and scalable production deployment.
Drive delivery of AI-native product experiences by partnering with engineering teams to prioritize use cases, iterate quickly, and ensure high-impact, user-centered solutions.
Establish strong safety, reliability, and evaluation frameworks for AI systems, including monitoring tools, guardrails, and continuous improvement mechanisms.
Develop reusable engineering standards, libraries, and best practices for AI development, including prompt engineering, evaluation frameworks, and human-in-the-loop workflows.
Lead and grow high-performing, inclusive engineering teams by mentoring managers and ICs, supporting hiring, and fostering a culture of ownership and psychological safety.
Partner cross-functionally with product, support, customer success, and GTM teams to ensure successful rollout, adoption, and continuous feedback loops for AI capabilities.
Define and own key success metrics such as adoption, system reliability, performance, and developer velocity, using insights to guide investment and prioritization.
Collaborate on complex, cross-platform initiatives involving enterprise-scale systems to ensure technical feasibility, ROI, and architectural integrity.

Requirements:

15+ years of software engineering experience, including extensive leadership of multiple engineering teams and managers in cloud and enterprise/mainframe environments.
Deep hands-on experience with modern AI systems, including large language models, retrieval-augmented generation, agentic workflows, tool/function calling, and evaluation systems.
Strong background in designing scalable distributed systems, with experience operating in complex, multi-product environments with clear ownership boundaries.
Proven ability to think at both systems level and product level, connecting technical architecture with real customer workflows and business outcomes.
Experience building and scaling high-performing, inclusive engineering organizations, including hiring, mentoring, and developing technical leaders.
Strong communication skills with the ability to translate complex AI and system concepts into clear, actionable narratives for technical and non-technical stakeholders.
Experience working in fast-paced, globally distributed, remote-first environments across multiple time zones.
Demonstrated use of AI-first development practices, including experimentation with agentic coding workflows and AI-assisted engineering processes.
Familiarity with experimentation frameworks, offline evaluation, and human review loops to continuously improve AI system performance.
Strong adaptability and resilience, with the ability to lead through ambiguity and drive clarity in evolving technical landscapes.

Benefits:

Competitive annual salary range: $161,000 - $225,400 gross per year
Unlimited vacation policy, plus paid holidays and sick leave
Comprehensive health, wellness, life, and disability insurance coverage for employees and dependents
401(k) and Roth retirement savings plans with company matching contributions
Monthly student loan repayment assistance program
Tuition and certification reimbursement programs
Access to leadership development and technical training opportunities
Flexible remote-first work environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Technical Director - Mainframe AI Infrastructure in United States at Jobgether

Explore Related Opportunities

Job Description

Scan to Apply

Job Location

Frequently asked questions about this position