AI Infrastructure Architect in at LeoTech
Explore Related Opportunities
Job Description
Leo Technologies is building frontier AI and data science capabilities for law enforcement agencies, federal corrections, and counterintelligence programs. Our flagship product, Verus Voice, is established as the premium solution in our market. As our AI workloads scale in volume, sensitivity, and mission criticality, we are seeking an Architect, AI Infrastructure to design and own the compute, data, and deployment backbone that everything else runs on.
This is an operator-level role, not a caretaker role. You will set the technical direction for our AI infrastructure, make consequential architectural calls, and be given the authority to act on them.
ABOUT THE MISSION
Our AI and Data Science team builds the analytical infrastructure that authorized agencies depend on to protect national security and public safety. The infrastructure you architect will directly support:
• Training, fine-tuning, and serving agentic AI models that automate and augment investigative workflows for law enforcement and counterintelligence units.
• High-volume ingestion, processing, and analysis pipelines for communications data — mail, messages, and phone calls — for federal corrections facilities, including maximum-security prisons housing high-value targets.
• Secure, compliant deployments across additional authorized agencies under appropriate legal frameworks; you will be fully read in on applicable programs and must be eligible for TS/SCI clearance.
• Onsite and customer-side environments, in close partnership with DevOps personnel embedded at agency sites, to ensure seamless system integration and sustained mission success.
Requirements:WHAT YOU WILL OWN
Infrastructure Architecture & Engineering
• Define, own, and evolve the end-to-end architecture for AI/ML infrastructure: GPU compute, model training and inference platforms, data pipelines, storage, and networking.
• Design for the full range of deployment targets — cloud, on-premise, and air-gapped or disconnected agency environments — with a single coherent architecture and codebase.
• Set technical standards for infrastructure-as-code, CI/CD, observability, and platform engineering practices across internal and external development teams.
• Own capacity planning, performance engineering, and cost efficiency for AI workloads as data volumes and model complexity scale.
• Evaluate and select core infrastructure technologies, and make build-vs-buy decisions with clear-eyed accounting of mission, security, and compliance constraints.
Reliability, Security & Compliance
• Architect for mission-grade reliability: define SLOs, failure domains, redundancy, and disaster recovery for systems agencies depend on operationally.
• Embed security into the architecture from the ground up — zero-trust patterns, encryption in transit and at rest, least-privilege access, and full auditability of sensitive data flows.
• Ensure infrastructure designs meet or exceed applicable compliance frameworks (CJIS, FedRAMP, and related federal requirements), and partner with compliance stakeholders through audits and authorizations.
• Establish incident response, escalation, and postmortem practices in partnership with DevOps and SRE personnel.
Cross-Functional Integration
• Serve as the connective tissue between internal AI/Data Science engineering, the external dev team, onsite DevOps, and agency technical stakeholders on all infrastructure matters.
• Translate roadmap priorities from product leadership into infrastructure investments, sequencing platform work so it lands ahead of product need rather than behind it.
• Maintain clear, accurate architecture documentation and ensure all parties operate from a single source of truth.
• Mentor engineers across the organization on infrastructure best practices, and partner with leadership to develop the platform capabilities the mission requires.
QUALIFICATIONS
Required
• Active TS/SCI clearance, or the demonstrated background to obtain one (clearance sponsorship is provided for the right candidate).
• 10+ years in infrastructure, platform, or site reliability engineering, with at least 3 years in an architect or technical leadership role.
• Demonstrated experience architecting infrastructure for AI/ML workloads: GPU clusters, model training and serving platforms, and large-scale data pipelines.
• Deep hands-on expertise with Kubernetes, infrastructure-as-code (Terraform or equivalent), and at least one major cloud provider, plus real experience with on-premise or hybrid deployments.
• Track record designing systems for high-security, high-compliance environments, and holding external teams or vendors accountable to architectural standards.
• Comfortable operating with ambiguity and driving decisions in a fast-moving, mission-driven organization.
• Exceptional written and verbal communication; ability to brief non-technical agency stakeholders and highly technical engineers in the same week.
Preferred
• Prior experience working with or inside federal law enforcement, intelligence community, Department of Defense, or corrections programs.
• Familiarity with the govtech compliance landscape (CJIS, FedRAMP, IL4/IL5, NIST 800-53) and experience carrying systems through authorization processes.
• Experience deploying and operating AI systems in air-gapped, disconnected, or bandwidth-constrained environments.
• Background with speech analytics, NLP, or LLM inference infrastructure at production scale.
• Experience in a startup or growth-stage company where the platform is shaped by the person in the seat, not inherited.
This organization is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, disability, or veteran status. This position requires U.S. citizenship and is subject to government security investigation.