What is the role of a Senior AI Inference Compiler Engineer at Jobgether?

The Senior AI Inference Compiler Engineer position at Jobgether is a Full-time or part-time position opportunity in the Information Technology field.

Where is this Senior AI Inference Compiler Engineer job located?

United States, Other / Non-US, United States

What type of employment is offered for this Senior AI Inference Compiler Engineer role?

Full-time or part-time position

What is the expected salary for this Senior AI Inference Compiler Engineer job?

Compensation will be discussed during the hiring process.

How can I apply for the Senior AI Inference Compiler Engineer position at Jobgether?

You can apply directly through the application link provided.

Senior AI Inference Compiler Engineer at Jobgether

Senior AI Inference Compiler Engineer

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior AI Inference Compiler Engineer in the United States.

This role offers the opportunity to advance the performance and efficiency of AI inference engines across GPUs, personal devices, robotics, and autonomous systems. You will be instrumental in designing compiler IRs, optimizing kernel generation, and collaborating closely with hardware and deep learning framework teams to deliver cutting-edge inference performance. The position requires deep technical expertise, creativity, and the ability to independently scope and lead development efforts. You will work in a dynamic, high-growth environment where your contributions directly impact the deep learning community and next-generation AI applications. The role emphasizes performance, scalability, and innovation, providing the chance to influence both software and hardware co-design. Strong collaboration and problem-solving skills are essential, as you will partner with multiple teams to implement high-performance solutions. This position is ideal for engineers passionate about compilers, deep learning, and GPU-accelerated AI technologies.

Accountabilities:

Develop compiler intermediate representations (IR), programming models, and optimizations for current and future GPU architectures.
Collaborate with deep learning software framework and hardware architecture teams to accelerate AI inference performance.
Define public APIs, implement compiler optimizations, and generate high-performance kernels for neural networks and other workloads.
Conduct performance analysis, debugging, and testing to ensure optimal execution across platforms.
Lead independent development projects, setting scope, objectives, and technical solutions.
Contribute to the overall evolution of the AI inference compiler, balancing performance, build time, memory footprint, and usability.

Requirements:

Bachelors, Masters, or Ph.D. in Computer Science, Computer Engineering, or related field, or equivalent experience.
3+ years of experience in compiler technologies, performance analysis, and compiler optimizations.
Proficiency in C/C++ and Python, with strong software design, debugging, and test development skills.
Experience with compiler frameworks such as MLIR, XLA, LLVM, or similar.
Ability to work independently, define project goals, and drive development initiatives.
Strong interpersonal and communication skills to collaborate effectively in fast-moving, product-focused teams.
Preferred experience includes understanding deep learning models/frameworks (e.g., PyTorch, XLA), GPU kernel optimization, CUDA/OpenCL programming, LLM inference techniques, and hardware bring-up experience.

Benefits:

Competitive base salary range of $152,000 $241,500 USD, with eligibility for equity and performance-based incentives.
Comprehensive healthcare coverage including medical, dental, and vision.
Paid time off, parental leave, and flexible work arrangements.
Opportunities for professional development, learning, and growth in a high-impact AI environment.
Collaborative and innovative work culture with cutting-edge technology exposure.
Access to wellness programs and resources supporting physical and mental health.

Why Apply Through Jobgether?

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Senior AI Inference Compiler Engineer at Jobgether – United States

About This Position

Scan to Apply

Job Location

Frequently asked questions about this position