Machine Learning Engineer — Training Optimization in Ireland, Scotland at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Machine Learning Engineer — Training Optimization based in Ireland.

This role offers the opportunity to improve the foundations behind large-scale AI model development and deployment.
You will work at the intersection of machine learning research, systems engineering, and production optimization.
The position focuses on making model training faster, more stable, and more cost-efficient through advanced engineering techniques.
You will optimize training pipelines, improve distributed systems, and collaborate with researchers to push model capabilities forward.
This is a high-impact opportunity for an engineer who enjoys solving complex performance challenges at scale.
You will have significant ownership in shaping training infrastructure, experimentation workflows, and the future of AI systems.

As a Machine Learning Engineer focused on Training Optimization, you will improve the efficiency, scalability, and reliability of large-scale model training systems. You will combine deep technical expertise with practical engineering execution to optimize how advanced AI models are developed.

• Optimize large-scale model training pipelines to improve throughput, convergence, stability, and overall computational efficiency.
• Improve distributed training approaches, including data parallelism, model parallelism, and pipeline parallelism strategies.
• Tune key training components such as optimizers, learning rate schedulers, batch sizes, and numerical precision methods including bf16, fp16, and fp8.
• Identify and resolve performance bottlenecks through profiling, system analysis, and infrastructure-level improvements.
• Collaborate closely with research teams to develop architecture-aware training strategies and improve model performance.
• Build and maintain reliable training infrastructure, including checkpointing systems, fault tolerance mechanisms, and reproducible workflows.
• Evaluate and integrate advanced training techniques such as gradient checkpointing, ZeRO, FSDP, and custom optimization solutions.
• Define, monitor, and improve training performance metrics to continuously enhance efficiency.
• Translate research concepts into production-ready systems and scalable engineering solutions.

The ideal candidate is a machine learning engineer with strong experience in training large neural networks and optimizing complex AI systems. You should be comfortable working across research and engineering environments while solving challenging scalability and performance problems.

• Strong experience training large-scale neural networks, including large language models or similarly complex architectures.
• Hands-on experience with machine learning training optimization, beyond simply using existing models.
• Strong understanding of backpropagation, optimization algorithms, training dynamics, and model convergence behavior.
• Experience with distributed machine learning training systems and large-scale computing environments.
• Proficiency with PyTorch and modern machine learning development workflows.
• Ability to work close to hardware constraints, including GPU performance, memory limitations, and networking considerations.
• Strong programming skills with the ability to transform research ideas into reliable production code.
• Experience with multi-node and multi-GPU training environments is highly preferred.
• Familiarity with frameworks and technologies such as DeepSpeed, FSDP, Megatron, or custom training stacks is a plus.
• Experience optimizing workloads on NVIDIA or AMD GPU platforms is beneficial.
• Contributions to open-source machine learning infrastructure or research projects are valued.
• Exposure to alternative neural network architectures beyond Transformers is a plus.

• Competitive compensation package with meaningful equity opportunities.
• Opportunity to work on cutting-edge AI models and large-scale training systems.
• High ownership role where your contributions directly influence technical direction and company growth.
• Collaboration with a small, highly technical team focused on engineering excellence and research innovation.
• Fast feedback loops and an environment that encourages experimentation and impact.
• Opportunity to solve complex machine learning infrastructure challenges at significant scale.
• Strong emphasis on technical quality, continuous learning, and advanced AI development.
• Ability to contribute to foundational systems shaping future AI capabilities.