Member of Technical Staff, Reinforcement Learning in San Mateo, California at Inception
Employment Type: Full-Time
Inception
San Mateo, California, United States
Posted on
Explore Related Opportunities
Math and Computer Science Teachers, Postsecondary jobs near me in CaliforniaJobs near me in CaliforniaMath and Computer Science Teachers, Postsecondary jobs
Job Description
The Role
We seek experienced scientists and engineers with deep expertise in post-training large language models through reinforcement learning. You will design and implement RL training pipelines for our diffusion LLMs, develop reward modeling strategies, and build the algorithms that align model behavior with human intent at scale.
Key Responsibilities
- Design, develop, and optimize RL training pipelines (PPO, DPO, RLHF, and novel approaches) for diffusion-based LLMs.
- Build and iterate on reward models, reward shaping strategies, and evaluation of reward quality.
- Implement innovative approaches for fine-tuning and scaling generative AI models.
- Work on data preprocessing pipelines, model evaluation, and alignment to enterprise use cases.
- Research and implement techniques for controlled text generation and constraint satisfaction.
- Improve training stability, efficiency, and reproducibility of RL workloads.
Qualifications
- BS/MS/PhD in Computer Science or a related field (or equivalent experience).
- At least 2 years of experience working on ML projects in PyTorch (or equivalent), preferably in a research lab or engineering role.
- Excellent familiarity with transformers and core LLM concepts (autoregressive pretraining, instruction tuning, in-context learning, KV caching).
- Hands-on experience with reinforcement learning from human feedback (RLHF), PPO, DPO, or related post-training methods.
- Familiarity with training and inference in diffusion models.
- Experience training deep learning models at scale in distributed computing environments.
Preferred Skills
- Extensive experience training transformer-based language models from scratch.
- Experience designing and implementing reward models or preference learning systems.
- Knowledge of advanced training techniques (mixed precision, gradient accumulation, etc.).
- Background in optimization theory and neural network architecture design.
- Experience with LLM serving frameworks like vLLM, SGLang, or TensorRT.
Scan to Apply
Just scan this QR code to apply from your phone.
Job Location
San Mateo, California, United States
Frequently asked questions about this position
Continue to apply
Enter your email to continue. You’ll be redirected to the employer’s application.By clicking Continue, you understand and agree to JobTarget's Terms of Use and Privacy Policy.