Software Engineer, AI (Ruby) at Jobgether – United States
Explore Related Opportunities
About This Position
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Software Engineer, AI (Ruby) in the United States.
This role focuses on improving the quality of large language models by contributing high-signal engineering feedback that directly shapes how AI systems generate and refine production-level code. You will work in a highly analytical, detail-driven environment where your software engineering expertise is used to evaluate, correct, and improve AI-generated outputs across a variety of programming languages, with a strong emphasis on Ruby. The work is centered on code reasoning, review, and structured feedback rather than traditional feature development. You will play a key role in helping models learn to write cleaner, safer, and more efficient code by applying real-world engineering judgment. The environment is remote, flexible, and asynchronous, requiring strong autonomy and communication skills. This is an opportunity to directly influence the evolution of AI coding capabilities while working at the intersection of software engineering and machine learning feedback systems.
In this role, you will help train and improve AI models by providing expert-level software engineering evaluation and feedback on generated code. Your responsibilities include:
- Reviewing, comparing, and ranking multiple AI-generated code solutions, clearly explaining trade-offs in correctness, performance, and design.
- Repairing, refactoring, and improving code snippets to meet production-quality standards across Ruby and other languages.
- Identifying logic errors, security issues, performance bottlenecks, and style inconsistencies in generated outputs.
- Providing structured, high-quality written feedback that helps guide model learning and improvement.
- Contributing to reinforcement learning from human feedback (RLHF) workflows by labeling, editing, and validating outputs.
- Ensuring consistency and accuracy in evaluations to support reliable model training signals.
- Working asynchronously while independently managing tasks and adhering to quality guidelines.
The ideal candidate is an experienced software engineer with strong code review instincts and exceptional attention to detail. You should be comfortable working independently in a structured but low-oversight environment and be able to clearly articulate technical reasoning in writing. Key qualifications include:
- 3+ years of professional software engineering experience, with strong expertise in Ruby.
- Strong ability to review and critique code for correctness, efficiency, maintainability, and security.
- Excellent written communication skills, with the ability to clearly justify technical decisions.
- Strong analytical thinking and attention to detail when evaluating complex code scenarios.
- Comfort working asynchronously and independently in a remote contractor environment.
- Ability to read and interpret technical documentation and programming language specifications.
- No prior AI/ML or RLHF experience required, but curiosity about AI systems is beneficial.
- Fully remote work with global flexibility (within approved contractor locations).
- Competitive hourly compensation ranging from $30–$70/hr, depending on experience and project type.
- Flexible scheduling with a minimum of 15 hours per week and potential for 40+ hours depending on availability.
- Opportunity to directly contribute to cutting-edge AI model training and improvement.
- Weekly payments via PayPal or Stripe.
- Exposure to advanced AI development workflows without requiring prior machine learning experience.