Ruby Engineer

About the Role

As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code or generate your own solutions, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for readability, maintainability, and correctness; identify errors in MVC structure, domain modeling, or control flow; fact-check information; write high-quality explanations and model solutions that demonstrate idiomatic Ruby patterns; and rate and compare multiple AI responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, and your work will directly help improve the world’s premier AI models while giving you the flexibility of impactful, detail-oriented remote contract work.

Responsibilities

• Review AI-generated Ruby and Rails code and/or produce original Ruby/Rails solutions.
• Evaluate reasoning quality, step-by-step problem-solving, and correctness of AI responses.
• Assess readability, maintainability, and logical correctness across models, controllers, services, and domain modeling.
• Identify errors in MVC structure, domain modeling, control flow, and other architectural or implementation issues.
• Fact-check information in code comments, examples, and explanations.
• Write clear, structured, pedagogical technical explanations and model solutions demonstrating idiomatic Ruby patterns.
• Rate and compare multiple AI responses to improve model accuracy, fluency, and contextual relevance.
• Create detailed prompts and training content to guide AI learning across diverse topics.
• Test models for potential inaccuracies or biases and validate reliability across use cases.

Qualifications

• 1–2+ years of professional Ruby programming experience in production environments.
• Strong understanding of Ruby on Rails, MVC architecture, and idiomatic Ruby patterns for structuring application code.
• Hands-on software engineering experience building and maintaining Ruby or Rails applications with exposure to real-world production constraints.
• Ability to evaluate readability, maintainability, and logical correctness in Ruby and Rails code, including model, controller, and service-layer design.
• Significant experience using LLMs or AI coding assistants while programming, with a disciplined approach to validating and reviewing their output.
• Excellent English writing skills, capable of producing clear, structured, and pedagogical technical explanations and code reviews.
• Minimum Bachelor’s degree in Computer Science or a closely related technical field.
• Previous experience with AI data training, large-scale code review, or evaluation of AI-generated technical content is strongly preferred.
• Minimum C1 English proficiency and an extremely detail-oriented working style are required.
• Highly preferred: experience with frameworks and tools such as Ruby on Rails, Sinatra, and RSpec in real projects.
• Preferred: merged PRs in Ruby open-source projects, experience with metaprogramming or test-heavy systems, and competitive programming exposure.

Additional Information

• There is no immediate project for this role; however, if qualified, you will be among the first experts contacted when relevant opportunities arise.
• Joining the expert network provides access to future projects available through SME Careers.