Search Quality Evaluator

About the Role

Search Quality Evaluator (AI Training)

What if your everyday internet habits and critical thinking could directly improve how AI finds and presents information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that the AI systems people rely on every day are accurate, relevant, and genuinely useful.

This is a fully remote, flexible contract role open to anyone who is comfortable browsing the web and has a sharp eye for quality. Organization: Alignerr. Type: Hourly Contract. Location: Remote. Commitment: 10–40 hours/week.

Responsibilities

• Evaluate search engine results for relevance, accuracy, and overall usefulness to the searcher
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple search results and rank them by quality and helpfulness
• Provide clear, concise written explanations to support your ratings and decisions
• Work through task-based batches independently, at your own pace and on your own schedule

Qualifications

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a methodical, systematic approach to evaluation
• Clear and concise written communicator in English
• Self-motivated and reliable when working independently
• No prior AI, tech, or search industry experience required
• Nice to have: Background in research, journalism, library science, or content evaluation; experience with quality assurance, fact-checking, or critical analysis; familiarity with AI tools or search platforms as an end user; broad general knowledge across a variety of topics

Benefits

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute directly to improving how AI delivers information to people around the world
• Potential for ongoing work and contract extension as new projects launch