Attorney and Lawyer

About the Role

In this hourly, remote contractor role, you will work as an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and/or create expert legal content, evaluating reasoning quality and step-by-step issue analysis while providing precise written feedback. Your legal expertise directly helps improve AI models by making their legal reasoning more accurate, reliable, and clearly explained. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs.

Responsibilities

• Review and evaluate AI-generated legal responses for accuracy, clarity, completeness, and adherence to the prompt.
• Identify errors in legal reasoning, rule application, procedural steps, and risk or assumption handling.
• Fact-check legal concepts and, when required, verify citations to primary authority.
• Write high-quality explanations and model answers demonstrating correct legal analysis and clear communication.
• Rate and compare multiple responses based on correctness and reasoning quality.
• Develop AI training content: create detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, memos).
• Optimize AI performance by evaluating and ranking responses to improve correctness, clarity, defensibility, and risk awareness.
• Ensure model integrity by testing outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.

Qualifications

• JD/LLB (or equivalent law degree) and active bar membership or eligibility in at least one jurisdiction.
• 5+ years of professional experience practicing law (law firm, in-house, government, or legal aid).
• Strong ability in issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
• Demonstrated experience in one or more practice areas (examples: commercial/contracts, employment, privacy, corporate, litigation, IP, real estate, compliance).
• Strong research skills: locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
• Excellent drafting/editing skills: contracts/clauses, memos, letters, policies, pleadings as applicable, with attention to precision and tone.
• Exceptional attention to detail when fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks; minimum C1 English proficiency.
• Comfortable evaluating answers for internal consistency, client safety, and appropriateness to context (consumer vs business, HR vs litigation).
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
• Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge-management work is strongly preferred.

Additional Information

• Important: There is no immediate project for this role; however, if qualified, you will be among the first experts contacted when relevant opportunities arise.
• Participation provides access to future projects available through the SME Careers expert network.