Medical Doctor (Specialist)

About the Role

In this hourly, remote contractor role you will work as a Medical Doctor (Specialist) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert medical content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. Your healthcare expertise helps improve AI clinical reasoning by making outputs more accurate, reliable, and clearly explained.

Responsibilities

• Create detailed prompts and gold-standard answers across clinical topics aligned to your specialty, ensuring accuracy and appropriate scope.
• Assess AI solutions for accuracy, clarity, safety, and adherence to the prompt, identifying errors in clinical methodology, differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning.
• Evaluate and rank AI responses to enhance correctness, safety, clarity, and contextual relevance; rate and compare multiple responses based on correctness and reasoning quality.
• Fact-check medical information and write high-quality explanations and model solutions that demonstrate correct reasoning.
• Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across use cases and patient populations.

Qualifications

• MD/DO (or equivalent) with completed specialty training (residency/fellowship as applicable) and board eligibility/certification (or local equivalent).
• 5+ years of post-training clinical experience in a specialty setting (hospital, outpatient, academic, or community practice).
• Strong clinical reasoning skills: differential diagnosis, triage, red flags, escalation pathways, guideline-based care, diagnostic pathways, and patient-safety considerations relevant to your specialty.
• Exceptional attention to detail when fact-checking clinical content and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results.
• Minimum C1 English proficiency (comfortable writing precise clinical feedback).
• Comfortable evaluating internal consistency (timelines, physiology, dosing/contraindications), appropriateness for setting (ED vs inpatient vs outpatient), and risk/benefit tradeoffs.
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
• Prior experience with AI data training/annotation, guideline work, utilization review, clinical documentation review, or healthcare editorial QA is strongly preferred.

Additional Information

• This role is with SME Careers, an AI data services company. There is no immediate project; if qualified, you will be among the first experts contacted for relevant opportunities and will gain access to future projects through the expert network.
• Board-certified/board-eligible specialists across many fields are welcome, including but not limited to Internal Medicine, Family Medicine, Emergency Medicine, Pediatrics, OB/GYN, Cardiology, Neurology, Psychiatry, General Surgery, Anesthesiology, Critical Care, Radiology, Oncology, Dermatology, Orthopedics, Gastroenterology, Pulmonology, Nephrology, Endocrinology, Infectious Disease, and Pathology.