Agentic Audio Specialist - Freelance AI Trainer Project

About the Role

A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.

Responsibilities

• Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: Flight bookings and travel support; Financial services; Telecommunications and technical support.
• Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
• Evaluate model performance across a standardized set of qualitative and quantitative metrics.
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Evaluation Metrics

• Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including: Task completion accuracy and efficiency; Conversational naturalness (tone, flow, and coherence); Audio comprehension and response quality; Instruction adherence and contextual understanding.

Qualifications

• Basic computer programming literacy, including understanding of JSON structures, familiarity with functions and methods, and ability to reason about structured data and simple logic.
• Technical communication clarity when handling support-style problem-solving.
• Strong verbal communication skills in a simulated customer support context.
• English proficiency including fluency across reading, listening, writing, and speaking.

Technical & Equipment Requirements

• Access to a high-quality microphone to ensure clean, reliable audio input during evaluations.
• Comfort working with structured prompts, evaluation rubrics, and technical guidelines.
• Device capable of running audio recording software and opening large technical documentation.
• As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Benefits

• Pay range of $11-to- $30.65 per hour, exact rate determined after evaluating experience, expertise, and geographic location.

Additional Information

• Employment type: Contract.
• Workplace type: Remote.
• Seniority level: Mid‑Senior Level.