Crossing Hurdles is a recruitment firm. We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-edge AI systems.

Position: Audio Generalist Evaluator Expert

Type: Hourly Contract (Remote)

Compensation: $35 - $40/hour

Location: Remote

Duration: Flexible (10–40 hrs/week, 1-2 months, extension feasible)

Requirements

1. Strong writing and critical thinking skills.
2. Familiarity with Chat-GPT or similar tools for personal decision-making or hobbies / general interests
3. Strong attention to detail and ability to follow precise guidelines
4. Breaking down complex concepts into well-crafted text
5. Prior teaching or research experience is an advantage, though not mandatory

Role (Training support will be provided)

1. Design and Optimize Prompts - Create detailed audio prompts with multiple constraints and instructions.
2. Define and Document Evaluation Standards - Establish high-level expectations for correct responses in general audio consumer contexts, and develop comprehensive rubric.
3. Conduct Model Testing and Grading - Run prompts through models and assess preliminary outputs against expectations.
4. Support Benchmarking and Quality Assurance - Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

Application Process

1. Upload resume
2. Participate in AI interview (10 min)
3. Written task might be allocated
4. Submit form

PS - This is an urgent position, hence recommending to apply asap.

Are you looking for remote jobs near your area? At Yulys, thousands of employers are looking for exceptional talent like yours. Find a perfect job now.