Andromeda Sadiradra - Audio Rater - Generalist - English (New Zealand)

Welo Global is growing its Welo Data community with a focused role for someone who loves listening closely and judging responses with care. The position is for an Audio Rater who will evaluate conversations between users and AI voice agents, focusing on how helpful and how natural the AI responses are. The work is done remotely from New Zealand, and it’s a good fit if you enjoy precise assessment and writing concise explanations for your ratings.

The project moves quickly, starting ASAP, and is designed as a freelance engagement. You’ll be contributing about 10 hours each week, working in English. If you’re comfortable working independently, delivering thoughtful evaluations, and keeping notes clear for others to follow, this could be a solid match.

What you’ll do on a typical day

In this role you’ll listen to recorded exchanges between a user and an AI voice agent and judge how well the agent responds. You’ll rate each turn on two independent scales, 1 to 5, looking at the substance of the reply and the way it’s delivered, content and prosody. For every scoring decision you’ll add a short, specific justification that explains why you gave that score, so the reasoning is transparent and repeatable.

To keep outcomes consistent, you’ll treat each evaluation with the same level of scrutiny, applying the same criteria across sessions and turns. You’ll document your judgments clearly so others can follow your thought process, and you’ll stay aligned with the project’s timing and quota requirements as you work through the recorded material.

Must-have requirements, and nice-to-haves

• Keen listening skills paired with strong attention to detail
• Ability to produce consistent, well-supported ratings
• Clear and concise written communication
• Reliable availability for about 10 hours per week

Nice-to-haves: none specified beyond the must-haves.

Pay, benefits and practical details

The engagement is remote and based in New Zealand, with an ASAP start. It is a freelance role requiring around 10 hours of work each week, conducted in English. The pay rate for this position is $22.10 per hour.

Advice for applicants

Highlight on your resume that you excel at careful listening, attention to detail, and clear written explanations. If you’ve done audio evaluation or similar scoring work before, give a concrete example of how you approached a turn, what you looked for, and how you justified your score.

Demonstrate how you would handle the two 1–5 scales by outlining a short example of how you’d rate a turn and what a justification might look like. Include a sample phrasing that shows you can separate content quality from prosody, and explain why you chose those scores in a concise sentence or two.

Be ready to discuss how you’d manage a 10-hour-per-week freelance schedule, including how you block time, stay organized, and maintain consistency across multiple conversations. If asked to calibrate with a sample clip, have in mind how you’d document your reasoning so the team can calibrate with you.

When you ask a question in the interview, focus on the scoring process and calibration. A smart query is to ask for a sample turn and the expected style of the justification, plus whether there’s a standard rubric or exemplar ratings you should align with.