AI Response Quality Evaluator

I am putting together a small team of English-proficient language specialists—ideally those with the depth of insight that comes from being a language professor—to help me judge how naturally two competing AI models handle everyday conversation.

Here is what the assignment looks like day to day: I will send you a real-life prompt along with two anonymous AI answers. You read both, decide which one communicates more clearly and authentically, and then write a concise note (one or two sentences) explaining why it wins. No code review or technical debugging is involved; the whole focus is linguistic quality, tone, coherence, and real-world usefulness.

The project runs for roughly three weeks, and I have set the compensation at $65 per hour. Workload is flexible: you can log in whenever you have a block of time, complete the comparisons assigned to you for that day, and log out—perfect for academics or editors fitting this in around other commitments.

What I’m looking for
• Near-native command of English and an instinct for conversational nuance
• A background that mirrors my own preference for language professors, though seasoned linguists, editors, translators, or similar experts are welcome
• An ability to articulate quick, thoughtful rationales without slipping into jargon

If this sounds like an enjoyable way to put your linguistic expertise to work, please reach out with a brief note about your experience and your earliest availability, and I’ll share a short sample task so you can see exactly how the platform works.