CJ
Bilingual AI Response Evaluator
Accepting applicationsChatGPT Jobs · New York, NY
Full-Time Mid AIMachine Learningaiaterf
Posted
3d ago
Category
Test
Experience
Mid
Country
United States
Job Description
Generalist - English & Russian
Company: Mercor
Location: Remote (New York, NY)
Type: Contract
Compensation: $25–$40/hour
Demographics
Role Responsibilities
Conduct fact-checking using trusted public sources and external tools.
Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
Assess reasoning quality, clarity, tone, and completeness of responses.
Ensure model responses align with expected conversational behavior and system guidelines.
Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
Must-Have:
Bachelor's degree
Native speaker in Russian
Significant experience using large language models
Excellent writing skills in English
Strong attention to detail
Background or experience in domains requiring structured analytical thinking
Preferred
Experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high-quality written content
Experience comparing multiple outputs and making fine-grained qualitative judgments
Application Process (20–30 mins)
Upload resume
AI interview based on your resume
Submit form
For details: talent.docs.mercor.com/welcome | Support: support@mercor.com
Machine Learning & Artificial Intelligence
Show more Show less
Generalist - English & Russian
Company: Mercor
Location: Remote (New York, NY)
Type: Contract
Compensation: $25–$40/hour
Demographics
Role Responsibilities
Conduct fact-checking using trusted public sources and external tools.
Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
Assess reasoning quality, clarity, tone, and completeness of responses.
Ensure model responses align with expected conversational behavior and system guidelines.
Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
Must-Have:
Bachelor's degree
Native speaker in Russian
Significant experience using large language models
Excellent writing skills in English
Strong attention to detail
Background or experience in domains requiring structured analytical thinking
Preferred
Experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high-quality written content
Experience comparing multiple outputs and making fine-grained qualitative judgments
Application Process (20–30 mins)
Upload resume
AI interview based on your resume
Submit form
For details: talent.docs.mercor.com/welcome | Support: support@mercor.com
Machine Learning & Artificial Intelligence
Show more Show less