R

Remote STEM Jobs in Canada

Accepting applications

Rex.zone · California, United States

Full-Time Mid_senior AIaiarmatementor
Posted
1 May
Category
Test
Experience
Mid_senior
Country
United States
Remote STEM Jobs in Canada (Full Time)

Rex.zone connects mid-senior engineers and STEM professionals to real-world AI/ML training workflows, including LLM evaluation, RLHF-style preference ranking, data labeling, QA evaluation, and prompt evaluation. You will help improve model performance by producing and reviewing high-quality training data and enforcing annotation guidelines compliance.

What You Will Do

Contribute to training data quality through labeling, review, and adjudication
Perform RLHF-style preference ranking and helpfulness/harmlessness evaluations
Execute prompt evaluation and response grading for large language model evaluation
Apply annotation guidelines, document edge cases, and support rubric adherence
Run QA evaluation workflows, track defects, and recommend process improvements
Support NLP tasks (e.g., named entity recognition, taxonomy tagging)
Support computer vision annotation (e.g., bounding boxes, polygons, classification)
Support content safety labeling (policy categories, risk scoring, refusals)
Collaborate with teams across AI labs, tech startups, annotation vendors, and BPO operations

Required Qualifications

Mid-senior experience in STEM or engineering
Strong analytical writing and attention to detail for evaluation rubrics
Familiarity with AI/ML concepts, LLM behavior, and model failure modes
Experience with data labeling, QA evaluation, or guideline-driven review
Ability to work full-time remotely with reliable internet and secure work practices

Preferred Qualifications

Exposure to RLHF, prompt evaluation, and rubric-based grading
Experience with NLP and/or computer vision annotation
Experience with content safety labeling and policy enforcement
Comfort using annotation platforms, spreadsheets, and issue trackers
Ability to mentor peers on annotation guidelines compliance and training data quality

How To Apply

Apply via Rex.zone and highlight your STEM/engineering background, guideline-driven work, and examples that improved training data quality or model performance.
Show more Show less