Senior Data Annotator Jobs in London
<strong>Senior Data Annotator (Remote, Full-time)<br><br></strong>Join Rex.zone to produce high-quality training data for AI/ML systems. You will lead annotation workstreams for LLM training pipelines, generating gold-standard labels, RLHF preference data, and QA evaluation outputs to improve downstream model performance across NLP, computer vision, and content safety workflows.<br><br><strong>What You Will Do<br><br></strong><ul><li>Execute and review data annotation tasks across text, image, and multimodal datasets</li><li>Create and refine labeling taxonomies, edge-case definitions, and decision rubrics</li><li>Perform RLHF preference ranking, pairwise comparisons, and rubric-based scoring</li><li>Run QA evaluation, error analysis, and inter-annotator agreement checks</li><li>Complete prompt evaluation for instruction-following, helpfulness, and harmlessness</li><li>Label and validate named entity recognition datasets and entity linking rules</li><li>Contribute to content safety labeling (toxicity, self-harm, hate, policy compliance)</li><li>Maintain annotation guidelines compliance documentation and change logs</li><li>Collaborate with engineering and data operations to improve tooling and throughput<br><br></li></ul><strong>Requirements<br><br></strong><ul><li>Mid-senior experience in data annotation, data labeling, or AI/ML evaluation</li><li>Experience with RLHF workflows and rubric-based evaluation</li><li>Strong writing and reasoning skills for LLM evaluation and prompt evaluation</li><li>Comfort with QA evaluation methods (sampling, audits, consistency checks)</li><li>Familiarity with structured schemas such as named entity recognition</li><li>Ability to work independently in a remote environment with high attention to detail<br><br></li></ul><strong>Success Metrics<br><br></strong><ul><li>Improved training data quality (audit pass rates, lower defect rates)</li><li>High agreement and stable calibration across annotators/reviewers</li><li>Clear documentation of edge cases, rubric updates, and QA outcomes<br><br></li></ul><strong>Pay<br><br></strong>$30–$50 per hour (base pay; rate depends on skills and experience).