[Remote] AI Data Labeling Jobs Brazil
Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring for remote, full-time AI Data Labeling roles focused on training data creation and evaluation workflows for AI/ML systems. The role involves supporting LLM training pipelines and multimodal model development through consistent labeling and review.
Responsibilities
- Label text, image, and/or multimodal data following detailed annotation guidelines
- Perform RLHF tasks such as preference ranking and helpfulness/harmlessness evaluations
- Execute QA evaluation (spot checks, consensus review, error categorization) to improve training data quality
- Conduct prompt evaluation and rubric-based scoring for instruction tuning and LLM evaluation
- Document edge cases, propose clarifications, and contribute to feedback loops that improve model performance
- Support NLP labeling (intent, sentiment, toxicity, topic, summarization quality)
- Perform named entity recognition and entity linking
- Conduct content safety labeling for policy compliance and risk mitigation
- Perform computer vision annotation (bounding boxes, polygons, keypoints)
- Conduct grounding checks, reasoning quality ratings, and refusal/safety assessments
Skills
- Experience in data annotation or QA evaluation in production workflows
- Strong annotation guideline compliance, accuracy, and consistency
- Comfort with structured labeling schemas and rubric-based scoring
- Ability to work independently in a remote environment and meet throughput targets
- Exposure to RLHF, prompt evaluation, LLM evaluation, NER, content safety, or computer vision annotation
- Familiarity with inter-annotator agreement, sampling-based QA, audits, and error analysis
Company Overview