Teams at Cohere AI

As a Data Annotation Specialist, you'll label, audit, and correct machine learning data while ensuring high accuracy in Japanese. You'll also evaluate responses and recommend optimizations based on project guidelines.

Label, rank, audit, and refine human- and model-generated text to improve LLM safety and policy alignment. Apply nuanced safety guidelines, create adversarial prompts and test cases, identify annotation inconsistencies, and provide feedback. Work independently in a remote, asynchronous team, handling potentially explicit or disturbing content with high attention to detail and consistency.

Evaluate and label model-generated and human-written software engineering outputs for coding, debugging, and codebase-related tasks. Assess agent trajectories, prompt models for complex coding tasks, proofread and improve responses, and report quality and performance trends. Part-time contractor role contributing to model development.