Welo Global Logo

Welo Global

Project Perseus | Data Labeling Associate - Portuguese (Brazil) Speakers (Human-in-the-Loop AI)

Posted 3 Months Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Metropolitan Area Apt, ON, CAN
Junior
In-Office or Remote
Hiring Remotely in Metropolitan Area Apt, ON, CAN
Junior
Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.
The summary above was generated by AI

Overview

Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.

This is not a traditional annotation role.

You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.

We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.

Project Details

  • Job Title: Data Labeling Associate
  • Hiring in: Onsite (Bay Area, Seattle, NYC, or client-dependent) 
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
  • Pay Rate: $34/hour

Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin. Please only apply if you meet this location requirement.

 

What You’ll Do

  • Evaluate AI model outputs and provide structured, high-quality feedback
  • Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
  • Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
  • Contribute to improving evaluation frameworks, not just executing them
  • Identify trends in model performance and communicate insights clearly
  • Participate in team discussions, calibrations, and stakeholder syncs
  • Partner with leads and cross-functional teams to refine quality standards
  • Document findings in a clear, concise, and actionable way

What We’re Looking For

  • Native-level Portuguese (Brazil) proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.  
  • 1–2 years of professional writing experience with strong, structured writing skills
  • Ability to apply complex writing rules and guidelines consistently
  • Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
  • Strong critical thinking and attention to detail
  • Ability to make sound judgment calls in ambiguous situations
  • Naturally curious about AI, technology, and how systems behave
  • Comfortable speaking up, asking questions, and contributing ideas
  • Strong written and verbal communication skills
  • Ability to stay consistent while working with evolving guidelines
  • Experience in data quality, QA, annotation, or analysis is helpful — but not required

Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.

Similar Jobs

37 Minutes Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Machine Learning
Leads the Launch and Sandboxes engineering team building cloud execution environments, job submission services, compute orchestration, and HPC integrations. Owns roadmap delivery, architecture, reliability, technical debt, customer outcomes, and cross-team coordination. Develops engineers into autonomous leaders while maintaining technical fluency in Go, Python, Kubernetes, distributed systems, authentication, and billing infrastructure.
Top Skills: Authentication SystemsBilling InfrastructureCloud Virtual MachinesContainer OrchestrationDistributed SystemsGoHpc SchedulersKubernetesLlm-Based Coding ToolsPython
47 Minutes Ago
Remote or Hybrid
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead enterprise-wide product strategy for security and risk partnerships. Identify and evaluate partner opportunities, guide technical due diligence and integration architecture, build investment cases, define success metrics, and incubate joint customer solutions. Influence internal and partner roadmaps, align engineering, product marketing, business development, security, risk, and sales teams, and advise executives on partner investments, co-selling, and joint roadmap commitments.
Top Skills: Agentic SocAIGovernance Risk And Compliance (Grc)Identity And Access ManagementSecurity OperationsServicenowThreat And Vulnerability Management
53 Minutes Ago
Easy Apply
Remote
Easy Apply
Senior level
Senior level
Healthtech • Software
Designs retrieval architectures, develops and evaluates AI agents, and owns production deployments for healthcare applications. Responsibilities include hands-on coding, release management, on-call support, cross-functional collaboration, and ensuring HIPAA-compliant security. The role requires software development experience, cloud and CI/CD knowledge, AI architecture expertise, and experience with agent frameworks, language models, RAG, multi-agent systems, and evaluation frameworks.
Top Skills: Ai ArchitecturesCi/CdCloud PlatformsCohere Ai AgentsEvaluation FrameworksGraph-Based Data RetrievalHipaaInfrastructure As Code (Iac)Language ModelsMulti-Agent SystemsMultimodal Data RetrievalRetrieval-Augmented Generation (Rag)

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account