Search Relevance SME - Digital Content

Reposted 10 Days Ago
8 Locations
Remote
Junior
Machine Learning • Natural Language Processing
The Role
As a Search Relevance SME, you will evaluate data submissions, monitor quality, provide feedback to raters, and recommend training sessions based on error trends.
Summary Generated by Built In
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:

ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.

Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.

Role Overview

We are seeking a Search Relevance Subject Matter Expert (SME) to join our team. In this role, you will act as a Subject Matter Expert for a high-profile streaming platform. Working closely with our raters, you will evaluate submissions in Label Studio, monitoring the data quality. By identifying recurring errors and offering actionable feedback, you will ensure our team consistently meets and exceeds client expectations.

Key Responsibilities

  • Quality Assurance & Guideline Adherence
  • Evaluate/correct data annotations for accuracy and compliance with the client’s rating guidelines.
  • Collaborate with team members to clarify and update guidelines as needed.

Qualifications

  • Previous QA experience: Prior exposure to any kind of QA is highly desirable.
  • Strong Analytical & Communication Skills: Ability to synthesize error trends and present clear, actionable insights.
  • Multicultural & Pop Culture Awareness: Deep understanding of multicultural perspectives and global pop culture trends is essential for enhancing search relevance.
  • Strong English Proficiency: Good command of written and spoken English, as all communication, documentation, and task guidelines are in English.
  • Availability for 10–20 hours per week: Flexible schedule with some overlap in working hours for communication with global teams.
  • Self-Motivated & Detail-Oriented: Capable of working independently, meeting deadlines, and maintaining strict quality standards in a remote setting.

Top Skills

Label Studio
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
On-site Workplace
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them.

• Global team of 2,100+
• Offices in North America, Europe and Asia
• Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017
• Accredited professional translators and interpreters for 250+ languages

www.welocalize.com

Similar Jobs

Cash App Logo Cash App

Business Analytics Lead

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote
Hybrid
8 Locations
277K-415K Annually

Coinbase Logo Coinbase

Senior Data Scientist

Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Remote
Canada
180K-212K Annually

Instacart Logo Instacart

Sr. Data Scientist

eCommerce • Food • Software
Remote
4 Locations
158K-208K Annually

Instacart Logo Instacart

Data Scientist

eCommerce • Food • Software
Remote
4 Locations
117K-150K Annually

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Learneo Thumbnail
Software • Machine Learning • Edtech • Artificial Intelligence
NL
80 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account