Skip to main contentA logo with &quat;the muse&quat; in dark blue text.
TikTok

Search Operation Quality Assurance for AI Model Evaluation

Seoul, South Korea

Responsibilities

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.

Want more jobs like this?

Get Data and Analytics jobs in Seoul, South Korea delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

Join us.

Our Trust & Safety team's commitment is to keep our online community safe. We have invested heavily in human and machine based moderation to remove harmful content quickly and often before it reaches our general community.

The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance.

What will I be doing?
- Complete regular assessments of AI model's quality in accordance with evaluation standard documents, based on business requirements
- Plan, conduct and support policy training and go-live processes for in-house specialists. Coordinate and support in-house specialists' tasks and data delivery
- Ensure overall data delivery quality and improve project performance to achieve established targets:
- Conduct quality inspection of evaluated data and specialists' daily tasks, comb the types of AI model bad cases
- Be responsible for standard document clarifications to ensure better understanding for in-house evaluation specialists
- Conduct calibration meetings with the team to analyze and align on different cases, evaluate performance, offer solutions and suggestions to improve accuracy rates
- Work and interact closely with POC and other stakeholders to provide timely and quality feedback on SOP/guidelines/data quality to optimize existing processes and to ensure overall project success
- Work on various evaluation-related projects outside core responsibilities based on business needs
- Perform other ad-hoc duties on relevant projects as assigned

Qualifications

What should I bring with me?
- Bachelor's Degree or above. Major in journalism, literature, mathematics, computer science, medicine, law, economics are preferred
- About 2 years work experience in QA/data analysis/project management
- Excellent language and communication skills: proficient Korean and English at all levels (reading, writing, listening, speaking). Overseas work/training experience or in a multi-cultural/multilingual environment is preferred
- Knowledge about AI or related models and search engines, familiarity with social media platforms
- QA and quality improvement experience, familiarity with RCA and data analysis
- An in-depth understanding of local culture and familiarity with the Internet usage habits of local users
- Ability to learn quickly, adapt to a fast-paced environment and respond to day-to-day challenges
- Strong interpersonal skills, excellent attention to detail, precision and accuracy
- Resilience, flexibility and commitment to self-care to manage the role's demands

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Client-provided location(s): Seoul, South Korea
Job ID: TikTok-7329361070954547466
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • HSA
    • Life Insurance
    • Fitness Subsidies
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Snacks
    • Pet-friendly Office
    • Happy Hours
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Company Equity
  • Professional Development

    • Promote From Within
    • Access to Online Courses
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Mentor Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at TikTok.