Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

TikTok Shop - Large Language Model Quality Analyst

AT TikTok
TikTok

TikTok Shop - Large Language Model Quality Analyst

Kuala Lumpur, Malaysia

Responsibilities

About the team
Global E-Commerce's Governance and Experience (GNE) is a global team responsible for ensuring a safe and trustworthy marketplace for not only our buyers, but also our sellers and creators. The Service and Moderation Team (SMT) is part of the GNE organization. Our mission is to create the most trustworthy E-commerce platform with a delightful service experience. SMT is looking for a Model Labeling Quality Assurance Analyst role to manage BPO partners to make high quality delivery for model labeling projects to assure model accuracy.

Roles & Responsibilities
- Continuously improve the large model's moderation accuracy through quality inspection, analyzing abnormal data, accurately attributing issues, and raising alerts.

Want more jobs like this?

Get jobs in Kuala Lumpur, Malaysia delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

- Conduct CoT (Chain-of-Thought) fine labeling for typical tasks to optimize large model training data and improve model inference ability.
- Attribute quality issues, accurately identify problems at each stage, categorize them, and escalate to relevant teams for resolution.
- Analyze the effectiveness of moderation rules and determine whether issues stem from the rules themselves, suggesting improvements as needed.
- Participate in the creation and optimization of quality inspection processes. Identify process or attribution label system issues during attribution and drive continuous improvements.
- Collaborate closely with large model operations, policy, model labeling, and other teams to optimize moderation policies, model decisions, and engineering capabilities.
- Provide structured feedback and support to help external stakeholders resolve issues.

Qualifications

Minimum Qualifications
- Bachelor's degree or higher, preferably in Computer Science, Information Management, Law, Linguistics, or related fields.
- At least 3 years of experience in content safety moderation quality inspection, or related fields on e-commerce platforms.
- Strong logical analysis ability to identify potential risks in quality inspection data.
- Strong communication skills to collaborate clearly and effectively with cross-functional teams.
- Attention to detail and strong responsibility to efficiently and accurately complete quality inspection tasks.
- Strong learning ability to quickly master new moderation standards and processes.

Preferred Qualifications
- Familiarity with the e-commerce platform moderation policies, with the ability to identify rule issues.
- Experience with the working principles and application scenarios of large models.
- Strong professional ethics and the ability to work in a fast paced environment.

Client-provided location(s): Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Job ID: TikTok-7483006094606076167
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • HSA
    • Life Insurance
    • Fitness Subsidies
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Snacks
    • Pet-friendly Office
    • Happy Hours
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Company Equity
  • Professional Development

    • Promote From Within
    • Access to Online Courses
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Mentor Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at TikTok.