Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Machine Learning Engineer, Multimodality

AT TikTok
TikTok

Machine Learning Engineer, Multimodality

San Jose, CA

Responsibilities

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact-for ourselves, our company, and the users we serve. Join us.

Want more jobs like this?

Get jobs in San Jose, CA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


Our Business Integrity team has a strong user focus and a dedication to technical excellence. We aim to meet our users' needs with reliable and high-performing platforms and services.

We use an AIGC large model, deep learning, machine learning and other technologies to establish a safe and trusted connection between billions of active users and the company's commercial products (advertising, e-commerce, live broadcast, etc.). By building a highly concurrent and highly reliable risk control system, we can perceive and deal with the risks of commercial products in real time. By building an end-to-end deep learning model and machine learning system, we can understand the content of commercial products and automatically review tens of millions of content in a short time. We sincerely invite you to join us and build the most advanced risk control system in the industry.

Responsibilities:
1. Responsible for understanding content of advertisements, including titles, images, videos, OCR texts, ASR texts, etc.
2. Responsible for the construction of models, such as AIGC model, image/video model, multimodality model, etc.
3. Responsible for model acceleration, improving inference efficiency while maintaining the effectiveness of models.
4. Responsible for tracking and implementation of SOTA technologies in the CV/Multimodality.

Qualifications

Minimum Qualifications
1. Excellent algorithm foundation and programming ability, familiar with mainstream programming languages such as python/c++.
2. Familiar with model training frameworks, such as tensorflow, pytorch, mxnet, etc.
3. Proficiency in building or finetuning LLMs at scale. Worked across CV, NLP or text/audio technologies.

Preferred Qualifications
1. Excellent algorithm foundation and programming ability, familiar with mainstream programming languages such as python/c++.
2. Familiar with NLP-related tasks, such as text classification, keyword matching, large language model (LLM), etc.
3. Familiar with CV-related tasks, such as image/video classification, object detection, retrieval, etc.
4. Familiar with multimodality technologies, such as vision-language pretraining.
5. Bachelor's degree or above, majoring in Computer Science, Computer Engineering, Electrical Engineering, or other related fields.
6. Have excellent analytical and problem-solving skills, logical thinking skills, communication and collaboration skills. Maintain curiosity about new things, and have a strong sense of responsibility, integrity and reliability.
7. Experience in Gen-AI or AIGC models is preferred.
8. Published papers in CVPR, ICCV, ECCV, TPAMI, IJCV, ICML, NeurIPS, ICLR, ACL, EMNLP, NAACL, etc.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $113500 - $355000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Our company benefits are designed to convey company culture and values, to create an efficient and inspiring work environment, and to support our employees to give their best in both work and life. We offer the following benefits to eligible employees:

We cover 100% premium coverage for employee medical insurance, approximately 75% premium coverage for dependents and offer a Health Savings Account(HSA) with a company match. As well as Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans. In addition to Flexible Spending Account(FSA) Options like Health Care, Limited Purpose and Dependent Care.

Our time off and leave plans are: 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO) (prorated upon hire and increased by tenure) and 10 paid sick days per year as well as 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.

We also provide generous benefits like mental and emotional health benefits through our EAP and Lyra. A 401K company match, gym and cellphone service reimbursements. The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Client-provided location(s): San Jose, CA, USA
Job ID: TikTok-7436163372587141394
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • HSA
    • Life Insurance
    • Fitness Subsidies
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Snacks
    • Pet-friendly Office
    • Happy Hours
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Company Equity
  • Professional Development

    • Promote From Within
    • Access to Online Courses
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Mentor Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at TikTok.