Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

LLMOps / MLOps - Localization Program Manager

AT Uber
Uber

LLMOps / MLOps - Localization Program Manager

Krakow, Poland

About the Role

The Uber Localization Team is currently seeking a Localization Technical Operation Program Manager with a strong background in Machine Learning (ML). In this pivotal role, you'll be at the helm of defining and driving the mission and vision for our Machine Translation (MT) and Large Language Models (LLM) projects, with a keen focus on enhancing translation quality while prioritizing scalability and cost-effectiveness. Your leadership will drive the research into the most promising MT and LLM models, ensuring they meet the needs of both our internal and external clients. Collaborating closely with the Localization (L10n) team, cross-functional teams within Uber, vendors, MLOps/LLMOps specialists, and external clients, you will spearhead the development of in-house Machine Translation and LLM models. These models are set to revolutionize how we support both our internal and external teams, aligning with our commitment to excellence in localization and global communication.

Want more jobs like this?

Get Software Engineering jobs in Krakow, Poland delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


What You'll Do

* Program Development and Execution: Design and implement comprehensive MT and LLM programs that serve both Uber's internal operations and our external clients, ensuring these programs support our global communication and localization strategies effectively.

* Integration and Technical Liaison: Build seamless integration points between Uber's internal services and tools, connecting them to our MT/LLM pipeline. Act as a technical liaison for customers and external clients, gathering requirements and discussing potential integration points to optimize our MT/LLM pipeline's efficiency and utility.

* Best Practices and Guidelines: Establish and define MT-only and MT + LLM best practices for all clients, whether new or existing, to ensure consistency, quality, and efficiency in our localization efforts.

* Model Selection and Evaluation: Work closely with Localization Operations (LocOps) and ML/LLM/AI engineers to select, evaluate, analyze, train, and deploy the most effective MT and LLM models. Your goal will be to enhance both internal and external localization processes.

* Support and Training: Address and fulfill team member requests related to MT and LLM programs, providing support and training where necessary to ensure all team members can leverage these tools effectively.

* Stakeholder Management: Over time, develop and maintain key relationships with stakeholders reliant on MT and/or LLM for their translations. Monitor the quality and impact of translations to continuously improve our existing or new offerings.

* Cross-functional Leadership: Proactively engage with other members of the localization team and external partners to lead tool-related discussions and cross-functional initiatives. This involves gathering requirements, writing product requirements documents (PRDs), and/or overseeing their implementation to enhance our localization tools and processes.

* Data Analysis and Dashboard Development: Collaborate with data analysts and engineers to develop a user-friendly dashboard for clients. This dashboard will provide insights into MT/LLM performance, facilitating informed decision-making and strategy adjustments.

What You'll Need

* College degree in Computer Sciences or equivalent technical degree

* 2 years of experience in running MT/ML/AI or other machine learning programs in a medium to large-sized company (either from the client or vendor side)

* 1 year of experience in localization within the high-tech industry from the client or vendor side

* Understanding of MT engines, LLM models, parameter size, cost, training algorithms, and usage cases from both internal and external clients for the effective deployment of suitable MT and LLM models in production

* Familiarity with NLP and computational aspects of MT/LLM

* Proficiency in scripting languages like Python, Perl, GO, Ruby, Postman, and SQL

* Ability to streamline complex processes and enhance workflow efficiency, aided by guidance from senior team members

* Basic understanding of the Localization Operation Program roles, along with their day-to-day functions

* Basic understanding of localization and internationalization processes

* Capacity to navigate through ambiguity, work independently, and guide the course of projects

* Strong analytical and problem-solving skills, complemented by excellent business judgment

* High level of attention to detail, quality-oriented, and proactive

* Excellent written and verbal communication skills

* Ability to manage stakeholders across businesses, both internally and externally, with guidance from senior team members

* A self-directed approach, willing to take the initiative in confronting substantial challenges head-on

* Commitment to quality, which will influence the direction of the Uber brand

* Excellent team player

* Passionate about Uber and our mission.

Bonus Points If

* 3+ years experience in AI/ML in the high-tech industry on the client-side and leading MT/LLM programs is a plus

* Pre-train and fine-tune LLM with the focus on multilingual using few-shots, RAG or other technique is a huge plus

We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward, together.

Offices continue to be central to collaboration and Uber's cultural identity. Unless formally approved to work fully remotely, Uber expects employees to spend at least half of their work time in their assigned office. For certain roles, such as those based at green-light hubs, employees are expected to be in-office for 100% of their time. Please speak with your recruiter to better understand in-office expectations for this role.

*Accommodations may be available based on religious and/or medical conditions, or as required by applicable law. To request an accommodation, please reach out to accommodations@uber.com.

Client-provided location(s): Kraków, Poland
Job ID: Uber-132967
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • FSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Fertility Benefits
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Pet-friendly Office
    • Snacks
    • Some Meals Provided
    • On-Site Cafeteria
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Sabbatical
    • Volunteer Time Off
  • Financial and Retirement

    • 401(K)
    • Company Equity
    • Performance Bonus
  • Professional Development

    • Work Visa Sponsorship
    • Associate or Rotational Training Program
    • Promote From Within
    • Mentor Program
    • Access to Online Courses
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Diversity, Equity, and Inclusion Program