Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Principal Machine Learning Engineer, Evaluation

AT Autodesk
Autodesk

Principal Machine Learning Engineer, Evaluation

San Francisco, CA

Job Requisition ID #

25WD85713

Position Overview

The work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world. As a Principal Machine Learning Engineer with a focus on model evaluation, you will play a critical role in ensuring the quality and performance of ML models across our portfolio of products. This position will help shape the customer experience by ensuring that ML-powered features meet high standards for accuracy, reliability, and user satisfaction.

In this role, you will identify and document quality and performance issues in ML models, establish robust evaluation criteria, and develop systems to continuously improve ML models in production. You will report to a research manager in the Autodesk AI Lab team within Autodesk Research. We are a global team, located in London, San Francisco, Toronto, and remotely. For this role we support both in-person, hybrid, and remote work.

Want more jobs like this?

Get jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.


Responsibilities

  • Identify, document, and communicate quality and performance issues with ML models
  • Design and implement evaluation methodologies, datasets, and metrics to asess the quality, performance, and reliability of ML models
  • Test the end-to-end user experience of ML powered features in Autodesk products to ensure alignment with customer needs and product requirements
  • Collaborate with AI researchers, engineers, and product teams to understand business requirements and improve ML model performance and customer experience
  • Process and analyze data from various sources to evaluate ML model behavior and customer outcomes
  • Stay up-to-date on the latest AI/ML evaluation techniques and best practices, applying them to Autodesk products
  • Present results and insights to collaborators, leadership, and stakeholders

Minimum Qualifications

  • BSc or MSc in Computer Science, Mechanical Engineering, or equivalent industry experience
  • 3+ years of professional experience related to ML model development/evaluation and CAD software
  • Experience designing and implementing model evaluation methodologies and metrics
  • Experience evaluating ML model performance under real-world conditions
  • Experience using CAD software such as Fusion 360 and AutoCAD
  • Strong written documentation skills to document evaluation criteria, results, and improvement recommendations

Preferred Qualifications

  • Knowledge of data representations, including 2D and 3D geometry
  • Experience with version control, reproducibility, and writing reusable, testable code
  • Experience with cloud services and architectures (e.g. AWS, Azure)
  • Knowledge of the design, manufacturing

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.

Client-provided location(s): San Francisco, CA, USA; Toronto, ON, Canada
Job ID: autodesk-25WD85713
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Long-Term Disability
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • FSA
    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Health Reimbursement Account
    • On-Site Gym
    • Pet Insurance
    • Mental Health Benefits
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
    • Non-Birth Parent or Paternity Leave
    • Birth Parent or Maternity Leave
    • Adoption Leave
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
    • Work-From-Home Stipend
  • Office Life and Perks

    • Some Meals Provided
    • Commuter Benefits Program
    • Casual Dress
    • Pet-friendly Office
    • Happy Hours
    • Snacks
    • Company Outings
  • Vacation and Time Off

    • Personal/Sick Days
    • Paid Holidays
    • Unlimited Paid Time Off
    • Leave of Absence
    • Paid Vacation
    • Sabbatical
    • Volunteer Time Off
  • Financial and Retirement

    • Relocation Assistance
    • Performance Bonus
    • Stock Purchase Program
    • Company Equity
    • 401(K) With Company Matching
  • Professional Development

    • Shadowing Opportunities
    • Access to Online Courses
    • Promote From Within
    • Learning and Development Stipend
    • Lunch and Learns
    • Tuition Reimbursement
    • Mentor Program
    • Internship Program
    • Leadership Training Program
    • Professional Coaching
    • Associate or Rotational Training Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)
    • Woman founded/led
    • Black founded/led
    • BIPOC founded/led
    • Latinx founded/led
    • Asian founded/led
    • LGBTQ+ founded/led
    • Veteran founded/led