Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

AI Research Scientist, Generative AI Evaluation Foundations, AI Judges team

AT Meta
Meta

AI Research Scientist, Generative AI Evaluation Foundations, AI Judges team

London, United Kingdom

The Generative AI Evaluation organization's mission is to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI judges team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers), covering a broad spectrum of metrics from helpfulness to safety. We are looking for a strong AI research scientist, with passion for Generative AI and in particular measurement/assessment of these cutting edge models. You'd join one of our projects and build methods to solve open challenges and unblock the execution and application of AI-assisted measurements to GenAI models, particularly Llama.We are looking for a team player, who thrives in ambiguity, quickly adapting to new problems and AI metrics from helpfulness to safety; preferred candidates have experience in doing applied research/evaluations on large scale GenAI models.

Want more jobs like this?

Get jobs in London, United Kingdom delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


AI Research Scientist, Generative AI Evaluation Foundations, AI Judges team Responsibilities:
  • Conduct research on the metrics and methodologies to assess/evaluate GenAI models (in particular Llama models)
  • Collaborate with cross-functional teams to ensure that our GenAI models are assessed leveraging state of the art solutions, and potentially co-develop them with partner teams
  • Stay up-to-date with the latest developments in the field of Generative AI and their evaluations/AI-assisted evaluation in particular
  • Communicate research findings and recommendations to stakeholders and scientific community
Minimum Qualifications:
  • PhD in the field of Deep learning, Machine Learning, Computer Vision, NLP, Computer Science or a related field.
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field
  • Experience with conducting research and publishing in top tier peer-reviewed journals and AI conferences
  • Excellent communication and collaboration skills
  • Ability to work independently and as part of a team
Preferred Qualifications:
  • Background and/or previous work in Generative AI
  • Background and/or previous work in evaluations of GenAI models
  • 3+ years of experience after PhD
  • Track record of setting technical direction, driving consensus and successful cross-functional partnership
About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Client-provided location(s): London, UK
Job ID: a1KDp00000E2KT5MAN
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Sabbatical
    • Leave of Absence
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Pension
    • Company Equity
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Learning and Development Stipend
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)
    • Founder led

Company Videos

Hear directly from employees about what it is like to work at Meta.