Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Senior/Lead Software Engineer - AI Evaluation & Optimization

AT Salesforce
Salesforce

Senior/Lead Software Engineer - AI Evaluation & Optimization

San Francisco, CA

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category
Software Engineering

Job Details

About Salesforce

We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place.

Want more jobs like this?

Get jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.


We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place!

The goal of the Evaluation & Optimization team is to empower LLM agent builders to evaluate their agent's performance and optimize them to better serve their own business needs. We do this by building tools which allow for deep introspection into the performance of an Agent which empower users to pinpoint where improvements can be made. These tools are made available to users in a variety of ways, including an easy-to-use user interface embedded within Salesforce's Agentforce platform as well as API tools for internal or highly technical teams to leverage.

Agents and LLMs are a fast evolving technology. As a team deeply embedded in LLM infrastructure we are looking for engineers who enjoy a fast-paced environment, can deliver incrementally, and think creatively.

Your impact:

  • Build, scale and maintain critical features of the Einstein platform that is at the forefront of Salesforce AI and LLM innovation.
  • Understand the customer/business requirements and translate them to elegant/flexible/easy-to-use platform capabilities
  • Lead/Participate in Software Design and Architecture discussions
  • Drive the execution and delivery of features by collaborating with architects, product owners, engineers, user experience designers and data scientists
  • Develop test strategies, design automation frameworks, write unit/functional tests to drive up code coverage and automation goals
  • Lead and mentor junior members of the team
  • Adopt, embrace, and promote agile and test-driven software development practices
  • Make/Participate in critical decisions that attribute to the success of the platform
  • Be a multiplier and have a passion for team and team members' success
  • Be a vocal advocate for technical excellence and help the team members make sound decisions

Basic qualifications and skills:

  • Bachelors (or) Masters degree in Computer Science, Software Engineering, or related STEM field with strong competencies in algorithms, data structures and software design
  • 6+ years of hands-on experience building, scaling and maintaining large scale, complex distributed systems and/or full stack software applications in the B2B (or B2C) SaaS space that scale for millions of users and operate 24x7
  • In-depth working knowledge of at least one object-oriented compiled, statically-typed language (Java, C++, etc), and a scripting language (Python, Ruby, etc)
  • Solid experience in REST based API development, API lifecycle management and/or client SDKs development
  • Experience in test-driven development with focus on unit testing, integration testing and end-to-end automation
  • Solid understanding of SDLC, and best practices in design, development, testing, and deployment
  • Experience with Agile development methodologies, pair programming, continuous integration (CI) and continuous deployment (CD)
  • Ability to support/resolve production customer escalations with excellent debugging and problem solving skills
  • Strong verbal and written communication skills. Self driven with superior organizational and project management skills. Ability to work effectively in a distributed team setting

Nice to have skills

  • Experience with Python
  • Solid understanding of web technologies, such as HTTP, XML, JavaScript, AJAX, HTML, JSON, etc. Familiarity with frameworks such as React or Vue.js is nice to have
  • Experience with developer tools such as Git and Jenkins
  • Demonstrated experience of working with ReST and thorough understanding of its fundamentals
  • Working knowledge of building B2B or B2C SaaS applications using cloud providers such as AWS, GCP, or Azure is desired
  • Exposure to Artificial Intelligence (AI) technologies such as Machine Learning, Deep Learning, etc. from data engineering perspective is a plus
  • Some Salesforce platform/ecosystem knowledge is nice to have

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.

For California-based roles, the base salary hiring range for this position is $137,100 to $334,600.

Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, benefits. More details about our company benefits can be found at the following link: https://www.salesforcebenefits.com.

Client-provided location(s): San Francisco, CA, USA; Palo Alto, CA, USA
Job ID: Salesforce-JR270612
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Adoption Leave
    • Return-to-Work Program
    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
    • Sabbatical
    • Volunteer Time Off
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Company Equity
    • Stock Purchase Program
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Tuition Reimbursement
    • Learning and Development Stipend
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
    • Leadership Training Program
    • Professional Coaching
    • Work Visa Sponsorship
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Unconscious Bias Training
    • Diversity, Equity, and Inclusion Program

Company Videos

Hear directly from employees about what it is like to work at Salesforce.