Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Distributed Systems Data Engineer, Machine Learning (Slack Search)

AT Salesforce
Salesforce

Distributed Systems Data Engineer, Machine Learning (Slack Search)

Atlanta, GA

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category
Software Engineering

Job Details

About Salesforce

We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place.

Want more jobs like this?

Get jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.


At Slack, we are dedicated to revolutionizing the way people find and interact with information. Our mission is to build cutting-edge search technologies that deliver relevant and personalized results to our users. We are looking for a talented and passionate Search Infrastructure Data Engineer to join our team and help us

achieve this goal.

About the Team:

The Core Infrastructure organization at Slack is responsible for designing, developing, and maintaining the information retrieval infrastructure that supports our Search, ML, and many other product experiences. This stack is at the heart of what makes Slack such a compelling store of company knowledge, allowing our customers to find and discover messages, channels, people, files, and other business units within their workspaces. We are also heavily invested in generative AI, helping build products that leverage the full wealth of knowledge in our company.

Job Description:

As a Search Infrastructure Data Engineer, you will work across the Search Infra and ML Infra teams to support their data engineering needs. You will be responsible for designing, building, and maintaining the data infrastructure and pipelines that power our search and recommendation systems. You will work closely with data scientists, machine learning/ai engineers, and software developers to ensure that our search algorithms are efficient, scalable, and deliver high-quality results.

Key Responsibilities:

  • Design and develop scalable and resilient information retrieval infrastructure to power search and other products.
  • Build and integrate scalable backend systems, platforms, and tools that power our data warehouse and help our partners implement, deploy, and analyze data assets.
  • Develop and maintain ETL processes to ensure data quality and consistency.
  • Collaborate with data scientists and machine learning engineers to deploy machine learning models for semantic retrieval in our own kubernetes-based deployment system, working with tools like Chef and Hashicorp Terraform.
  • Optimize data storage and retrieval to support real-time search queries and recommendations.
  • Monitor and troubleshoot data pipelines in production.
  • Work with the Search and ML Infrastructure teams to maintain and improve various data pipelines.
  • Mentor other engineers and deeply review code.
  • Improve engineering standards, tooling, and processes.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 5+ years of relevant technical experience, including significant experience in data engineering, with a focus on search.
  • Experience with search technologies such as Elasticsearch, Solr, or Lucene.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with big data technologies such as Airflow, EMR, Hadoop, Hive, Spark, and Kafka.
  • Solid understanding of SQL and NoSQL databases.
  • Experience with cloud platforms (e.g., AWS, GCP, Azure) and containerization (e.g., Docker, Kubernetes).
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Knowledge of natural language processing (NLP) techniques and tools.
  • Experience with A/B testing and experimentation frameworks.
  • Familiarity with data visualization tools and techniques.
  • Experience with vector-based retrieval systems like Vespa, Milvus, or Solr.
  • Experience with ML model serving frameworks/toolkits like Kubeflow, MLflow, Sagemaker, and AWS Bedrock.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge search technologies.
  • Collaborative and inclusive work environment.
  • Professional development and growth opportunities.

Slack has a positive, diverse, and supportive culture-we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative.

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

Client-provided location(s): Atlanta, GA, USA; Dallas, TX, USA
Job ID: Salesforce-JR267397
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Adoption Leave
    • Return-to-Work Program
    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
    • Sabbatical
    • Volunteer Time Off
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Company Equity
    • Stock Purchase Program
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Tuition Reimbursement
    • Learning and Development Stipend
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
    • Leadership Training Program
    • Professional Coaching
    • Work Visa Sponsorship
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Unconscious Bias Training
    • Diversity, Equity, and Inclusion Program

Company Videos

Hear directly from employees about what it is like to work at Salesforce.