Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Senior System Software Engineer, NIM

AT NVIDIA
NVIDIA

Senior System Software Engineer, NIM

Santa Clara, CA / Remote

Do you want to help bring AI responsibly to the world? We are seeking a Senior Systems Software Engineer who is technical, creative and driven to provide enterprise ready AI for use by the world. You will build and deploy high-performance, scalable cloud native solutions for AI deployment in all clouds and on-premise software. Our efforts focus on enabling AI inference accelerated by GPUs. You will use your deep understanding in service oriented architecture, cloud-native infrastructure using Kubernetes, distributed systems, multi-threading, machine learning, and cloud services to develop the control plane for AI.

What you'll be doing:

You will design industry leading microservices running in Kubernetes which enable scalable, reliable, cloud-native AI accelerated by the GPU. Your software is optimized, well tested micro-services that will scalably drive the AI infrastructure, taking inference to new levels using GPUs and distributed systems. Senior engineers are expected to mentor members of the team enabling them to develop their software engineering, SOA, AI, ML skills and understanding. You are a technical leader, mentor, and role-model.

Want more jobs like this?

Get Software Engineering jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.


What we need to see:

  • Trained software engineer with a Masters or equivalent experience in Computer Science, Computer Engineering or related field.
  • 8+ years of relevant experience.
  • Hands-on experience developing SaaS/PaaS, distributed enterprise or HPC solutions using micro-services, gRPC or high-performance APIs that scale out in highly distributed infrastructures.
  • Be able to show a track record of crafting well-designed, secure solutions and delivering high-quality software on time with strong engineering skills when faced with complicated and ambiguous problems.
  • A history of teamwork, mentoring and improving your fellow team members with skills in a wide variety of languages including: C, C++, C#, and Python.

Ways to stand out from the crowd:

  • Previous experience of working with matrix organizations with changing priorities, continuously learning new enabling technologies and driving your impact across teams and organizations.
  • Having real world machine learning experience on production systems will help you come up to speed with our technology.
  • Your daily work will involve distributed computing and all layers of system, hardware, system software. Direct Kubernetes experience is a plus.
  • Experience understanding of performance across the whole system goes a long way.
  • Our development environment includes multiple CI/CD systems and involves working with open source communities.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and accomplished people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Client-provided location(s): Santa Clara, CA, USA
Job ID: NVIDIA-JR1970004
Employment Type: Full Time