At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues - caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all with heart, each and every day.Position Summary
We're seeking a Sr Software AI Engineer to build our next generation of GenAI solutions and autonomous agent systems. In this role, you'll contribute to our technical vision for large language model applications and will work with teams in implementing production-grade AI systems. You will be focusing on retrieval-augmented generation (RAG) architectures, agentic systems, and custom LLM implementations. You'll work closely with product teams to translate complex business requirements into scalable AI solutions, leveraging Azure's AI services, LangChain, vector databases, and cloud-native infrastructure. Your expertise in both open-source and commercial LLMs (including Azure OpenAI deployments) will be crucial in making strategic technology choices that balance innovation with practicality. You will define and implement architectures that bring large language models (LLMs) and agentic systems to life, delivering tangible business outcomes while pushing the boundaries of AI innovation.
Want more jobs like this?
Get Software Engineering jobs in Austin, TX delivered to your inbox every week.
The ideal candidate brings deep expertise in production ML systems, with demonstrated experience scaling AI applications in Azure cloud environments. You should have a strong background in Python development, modern ML frameworks (PyTorch/TensorFlow), and distributed systems.
Required Qualifications
- Contribute to the architecture and implementation of autonomous AI agents and multi-agent systems, including the development of specialized agents for task automation and business process optimization
- Design and implement enterprise-scale RAG systems integrated with Azure Cognitive Search and custom knowledge bases, ensuring high performance and accuracy
- Drive the adoption of best practices for GenAI development, including prompt engineering, model evaluation, and responsible AI guidelines
- Architect and oversee the deployment of production AI systems using Azure's ML infrastructure, including monitoring, logging, and performance optimization
- Foster a culture of technical excellence by mentoring engineering teams, providing hands-on guidance during system design and development, and establishing frameworks for peer code reviews and best practices in AI deployment while contributing to our AI Center of Excellence
- Collaborate with product managers, data scientists, and domain experts to translate business challenges into scalable AI-powered solutions, ensuring smooth integration across diverse systems.
- Experience with autonomous agents
- RAG implementations
- Vector databases (FAISS, Pinecone)
- Containerized deployments using Docker and Kubernetes are all crucial for this role.
- Deep expertise in production ML systems, with demonstrated experience scaling AI applications in Azure cloud environments.
- You should have a strong background in Python development, modern ML frameworks (PyTorch/TensorFlow), and distributed systems.
- Bachelor's degree in Computer Science or related eld, or equivalent work experience.
40Time Type
Full timePay Range
The typical pay range for this role is:$92,700.00 - $185,400.00This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.Great benefits for great peopleWe take pride in our comprehensive and competitive mix of pay and benefits - investing in the physical, emotional and financial wellness of our colleagues and their families to help them be the healthiest they can be. In addition to our competitive wages, our great benefits include:
- Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan.
- No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching.
- Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.