Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

AI Platform Engineer (GCP) - Remote

AT The Hartford
The Hartford

AI Platform Engineer (GCP) - Remote

Charlotte, NC

Senior Staff Software Engineer - IE07HE

We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future.

The Hartford seeks energetic and passionate AI Platform Engineers to build AI Operations (AIOps, MLOps, FMOps, LLMOps) services for our AI Platform team. Our team supports data science and business teams across the enterprise, driving streamlined processes and smarter decision-making in functions like Actuarial, Product, Underwriting, and Sales. As an AI Platform Engineer within the AI Operations organization, you will play a significant role in delivering modern and sustainable data science products generating meaningful outcomes for the enterprise.

Want more jobs like this?

Get Software Engineering jobs in Charlotte, NC delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


We are looking for talent who embraces our core values:

  • Solution-Oriented: We build solutions, not just models, focusing on end-to-end business problems and systems design.
  • Trust and Transparency: We collaborate closely with partners, mindful of their capacity to absorb change.
  • Reliability: Our products come with full monitoring solutions to ensure they deliver as expected.
  • Influence through Humility: We listen carefully to our customers and become partners in problem-solving.
  • Practical and Evolutionary: We deliver minimally viable products first and expand their sophistication over time based on feedback.

This role can have a Hybrid or Remote work arrangement. Candidates who live near one of our office locations will have the expectation of working in an office 3 days a week (Tuesday through Thursday) Candidates who do not live near an office will have a remote work arrangement, with the expectation of coming into an office as business needs arise.

Responsibilities:

  • Provide technical mentorship and career growth opportunities for team members.
  • Drive the development and implementation of Gen AI and AI solutions on the AI platform.
  • Develop the design and lead the development and scaling of large platforms, focusing on reliability, scalability, and security.
  • Architect and design end-to-end solutions at a component level.
  • Enhance platform functionality with strong engineering expertise in AI, ML, Agentic Frameworks, and modern data technologies.
  • Collaborate with cross-functional teams to efficiently implement AI platform components.
  • Develop core AI platform capabilities.
  • Leverage strong engineering expertise in platform functionality, AI, ML, and modern data technologies.
  • Manage engineering tasks, driving execution, and optimizing workflows with minimal guidance.
  • Explore new services and capabilities in AWS, Google Cloud Platform, and Azure to support GenAI and ML services.
  • Develop and promote best practices in AI, ML, and data engineering across teams.
  • Research, experiment with, and implement suitable GenAI algorithms, tools, and technologies.
  • Collaborate with partners in Enterprise Data, Data Science, Business, Cloud Enablement Team, and Enterprise Architecture teams.
  • Execute the vision and roadmap for AI solutions on the platform.
  • Review work of systems-level engineers to calibrate deliverables against project and business expectations.

Qualifications:

  • Bachelor's degree in Computer Science, Computer Engineering, or a technical field.
  • Proven experience with Google Cloud Platform (GCP).
  • 6+ years of experience with Terraform.
  • 3+ years of experience with Docker & Kubernetes (K8s).
  • 2+ years of experience with HELM.
  • Proven experience in working with other cloud providers such as AWS cloud is a plus.
  • Programming experience with Python is a plus but not required.
  • At least 4 years of experience designing and building data-intensive solutions using distributed system design and event-driven architecture.
  • 8+ years building and shipping software and/or platform infrastructure solutions for enterprises.
  • Experience with CI/CD pipelines, Automated Testing, Automated Deployments, Agile methodologies, Unit Testing, and Integration Testing tools.
  • Experience with building scalable serverless applications (real-time/batch) on GCP stack (Cloud Functions + Cloud Run).
  • Knowledge of distributed NoSQL database systems and data engineering, ETL technology.
  • Conversational UX/UI design (chatbots) and Human-Agent-Interaction (HAI) is a plus.
  • Experience with IR, vector embedding, and Hybrid/Semantic search technologies.
  • Experience with GCP BigQuery, Cloud Functions, AI Platform, API Gateway, GKE/Docker is must.
  • Knowledge about customization techniques across various stages of the RAG pipeline, including model fine-tuning, retrieval re-ranking, HNSW, and product quantization is a plus.
  • Strong proficiency in embeddings, ANN/KNN, vector stores, database optimization, & performance tuning.
  • Experience with LLM orchestration frameworks like Langchain, LlamaIndex, LangSmith, LangGraph, etc.
  • Experience with Generative AI Guardrails, responsible AI, adversarial attack mitigation, and red teaming is a plus.
  • Foundational understanding of Natural Language Processing and Deep Learning.
  • Excellent problem-solving skills and the ability to work in a collaborative team environment.
  • Excellent communication skills.

Candidate must be authorized to work in the US without company sponsorship. The company will not support the STEM OPT I-983 Training Plan endorsement for this position.

Compensation

The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency and demonstration of competencies required for the role. The base pay is just one component of The Hartford's total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:

$126,160 - $189,240

Equal Opportunity Employer/Females/Minorities/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age

About Us | Culture & Employee Insights | Diversity, Equity and Inclusion | Benefits

Client-provided location(s): Charlotte, NC, USA
Job ID: hartford-R2519903_Charlotte
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • On-Site Gym
    • Mental Health Benefits
    • Virtual Fitness Classes
    • Fitness Subsidies
    • FSA
    • HSA
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
    • Adoption Leave
  • Work Flexibility

    • Hybrid Work Opportunities
    • Remote Work Opportunities
    • Flexible Work Hours
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • On-Site Cafeteria
    • Company Outings
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Volunteer Time Off
    • Personal/Sick Days
  • Financial and Retirement

    • 401(K) With Company Matching
    • Stock Purchase Program
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
    • Profit Sharing
  • Professional Development

    • Internship Program
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Tuition Reimbursement
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Learning and Development Stipend
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Diversity, Equity, and Inclusion Program

Company Videos

Hear directly from employees about what it is like to work at The Hartford.