Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Lead, Software Engineer - AWS Data Solution Architect

AT Prudential Financial
Prudential Financial

Lead, Software Engineer - AWS Data Solution Architect

Newark, NJ / Remote

Job Classification:
Technology - Engineering & Cloud

Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, you'll unlock an exciting and impactful career - all while growing your skills and advancing your profession at one of the world's leading financial services institutions.

Your Team

As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. You will code, test and debug new and existing applications as you implement capabilities to solve sophisticated business problems, deploy innovative products, services and experiences to delight our customers! In addition to advanced technical expertise and experience, you will bring excellent problem solving, communication and teamwork skills, along with agile ways of working, strong business insight, an inclusive leadership attitude and a continuous learning focus to all that you do.

Want more jobs like this?

Get jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.


Here is What You Can Expect on a Typical Day

  • Design and build scalable solutions and services in AWS, ensuring the solution meets business and technical requirements.
  • Professional hands-on experience in developing extensible data pipeline and reusable data processors using PySpark, Scala, Python in AWS Glue and Lambda functions.
  • Architect and develop secure, robust cloud-based services, real-time APIs, service integrations, and automations using a microservice architectural style.
  • Lead the Solution design and implementation of solutions using AWS services.
  • Maintain proficiency and implement best practices in AWS development tools and standards.
  • Define and deploy job monitoring, metrics, and logging systems on AWS.
  • Implement continuous integration and deployment (CI/CD) pipelines.
  • Ability to comprehend requirements, identify potential tools/services in the market, and conduct comprehensive assessments leading to an informed selection process.
  • Ability to coach/interact other technical resources, enterprise architects and cloud architects with minimal guidance and effectively leverage diverse ideas, experiences, thoughts, and perspectives to the benefit of the organization.
  • Ability to excel in both independent and collaborative team environments.
  • Lead the troubleshooting and resolution of issues in development, test, and production environments.

The Skills & Expertise You Bring

  • Expertise in architecture, designing and building scalable cloud-based application leveraging AWS services.
  • Proven experience with services like EC2, ECS, Kong, ALB, SQS/SNS, Kinesis, RDS, S3, Lambda, Glue, DynamoDB, EMR, VPC, Route 53, CloudFormationerraform, CloudWatch, Dynatrace, IAM
  • Experience in building scalable and stronger data pipelines to support data integration, data processing, data quality and monitoring.
  • Experience in handling various hierarchical data structures and file formats such as parquet, Json and Avro files
  • Strong knowledge of DevOps principles and methodologies and toolset experience in bitbucket/GitHub and Jenkins/Terraform in adopting CI/CD approach.
  • Automate infrastructure provisioning and configuration management using as code, with experience in tools such as Terraform or CloudFormation.

Proficient in:

  • Programming languages: Python, PySpark / Scala is mandatory
  • Database: PostgreSQL, DynamoDB, Redis, GraphDBs
  • Architecture & Design Patterns: Specialized in Microservices and Service-oriented Architecture (SoA) with a focus on building web service APIs using REST and SOAP protocols, and adept in handling JSON and XML data formats.
  • Software security skills: Proficient in secure coding, web application security, and DevSecOps with a strong understanding of concepts like authentication, authorization, encryption, digital signature, JWT, SSL, web service proxies, firewall, SAML 2.0, OpenID Connect, and OAuth 2.0.
  • DevOps Tools & Practices: Skilled in branching techniques and the use of platforms such as GitHub and Bitbucket; proficient in DevOps practices and tools, including Jenkins.
  • Proficient in monitoring and logging techniques used throughout the SDLC.
  • Experience in programming language such as Node.js, Java is an added advantage.
  • Excellent communication and collaboration skills.

Preferred Qualifications:

  • 10-12 years of experience as an AWS Cloud Data Architect or related role.
  • Involved in Architecture & design of Enterprise cloud systems.
  • Strong understanding of data engineering principles and methodologies.
  • Solution Design Thinking
  • Experience in performing detailed tool Assessment and selection process.
  • Knowledge of data governance, metadata management and data quality is a plus.

You'll Love Working Here Because You Can

Join a team and culture where your voice matters; where every day, your work transforms our experiences to make lives better. As you put your skills to use, we'll help you make an even bigger impact with learning experiences that can grow your technical AND leadership capabilities. You'll be surprised by what this rock-solid organization has in store for you.

#LI-LR1 #LI-Remote

What we offer you:

Prudential is required by state specific laws to include the salary range for this role when hiring a resident in applicable locations. The salary range for this role is from $135,100.00 to $201,000.00. Specific pricing for the role may vary within the above range based on many factors including geographic location, candidate experience, and skills.
  • Market competitive base salaries, with a yearly bonus potential at every level.


  • Medical, dental, vision, life insurance, disability insurance, Paid Time Off (PTO), and leave of absences, such as parental and military leave.


  • 401(k) plan with company match (up to 4%).


  • Company-funded pension plan.


  • Wellness Programsincluding up to $1,600 a year for reimbursement of items purchased to support personal wellbeing needs.


  • Work/Life Resources to help support topics such as parenting, housing, senior care, finances, pets, legal matters, education, emotional and mental health, and career development.


  • Education Benefit to help finance traditional college enrollment toward obtaining an approved degree and many accredited certificate programs.


  • Employee Stock Purchase Plan: Shares can be purchased at 85% of the lower of two prices (Beginning or End of the purchase period), after one year of service.

Eligibility to participate in a discretionary annual incentive program is subject to the rules governing the program, whereby an award, if any, depends on various factors including, without limitation, individual and organizational performance. To find out more about our Total Rewards package, visit Work Life Balance | Prudential Careers. Some of the above benefits may not apply to part-time employees scheduled to work less than 20 hours per week.

Prudential Financial, Inc. of the United States is not affiliated with Prudential plc. which is headquartered in the United Kingdom.

Prudential is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender identity, national origin, genetics, disability, marital status, age, veteran status, domestic partner status, medical condition or any other characteristic protected by law.

If you need an accommodation to complete the application process, please email accommodations.hw@prudential.com.

If you are experiencing a technical issue with your application or an assessment, please email careers.technicalsupport@prudential.com to request assistance.

Client-provided location(s): Newark, NJ, USA
Job ID: Prudential-R-118066
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Health Insurance
  • Parental Benefits

    • Adoption Leave
    • Birth Parent or Maternity Leave
    • Adoption Assistance Program
    • Family Support Resources
  • Vacation and Time Off

    • Paid Holidays
    • Personal/Sick Days
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Pension
    • Stock Purchase Program