Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Lead Cloud Data Engineer - Databricks

AT Mastercard
Mastercard

Lead Cloud Data Engineer - Databricks

O'Fallon, MO

Our Purpose

We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team - one that makes better decisions, drives innovation and delivers better business results.

Want more jobs like this?

Get Data and Analytics jobs in O'Fallon, MO delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

Title and Summary

Lead Cloud Data Engineer - Databricks

Who is Mastercard?

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Overview

The Mastercard Data Warehouse team is looking for a Lead Cloud Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. This role will be responsible for enablement of Cloud data platforms for Mastercard transaction data warehouse. These are new platforms that will operate in a hybrid model along side Mastercard's existing on-premise Hadoop Data Warehouse that is being used by various groups to derive insights, perform Machine Learning and Data Science activities which in turn supports various revenue generating initiatives across the organization.

Role

• Design and develop high quality, secure, scalable software solutions based on technical requirements specifications and design artifacts within expected time and budget
• Develop and build solutions on cloud data platforms - Databricks - adhering to industry standards.
• Develop and build Databricks as a platform for the engineering community to use
• Build governance framework for cloud data storage and usage for enterprise data platforms.
• Collaborate on cross-functional agile teams - that include Developers, Report/BI Developers and Product Owners
• Work closely with Product Owners to understand cloud use cases and determine the best way to implement those.
• Provide technology leadership in the cloud big data space to development and product teams.
• Provide technology leadership to other leaders in big data and cloud data platform space.
• Stay abreast of Data Platform technology trends and industry best practices to hone and maintain your talent
• Participate in architectural discussions , iteration planning, and feature sizing meetings
• Adhere to Agile processes and participate actively in agile ceremonies
• Stakeholder management skills

All About You

• 12-15 years of hands on experience with Cloud data platform
• Hands on experience in Databricks and deep understanding of its architecture
• Experience managing, developing and supporting data lakes, lakehouses, warehouse on premise and on cloud, ETL solutions and other analytics solutions. Exposure to technology trends like R, Python and similar technology is added advantage.
• Experience working with development/engineering teams in a global environment
• In depth practical experience on native cloud services - Azure and/or AWS.
• Strong understanding of cloud DevOps practices and implementation.
• Experience in cloud data migration for large sized enterprise data warehouse environments.
• Understanding of cloud data governance include compute optimization, cost control, user profile management etc.
• In depth understanding of cloud operations strategy and user management across various cloud providers and cloud platforms.
• Strong understanding and hands-on on cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.
• Experience in establishing new engineering team and working towards taking the team to steady state
• Understanding of database technologies like Exadata/Oracle/Netezza/SQL server databases
• Understanding of SDLC and experience in establishing processes, standards and governance to bring efficiency within development team

Mastercard is an inclusive equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

In line with Mastercard's total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary based on location, experience and other qualifications for the role and may be eligible for an annual bonus or commissions depending on the role. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance), flexible spending account and health savings account, paid leaves (including 16 weeks new parent leave, up to 20 paid days bereavement leave), 10 annual paid sick days, 10 or more annual paid vacation days based on level, 5 personal days, 10 annual paid U.S. observed holidays, 401k with a best-in-class company match, deferred compensation for eligible roles, fitness reimbursement or on-site fitness facilities, eligibility for tuition reimbursement, gender-inclusive benefits and many more.

Pay Ranges
O'Fallon, Missouri: $138,000 - $221,000 USD

Client-provided location(s): O'Fallon, MO, USA
Job ID: Mastercard-22331_R-229080
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Pet Insurance
    • Mental Health Benefits
    • Virtual Fitness Classes
    • Health Reimbursement Account
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
    • On-site/Nearby Childcare
    • Adoption Leave
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • Happy Hours
    • Snacks
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
    • Some Meals Provided
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
    • Volunteer Time Off
  • Financial and Retirement

    • 401(K) With Company Matching
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
    • Stock Purchase Program
    • 401(K)
  • Professional Development

    • Tuition Reimbursement
    • Promote From Within
    • Mentor Program
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
    • Work Visa Sponsorship
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Shadowing Opportunities
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Diversity, Equity, and Inclusion Program