Skip to main contentA logo with &quat;the muse&quat; in dark blue text.
Autodesk

Principal Engineer, Central Data Lake Lead

San Francisco, CA

Job Requisition ID #

24WD77185

Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Software Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable data platform used by numerous teams across the company. Reporting to our Software Engineering Manager for Platform Infrastructure, you'll help us tackle tough problems and improve our platform's reliability, resiliency, and scalability. If you enjoy developing high quality and resilient systems and want to make a big impact with data at Autodesk, we want to meet you!

As a Lead for our Central Data Lake, you will:

  • Design, develop, and operate highly reliable large-scale data lake
  • Partner closely with Product teams to understand requirements and design new capabilities that go directly into customer's hands
  • Build and scale data infrastructure that powers batch and real-time data processing of billions of records daily
  • Automate and administer big data applications and services on cloud
  • Help drive observability into the health of our data infrastructure and understanding of system behavior
  • Guide initiatives to enable best practices across infrastructure, deployments, automation, and accessibility
  • Set technical directions and influence cross-functional teams
  • Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance
  • Develop and implement security best practices at the data, application, infrastructure, and network layers

Want more jobs like this?

Get Data and Analytics jobs in San Francisco, CA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

Minimum Qualifications

  • 10+ years of hands-on direct internal experience in large-scale data intensive distributed systems, especially in query engines, object storage, data warehouse, data lake, data analytics, SQL/NoSQL databases, distributed file systems and data platform infrastructure
  • Experience with Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, and Avro
  • Experience provisioning and managing orchestration tools like Airflow
  • Excellent coding skills and experience in Python, Unix shell scripting
  • Experience building, implementing and automating APIs
  • Experience building code-driven infrastructure on AWS through end-to-end automation including integration tests and unit tests
  • Experience with Self-service platform offering by building APIs to deploy Cloud resources
  • Demonstrated experience with EKS, EMR, S3, IAM, Networking and other AWS services
  • Experience with observability tools (such as, Hive, Spark, Presto, Jenkins, CloudOS, Datadog)
  • Experience communicating solutions and resolutions with technical and non-technical audiences
  • Willingness to participate in professional development activities to stay current on industry knowledge and excitement about breaking the status quo by seeking innovative solutions
  • Experience with public clouds (AWS, Azure, GCP)
  • Computer Science degree (or equivalent experience will be considered)

#LI-CD2

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk - our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you're an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/

Salary transparency

Salary is one part of Autodesk's competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Client-provided location(s): San Francisco, CA, USA
Job ID: autodesk-24WD77185
Employment Type: Full Time

Perks and Benefits

  • Health and Wellness

    • Long-Term Disability
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • FSA
    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Health Reimbursement Account
    • On-Site Gym
    • Pet Insurance
    • Mental Health Benefits
  • Parental Benefits

    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
    • Non-Birth Parent or Paternity Leave
    • Birth Parent or Maternity Leave
    • Adoption Leave
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
    • Work-From-Home Stipend
  • Office Life and Perks

    • Some Meals Provided
    • Commuter Benefits Program
    • Casual Dress
    • Pet-friendly Office
    • Happy Hours
    • Snacks
    • Company Outings
  • Vacation and Time Off

    • Personal/Sick Days
    • Paid Holidays
    • Unlimited Paid Time Off
    • Leave of Absence
    • Paid Vacation
    • Sabbatical
    • Volunteer Time Off
  • Financial and Retirement

    • Relocation Assistance
    • Performance Bonus
    • Stock Purchase Program
    • Company Equity
    • 401(K) With Company Matching
  • Professional Development

    • Shadowing Opportunities
    • Access to Online Courses
    • Promote From Within
    • Learning and Development Stipend
    • Lunch and Learns
    • Tuition Reimbursement
    • Mentor Program
    • Internship Program
    • Leadership Training Program
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)
    • Woman founded/led
    • Black founded/led
    • BIPOC founded/led
    • Latinx founded/led
    • Asian founded/led
    • LGBTQ+ founded/led
    • Veteran founded/led