Lead Data Engineer

Overview

We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team. In this critical role, you will be responsible for designing, developing, and maintaining robust and scalable data solutions on the Microsoft Azure platform. You will work closely with data scientists, analysts, and business stakeholders to translate business requirements into effective data pipelines and data models.

Responsibilities

• Design, develop, and implement data pipelines and ETL/ELT processes using Azure Data Factory, Azure Databricks, and other relevant Azure services.
• Develop and maintain data lakes and data warehouses on Azure, including Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
• Build and optimize data models for data warehousing, data marts, and data lakes.
• Develop and implement data quality checks and data governance processes.
• Troubleshoot and resolve data-related issues.
• Collaborate with data scientists and analysts to support data exploration and analysis.
• Stay current with the latest advancements in cloud computing and data engineering technologies.
• Mentor junior data engineers and contribute to the development of best practices.
• Participate in all phases of the software development lifecycle, from requirements gathering to deployment and maintenance.

• The expected compensation range for this position is between $89,000 - $149,000.
• Location, confirmed job-related skills, experience, and education will be considered in setting actual starting salary. Your recruiter can share more about the specific salary range during the hiring process.
• Bonus based on performance and eligibility target payout is 10% of annual salary paid out annually.
• Paid time off subject to eligibility, including paid parental leave, vacation, sick, and bereavement.
• In addition to salary, PepsiCo offers a comprehensive benefits package to support our employees and their families, subject to elections and eligibility: Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts, Employee Assistance Program (EAP), Insurance (Accident, Group Legal, Life), Defined Contribution Retirement Plan.

• 10+ years of experience in data engineering, with at least 5 years of experience working with Azure data services.
• Strong proficiency in SQL, Python, and other relevant programming languages.
• Experience with data warehousing and data lake architectures.
• Experience with ETL/ELT tools and technologies, such as Azure Data Factory, Azure Databricks, and Apache Spark.
• Experience with data modeling and data warehousing concepts.
• Experience with data quality and data governance best practices.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Experience with Agile development methodologies.
• Bachelor's degree in Computer Science, Engineering, or a related field required (Master's degree preferred).
• Relevant Azure certifications (e.g., Azure Data Engineer Associate) are a plus.

• Experience with machine learning and artificial intelligence.
• Experience with containerization technologies (e.g., Docker, Kubernetes).
• Experience with DevOps practices and tools.