Senior Big Data Engineer

We are seeking an experienced Senior Big Data Engineer to join a leading beauty industry innovator.
The ideal candidate will be deeply involved in aggregating commercial purchases, marketing campaigns, catalog data, and more from various sources into a data lake, helping to redefine the way beauty is perceived and offered.
The remote option applies only to the Candidates who will be working from any location in Ukraine.

#LI-DNI

Responsibilities

• Architect and maintain ETL and ELT pipelines, large batch/micro batch processing, and streaming systems
• Build the infrastructure for optimal data extraction, transformation, and loading using ADF, Spark, or Kafka
• Identify and implement internal process improvements such as automating manual operations and optimizing data delivery
• Act as a single point of contact for top management and stakeholders over any delivery-related matters
• Provide technical leadership and ensure sound architecture and technical quality standards in implementations
• Write user stories and acceptance criteria for agile/scrum workflows
• Coordinate with multiple disciplines and stakeholders to align on project requirements
• Ensure projects align with client processes and methodologies, focusing on agile approaches
• Develop a strategy for continuous delivery and risk management throughout the delivery cycle
• Measure and work to improve delivery productivity
• Support Data Engineers by providing consultation to ensure quality and timely delivery
• Perform production support and execute deployment activities

• Proficiency in SQL, Spark, and Scala
• Competency in building infrastructure for data extraction, transformation, and loading
• Understanding of internal process improvements such as automation and data optimization
• Background in technical leadership, including ensuring architectures meet quality standards
• Capability to write and manage agile/scrum workflow user stories
• Familiarity with coordinating project requirements among various stakeholders
• Knowledge of various delivery models with a focus on agile methodologies
• Expertise in strategy development for continuous delivery and risk management
• Proficiency in measuring and improving delivery productivity
• Experience with production support and deployment activities
• Strong interpersonal and communication skills
• English proficiency at level B2 or above

• Familiarity with Spark Streaming, Azure, and Databricks

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children