We are looking for a Lead Data Software Engineer with a strong background in Databricks and an open-minded personality. This role requires someone ready to join a friendly environment and become a core contributor to our team of experts.
Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Lead Data Software Engineer.
#LI-DNI
Responsibilities
- Lead a small team of engineers in designing, developing, and maintaining scalable data pipelines and architectures
- Develop and optimize data models and ETL processes using Databricks and other technologies
- Implement data quality checks and monitoring to ensure high data integrity
- Stay updated with emerging trends in data engineering and recommend new tools when beneficial
- Troubleshoot and resolve data-related issues promptly
- Participate in code reviews to maintain high standards of code quality
Want more jobs like this?
Get jobs in Madrid, Spain delivered to your inbox every week.
- Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, deployment, and versioning
- Ability to lead a development team of 2-5 engineers
- Solid understanding of data architectures and data modelling; experienced in designing and building ETL pipelines with Databricks
- Expertise in Spark using (either Scala or PySpark)
- Knowledge of SDLC and Agile frameworks
- Proficiency in cloud-native technologies and software engineering best practices, including containers, unit tests, linting, and code style checks
- Engineering experience with AWS, Azure, or GCP
- Experience with big data and performance optimization of data-intensive applications
- Proactivity and client-facing experience
- Ability to deal with ambiguity and work independently
- Desire to work in a transparent and fast-moving startup environment
- Fluent in English communication skills at a B2+ level
- Private health insurance
- EPAM Employees Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses
- Why Join EPAM
- WORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
- CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
- CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
- STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.