We are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and open-minded personality, who can join our friendly environment and become a core contributor to our team of experts.
Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Lead Data Software Engineer.
#LI-DNI
Responsibilities
- Lead a small team of engineers in creating and maintaining scalable data pipelines and architectures
- Develop and optimize data models and ETL processes utilizing Databricks alongside other technologies
- Implement data quality checks and monitoring frameworks to ensure high data integrity
- Stay abreast with emerging data engineering trends and technologies, advocating for the adoption of new tools when beneficial
- Troubleshoot and resolve data-related issues efficiently
- Conduct code reviews and uphold high standards of code quality
- Foster a collaborative and inclusive environment for the team to grow their skills and expertise
- Interact with clients, managing expectations and delivering high-quality solutions that meet their needs
- Drive innovation by proposing new data strategies and enhancements
- Work collaboratively within an Agile framework to meet project timelines and deliverables
Want more jobs like this?
Get jobs in Madrid, Spain delivered to your inbox every week.
- Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, deployment, and versioning
- Capability to lead a development team of 2-5 engineers
- Solid understanding of data architectures and proficient in data modeling, building, and optimizing ETL pipelines with Databricks using external orchestrators like Airflow
- Expertise in Spark, using either Scala or PySpark
- Knowledge of the software development lifecycle and Agile frameworks
- Proficiency in cloud-native technologies and familiarity with engineering best practices including containers, unit tests, linting, and code style checks
- Engineering experience in cloud environments with AWS, Azure, or GCP
- Experience focused on big data and performance optimization of data-intensive applications
- Proactive approach with the ability to operate independently
- Excellent client-facing skills and ability to handle ambiguous situations effectively
- Fluent English communication skills at a B2+ level
- Private health insurance
- EPAM Employees Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses
- Why Join EPAM
- WORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
- CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
- CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
- STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.