We are looking for a Senior Data Software Engineer with a strong background in Databricks to join our team.
The ideal candidate will be an open-minded professional, well-versed in data engineering, who can effortlessly integrate into our friendly work environment and contribute significantly to our projects.
#LI-DNI
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures
- Optimize data models and ETL processes using Databricks and other relevant technologies
- Implement data quality checks and monitoring to ensure high data integrity
- Stay abreast of emerging trends and technologies in data engineering, proposing new tools where beneficial
- Troubleshoot and resolve data-related issues promptly
- Participate in code reviews to maintain high standards of code quality
- Collaborate with other team members and stakeholders to enhance data-driven decisions
- Mentor junior data engineers and share knowledge within the team
- Contribute to the continuous improvement of our data engineering practices and procedures
Want more jobs like this?
Get jobs in Madrid, Spain delivered to your inbox every week.
- Hands-on experience with Databricks: Delta Lake, workflows, Delta Live Tables, deployment, and versioning
- Solid understanding of data architectures and strong data modeling skills
- Proficiency in Spark (either Scala or PySpark)
- Expertise in designing and building ETL pipelines with Databricks using external orchestrators like Airflow
- Experience with cloud-native technologies, containers, and software engineering best practices including unit tests, linting, and code style checks
- Engineering background with either AWS, Azure, or GCP
- Familiarity with big data and performance optimization of data-intensive applications
- Proactivity and experience in client-facing roles
- Ability to work independently in ambiguous situations
- Desire to function effectively in a transparent, fast-moving startup environment
- Fluent English communication skills at a B2+ level
- Private health insurance
- EPAM Employees Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses
- Why Join EPAM
- WORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
- CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
- CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
- STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.