We are seeking a Data Platform Engineer to join our dynamic team as we address exciting challenges like cloud spending, pipeline performance, and data monitoring.
Our team is responsible for delivering high-quality Data Products that enhance mission-critical use cases such as Fleet Diagnostics, Process Efficiency, and Availability Reporting. The selected candidates will play a crucial role in the development and support of existing pipelines and the implementation of new demands as we migrate workloads to Azure.
#LI-DNI
Responsibilities
- Maintain and enhance existing data systems and pipelines
- Analyze and resolve new and complex data issues in the Generated Business Record (Gold layer)
- Adapt and implement changes driven by new demands from Data Consumers or from the Platform team
- Develop modifications and enhancements for our current Data Platform
- Manage the integration and processing of complex datasets, including the creation of datasets from scratch
- Collaborate with team members on elaborate projects, particularly when integrating substantial new datasets
- Evolve with technological advancements, adopting new tools and methodologies as required
Want more jobs like this?
Get jobs in Lisbon, Portugal delivered to your inbox every week.
- A minimum of 2 years of relevant working experience in data engineering or a similar field
- Proficiency in PySpark
- Background in cloud computing, focusing on Azure infrastructure
- Previous experience with large and complex dataset handling
- Capability to work collaboratively with varied stakeholders within the team
- Understanding of pipeline performance optimization and orchestration
- Flexibility to manage data monitoring and root cause analysis within datasets
- Fluent English communication skills at a B2+ level
- Experience in Azure Analytics Engineering
- Familiarity with Azure DevOps practices
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours