We are looking for a Senior Data Platform Engineer to join our dynamic team as we tackle exciting challenges such as cloud spending, pipeline performance, and data monitoring.
Our team is tasked with delivering high-quality Data Products that support mission-critical use cases including Fleet Diagnostics, Process Efficiency, and Availability Reporting. The successful candidates will be instrumental in the evolution and maintenance of existing pipelines and the onboarding of new projects during our migration to Azure.
#LI-DNI
Responsibilities
- Keep current data systems and pipelines up to date and functioning optimally
- Tackle new and complex data issues in the Generated Business Record (Gold layer)
- Implement changes necessitated by new requirements from Data Consumers or the Platform team
- Enhance and modify our existing Data Platform
- Organize the integration and processing of complex datasets, including building datasets from scratch
- Collaborate with team members on complex projects, particularly when merging significant new datasets
- Adapt to technological advancements by adopting new tools and methods as needed
Want more jobs like this?
Get jobs in Lisbon, Portugal delivered to your inbox every week.
- A minimum of 3 years of relevant work experience in data engineering or a related field
- Proficiency in PySpark
- Background in cloud computing, with a focus on Azure infrastructure
- Prior handling of large and complex datasets
- Capability to collaborate with various stakeholders within the team
- Understanding of pipeline performance optimization and orchestration
- Flexibility to handle data monitoring and root cause analysis within datasets
- Fluent English communication skills at a B2+ level
- Azure Analytics Engineering expertise
- Understanding of Azure DevOps practices
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours